I'm trying to display some results with a lift chart, but the output of the chart is not what I was expecting. The x-axis of the lift chart, which is labeled as "fraction" should be the fraction of the dataset (ordered by confidence values) used to calculate the lift. The y-axis should be the (cumulative) lift, calculated as (% of positive labels in this fraction of the dataset) / (% of positive labels in the entire dataset).
I've looked at the code in the file LiftDataGenerator, and it looks like the example set is being ordered by confidence values, but then the x-value is simply the rank order of each example, and the lift is calculated from the cumulative values in the confidence matrix as: (TP*(FP+TN)) / ((TP+FP)*(TP+FN)), which isn't far from what I'm looking for, but it isn't quite right. Is this a bug, or is this just an incarnation of the lift chart that is different from the one that I'm used to?
On a related note, I tried to modify the code in LiftDataGenerator directly, to get it to display the results as I wanted them, but RapidMiner never seemed to compile my changes. I'm on Windows, and I always run RapidMiner through the GUI. If I want to create my own operators, do I need to have a development package like Eclipse, or is there another way to get RapidMiner to re-compile itself?
Thanks in advance for any help!