Pages: [1]
  Print  
Author Topic: Confusion about Confusion Matrix (pun intended)  (Read 987 times)
wypee
Newbie
*
Posts: 7


« on: January 17, 2014, 04:42:38 AM »

Guys, please help me make sense of this performance vector. I know how to interpret the Accuracy tab:



But when I click on the precision tab, I get this:



Why the pred0,true0 cell count has gone from 1846 to 437? Why is the precision tab precision 19.14% not matching with any of the class precision on the accuracy tab (80.86% and 77.39%)?

 
Logged
wypee
Newbie
*
Posts: 7


« Reply #1 on: January 17, 2014, 04:45:28 AM »

Not sure why the images are coming as broken. Here are the links:

https://www.dropbox.com/s/0yjm2pdtw2a4zpm/1.png

https://www.dropbox.com/s/0btzchvmi1wi6iy/2.png
Logged
Marius Helf
Administrator
Hero Member
*****
Posts: 1805



WWW
« Reply #2 on: January 17, 2014, 10:05:34 AM »

This looks definitely like a bug. Can you please post a process that reproduces this behavior?

Best regards,
Marius
Logged

Please add [SOLVED] to the topic title when your problem has been solved! (do so by editing the first post in the thread and modifying the title)
Please click here before posting.
wypee
Newbie
*
Posts: 7


« Reply #3 on: January 17, 2014, 03:00:38 PM »

Thanks Marius. Here is the process:

https://www.dropbox.com/s/cf15krxbmllihlp/insult_process.rmp

This is for one of the kaggle competition to classify user comments as insulting/not-insulting. It uses the following sub-process:

https://www.dropbox.com/s/hzdj0ef7kczouol/prep_text_data.rmp

Regards,
Yogesh
Logged
Marius Helf
Administrator
Hero Member
*****
Posts: 1805



WWW
« Reply #4 on: January 20, 2014, 09:46:55 AM »

Thank you. If have created an internal bug report.
Logged

Please add [SOLVED] to the topic title when your problem has been solved! (do so by editing the first post in the thread and modifying the title)
Please click here before posting.
Marco Boeck
Administrator
Hero Member
*****
Posts: 1266


WWW
« Reply #5 on: May 12, 2015, 01:19:49 PM »

Hi,

the issue has been fixed and will be included in the next release.

Regards,
Marco
Logged

Are you from a scientific background and want to use RapidMiner Studio 6? Check out our new RapidMiner Academia program!
SvenVanPoucke
Full Member
***
Posts: 115


Give me dogs and snow, and you can keep the rest.


WWW
« Reply #6 on: May 12, 2015, 02:11:00 PM »

Hi,
Perhaps a very stupid question, but the results presented in a confusion matrix are correct even with this bug (and can be used in scientific writings)?
Cheers
Sven
Logged

Medical doctor, anesthesiologist, emergency medicine, hyperbaric oxygen therapy, ontology, image data mining, data mining in health care related data.
Pages: [1]
  Print  
 
Jump to: