com.rapidminer.operator.performance
Class SimplePerformanceEvaluator

java.lang.Object
  com.rapidminer.operator.Operator
      com.rapidminer.operator.performance.AbstractPerformanceEvaluator
          com.rapidminer.operator.performance.SimplePerformanceEvaluator

All Implemented Interfaces:

ConfigurationListener, PreviewListener, ParameterHandler, LoggingHandler

public class SimplePerformanceEvaluator
extends AbstractPerformanceEvaluator

In contrast to the other performance evaluation methods, this performance evaluator operator can be used for all types of learning tasks. It will automatically determine the learning task type and will calculate the most common criteria for this type. For more sophisticated performance calculations, you should check the operators RegressionPerformanceEvaluator, PolynominalClassificationPerformanceEvaluator, or BinominalClassificationPerformanceEvaluator. You can even simply write your own performance measure and calculate it with the operator UserBasedPerformanceEvaluator.

The operator expects a test ExampleSet as input, whose elements have both true and predicted labels, and delivers as output a list of most commmon performance values for the provided learning task type (regression of (binominal) classification. If an input performance vector was already given, this is used for keeping the performance values.

Author:

Ingo Mierswa

Field Summary

Fields inherited from class com.rapidminer.operator.performance.AbstractPerformanceEvaluator

PARAMETER_COMPARATOR_CLASS, PARAMETER_MAIN_CRITERION, PARAMETER_SKIP_UNDEFINED_LABELS

Constructor Summary

SimplePerformanceEvaluator(OperatorDescription description)

Method Summary

protected void	checkCompatibility(ExampleSet exampleSet) Does nothing.
protected double[]	getClassWeights(Attribute label) Returns null.
java.util.List<PerformanceCriterion>	getCriteria() Delivers the list of criteria which is able for this operator.
protected void	init(ExampleSet testSet) Uses this example set in order to create appropriate criteria.
protected boolean	showComparatorParameter() Returns false.
protected boolean	showSkipNaNLabelsParameter() Returns false.

Methods inherited from class com.rapidminer.operator.performance.AbstractPerformanceEvaluator

apply, evaluate, evaluate, getInputClasses, getInputDescription, getOutputClasses, getParameterTypes, showCriteriaParameter

Methods inherited from class com.rapidminer.operator.Operator

addError, addValue, addWarning, apply, checkDeprecations, checkForStop, checkIO, checkProperties, clearErrorList, cloneOperator, createExperimentTree, createExperimentTree, createFromXML, createMarkedExperimentTree, createMarkedProcessTree, createProcessTree, createProcessTree, getAddOnlyAdditionalOutput, getApplyCount, getDeliveredOutputClasses, getDeprecationInfo, getDesiredInputClasses, getEncoding, getErrorList, getExperiment, getInnerOperatorsXML, getInput, getInput, getInput, getIOContainerForInApplyLoopBreakpoint, getIODescription, getLog, getName, getOperatorClassName, getOperatorDescription, getParameter, getParameterAsBoolean, getParameterAsColor, getParameterAsDouble, getParameterAsFile, getParameterAsFile, getParameterAsInputStream, getParameterAsInt, getParameterAsMatrix, getParameterAsString, getParameterList, getParameters, getParameterType, getParent, getProcess, getStartTime, getStatus, getUserDescription, getValue, getValues, getXML, hasBreakpoint, hasBreakpoint, hasInput, inApplyLoop, isDebugMode, isEnabled, isExpanded, isParallel, isParameterSet, log, logError, logNote, logWarning, performAdditionalChecks, processFinished, processStarts, register, registerOperator, remove, rename, resume, setApplyCount, setBreakpoint, setEnabled, setExpanded, setInput, setListParameter, setOperatorParameters, setParameter, setParameters, setParent, setUserDescription, toString, unregisterOperator, writeXML

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

SimplePerformanceEvaluator

public SimplePerformanceEvaluator(OperatorDescription description)

Method Detail

checkCompatibility

protected void checkCompatibility(ExampleSet exampleSet)
                           throws OperatorException

Does nothing.

Specified by:

checkCompatibility in class AbstractPerformanceEvaluator

Throws:

OperatorException

getClassWeights

protected double[] getClassWeights(Attribute label)
                            throws UndefinedParameterError

Returns null.

Specified by:

getClassWeights in class AbstractPerformanceEvaluator

Throws:

UndefinedParameterError

init

protected void init(ExampleSet testSet)

Uses this example set in order to create appropriate criteria.

Overrides:

init in class AbstractPerformanceEvaluator

showSkipNaNLabelsParameter

protected boolean showSkipNaNLabelsParameter()

Returns false.

Overrides:

showSkipNaNLabelsParameter in class AbstractPerformanceEvaluator

showComparatorParameter

protected boolean showComparatorParameter()

Returns false.

Overrides:

showComparatorParameter in class AbstractPerformanceEvaluator

getCriteria

public java.util.List<PerformanceCriterion> getCriteria()

Description copied from class: AbstractPerformanceEvaluator

Delivers the list of criteria which is able for this operator. Please note that all criteria in the list must be freshly instantiated since no copy is created in different runs of this operator. This is important in order to not mess up the results. This method must not return null but should return an empty list in this case.

Specified by:

getCriteria in class AbstractPerformanceEvaluator