The Distributed Data Mining (DM) Plugin for RapidMiner (formerly YALE) provides a framework and basic functionality for simulations of distributed data mining scenarios. It includes flexible networking pattern and distribution schemes of examples to nodes as well as interactive visualizations.

The Distributed Data Mining Plugin for RapidMiner allows to perform distributed data mining experiments in a simple and flexible way. The experiments are not actually executed on distributed network nodes. The plugin only simulates this. Simulation makes it easy to experiment with diverse network structures and communication patterns. Optimal methods and parameters can be identified efficiently before putting the system into use. The network structure can for example be optimized as part of the general parameter optimization. While this cannot replace testing the system in an actual network, it makes the development stage much more efficient. This follows the general philosophy of RapidMiner as rapid prototyping tool for large scale data mining applications.

The key features are:

• 100% Java implementation
• Very easy to extend
• Flexible choice of network structure and communication costs
• Allows to simulate point-to-point, broadcast and blackboard based communication
• Integrates with all RapidMiner operators
• View-based distribution of an example set to several nodes without replication
• Interactive visualization

Download and Documentation

The following files are available from the RapidMiner Plugins download page: