Thursday, November 11, 2010

Data Mining Algorithms on a Modern Processor

In this paper , we characterize the performance  and memory access behavior of several data mining algorithms.Specifically , we consider algorithms for frequent itemset mining ,sequence mining ,graph mining ,clustering ,outlier detection  and decision tree induction.Our Study reveals that data mining algorithm are compute and memory intensive.Furthermore ,some algorithm have poor spatial locality,while most algorithms have poor temporal locality.Hardware prefetching helps the algorithms with good spatial locality ,but most algorithms are unable to leverage simultaneous multithreading because of their memory intensive nature.
Consequently ,All these algorithms grossly under-utilize a modern day processor.Using the knowledge gleaned in this investigation ,we briefly show how we improve the performance of a frequent itemset mining algorithm ,FPGrowth on modern processor.Our study suggests that a specialized memory system with several thread contexts per processor is needed to allow these algorithms to scale on future microprocessors.