Technical Papers Archive

ReSemble: Reinforced Ensemble Framework for Data Prefetching

Authors: Pengmiao Zhang (University of Southern California (USC)); Rajgopal Kannan (United States Army Research Laboratory, University of Southern California (USC)); Ajitesh Srivastava (University of Southern California (USC)); Anant V. Nori (Intel Corporation); and Viktor K. Prasanna (University of Southern California (USC))

Abstract: Data prefetching hides memory latency by predicting and loading necessary data into cache beforehand. Most prefetchers in the literature are efficient for specific memory address patterns thereby restricting their utility to specialized applications--they do not perform well on hybrid applications with multifarious access patterns. Therefore we propose ReSemble: a reinforcement learning based adaptive ensemble framework that enables multiple prefetchers to complement each other on hybrid applications. Our RL trained ensemble controller takes prefetch suggestions from all prefetchers as input, selects the best suggestion dynamically, and learns online toward getting higher cumulative rewards, which are collected from prefetch hits/misses. Our ensemble framework using a simple multilayer perceptron as the controller achieves averages of 85.27% (accuracy) and 44.22% (coverage), leading to 31.02% IPC improvement, which outperforms state-of-the-art individual prefetchers by 8.35%--26.11%, while also outperforming SBP, a state-of-the-art (non-RL) ensemble prefetcher by 5.69%.




Back to Technical Papers Archive Listing