ReSemble: Reinforced Ensemble Framework for Data Prefetching
DescriptionData prefetching hides memory latency by predicting and loading necessary data into cache beforehand. Most prefetchers in the literature are efficient for specific memory address patterns thereby restricting their utility to specialized applications--they do not perform well on hybrid applications with multifarious access patterns. Therefore we propose ReSemble: a reinforcement learning based adaptive ensemble framework that enables multiple prefetchers to complement each other on hybrid applications. Our RL trained ensemble controller takes prefetch suggestions from all prefetchers as input, selects the best suggestion dynamically, and learns online toward getting higher cumulative rewards, which are collected from prefetch hits/misses. Our ensemble framework using a simple multilayer perceptron as the controller achieves averages of 85.27% (accuracy) and 44.22% (coverage), leading to 31.02% IPC improvement, which outperforms state-of-the-art individual prefetchers by 8.35%--26.11%, while also outperforming SBP, a state-of-the-art (non-RL) ensemble prefetcher by 5.69%.
Event Type
Paper
TimeThursday, 17 November 20224:30pm - 5pm CST
LocationC146
TP
Architectures
Machine Learning and Artificial Intelligence
Recorded
Archive
view
