关键词: 存储控制器, 访存调度算法, 自适应性, 强化学习

Abstract: In modern processors, memory controller is the manager and executant of the access to off-chip memories. The scheduling algorithm used by memory controller has a great influence on the performance of access to off-chip memory. For the situation that current scheduling algorithm can’t adapt to the change of workload, it proposes ALHS algorithm based on reinforcement learning method in this paper. ALHS optimizes its scheduling policy by adjusting the upper limit of page hits in FR-FCFS scheduling. The experiment on multi-workload shows that ALHS improves access speed by 10.98% compared to FR-FCFS and obtains performance improvement close to the optimistic policy. It shows that ALHS can explore the experiment environment and optimizes itself.

Key words: memory controller, memory scheduling algorithm, adaptive, reinforcement learning