Bilkent University
Department of Computer Engineering

---

M.S.THESİS PRESENTATİON

 

Dynamic Voltage/Frequency Scaling in GPUs Through Genetic Algorithm

 

Pouria Hasani
Master Student
(Supervisor: Prof.Dr.Özcan Öztürk)
Computer Engineering Department
Bilkent University

Abstract: DVFS is the primary approach to optimizing CPUs' power consumption. There are a handful of approaches conducted using this technique in GPGPUs. However, due to the massively parallel execution of threads on GPUs and load imbalance on SMs, finding the best global frequency for GPU cores is not a simple task. Moreover, the proposed approaches in the literature mostly rely on an offline model, where the optimal voltage and frequency for an application is found to be used in the next execution. In this work, we use a combination of an analytical model and a genetic algorithm to adjust per SM frequency dynamically, aiming at decreasing GPU's power consumption with the least amount of performance loss without a need for offline execution. We tested our approach using 16 GPU kernels from different domains with ranging features. Our results show that we can save 9.6% of GPU’s total energy on average with less than 0.95% performance loss. We also discuss further improvements and possible extensions to the proposed approach.

 

DATE: 16 September 2022, Friday @ 16:00 Zoom