View : 371 Download: 0
Adaptive Resource Planning for AI Workloads with Variable Real-Time Tasks
- Title
- Adaptive Resource Planning for AI Workloads with Variable Real-Time Tasks
- Authors
- Nam, Sunhwa Annie; Cho, Kyungwoon; Bahn, Hyokyung
- Ewha Authors
- 반효경; 조경운
- SCOPUS Author ID
- 반효경; 조경운
- Issue Date
- 2023
- Journal Title
- CMC-COMPUTERS MATERIALS & CONTINUA
- ISSN
- 1546-2218
1546-2226
- Citation
- CMC-COMPUTERS MATERIALS & CONTINUA vol. 74, no. 3, pp. 6823 - 6833
- Keywords
- Resource planning; artificial intelligence; real-time system; task scheduling; optimization problem; genetic algorithm
- Publisher
- TECH SCIENCE PRESS
- Indexed
- SCIE; SCOPUS
- Document Type
- Article
- Abstract
- AI (Artificial Intelligence) workloads are proliferating in modern real-time systems. As the tasks of AI workloads fluctuate over time, resource planning policies used for traditional fixed real-time tasks should be reexamined. In particular, it is difficult to immediately handle changes in real-time tasks without violating the deadline constraints. To cope with this situation, this paper analyzes the task situations of AI workloads and finds the following two observations. First, resource planning for AI workloads is a complicated search problem that requires much time for optimization. Second, although the task set of an AI workload may change over time, the possible combinations of the task sets are known in advance. Based on these observations, this paper proposes a new resource planning scheme for AI workloads that supports the re-planning of resources. Instead of generating resource plans on the fly, the proposed scheme pre-determines resource plans for various combinations of tasks. Thus, in any case, the workload is immediately executed according to the resource plan maintained. Specifically, the proposed scheme maintains an optimized CPU (Central Processing Unit) and memory resource plan using genetic algorithms and applies it as soon as the workload changes. The proposed scheme is implemented in the opensource simulator SimRTS for the validation of its effectiveness. Simulation experiments show that the proposed scheme reduces the energy consumption of CPU and memory by 45.5% on average without deadline misses.
- DOI
- 10.32604/cmc.2023.035481
- Appears in Collections:
- 인공지능대학 > 컴퓨터공학과 > Journal papers
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML