Can I read CMD: A Cache-assisted GPU Memory Deduplication Architecture on EtoBox?

CMD: A Cache-assisted GPU Memory Deduplication Architecture by Zhao, Wei; Feng, Dan; Tong, Wei; Wei, Xueliang; Wu, Bing is a scholarly article available to read on EtoBox.

What is CMD: A Cache-assisted GPU Memory Deduplication Architecture about?

Massive off-chip accesses in GPUs are the main performance bottleneck, and we divided these accesses into three types: (1) Write, (2) Data-Read, and (3) Read-Only. Besides, We find that many writes are duplicate, and the duplication can be inter-dup and intra-dup. While inter-dup means different memory blocks are identical, and intra-dup means all the 4B elements in a line are the same. In this work, we propose a cache-assisted GPU memory deduplication architecture named CMD to reduce the off-chip accesses via utilizing the data duplication in GPU applications. CMD includes three key design contributions which aim to reduce the three kinds of accesses: (1) A novel GPU memory deduplication architecture that removes the inter-dup and inter-dup lines. As for the inter-dup detection, we reduce the extra read requests caused by the traditional read-verify hash process. Besides, we design several techniques to manage duplicate blocks. (2) We propose a cache-assisted read scheme to reduce the reads to duplicate data. When an L2 cache miss wants to read the duplicate block, if the reference block has been fetched to L2 and it is clean, we can copy it to the L2 missed block without accessin

Author

Zhao, Wei; Feng, Dan; Tong, Wei; Wei, Xueliang; Wu, Bing

Published

2024

Language

EN