Can I read System-level Monitoring of Floating-point Performance to Improve Effective System Utilization on EtoBox?

System-level Monitoring of Floating-point Performance to Improve Effective System Utilization by Davide Del Vento; Thomas Engel; Siddhartha S. Ghosh; David L. Hart; Rory Kelly; Si Liu; Richard Valent is a scholarly article available to read on EtoBox.

What is System-level Monitoring of Floating-point Performance to Improve Effective System Utilization about?

NCAR's Bluefire supercomputer is instrumented with a set of low-overhead processes that continually monitor the floatingpoint counters of its 3,840 batch-compute cores. We extract performance numbers for each batch job by correlating the data from corresponding nodes. From experience and heuristics for good performance, we use this data, in part, to identify poorly performing jobs and then work with the users to improve their job's efficiency. Often, the solution involves simple steps such as spawning an adequate number of processes or threads, binding the processes or threads to cores, using large memory pages, or using adequate compiler optimization. These efforts typically result in performance improvements and a wall-clock runtime reduction of 10% to 20%. With more involved changes to codes and scripts, some users have obtained performance improvements of 40% to 90%. We discuss our instrumentation, some successful cases, and its general applicability to other systems.

Author

Davide Del Vento; Thomas Engel; Siddhartha S. Ghosh; David L. Hart; Rory Kelly; Si Liu; Richard Valent

Publisher

ACM

Published

2011

Language

EN