Performance metrics and auditing framework using application kernels for high-performance computer systems
Article first published online: 14 JUN 2012
Copyright © 2012 John Wiley & Sons, Ltd.
Concurrency and Computation: Practice and Experience
Volume 25, Issue 7, pages 918–931, May 2013
How to Cite
Furlani, T. R., Jones, M. D., Gallo, S. M., Bruno, A. E., Lu, C.-D., Ghadersohi, A., Gentner, R. J., Patra, A., DeLeon, R. L., von Laszewski, G., Wang, F. and Zimmerman, A. (2013), Performance metrics and auditing framework using application kernels for high-performance computer systems. Concurrency Computat.: Pract. Exper., 25: 918–931. doi: 10.1002/cpe.2871
- Issue published online: 17 APR 2013
- Article first published online: 14 JUN 2012
- Manuscript Revised: 11 MAY 2012
- Manuscript Accepted: 11 MAY 2012
- Manuscript Received: 23 SEP 2011
- HPC Metrics;
- application kernels;
This paper describes XSEDE Metrics on Demand, a comprehensive auditing framework for use by high-performance computing centers, which provides metrics regarding resource utilization, resource performance, and impact on scholarship and research. This role-based framework is designed to meet the following objectives: (1) provide the user community with a tool to manage their allocations and optimize their resource utilization; (2) provide operational staff with the ability to monitor and tune resource performance; (3) provide management with a tool to monitor utilization, user base, and performance of resources; and (4) provide metrics to help measure scientific impact. Although initially focused on the XSEDE program, XSEDE Metrics on Demand can be adapted to any high-performance computing environment. The framework includes a computationally lightweight application kernel auditing system that utilizes performance kernels to measure overall system performance. This allows continuous resource auditing to measure all aspects of system performance including filesystem performance, processor and memory performance, and network latency and bandwidth. Metrics that focus on scientific impact, such as publications, citations and external funding, will be included to help quantify the important role high-performance computing centers play in advancing research and scholarship. Copyright © 2012 John Wiley & Sons, Ltd.