ptc-catalog
Multi-System Performance Testing
Download this PTC (Markdown)Target
Regular, automated testing at on all target platforms.
User Story
As a software engineer I want to incorporate regular performance testing into my development cycle so that I am able to maintain or improve performance on modern architectures.
Card(s)
| Stage | Description |
|---|---|
| 0 | Current performance testing practice, e.g., no regular performance testing |
| 1 | Irregular, manual, performance evaluation to identify bottlenecks on a single system |
| 2 | Regular (e.g., monthly) manual performance testing on a single system |
| 3 | Regular (e.g., monthly) manual performance testing on several target HPC systems |
| 4 | Partially automated performance testing on several target HPC systems |
| 5 | Completely automated, regular (e.g., nightly) performance testing on all target HPC systems; designated team member monitors results and creates issues as software components are changed, added, or removed or new hardware platforms are targeted. |
Related Cards
- The Performance Regression Testing Card has details on developing a performance regression tests itself.
This card originally proposed by Boyana Norris
Acknowledgement
This Project Tracking Card originated from the PSIP PTC Catalog. The development of the PSIP PTC Catalog was supported by the Exascale Computing Project (17-SC-20-SC), a collaborative effort of the U.S. Department of Energy Office of Science and the National Nuclear Security Administration.