The pursuit of scalable quantum computing requires standardized metrics to evaluate progress across heterogeneous hardware. To address this, Sandia National Laboratories, in partnership with Quantinuum and NVIDIA, has unveiled the Quantum Universal Operations Performance System (QUOPS). This framework is designed to provide a comprehensive benchmark for quantum hardware by measuring integrated performance across both physical and logical qubit platforms.
At the core of the QUOPS framework are two primary metrics: the QUOPS score (Q) and the QUOPS rate (Ω). The 'Q' score serves as a measure of circuit size, while the 'Ω' rate quantifies operational throughput. By establishing these standardized benchmarks, the initiative aims to move beyond isolated performance metrics, offering a more holistic view of how quantum systems handle complex operations.
Initial data gathered using the QUOPS framework highlights significant performance variations across leading hardware providers. Quantinuum’s Helios-1 platform demonstrated a physical score of Q = 1,504. In comparison, Google’s Willow and IBM’s ibm_boston achieved scores of Q = 216 and Q = 204, respectively. These figures provide a baseline for comparing the efficiency and scalability of different quantum architectures.
This development is significant for the industry as it provides a common language for researchers and engineers. By standardizing how performance is measured, the QUOPS framework facilitates more transparent comparisons between competing technologies, ultimately accelerating the development of reliable, large-scale quantum systems for practical applications.