Performance Validation¶
This document contains specification and explanation of the hardware error definitions and benchmarks. The code to perform analysis for the hardware specification data in the Product Data Sheets can be found in the specified GitHub repository. Product data sheets are provided per generation of quantum computers, and specify representative error rates typical of standard machine operation, in addition to a max threshold the error rates are unlikely exceed.
Machine Specification¶
The product data sheets report representative error rates typical of standard machine operation, in addition to a max threshold the error rates are unlikely to exceed. The performance specifications detailed below are systematic and quantitative component-level metrics using the latest Randomized Benchmarking (RB) sweep [1]. Performance specifications are reported on a per machine basis.
Machine specifications are tabulated below for each hardware target available to customers. Each error rate is measured using component benchmarks detailed here. The total 1-qubit (2-qubit) infidelity, \(F_{T}\), includes both the infidelity, \(F_{RB}\), from RB and also the leakage error per 1-qubit (2-qubit) gate, \(L\). The total \(N\)-qubit infidelity is calculated as,
where D=1 (D=2). The 1-qubit (2-qubit) infidelity, \(F_T\) is reported as 1-Qubit Gate Error (2-Qubit Gate Error). Additionally, the leakage error rate per 1-qubit (2-qubit) gate, \(L\), is reported as 1-Qubit Gate Leakage Error (2-Qubit Gate Leakage Error). The reported Memory Error per Depth-1 Time captures the idling error of qubits during a random transport. Measurement Crosstalk Error measures the crosstalk due to Measurement and Reset on qubits in the trap that are not measured or reset. SPAM Error estimates the state-preparation and measurement error for the \(| 0 \rangle\) (\(| 1 \rangle\)) state.
Infidelity |
Uncertainty |
|
|---|---|---|
1-Qubit Gate Error |
1.8e-05 |
2.9e-06 |
1-Qubit Gate Leakage Error |
6.4e-06 |
1.2e-06 |
2-Qubit Gate Error |
9.7e-04 |
6.2e-05 |
2-Qubit Gate Leakage Error |
2.2e-04 |
2.7e-05 |
Memory Error per Depth-1 Circuit Time |
2.2e-04 |
9.2e-05 |
Measurement Crosstalk Error |
4.1e-05 |
1.7e-06 |
SPAM Error (0) |
1.2e-03 |
1.1e-04 |
SPAM Error (1) |
3.4e-03 |
1.8e-04 |
Infidelity |
Uncertainty |
|
|---|---|---|
1-Qubit Gate Error |
4.7e-05 |
1.2e-05 |
1-Qubit Gate Leakage Error |
8.8e-06 |
2.9e-06 |
2-Qubit Gate Error |
1.2e-03 |
7.4e-05 |
2-Qubit Gate Leakage Error |
1.6e-04 |
2.1e-05 |
Memory Error per Depth-1 Circuit Time |
3.1e-04 |
2.2e-05 |
Measurement Crosstalk Error |
1.9e-05 |
4.2e-07 |
SPAM Error (0) |
6.5e-04 |
8.5e-05 |
SPAM Error (1) |
3.2e-03 |
1.9e-04 |
Infidelity |
Uncertainty |
|
|---|---|---|
1-Qubit Gate Error |
3.9e-05 |
4.2e-06 |
1-Qubit Gate Leakage Error |
1.2e-05 |
4.3e-06 |
2-Qubit Gate Error |
8.3e-04 |
6.6e-05 |
2-Qubit Gate Leakage Error |
1.4e-04 |
2.2e-05 |
Memory Error per Depth-1 Circuit Time |
1.8e-04 |
2.1e-05 |
Measurement Crosstalk Error |
1.3e-05 |
1.2e-06 |
SPAM Error (0) |
6.7e-04 |
8.7e-05 |
SPAM Error (1) |
1.9e-03 |
1.4e-04 |
Infidelity |
Uncertainty |
|
|---|---|---|
1-Qubit Gate Error |
2.8e-05 |
5.0e-06 |
1-Qubit Gate Leakage Error |
4.4e-06 |
1.8e-06 |
2-Qubit Gate Error |
1.2e-03 |
7.5e-05 |
2-Qubit Gate Leakage Error |
1.9e-04 |
3.8e-05 |
Memory Error per Depth-1 Circuit Time |
2.9e-04 |
2.9e-05 |
Measurement Crosstalk Error |
2.1e-05 |
3.6e-07 |
SPAM Error (0) |
7.2e-04 |
9.0e-05 |
SPAM Error (1) |
4.0e-03 |
2.1e-04 |
Infidelity |
Uncertainty |
|
|---|---|---|
1-Qubit Gate Error |
0.3e-04 |
0.1e-4 |
1-Qubit Gate Leakage Error |
1.1e-05 |
0.6e-5 |
2-Qubit Gate Error |
7.9e-04 |
0.1e-4 |
2-Qubit Gate Leakage Error |
2.4e-04 |
0.1e-4 |
Quadratic Memory Error per Depth-1 Circuit Time |
0.7e-04 |
2e-5 |
Linear Memory Error per Depth-1 Circuit Time |
5.0e-04 |
1.0e-4 |
Total Memory Error per Depth-1 Circuit Time |
5.7e-04 |
1.0e-4 |
Measurement Crosstalk Error |
0.5e-04 |
0.1e-4 |
SPAM Error (0) |
8e-04 |
1e-4 |
SPAM Error (1) |
1.6e-04 |
0.5e-4 |
Ternary SPAM Error (0) |
7.0e-04 |
1e-4 |
Ternary SPAM Error (1) |
2.08e-04 |
2e-4 |
Component Benchmarks¶
Component-level benchmarks capture the failure rate of specific quantum operations. These type of benchmarks are easier to interpret. Component validation is used in system-level models to better understand complete error budget for a specific machine.
1-qubit gate fidelity¶
The 1-qubit gate fidelity is measured using 1-qubit randomized benchmarking (RB) with random 1-qubit Clifford gates[2]. 1-qubit RB also uses final gate randomization to fix the asymptote of the RB decay curve, in order to reduce the number of fit parameters and allow fitting of shorter sequences [3]. We run 1-qubit RB with two qubits per active gate zone in parallel. The error rate is calculated by translating the RB decay curve to a per-Clifford average infidelity under the standard RB assumptions. Uncertainty is calculated from a semi-parametric bootstrap resampling of the collected data.
The spontaneous emission rate is also measured from 1-qubit RB experiments by applying a “leakage gadget” to the end of each circuit, which detects if a qubit leaks out of the computational subspace[4]. The number of leakage events depends on the number of gates applied and the spontaneous emission rate. By fitting the number of detected leakage events as a function of number of gates, we can extract an estimate of the spontaneous emission rate.
Survival rate from 1-qubit randomized benchmarking projects for H1-1¶
Survival rate from 1-qubit randomized benchmarking projects for H2-1¶
Survival rate from 1-qubit randomized benchmarking projects for H2-2¶
Survival rate from 1-qubit randomized benchmarking projects for Helios-1¶
Survival rate from 1-qubit randomized benchmarking projects for reimei¶
2-qubit gate fidelity¶
The 2-qubit gate fidelity is measured with 2-qubit RB using similar methods outlined above on 1-qubit RB. 2-qubit RB is run with 2-qubit random Clifford gates on pairs of qubits in each active gate zone in parallel. The infidelity of our native entangling gate is estimated by scaling per-Clifford infidelity by the average number of entangling gates per Clifford (= 1.5). Datasets are also used to estimate the spontaneous emission rate using the leakage gadget described above, but with a scaling for the number of 2-qubit gates per Clifford.
Survival rate from 2-qubit randomized benchmarking projects for H1-1¶
Survival rate from 2-qubit randomized benchmarking projects for H2-1¶
Survival rate from 2-qubit randomized benchmarking projects for H2-2¶
Survival rate from 2-qubit randomized benchmarking projects for Helios-1¶
Survival rate from 2-qubit randomized benchmarking projects for reimei¶
State preparation and measurement (SPAM) error¶
The SPAM error is measured by preparing the qubits in the \(|0\rangle\) (or \(|1\rangle\) state) and measuring to determine the fraction of time the incorrect \(|1\rangle\) (or \(|0\rangle\)) state is returned. The reported SPAM error is the average between the \(|0\rangle\) and \(|1\rangle\) state-preparation experiments. All gate zones are measured in parallel, and the experiment is performed on both of the qubits (left and right in below data) in each active gate zone.
Avg. SPAM error |
Avg. SPAM error uncertainty |
0 SPAM error |
1 SPAM error |
|
G1-left |
2.95e-03 |
3.83e-04 |
2.10e-03 |
3.80e-03 |
G1-right |
2.15e-03 |
3.27e-04 |
1.60e-03 |
2.70e-03 |
G2-left |
1.80e-03 |
3.00e-04 |
8.00e-04 |
2.80e-03 |
G2-right |
2.40e-03 |
3.46e-04 |
7.00e-04 |
4.10e-03 |
G3-left |
2.85e-03 |
3.77e-04 |
1.30e-03 |
4.40e-03 |
G3-right |
2.55e-03 |
3.57e-04 |
1.80e-03 |
3.30e-03 |
G4-left |
2.30e-03 |
3.39e-04 |
1.50e-03 |
3.10e-03 |
G4-right |
1.85e-03 |
3.04e-04 |
1.10e-03 |
2.60e-03 |
G5-left |
2.35e-03 |
3.42e-04 |
9.00e-04 |
3.80e-03 |
G5-right |
2.05e-03 |
3.20e-04 |
4.00e-04 |
3.70e-03 |
Mean |
2.33e-03 |
1.08e-04 |
1.22e-03 |
3.43e-03 |
Avg. SPAM error |
Avg. SPAM error uncertainty |
0 SPAM error |
1 SPAM error |
|
G1-left |
2.450e-03 |
3.493e-04 |
6.000e-04 |
4.300e-03 |
G1-right |
2.900e-03 |
3.800e-04 |
9.000e-04 |
4.900e-03 |
G2-left |
1.350e-03 |
2.595e-04 |
4.000e-04 |
2.300e-03 |
G2-right |
1.400e-03 |
2.643e-04 |
4.000e-04 |
2.400e-03 |
G3-left |
1.900e-03 |
3.078e-04 |
6.000e-04 |
3.200e-03 |
G3-right |
1.750e-03 |
2.955e-04 |
8.000e-04 |
2.700e-03 |
G4-left |
1.900e-03 |
3.078e-04 |
9.000e-04 |
2.900e-03 |
G4-right |
1.950e-03 |
3.118e-04 |
6.000e-04 |
3.300e-03 |
Mean |
1.950e-03 |
1.102e-04 |
6.500e-04 |
3.250e-03 |
Avg. SPAM error |
Avg. SPAM error uncertainty |
0 SPAM error |
1 SPAM error |
|
G1-left |
1.500e-03 |
2.735e-04 |
4.000e-04 |
2.600e-03 |
G1-right |
1.050e-03 |
2.290e-04 |
5.000e-04 |
1.600e-03 |
G2-left |
1.100e-03 |
2.344e-04 |
7.000e-04 |
1.500e-03 |
G2-right |
1.150e-03 |
2.396e-04 |
4.000e-04 |
1.900e-03 |
G3-left |
1.450e-03 |
2.690e-04 |
9.000e-04 |
2.000e-03 |
G3-right |
1.650e-03 |
2.870e-04 |
1.100e-03 |
2.200e-03 |
G4-left |
1.200e-03 |
2.448e-04 |
7.000e-04 |
1.700e-03 |
G4-right |
1.150e-03 |
2.396e-04 |
7.000e-04 |
1.600e-03 |
Mean |
1.281e-03 |
8.941e-05 |
6.750e-04 |
1.888e-03 |
Avg. SPAM error |
Avg. SPAM error uncertainty |
0 SPAM error |
1 SPAM error |
|
G1-left |
1.250e-04 |
1.250e-04 |
2.500e-04 |
0.000e+00 |
G1-right |
5.000e-04 |
2.499e-04 |
1.000e-03 |
0.000e+00 |
G2-left |
3.750e-04 |
2.165e-04 |
5.000e-04 |
2.500e-04 |
G2-right |
1.250e-04 |
1.250e-04 |
2.500e-04 |
0.000e+00 |
G3-left |
5.000e-04 |
2.499e-04 |
5.000e-04 |
5.000e-04 |
G3-right |
2.500e-04 |
1.767e-04 |
5.000e-04 |
0.000e+00 |
G4-left |
7.500e-04 |
3.061e-04 |
1.000e-03 |
5.000e-04 |
G4-right |
7.500e-04 |
3.060e-04 |
1.500e-03 |
0.000e+00 |
G5-left |
7.500e-04 |
3.061e-04 |
1.000e-03 |
5.000e-04 |
G5-right |
2.500e-04 |
1.767e-04 |
5.000e-04 |
0.000e+00 |
G6-left |
6.250e-04 |
2.794e-04 |
1.000e-03 |
2.500e-04 |
G6-right |
0.000e+00 |
0.000e+00 |
0.000e+00 |
0.000e+00 |
G7-left |
1.125e-03 |
3.747e-04 |
2.000e-03 |
2.500e-04 |
G7-right |
1.000e-03 |
3.533e-04 |
1.750e-03 |
2.500e-04 |
G8-left |
3.750e-04 |
2.164e-04 |
7.500e-04 |
0.000e+00 |
G8-right |
2.500e-04 |
1.767e-04 |
5.000e-04 |
0.000e+00 |
Mean |
4.844e-04 |
6.148e-05 |
8.125e-04 |
1.562e-04 |
Avg. SPAM error |
Avg. SPAM error uncertainty |
0 SPAM error |
1 SPAM error |
|
G1-left |
1.650e-03 |
2.869e-04 |
4.000e-04 |
2.900e-03 |
G1-right |
2.150e-03 |
3.273e-04 |
5.000e-04 |
3.800e-03 |
G2-left |
2.050e-03 |
3.197e-04 |
6.000e-04 |
3.500e-03 |
G2-right |
3.050e-03 |
3.896e-04 |
8.000e-04 |
5.300e-03 |
G3-left |
2.000e-03 |
3.158e-04 |
7.000e-04 |
3.300e-03 |
G3-right |
2.350e-03 |
3.422e-04 |
8.000e-04 |
3.900e-03 |
G4-left |
2.950e-03 |
3.832e-04 |
9.000e-04 |
5.000e-03 |
G4-right |
2.650e-03 |
3.634e-04 |
1.100e-03 |
4.200e-03 |
Mean |
2.356e-03 |
1.211e-04 |
7.250e-04 |
3.988e-03 |
Memory error per qubit at depth-1 circuit time¶
To characterize memory error in depth-1 circuit time, we perform 1-qubit RB as described above, while interleaving specialized commands that force transport to create random 2-qubit pairings and run the preset cooling. The net RB error measured is the 1-qubit and memory error, averaged across all qubits, due to depth-1 circuits. We perform this test for all available qubits in the system. The figures below average across the survival rate across all qubits on the system.
For Helios additionally, the 98 qubits are partitioned into groups where the qubits in each group have a random 1Q Clifford operation applied after every \(k\) round of depth-1 transport operations, as shown in the figure below.
Circuit diagram for transport-1Q RB where different qubits receive different number of transport rounds between gates: q0 and q1 have depth-1; q2 and q3 have depth-2; q4 and q5 have depth-4; and q6 and q7 have depth-8.¶
Survival rate from 1-qubit and memory randomized benchmarking projects for H1-1¶
Survival rate from 1-qubit and memory randomized benchmarking projects for H2-1¶
Survival rate from 1-qubit and memory randomized benchmarking projects for H2-2¶
Survival rate from 1-qubit and memory randomized benchmarking projects for Helios-1¶
On Helios, Memory error is additionally reported for 2 components: linear memory error and quadratic memory error. These components can be extracted by fitting memory error per transport depth, \(l\), as shown by the quadratic equation below,
The fit parameters \(b\) and \(c\) correspond to the linear and quadratic components of the memory error. Quadratic memory error is “slow” noise that corresponds to coherent Z rotations on each qubit. Linear memory error is “fast” noise that corresponds to stochastic Z or leakage errors on each qubit.
Memory error and leakage rate are shown as a function of transport depth. The memory error data also accounts for leakage and is fit to a quadratic equation with fit coefficients 𝑏 and 𝑐, corresponding to the linear and quadratic components of the memory error. The leakage rate exhibits linear scaling with transport depth, with the per-depth leakage rate given by the slope.¶
Survival rate from 1-qubit and memory randomized benchmarking projects for reimei¶
Mid-circuit measurement cross-talk error¶
Although qubits are physically separated during measurement and reset, there is a small chance that an unmeasured qubit in the \(|1\rangle\) state will absorb the detection light, destroying its quantum state, and potentially scattering to the non-computational states used for state detection. This is not an issue with measurement at the end of a circuit when all qubits are measured but can impact circuits with mid-circuit measurement and reset. The mid-circuit measurement and reset cross-talk errors are quantified by the population decay of an unmeasured qubit while applying many measurement or reset pulses to a neighboring qubit [5].