Quality Standards
A multisite study of cobas pure finds nearly half of 17 assays cannot meet desirable uncertainty goals
A study of the new Cobas Pure detailed imprecision and bias. Can these instruments meet the new measurement uncertainty goals?
Over 45% of 17 assays in a multisite study of cobas pure assays cannot meet desirable uncertainty goals
Sten Westgard, MS
March 2025
An extensive study across Europe and Asia looked at one of the latest instruments to hit the market: cobas pure.
Performance evaluation of cobas pure integrated solutions at multiple sites in Europe and Asia. Baum H, Chun S, Findeisen P, Fleurkens H, Gu H, Jinyoung H, Prevot F, Radziszewski D, Rossier MF, Vogt N, Furrer J, Klopprogge K, Scheider-Thauren C. J Lab Med 2023; 47(3): 129-140. The study was conducted in Germany(2 sites), Poland, Switzerland, and South Korea.
"At all five sites, the Roche-manufacturerd and BioRad QC materials were measured using selected applications [tests] at two analyte concentration levels over 14-16 weeks. Pooled control materials (Roche-manufactured and BioRad) were used to minimize the potential influence of sample handling between sites and operators; two control samples were measured per application (low and high concentration)....Coefficients of variation (CVs) for repeatability (within-run precision), intermediate imprecision (within-laboratory precision), and reproducibility (across-laboratory precision) were calculated and compared...."
VISP siteAnalyte | Level |
Reproducibility CV | DESIRABLE mu | MINIMUM mu | ||
u:rw | verdict | u:rw | verdict | |||
ALT, level 1 | 47.7 | 2.7 | 2.325 | FAILS | 3.49 | PASSES |
level 2 | 117.1 | 3.8 | 2.325 | FAILS | 3.49 | FAILS |
AST level 1 | 48.5 | 1.9 | 2.375 | PASSES | 3.565 | PASSES |
level 2 | 146 | 2.3 | 2.375 | PASSES | 3.565 | PASSES |
Calcium, total, level 1 | 2.3 | 1.4 | 0.455 | FAILS | 0.68 | FAILS |
level 2 | 3.5 | 1.7 | 0.455 | FAILS | 0.68 | FAILS |
Chloride, level 1 | 84.9 | 3.0 | 0.245 | FAILS | 0.37 | FAILS |
level 2 | 108.1 | 2.5 | 0.245 | FAILS | 0.37 | FAILS |
Cholesterol, total, level 1 | 1.9 | 1.2 | 1.5 | PASSES | 3.5 | PASSES |
level 2 | 4.7 | 1.1 | 1.5 | PASSES | 3.5 | PASSES |
Creatinine, level 1 | 96.4 | 2.6 | 1.1 | FAILS | 1.65 | FAILS |
level 2 | 365.3 | 2.1 | 1.1 | FAILS | 1.65 | FAILS |
CRP, level 1 | 9.9 | 1.3 | 1.8 | PASSES | 2.8 | PASSES |
level 2 | 54.3 | 1.8 | 1.8 | PASSES | 2.8 | PASSES |
Folate, level 1 | 4.1 | 7.6 | 4 | FAILS | 6 | FAILS |
level 2 | 12.2 | 5.0 | 4 | FAILS | 6 | PASSES |
Glucose, level 1 | 5.7 | 2.0 | 1 | FAILS | 1.5 | FAILS |
level 2 | 13.0 | 2.4 | 1 | FAILS | 1.5 | FAILS |
hCG, level 1 | 9.1 | 2.4 | 2.2 | FAILS | 3.4 | PASSES |
level 2 | 922.4 | 1.6 | 2.2 | PASSES | 3.4 | PASSES |
Phosphate, level 1 | 1.3 | 1.1 | 1.92 | PASSES | 2.875 | PASSES |
level 2 | 2.5 | 1.7 | 1.92 | PASSES | 2.875 | PASSES |
Potassium serum, level 1 | 3.6 | 2.3 | 0.98 | FAILS | 1.47 | FAILS |
level 2 | 6.9 | 1.4 | 0.98 | FAILS | 1.47 | PASSES |
Proteins, total, level 1 | 50.1 | 2.2 | 0.65 | FAILS | 0.975 | FAILS |
level 2 | 78.8 | 2.5 | 0.65 | FAILS | 0.975 | FAILS |
Sodium level 1 | 112.5 | 1.4 | 0.135 | FAILS | 0.2 | FAILS |
level 2 | 137.7 | 1.5 | 0.135 | FAILS | 0.2 | FAILS |
T4, Free, level 1 | 16.7 | 2.5 | 1.4 | FAILS | 2.1 | FAILS |
level 2 | 43.2 | 2.4 | 1.4 | FAILS | 2.1 | FAILS |
TSH, level 1 | 1.3 | 1.4 | 1.445 | PASSES | 2.17 | PASSES |
level 2 | 7.7 | 1.4 | 1.445 | PASSES | 2.17 | PASSES |
Urea, level 1 | 6.5 | 2.1 | 3.525 | PASSES | 5.3 | PASSES |
level 2 | 20.0 | 2.1 | 3.525 | PASSES | 5.3 | PASSES |
Ludwigburg Analyte | Level |
Intermediate precision |
DESIRABLE mu | MINIMUM mu | ||
u:rw | verdict | u:rw | verdict | |||
ALT, level 1 | 45.7 | 1.5 | 2.325 | PASSES | 3.49 | PASSES |
level 2 | 111.0 | 1.6 | 2.325 | PASSES | 3.49 | PASSES |
AST level 1 | 49.3 | 1.0 | 2.375 | PASSES | 3.565 | PASSES |
level 2 | 148.1 | 1.1 | 2.375 | PASSES | 3.565 | PASSES |
Calcium, total, level 1 | 2.2 | 0.9 | 0.455 | FAILS | 0.68 | FAILS |
level 2 | 3.4 | 1.0 | 0.455 | FAILS | 0.68 | FAILS |
Chloride, level 1 | 82.5 | 1.1 | 0.245 | FAILS | 0.37 | FAILS |
level 2 | 104.5 | 1.1 | 0.245 | FAILS | 0.37 | FAILS |
Cholesterol, total, level 1 | 1.9 | 1.0 | 1.5 | PASSES | 3.5 | PASSES |
level 2 | 4.7 | 1.1 | 1.5 | PASSES | 3.5 | PASSES |
Creatinine, level 1 | 94.8 | 1.8 | 1.1 | FAILS | 1.65 | FAILS |
level 2 | 359.8 | 1.0 | 1.1 | PASSES | 1.65 | PASSES |
CRP, level 1 | 9.8 | 1.3 | 1.8 | PASSES | 2.8 | PASSES |
level 2 | 53.5 | 1.4 | 1.8 | PASSES | 2.8 | PASSES |
Folate level 1 | 4.1 | 6.3 | 4 | FAILS | 6 | FAILS |
level 2 | 12.8 | 4.1 | 4 | FAILS | 6 | PASSES |
Glucose, level 1 | 5.7 | 0.9 | 1 | PASSES | 1.5 | PASSES |
level 2 | 12.9 | 1.1 | 1 | FAILS | 1.5 | PASSES |
hCG, level 1 | 9.5 | 1.3 | 2.275 | PASSES | 3.415 | PASSES |
level 2 | 943.7 | 1.3 | 2.275 | PASSES | 3.415 | PASSES |
Phosphate, level 1 | 1.2 | 1.0 | 1.92 | PASSES | 2.875 | PASSES |
level 2 | 2.5 | 1.0 | 1.92 | PASSES | 2.875 | PASSES |
Potassium serum, level 1 | 3.5 | 1.4 | 0.98 | FAILS | 1.47 | FAILS |
level 2 | 6.7 | 1.1 | 0.98 | FAILS | 1.47 | PASSES |
Proteins, total, level 1 | 50.4 | 1.0 | 0.65 | FAILS | 0.975 | FAILS |
level 2 | 78.6 | 1.1 | 0.65 | FAILS | 0.975 | FAILS |
Sodium level 1 | 110.7 | 1.0 | 0.135 | FAILS | 0.2 | FAILS |
level 2 | 134.7 | 0.9 | 0.135 | FAILS | 0.2 | FAILS |
T4, Free, level 1 | 16.6 | 1.7 | 1.4 | FAILS | 2.1 | PASSES |
level 2 | 42.3 | 1.4 | 1.4 | PASSES | 2.1 | FAILS |
TSH, level 1 | 1.3 | 1.1 | 1.445 | PASSES | 2.17 | PASSES |
level 2 | 7.9 | 1.0 | 1.445 | PASSES | 2.17 | PASSES |
Urea, level 1 | 6.6 | 1.2 | 3.525 | PASSES | 5.3 | PASSES |
level 2 | 20.2 | 1.4 | 3.525 | PASSES | 5.3 | PASSES |
Wroclaw Analyte | Level |
Intermediate precision |
DESIRABLE mu | MINIMUM mu | ||
u:rw | verdict | u:rw | verdict | |||
ALT, level 1 | 45.1 | 1.2 | 2.325 | PASSES | 3.49 | PASSES |
level 2 | 109.7 | 1.3 | 2.325 | PASSES | 3.49 | PASSES |
AST level 1 | 47.7 | 1.0 | 2.375 | PASSES | 3.565 | PASSES |
level 2 | 142.5 | 0.8 | 2.375 | PASSES | 3.565 | PASSES |
Calcium, total, level 1 | 2.2 | 0.8 | 0.455 | FAILS | 0.68 | FAILS |
level 2 | 3.4 | 0.6 | 0.455 | FAILS | 0.68 | PASSES |
Chloride, level 1 | 80.7 | 1.4 | 0.245 | FAILS | 0.37 | FAILS |
level 2 | 102.9 | 1.2 | 0.245 | FAILS | 0.37 | FAILS |
Cholesterol, total, level 1 | 1.9 | 0.9 | 1.5 | PASSES | 3.5 | PASSES |
level 2 | 4.6 | 0.7 | 1.5 | PASSES | 3.5 | PASSES |
Creatinine, level 1 | 97.0 | 1.9 | 1.1 | FAILS | 1.65 | FAILS |
level 2 | 362.5 | 1.4 | 1.1 | FAILS | 1.65 | PASSES |
CRP, level 1 | 9.9 | 1.0 | 1.8 | PASSES | 2.8 | PASSES |
level 2 | 52.7 | 1.0 | 1.8 | PASSES | 2.8 | PASSES |
Folate level 1 | 4.2 | 6.3 | 4 | FAILS | 6 | FAILS |
level 2 | 13.0 | 4.0 | 4 | PASSES | 6 | PASSES |
Glucose, level 1 | 5.6 | 0.9 | 1 | PASSES | 1.5 | PASSES |
level 2 | 12.6 | 0.8 | 1 | PASSES | 1.5 | PASSES |
hCG, level 1 | 9.4 | 1.4 | 2.275 | PASSES | 3.415 | PASSES |
level 2 | 928.6 | 1.1 | 2.275 | PASSES | 3.415 | PASSES |
Phosphate, level 1 | 1.2 | 0.8 | 1.92 | PASSES | 2.875 | PASSES |
level 2 | 2.4 | 0.6 | 1.92 | PASSES | 2.875 | PASSES |
Potassium serum, level 1 | 3.5 | 0.9 | 0.98 | PASSES | 1.47 | PASSES |
level 2 | 6.7 | 0.8 | 0.98 | PASSES | 1.47 | PASSES |
Proteins, total, level 1 | 48.7 | 0.9 | 0.65 | FAILS | 0.975 | PASSES |
level 2 | 76.4 | 0.7 | 0.65 | FAILS | 0.975 | PASSES |
Sodium level 1 | 110.2 | 0.9 | 0.135 | FAILS | 0.2 | FAILS |
level 2 | 134.2 | 0.9 | 0.135 | FAILS | 0.2 | FAILS |
T4, Free, level 1 | 17.0 | 1.2 | 1.4 | PASSES | 2.1 | PASSES |
level 2 | 42.9 | 1.5 | 1.4 | FAILS | 2.1 | PASSES |
TSH, level 1 | 1.3 | 0.9 | 1.445 | PASSES | 2.17 | PASSES |
level 2 | 7.7 | 0.6 | 1.445 | PASSES | 2.17 | PASSES |
Urea, level 1 | 6.5 | 1.5 | 3.525 | PASSES | 5.3 | PASSES |
level 2 | 20.0 | 1.7 | 3.525 | PASSES | 5.3 | PASSES |
Seoul Analyte | Level |
Intermediate precision |
DESIRABLE mu | MINIMUM mu | ||
u:rw | verdict | u:rw | verdict | |||
ALT, level 1 | 45.8 | 1.3 | 2.325 | PASSES | 3.49 | PASSES |
level 2 | 108.4 | 2.3 | 2.325 | PASSES | 3.49 | PASSES |
AST level 1 | 47.6 | 0.9 | 2.375 | PASSES | 3.565 | PASSES |
level 2 | 141.4 | 0.7 | 2.375 | PASSES | 3.565 | PASSES |
Calcium, total, level 1 | 2.2 | 0.7 | 0.455 | FAILS | 0.68 | FAILS |
level 2 | 3.4 | 0.7 | 0.455 | FAILS | 0.68 | PASSES |
Chloride, level 1 | 85.7 | 0.9 | 0.245 | FAILS | 0.37 | FAILS |
level 2 | 107.3 | 0.9 | 0.245 | FAILS | 0.37 | FAILS |
Cholesterol, total, level 1 | 1.9 | 1.2 | 1.5 | PASSES | 3.5 | PASSES |
level 2 | 4.7 | 1.0 | 1.5 | PASSES | 3.5 | PASSES |
Creatinine, level 1 | 92.7 | 1.5 | 1.1 | FAILS | 1.65 | PASSES |
level 2 | 351.4 | 1.2 | 1.1 | FAILS | 1.65 | PASSES |
CRP, level 1 | 9.8 | 1.0 | 1.8 | PASSES | 2.8 | PASSES |
level 2 | 52.8 | 1.2 | 1.8 | PASSES | 2.8 | PASSES |
Folate level 1 | 4.5 | 4.6 | 4 | FAILS | 6 | PASSES |
level 2 | 13.1 | 3.8 | 4 | PASSES | 6 | PASSES |
Glucose, level 1 | 5.5 | 0.6 | 1 | PASSES | 1.5 | PASSES |
level 2 | 12.4 | 0.7 | 1 | PASSES | 1.5 | PASSES |
hCG, level 1 | 9.2 | 1.5 | 2.275 | PASSES | 3.415 | PASSES |
level 2 | 930.3 | 1.3 | 2.275 | PASSES | 3.415 | PASSES |
Phosphate, level 1 | 1.2 | 0.8 | 1.92 | PASSES | 2.875 | PASSES |
level 2 | 2.4 | 0.6 | 1.92 | PASSES | 2.875 | PASSES |
Potassium serum, level 1 | 3.5 | 1.5 | 0.98 | FAILS | 1.47 | FAILS |
level 2 | 6.7 | 1.0 | 0.98 | PASSES | 1.47 | PASSES |
Proteins, total, level 1 | 48.3 | 0.7 | 0.65 | FAILS | 0.975 | PASSES |
level 2 | 75.0 | 0.8 | 0.65 | FAILS | 0.975 | PASSES |
Sodium level 1 | 111.2 | 0.9 | 0.135 | FAILS | 0.2 | FAILS |
level 2 | 134.9 | 0.9 | 0.135 | FAILS | 0.2 | FAILS |
T4, Free, level 1 | 16.4 | 2.2 | 1.4 | FAILS | 2.1 | FAILS |
level 2 | 41.8 | 2.0 | 1.4 | FAILS | 2.1 | PASSES |
TSH, level 1 | 1.3 | 1.1 | 1.445 | PASSES | 2.17 | PASSES |
level 2 | 7.8 | 1.3 | 1.445 | PASSES | 2.17 | PASSES |
Urea, level 1 | 6.3 | 1.5 | 3.525 | PASSES | 5.3 | PASSES |
level 2 | 19.5 | 1.3 | 3.525 | PASSES | 5.3 | PASSES |
A summary of what can meet the uncertainty goals
The bright side is that a majority of these assays can hit desirable and minimum measurement uncertainty goals. The dark lining of that cloud is that the VISP laboratory, which calculated the longer term estimate of imprecision, reproducibility, did not. The more realistic operating performance, in other words, might not achieve these new goals.
Still another problem is that the u:ref and u:cal are not available to be included in a my calculation. The control CVs are taken as a surrogate, but the addition of the other uncertainties might push more assays into unacceptability. A final challenge is that all of these calculations don't take into account any bias. If bias is not zero, then even fewer of these assays will be able to hit the new mu goals.
The study did in fact determine bias, and we'll tackle that in a future article.