Tools, Technologies and Training for Healthcare Laboratories

A multisite study of cobas pure finds nearly half of 17 assays cannot meet desirable uncertainty goals

A study of the new Cobas Pure detailed imprecision and bias. Can these instruments meet the new measurement uncertainty goals?

Over 45% of 17 assays in a multisite study of cobas pure assays cannot meet desirable uncertainty goals

Sten Westgard, MS
March 2025

An extensive study across Europe and Asia looked at one of the latest instruments to hit the market: cobas pure.

Performance evaluation of cobas pure integrated solutions at multiple sites in Europe and Asia. Baum H, Chun S, Findeisen P, Fleurkens H, Gu H, Jinyoung H, Prevot F, Radziszewski D, Rossier MF, Vogt N, Furrer J, Klopprogge K, Scheider-Thauren C. J Lab Med 2023; 47(3): 129-140. The study was conducted in Germany(2 sites), Poland, Switzerland, and South Korea.

"At all five sites, the Roche-manufacturerd and BioRad QC materials were measured using selected applications [tests] at two analyte concentration levels over 14-16 weeks. Pooled control materials (Roche-manufactured and BioRad) were used to minimize the potential influence of sample handling between sites and operators; two control samples were measured per application (low and high concentration)....Coefficients of variation (CVs) for repeatability (within-run precision), intermediate imprecision (within-laboratory precision), and reproducibility (across-laboratory precision) were calculated and compared...."

 

VISP siteAnalyte  Level
Reproducibility CV DESIRABLE mu MINIMUM mu
  u:rw verdict u:rw verdict
ALT, level 1 47.7 2.7 2.325 FAILS 3.49 PASSES
   level 2 117.1 3.8 2.325 FAILS 3.49 FAILS
AST level 1 48.5 1.9 2.375 PASSES 3.565 PASSES
  level 2 146 2.3 2.375 PASSES 3.565 PASSES
Calcium, total, level 1 2.3 1.4 0.455 FAILS 0.68 FAILS
   level 2 3.5 1.7 0.455 FAILS 0.68 FAILS
Chloride, level 1 84.9 3.0 0.245 FAILS 0.37 FAILS
   level 2 108.1 2.5 0.245 FAILS 0.37 FAILS
Cholesterol, total, level 1 1.9 1.2 1.5 PASSES 3.5 PASSES
   level 2 4.7 1.1 1.5 PASSES 3.5 PASSES
Creatinine, level 1 96.4 2.6 1.1 FAILS 1.65 FAILS
   level 2 365.3 2.1 1.1 FAILS 1.65 FAILS
CRP, level 1 9.9 1.3 1.8  PASSES 2.8  PASSES
   level 2 54.3 1.8 1.8  PASSES 2.8  PASSES
Folate, level 1 4.1 7.6 4 FAILS 6 FAILS
   level 2 12.2 5.0 4 FAILS 6 PASSES
Glucose, level 1 5.7 2.0 1 FAILS 1.5 FAILS
   level 2 13.0 2.4 1 FAILS 1.5 FAILS
hCG, level 1 9.1 2.4 2.2 FAILS 3.4 PASSES
   level 2 922.4 1.6 2.2 PASSES 3.4 PASSES
Phosphate, level 1 1.3 1.1 1.92  PASSES 2.875 PASSES
   level 2 2.5 1.7 1.92  PASSES 2.875  PASSES
Potassium serum, level 1 3.6 2.3 0.98 FAILS 1.47 FAILS
   level 2 6.9 1.4 0.98 FAILS 1.47 PASSES
Proteins, total, level 1 50.1 2.2 0.65 FAILS 0.975 FAILS
   level 2 78.8 2.5 0.65 FAILS 0.975 FAILS
Sodium level 1 112.5 1.4 0.135 FAILS 0.2 FAILS
   level 2 137.7 1.5 0.135 FAILS 0.2 FAILS
T4, Free, level 1 16.7 2.5 1.4 FAILS 2.1 FAILS
    level 2  43.2 2.4 1.4 FAILS 2.1 FAILS
TSH, level 1 1.3 1.4 1.445 PASSES 2.17 PASSES
    level 2  7.7 1.4 1.445  PASSES 2.17  PASSES
Urea, level 1 6.5 2.1 3.525 PASSES 5.3 PASSES
   level 2 20.0 2.1 3.525 PASSES 5.3 PASSES

 

 

Ludwigburg Analyte  Level
Intermediate
precision
 
DESIRABLE mu MINIMUM mu
u:rw verdict u:rw verdict
ALT, level 1 45.7 1.5 2.325 PASSES 3.49 PASSES
   level 2 111.0 1.6 2.325 PASSES 3.49 PASSES
AST level 1 49.3 1.0 2.375 PASSES 3.565 PASSES
  level 2 148.1 1.1 2.375 PASSES 3.565 PASSES
Calcium, total, level 1 2.2 0.9 0.455 FAILS 0.68 FAILS
   level 2 3.4 1.0 0.455 FAILS 0.68 FAILS
Chloride, level 1 82.5 1.1 0.245 FAILS 0.37 FAILS
   level 2  104.5 1.1 0.245 FAILS 0.37 FAILS
Cholesterol, total, level 1 1.9 1.0 1.5 PASSES 3.5 PASSES
   level 2 4.7 1.1 1.5 PASSES 3.5 PASSES
Creatinine, level 1 94.8 1.8 1.1 FAILS 1.65 FAILS
   level 2 359.8 1.0 1.1 PASSES 1.65 PASSES
CRP, level 1 9.8 1.3 1.8  PASSES 2.8 PASSES
   level 2  53.5 1.4 1.8  PASSES 2.8 PASSES
Folate level 1 4.1 6.3 4 FAILS 6 FAILS
   level 2 12.8 4.1 4 FAILS 6 PASSES
Glucose, level 1 5.7 0.9 1 PASSES 1.5 PASSES
   level 2 12.9 1.1 1 FAILS 1.5 PASSES
hCG, level 1 9.5 1.3 2.275 PASSES 3.415 PASSES
   level 2 943.7 1.3 2.275 PASSES 3.415 PASSES
Phosphate, level 1 1.2 1.0 1.92 PASSES 2.875  PASSES
   level 2 2.5 1.0 1.92 PASSES 2.875  PASSES
Potassium serum, level 1 3.5 1.4 0.98 FAILS 1.47 FAILS
   level 2  6.7 1.1 0.98 FAILS 1.47 PASSES
Proteins, total, level 1 50.4 1.0 0.65 FAILS 0.975 FAILS
   level 2 78.6 1.1 0.65 FAILS 0.975 FAILS
Sodium level 1 110.7 1.0 0.135 FAILS 0.2 FAILS
   level 2 134.7 0.9 0.135 FAILS 0.2 FAILS
T4, Free, level 1 16.6 1.7 1.4 FAILS 2.1 PASSES
    level 2 42.3 1.4 1.4 PASSES 2.1 FAILS
TSH, level 1 1.3 1.1 1.445 PASSES 2.17 PASSES
    level 2 7.9 1.0 1.445  PASSES 2.17  PASSES
Urea, level 1 6.6 1.2 3.525 PASSES 5.3 PASSES
   level 2 20.2 1.4 3.525 PASSES 5.3 PASSES

 

 

Wroclaw Analyte  Level
Intermediate
precision
 
DESIRABLE mu MINIMUM mu
u:rw verdict u:rw verdict
ALT, level 1 45.1 1.2 2.325 PASSES 3.49 PASSES
   level 2  109.7 1.3 2.325 PASSES 3.49 PASSES
AST level 1 47.7 1.0 2.375 PASSES 3.565 PASSES
  level 2 142.5 0.8 2.375 PASSES 3.565 PASSES
Calcium, total, level 1 2.2 0.8 0.455 FAILS 0.68 FAILS
   level 2  3.4 0.6 0.455 FAILS 0.68 PASSES
Chloride, level 1 80.7 1.4 0.245 FAILS 0.37 FAILS
   level 2 102.9 1.2 0.245 FAILS 0.37 FAILS
Cholesterol, total, level 1 1.9 0.9 1.5 PASSES 3.5 PASSES
   level 2  4.6 0.7 1.5 PASSES 3.5 PASSES
Creatinine, level 1 97.0 1.9 1.1 FAILS 1.65 FAILS
   level 2 362.5 1.4 1.1 FAILS 1.65 PASSES
CRP, level 1 9.9 1.0 1.8  PASSES 2.8 PASSES
   level 2 52.7 1.0 1.8  PASSES 2.8 PASSES
Folate level 1 4.2 6.3 4 FAILS 6 FAILS
   level 2 13.0 4.0 4 PASSES 6 PASSES
Glucose, level 1  5.6 0.9 1 PASSES 1.5 PASSES
   level 2  12.6 0.8 1 PASSES 1.5 PASSES
hCG, level 1 9.4 1.4 2.275 PASSES 3.415 PASSES
   level 2 928.6 1.1 2.275 PASSES 3.415 PASSES
Phosphate, level 1 1.2 0.8 1.92 PASSES 2.875  PASSES
   level 2 2.4 0.6 1.92 PASSES 2.875  PASSES
Potassium serum, level 1 3.5 0.9 0.98 PASSES 1.47 PASSES
   level 2 6.7 0.8 0.98 PASSES 1.47 PASSES
Proteins, total, level 1 48.7 0.9 0.65 FAILS 0.975 PASSES
   level 2  76.4 0.7 0.65 FAILS 0.975 PASSES
Sodium level 1 110.2 0.9 0.135 FAILS 0.2 FAILS
   level 2 134.2 0.9 0.135 FAILS 0.2 FAILS
T4, Free, level 1 17.0 1.2 1.4 PASSES 2.1 PASSES
    level 2  42.9 1.5 1.4 FAILS 2.1 PASSES
TSH, level 1 1.3 0.9 1.445 PASSES 2.17 PASSES
    level 2 7.7 0.6 1.445  PASSES 2.17  PASSES
Urea, level 1 6.5 1.5 3.525 PASSES 5.3 PASSES
   level 2 20.0 1.7 3.525 PASSES 5.3 PASSES

 

Seoul Analyte  Level
Intermediate
precision
 
DESIRABLE mu MINIMUM mu
u:rw verdict u:rw verdict
ALT, level 1 45.8 1.3 2.325 PASSES 3.49 PASSES
   level 2 108.4 2.3 2.325 PASSES 3.49 PASSES
AST level 1 47.6 0.9 2.375 PASSES 3.565 PASSES
  level 2 141.4 0.7 2.375 PASSES 3.565 PASSES
Calcium, total, level 1 2.2 0.7 0.455 FAILS 0.68 FAILS
   level 2 3.4 0.7 0.455 FAILS 0.68 PASSES
Chloride, level 1 85.7 0.9 0.245 FAILS 0.37 FAILS
   level 2 107.3 0.9 0.245 FAILS 0.37 FAILS
Cholesterol, total, level 1 1.9 1.2 1.5 PASSES 3.5 PASSES
   level 2 4.7 1.0 1.5 PASSES 3.5 PASSES
Creatinine, level 1 92.7 1.5 1.1 FAILS 1.65 PASSES
   level 2 351.4 1.2 1.1 FAILS 1.65 PASSES
CRP, level 1 9.8 1.0 1.8  PASSES 2.8 PASSES
   level 2 52.8 1.2 1.8  PASSES 2.8 PASSES
Folate level 1 4.5 4.6 4 FAILS 6 PASSES
   level 2 13.1 3.8 4 PASSES 6 PASSES
Glucose, level 1 5.5 0.6 1 PASSES 1.5 PASSES
   level 2 12.4 0.7 1 PASSES 1.5 PASSES
hCG, level 1 9.2 1.5 2.275 PASSES 3.415 PASSES
   level 2 930.3 1.3 2.275 PASSES 3.415 PASSES
Phosphate, level 1 1.2 0.8 1.92 PASSES 2.875  PASSES
   level 2 2.4 0.6 1.92 PASSES 2.875  PASSES
Potassium serum, level 1 3.5 1.5 0.98 FAILS 1.47 FAILS
   level 2 6.7 1.0 0.98 PASSES 1.47 PASSES
Proteins, total, level 1 48.3 0.7 0.65 FAILS 0.975 PASSES
   level 2 75.0 0.8 0.65 FAILS 0.975 PASSES
Sodium level 1 111.2 0.9 0.135 FAILS 0.2 FAILS
   level 2 134.9 0.9 0.135 FAILS 0.2 FAILS
T4, Free, level 1 16.4 2.2 1.4 FAILS 2.1 FAILS
    level 2 41.8 2.0 1.4 FAILS 2.1 PASSES
TSH, level 1 1.3 1.1 1.445 PASSES 2.17 PASSES
    level 2 7.8 1.3 1.445  PASSES 2.17  PASSES
Urea, level 1 6.3 1.5 3.525 PASSES 5.3 PASSES
   level 2 19.5 1.3 3.525 PASSES 5.3 PASSES

 

A summary of what can meet the uncertainty goals

Cobas Pure assays (17) ability to meet desirable measurement uncertainty goals

2025 3 14 cobas pure minimu mu

The bright side is that a majority of these assays can hit desirable and minimum measurement uncertainty goals. The dark lining of that cloud is that the VISP laboratory, which calculated the longer term estimate of imprecision, reproducibility, did not. The more realistic operating performance, in other words, might not achieve these new goals.

Still another problem is that the u:ref and u:cal are not available to be included in a my calculation. The control CVs are taken as a surrogate, but the addition of the other uncertainties might push more assays into unacceptability. A final challenge is that all of these calculations don't take into account any bias. If bias is not zero, then even fewer of these assays will be able to hit the new mu goals.

The study did in fact determine bias, and we'll tackle that in a future article.

 

Let us know what you're interested in!
Please use this form to request more infromation about 

Westgard Products and Services.

Invalid Input
Invalid Input
Invalid Input
Invalid Input