In-House Validation of Analytical Methods: Procedures & Calculation Sheets
In-House Validation of Analytical Methods: Procedures & Calculation Sheets
In-House Validation of Analytical Methods: Procedures & Calculation Sheets
analytical methods
Procedures & Calculation sheets
versie 2, 21-6-2004
A full text version of this program can be found in UMA method 1009, Validating an analytical method
Warning: Most of the equations used in these sheets assume a full test as proposed by this
validation program. The equations are mostly not valid in deviating situations. To avoid any
obscurity there will be no output in several cases when not all results have been filled in.
This program contains instructions and calculation sheets for in-house validation of quantitative analytical methods.
In case of an in-house validation a part of a complete validation (which is a validation carried out when a new method
is developed and includes 6 different studies) is repeated to check if an analytical method is functioning properly in
a specific laboratory. In-house validation first of all includes the validation strategy when an official analytical method
or a method that is developed and validated elsewere is implemented for the first time in a laboratory. Furthermore it is
a validation strategy when the operation of a method is changed by using another analyst and/or instrument or when
the analysis prescription is modified by extending the concentration area, using a new matrix or changing other parts
of the method.
Four validation studies are described. The upper two are mandatory for an in-house validation. The lower two are only
needed in specific situations. If you do not know which studies are needed in your specific situation the scheme at
the bottom of this sheet might help you.
The validation studies described here are not new, and are extensively described in literature. What is new is that this
program provides you with fully automatic calculation sheets that circumvent the need for a profound knowledge of
statistics. More information about these studies is available in UMA method 1009 (Validating an analytical method)
Please click on one of the buttons to go to the sheet that describes the specific study
TRUENESS STUDY
The scheme below can help you to decide which studies are needed for your in-house validation.
The 6 blue boxes contain all the different validation studies possible when a complete validation
is needed. (validation of a new developed method). The options outlined in red and green are
specific for in-house validation. This program contains procedures and automatic calculation
sheets for these 4 studies.
More information about the procedures used in this program can be found in:
Statistics for Analytical Chemistry, 3rd edition, J.C. Miller and J.N. Miller
ISBN 0-13-030990-7
Statistical model:
X = Xw + δ + ε
Measured True systematic random
value value deviation error
Trueness Precision
Accuracy
The bias contains two contributions. The method bias that is inherent in the analytical method and the laboratory bias
that is attributed to a particular laboratory. Method bias refers to the deviation between the true value and the value
obtained with the method. It is well possible however that in the absence of a method bias, a particular laboratory
on the average finds a deviating result. This is the laboratory bias. When a trueness study is performed in a single
laboratory the method-bias and laboratory-bias are confounded and cannot be distinguished. In many cases the
so-called true value is not known and instead an accepted or consensus value is used.
The bias may be a constant deviation (off-set) from the true value. It may also be that the bias is proportional to the
concentration or to the amount (proportional bias).
The procedure which should be followed to carry out a trueness study is highly determined by the availability
of certified reference materials (CRM), test samples, standards or blank samples spiked with the analyte.
The type of bias which can be determined and the procedure which should be followed are summarised in the table below.
Please click on one of the buttons to continue with the desired study.
Blank sample
A blank sample is a sample which contains all constituents in roughly the same proportions as the test sample but none
of the analyte.
Standard
A standard is a sample which contains a known amount of the analyte but no matrix.
1. Trueness study with a certified reference material
A bias at the concentration level of the CRM can be determined with this study.
Procedure
1 Take 6 test portions from the Certified Reference Material (CRM).
2 Analyse each test portion in singular with the method that is to be validated.
Each test portion must undergo the complete analytical procedure including sample preparation.
When several analysts perform the analyses in practice, it is recommended either to determine the specific bias per
analyst/instrument combination or to divide the described tests among the analysts/instrument combinations.
3 Enter the results in the following table (blue fields). It is important that you fill in all fields. The conclusion is
generated automatically.
4 Conclusion
If a bias is detected it is recommended that the analytical method is subjected to a careful inspection to
improve the results. If an improvement cannot be acquired the test results can be used as a correction,
however with constraint. In the absence of further, more extensive tests, correction is allowed when:
The observed bias is modest, no more than 10% of the component concentration.
The concentration of the sought component in the test samples is close to the concentration in the CRM.
2. Trueness study with a blank sample spiked with standards or CRM
An off-set and proportional bias for a concentration range can be detected with this study. Calculations are
performed by regression analysis.
Procedure
1 Divide a blank sample in 4 roughly equal portions.
2 1 portion is taken as such (=blank)
3 3 test portions are spiked with different known amount of the component to be analysed (via either a CRM or standard).
The added amount are respectively low, intermediate and high (tested working range).
4 Analyse the 4 test portions (so including the blank) in duplicate with the method that is to be validated.
Each test portion must undergo the complete analytical procedure including sample preparation.
The samples must be analysed in random order.
5 Enter the results of the 8 analysis in the table below (blue fields). The graphical output and regression analysis are
generated automatically.
analysis results
component 1 2 0.60
x y1 y2 yaverow xi-xave (xi-xave)2 yi-yave (yi-yave)2 (xi-xave)(yi-yave) x2 ycal (y1-ycal)2 (y2-ycal)2 sum
blank 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
0.40
low 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
0.20
intermediate 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
high 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
00 10 20 30 40 50 60 70 80 90 00 total 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0!
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 1.
known amount of component average 0.00 0.00
If a statistically significant off-set or proportional bias is not detected, than this does not mean that the true
bias is zero.
It is therefore recommended to report the 95% confidence intervals of the intercept and the slope and the
maximum values of the bias as follows:
Procedure
1 Divide the test sample in 4 roughly equal portions.
2 1 portion is taken as such (unspiked test sample).
3 3 test portions are spiked with different known amount of the component to be analysed (either a CRM or standard).
The added amount are respectively low, intermediate and high (tested working range).
4 Analyse the 4 test portions (so including the blank) in duplicate with the method that is to be validated.
Each test portion must undergo the complete analytical procedure including sample preparation.
The samples must be analysed in random order.
5 Enter the results of the 8 analysis in the table below (blue fields). The graphical output and regression analysis is
generated automatically.
analysis results
unspiked test sample 0.60 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
low spiked test sample 0.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
0.40
intermediate spiked test sample 0.30
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
high spiked test sample 0.20 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
0.10 total 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0!
0.00
0.000.100.200.300.400.500.600.700.800.901.00
average 0.00 0.00
known amount of component
r: #DIV/0! sy/x: #DIV/0!
6 Regression analysis results & conclusion b:(slope) #DIV/0! sb: #DIV/0!
a:(intercept) #DIV/0! sa: #DIV/0!
Important Details from regression analysis GENERAL CONCLUSION
intercept #DIV/0! #DIV/0! CIb/2 #DIV/0!
slope #DIV/0! CIa/2 #DIV/0!
95% Confidence interval slope/2 #DIV/0! Note: An off-set bias cannot be detected by this type of set-up
These tables are derived from: Statistics for Analytical Chemistry
7 If a bias is detected it is recommended that the analytical method is subjected to a careful inspection to 3rd edition
improve the results. J.C. Miller and J.N. Miller
If a statistically significant proportional bias is not detected, than this does not mean that the true
bias is zero.
It is therefore recommended to report the 95% confidence intervals of the slope and the maximum
value of the proportional bias as follows:
Intercept #DIV/0!
8 Next to this the recovery of analyte at the three concentrations can be calculated
(Note: a proportional bias may cause a poor recovery at other concentration levels)
Recovery at low concentration (%) #DIV/0! %
Recovery at intermediate concentration (%) #DIV/0! %
Recovery at high concentration (%) #DIV/0! %
4. Trueness study with a CRM spiked with standards
An off-set and proportional bias for a concentration range can be detected with this study. Next to this the
recovery of analyte at the 3 concentration levels can be detected. Calculations are performed by regression analysis.
Note: spiking of a CRM with standards is only sensible if the concentration of the analyte in the CRM is below the range
of the method.
Procedure
1 Take 4 test portions from the Certified material (CRM).
2 1 portion is spiked with blank standard (or taken as such if no blank standard is available).
3 3 test portions are spiked with different known amount of the component to be analysed ( in the form of a standard).
The added amount are respectively low, intermediate and high (tested working range).
4 Analyse the 4 test portions (so including the blank) in duplicate with the method that is to be validated.
Each test portion must undergo the complete analytical procedure including sample preparation.
The samples must be analysed in random order.
5 Enter the results of the 8 analysis in the table below (blue fields). The graphical output and regression analysis
is generated automatically.
analysis results
CRM (+blank) 0.60 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
CRM + low st. 0.50 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
0.40
CRM + intermediate st. 0.30
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
CRM + high st. 0.20 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0! #DIV/0! #DIV/0! #DIV/0!
0.10 total 0.00 0.00 0.00 0.00 0.00 0.00 0 0.00 #DIV/0!
0.00
0.00 0.10 0.20 0.30 0.40 0.50 0.60 0.70 0.80 0.90 1.00
average 0.00 0.00
known amount of component
r: #DIV/0! sy/x: #DIV/0!
b:(slope) #DIV/0! sb: #DIV/0!
6 Regression analysis results & conclusion a:(intercept) #DIV/0! sa: #DIV/0!
If a statistically significant off-set or proportional bias is not detected, than this does not mean that the true
bias is zero.
It is therefore recommended to report the 95% confidence intervals of the intercept and the slope and the
maximum values of the bias as follows:
8 Next to this the recovery of analyte at the three concentrations can be calculated
(Note: a proportional bias may cause a poor recovery at other concentration levels)
Recovery at low concentration (%) #DIV/0! %
Recovery at intermediate concentration (%) #DIV/0! %
Recovery at high concentration (%) #DIV/0! %
5. Trueness study by comparison with a reference method on one
concentration level
A bias between two methods can be detected with this study.
Procedure
1 Take six test portions of a representative test sample (it is not necessary that the concentration of the
analyte is known exactly).
2 Analyse each test portion in singular with the method that is to be validated, and with a reference method.
Each test portion must undergo the complete analytical procedure including sample preparation.
The trueness of the reference method must of course be known exactly.
3 Enter the results in the following table (blue fields). It is important that you fill in all fields. The conclusion is
generated automatically.
4 If a bias is detected it is recommended that the analytical method is subjected to a careful inspection to
improve the results.
If a statistically significant bias is not detected, than this does not mean that the true bias is zero.
It is therefore recommended to report the maximum value of the bias (Biasmax) as follows:
Procedure
1 Take six representative test samples with a concentration evenly distributed over the concentration range
to be investigated (it is not necessary that the concentrations of the analyte are known exactly, they must be
known approximately).
2 Analyse each test sample in singular with the method that is to be validated, and a reference method.
Each test sample must undergo the complete analytical procedure including sample preparation.
3 The repeatability of both methods (expressed as a standard deviation) should be known exactly. This can
be obtained via a precision study. Please enter these figures in the table below:
method standard
deviation
to be validated
reference
4 Enter the results in the following table (blue fields). It is important that you fill in all fields. The conclusion is
generated automatically.
method method (dave) (sd) (CD) x y xi-xave (xi-xave)2 yi-yave (yi-yave)2 (xi-xave)(yi-yave)
1 low 0.00 0 0 0 ### #DIV/0! ### + ### #DIV/0! 0.00 0.00 0.00 0.00 0.00 0.00 0
2 0.00 12 x + NaN
f(x) = NaN 0.00 0.00 0.00 0.00 0.00 0.00 0
R² = 0
3 0.00 10 0.00 0.00 0.00 0.00 0.00 0.00 0
unvalidated method
4 0.00 8
0.00 0.00 0.00 0.00 0.00 0.00 0
6
5 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0
4
6 high 0.00 2
0.00 0.00 0.00 0.00 0.00 0.00 0
average #DIV/0! #DIV/0! 0 total 0.00 0.00 0.00 0.00 0.00 0.00 0
standard deviation #DIV/0! #DIV/0! C1 0 #DIV/0!
2 4 slope:
6 8 10 ###12 average 0.00 0.00
reference method
xave/sx yave/sy C2 #DIV/0!
r: #DIV/0!
5 If a bias is detected it is recommended that the analytical method is subjected to a careful inspection to
improve the results.
In the absence of a significant proportional bias, we recommend to report the 95% confidence interval
and the maximum value of the absolute bias as follows:
Statistical model:
X = Xw + δ + ε
Measured True systematic random
value value deviation error
Trueness Precision
Accuracy
Two important measures of precision are repeatability and reproducibility. The repeatability (expressed as r) represents
the smallest possible variability between testresults. The repeatability is defined as the maximum difference between
two analyses, that may be expected when they are carried out within a short time in a single laboratory by the same
operator using the same instrumentation. In contrast with this the reproducibility (expressed as R) represents the
highest possible variability between test results. The reproducibility, or more complete, the between-laboratory
reproducibility is defined as the maximum difference between two analyses, that may be expected when they are
performed by two different laboratories, and hence also different operators and instrumentation.
The reproducibility contains the largest amount of sources of variability, including those caused by the fact that different
laboratories use the method. If one implements an official method in a laboratory one is of course only interested in
the variability within the laboratory. For this purpose it is necessary to determine a within laboratory reproducibility.
This is a precision parameter that lies between the repeatability and the reproducibility.
Depending on the local situation several sources of variability can be of importance and taken in the precision study to
determine the within laboratory reproducibility. The factor "time" will always be of importance because the method will
be used on different days. Next to this if a method within the laboratory is used by different analists and/or different
instruments then the factors "operator" and "equipment" can also be incorporated in the precision study.
ISO uses the terms time-different intermediate precision standard deviation (S I(T)), operator-different intermediate
precision standard deviation (SI(O)), equipment-different intermediate precision standard deviation (S I(E)) and all
combinations (SI(TOE)).
The repeatability can be determined in a separate study but can also be obtained from the precision study in which
the within laboratory reproducibility is determined.
Please choose the appropriate study for your specific situation from the table below.
Next: click on one of the buttons to continue with the desired study.
The method is always carried out by the Precision study in which only
same analyst and on the same instrument the factor time is changed
The number of analysts that use the Precision study in which the
method times the number of instruments factors instrument & operator are
used by all analysts is larger than 2 (more varied over time.
than 2 analyst/instrument combinations)
1. Repeatability study
Procedure
1 Take 4 samples with concentrations distributed over the working range.
2 Analyse these samples in 5-fold on the same day. If it is impossible to perform al analyses on the same
day, the number of samples may be reduced but should never be lower than 3 levels in duplicate.
Each test portion must undergo the complete analytical procedure including sample preparation.
3 Enter the results in the following table (blue fields). The repeatability is calculated automatically.
Please note that the repeatability values (r) are calculated per concentration level separately and pooled.
This pooled, overall repeatability is only valid if the plot of the concentration vs the standard deviation does not reveal a
concentration dependency (see plot below the table).
10
6
SD
0
0 2 4 6 8 10 12
concentration
If the plot shows a linear relation between the SD (standard deviation) and the concentration, report both the relation and the
repeatability values per concentration level. If the plot does not show a relation between the SD and the concentration level the
pooled repeatability can be reported.
2. Precision study to determine repeatability and within
laboratory reproducibility
Precision study in which only the factor time is changed
(for 1 analyst using 1 instrument)
Procedure
1 Take 3 samples with concentrations distributed over the working range.
2 Analyse these samples in duplicate on the same day.
3 Repeat these analyses on 4 different days giving in total 24 analytical results.
4 Enter the results in the following table (blue fields). It is important that you fill in all fields.
Set-up of this test:
result
12
2 1 high 2 10 1 0 0 0 0 0 1
3 1 middle 1 8 2 0 0 0 0 1
4 1 middle 2 6
3 0 0 0 0 1
5 1 low 1 4
4 0 0 0 0 1
2
6 1 low 2 day
0
7 2 high 1 1 2 3 4
ANOVA SS df MSE F P Fcrit
8 2 high 2 between 0 3 0 #DIV/0! #DIV/0! 6.59
9 2 middle 1 Results Concentration Middle within 0 4 0
10 2 middle 2 12
11 2 low 1 10
total 0 7
12 2 low 2 8
result
6
13 3 high 1 4
14 3 high 2 2 Concentration middle
day
15 3 middle 1 0 day results results-d row-ave ovmean within-v df
16 3 middle 2 1 1.5 2 2.5 3 3.5 4
1 0 0 0 0 0 1
17 3 low 1 Results Concentration Low
2 0 0 0 0 1
18 3 low 2 12 3 0 0 0 0 1
19 4 high 1 10 4 0 0 0 0 1
20 4 high 2 8
result
21 4 middle 1 6
ANOVA SS df MSE F P Fcrit
22 4 middle 2 4
between 0 3 0 #DIV/0! #DIV/0! 6.59
2
23 4 low 1 day within 0 4 0
0
24 4 low 2 1 1.5 2 2.5 3 3.5 4
total 0 7
5 The repeatability and within laboratory reproducibility are calculated automatically for every
concentration level separately. Concentration low
day results results-d row-ave ovmean within-v df
Concentration repeatability within lab Comment 1 0 0 0 0 0 1
reproducibility 2 0 0 0 0 1
High 3 0 0 0 0 1
Middle 4 0 0 0 0 1
Low
ANOVA SS df MSE F P Fcrit
6 The repeatability and within laboratory reproducibility can be pooled over all concentration levels if the ratio between 0 3 0 #DIV/0! #DIV/0! 6.59
between the highest and lowest repeatability or within laboratory reproducibility is less than 3 (see the note below): within 0 4 0
Pooled repeatability/reproducibility
conc level r R r^2 R^2 df
high #VALUE! #VALUE!
middle #VALUE! #VALUE!
low #VALUE! #VALUE!
mean #VALUE! #VALUE!
sqrt(mean) #VALUE! #VALUE!
totdf 0
result
12
2 1 1 high 2 10 1 0 0 0 0 0 1
3 1 1 middle 1 8
2 0 0 0 0 1
4 1 1 middle 2 6
3 0 0 0 0 1
4
5 1 1 low 1 4 0 0 0 0 1
2
6 1 1 low 2 0
day
7 2 2 high 1 1 2 3 4 ANOVA SS df MSE F P Fcrit
8 2 2 high 2 between 0 3 0 #DIV/0! #DIV/0! 6.59
9 2 2 middle 1 Results Concentration Middle within 0 4 0
10 2 2 middle 2 12
11 2 2 low 1 10 total 0 7
12 2 2 low 2 8
result
6
13 3 1 high 1
4
14 3 1 high 2 2
Concentration middle
day
15 3 1 middle 1 0 day results results-d row-ave ovmean within-v df
16 3 1 middle 2 1 1.5 2 2.5 3 3.5 4 1 0 0 0 0 0 1
17 3 1 low 1 2 0 0 0 0 1
Results Concentration Low
18 3 1 low 2 12
3 0 0 0 0 1
19 4 2 high 1 10
4 0 0 0 0 1
20 4 2 high 2 8
5 The repeatability and within laboratory reproducibility are calculated automatically for every
concentration level separately. Concentration low
day results results-d row-ave ovmean within-v df
Concentration repeatability within lab Comment 1 0 0 0 0 0 1
reproducibility 2 0 0 0 0 1
High 3 0 0 0 0 1
Middle 4 0 0 0 0 1
Low
ANOVA SS df MSE F P Fcrit
6 The repeatability and within laboratory reproducibility can be pooled over all concentration levels if the ratio between 0 3 0 #DIV/0! #DIV/0! 6.59
between the highest and lowest repeatability or within laboratory reproducibility is less than 3 (see the note below): within 0 4 0
Pooled repeatability/reproducibility
conc level r R r^2 R^2 df
high #VALUE! #VALUE!
middle #VALUE! #VALUE!
low #VALUE! #VALUE!
mean #VALUE! #VALUE!
sqrt(mean) #VALUE! #VALUE!
totdf 0
result
12
2 1 1 high 2 10 1 0 0 0 0 0 1
3 1 1 middle 1 8
2 0 0 0 0 1
4 1 1 middle 2 6
3 0 0 0 0 1
4
5 1 1 low 1 4 0 0 0 0 1
2
6 1 1 low 2 0
day
7 2 2 high 1 1 2 3 4 ANOVA SS df MSE F P Fcrit
8 2 2 high 2 between 0 3 0 #DIV/0! #DIV/0! 6.59
9 2 2 middle 1 Results Concentration Middle within 0 4 0
10 2 2 middle 2 12
11 2 2 low 1 10 total 0 7
12 2 2 low 2 8
result
6
13 3 1 high 1
4
14 3 1 high 2 2
Concentration middle
day
15 3 1 middle 1 0 day results results-d row-ave ovmean within-v df
16 3 1 middle 2 1 1.5 2 2.5 3 3.5 4 1 0 0 0 0 0 1
17 3 1 low 1 2 0 0 0 0 1
Results Concentration Low
18 3 1 low 2 12
3 0 0 0 0 1
19 4 2 high 1 10
4 0 0 0 0 1
20 4 2 high 2 8
5 The repeatability and within laboratory reproducibility are calculated automatically for every
concentration level separately. Concentration low
day results results-d row-ave ovmean within-v df
Concentration repeatability within lab Comment 1 0 0 0 0 0 1
reproducibility 2 0 0 0 0 1
High 3 0 0 0 0 1
Middle 4 0 0 0 0 1
Low
ANOVA SS df MSE F P Fcrit
6 The repeatability and within laboratory reproducibility can be pooled over all concentration levels if the ratio between 0 3 0 #DIV/0! #DIV/0! 6.59
between the highest and lowest repeatability or within laboratory reproducibility is less than 3 (see the note below): within 0 4 0
Pooled repeatability/reproducibility
conc level r R r^2 R^2 df
high #VALUE! #VALUE!
middle #VALUE! #VALUE!
low #VALUE! #VALUE!
mean #VALUE! #VALUE!
sqrt(mean) #VALUE! #VALUE!
totdf 0
result
12
2 1 1 high 2 10 1 0 0 0 0 0 1
3 1 1 middle 1 8
2 0 0 0 0 1
4 1 1 middle 2 6
3 0 0 0 0 1
4
5 1 1 low 1 4 0 0 0 0 1
2
6 1 1 low 2 0
day
7 2 2 high 1 1 2 3 4 ANOVA SS df MSE F P Fcrit
8 2 2 high 2 between 0 3 0 #DIV/0! #DIV/0! 6.59
9 2 2 middle 1 Results Concentration Middle within 0 4 0
10 2 2 middle 2 12
11 2 2 low 1 10 total 0 7
12 2 2 low 2 8
result
6
13 3 1 high 1
4
14 3 1 high 2 2
Concentration middle
day
15 3 1 middle 1 0 day results results-d row-ave ovmean within-v df
16 3 1 middle 2 1 1.5 2 2.5 3 3.5 4 1 0 0 0 0 0 1
17 3 1 low 1 2 0 0 0 0 1
12 Results Concentration Low
18 3 1 low 2 3 0 0 0 0 1
10
19 4 2 high 1 4 0 0 0 0 1
8
20 4 2 high 2
result
21 4 2 middle 1 6
ANOVA SS df MSE F P Fcrit
22 4 2 middle 2 4
between 0 3 0 #DIV/0! #DIV/0! 6.59
23 4 2 low 1 2
day within 0 4 0
24 4 2 low 2 0
1 1.5 2 2.5 3 3.5 4
total 0 7
5 The repeatability and within laboratory reproducibility are calculated automatically for every
concentration level separately. Concentration low
day results results-d row-ave ovmean within-v df
Concentration repeatability within lab Comment 1 0 0 0 0 0 1
reproducibility 2 0 0 0 0 1
High 3 0 0 0 0 1
Middle 4 0 0 0 0 1
Low
ANOVA SS df MSE F P Fcrit
6 The repeatability and within laboratory reproducibility can be pooled over all concentration levels if the ratio between 0 3 0 #DIV/0! #DIV/0! 6.59
between the highest and lowest repeatability or within laboratory reproducibility is less than 3 (see the note below): within 0 4 0
Pooled repeatability/reproducibility
conc level r R r^2 R^2 df
high #VALUE! #VALUE!
middle #VALUE! #VALUE!
low #VALUE! #VALUE!
mean #VALUE! #VALUE!
sqrt(mean) #VALUE! #VALUE!
totdf 0
Example: Total solids analysis is performed on laboratory X by 4 analysts that use 3 total solids analysers
3 Each of the 4 analyst/instrument combinations analyses the 3 samples in duplicate on one day
giving in total 24 analytical results.
4 Enter the analyst/instrument combinations and the results in the following table (blue fields).
It is important that you fill in all result fields.
Set-up of this test:
result
12
2 1 high 2 10 1 0 0 0 0 0 1
3 1 middle 1 8 2 0 0 0 0 1
4 1 middle 2 6 3 0 0 0 0 1
5 1 low 1 4
4 0 0 0 0 1
2
6 1 low 2 day
0
7 2 high 1 1 2 3 4
ANOVA SS df MSE F P Fcrit
8 2 high 2 between 0 3 0 #DIV/0! #DIV/0! 6.59
9 2 middle 1 Results Concentration Middle within 0 4 0
10 2 middle 2 12
11 2 low 1 10 total 0 7
12 2 low 2 8
result
6
13 3 high 1 4
14 3 high 2 2 Concentration middle
day
15 3 middle 1 0 day results results-d row-ave ovmean within-v df
16 3 middle 2 1 1.5 2 2.5 3 3.5 4
1 0 0 0 0 0 1
17 3 low 1 Results Concentration Low
2 0 0 0 0 1
18 3 low 2 12 3 0 0 0 0 1
19 4 high 1 10 4 0 0 0 0 1
20 4 high 2 8
22 4 middle 2 4
between 0 3 0 #DIV/0! #DIV/0! 6.59
2
23 4 low 1 day within 0 4 0
0
24 4 low 2 1 1.5 2 2.5 3 3.5 4
total 0 7
5 The repeatability and within laboratory reproducibility are calculated automatically for every
concentration level separately. Concentration low
day results results-d row-ave ovmean within-v df
Concentration repeatability within lab Comment 1 0 0 0 0 0 1
reproducibility 2 0 0 0 0 1
High 3 0 0 0 0 1
Middle 4 0 0 0 0 1
Low
ANOVA SS df MSE F P Fcrit
6 The repeatability and within laboratory reproducibility can be pooled over all concentration levels if the ratio between 0 3 0 #DIV/0! #DIV/0! 6.59
between the highest and lowest repeatability or within laboratory reproducibility is less than 3 (see the note below): within 0 4 0
Pooled repeatability/reproducibility
conc level r R r^2 R^2 df
high #VALUE! #VALUE!
middle #VALUE! #VALUE!
low #VALUE! #VALUE!
mean #VALUE! #VALUE!
sqrt(mean) #VALUE! #VALUE!
totdf 0
All three limits are based on an estimate of the standard deviation at very low (signal) levels or of a blank sample.
A reliable estimate of this standard deviation is very essential and critical as it highly influences the calculated
limits of detection. For instance, its value may depend on whether replicates have been measured under repeatability
or within-laboratory reproducibility conditions.
One should also carefully consider the definition of the "signal". For instance when in chromatography the signal has
been defined as a peak area, it is not allowed to consider the baseline noise as a blank signal. In some other cases
the net signal is calculated as the difference between 2 signals, where one signal is usually a blank signal.
The use of blank samples (contains all ingredients except the analyte) is highly preferred over the use of a blank
solution (solvent) in determining the limit of detection and quantification. In order to avoid any ambiguity it is
highly recommended to analyse test portions of a fortified sample blank, with the lowest concentration
giving a detectable signal in all cases.
Procedure:
1 Take a test sample that contains the sought component in very low concentration, slightly above the
expected capability of detection.
If such a test sample is not available, make a suitable test sample by adding the sought component to a
blank sample in the desired concentration.
2 Divide the test sample in 10 roughly equal test portions.
3 Analyse each test portion once according to the analytical method that is to be validated. All test portions
should undergo the complete analytical procedure, including sample preparation.
4 Enter the results in the table below (blue fields).
test analytical
portion result
1
2
3
4
5
6
7
8
9
10
average
stand.dev
5 Calculations
Detection limit
Capability of Detection
Limit of Quantitation
If the Capability of Detection is more than 3 standard deviations away from the average, the test
should be repeated with a sample closer to the Capability of Detection.
RESULT TEST
Conclusion
| Average - Capability of Detection | =
stand.dev
6 Further calculations:
Possibly a decision limit can be calculated from the detection limit by using the standard algorithm
used to calculate the results from the signal (this is strongly dependent from the analytical procedure
and local circumstances)
If the result of the analysis of a sample is lower than the detection limit (result<detection limit, thus
signal<decision limit) report result as: Concentration < Capability of detection.
If the result of the analysis of a sample is between the detection limit and the capability of detection
(detection limit<result<capability of detection) report result with a 95% confidence interval, calculated
as follows:
CI= x +/- 2.262*s/√n
x=the analytical result
s=standard deviation of the 10 analytical results
n=number of observations used to obtain the analytical result
If the result of the analysis of a sample is above the capability of detection (result>capability of detection)
report result with a confidence interval calculated using the appropriate repeatability defined
in a precision study.
The confidence interval is now calculated as follows:
CI= x +/- 2.179*r/(2.8*√n )
x=the analytical result
r=repeatability
n=number of observations used to obtain the analytical result
Enter the requested information below (blue fields) to obtain an advice for reporting
(the table in procedure section 4 above should be filled in as well):
result x
n
repeatability r
Within the working range there may exist a linear range, where the detector response will have a linear
relationship to the analyte concentration. The extend of this range should be established during the
evaluation of the working range.
Procedure
1 Take at least 8 test samples with concentrations distributed over the concentration range where the samples
are expected. It is also possible to spike blank samples with different known amount of the component
to be analysed to obtain the samples.
2 Analyse these samples in duplicate with the method that is to be validated.
Each test portion must undergo the complete analytical procedure including sample preparation.
The samples must be analysed in random order
3 Enter the results in the following table (blue fields). The fields that are not used must be left empty
6 6
7
8 4
9
10 2
11
12 0
13 0 2 4 6 8 10 12
14
15 concentration
16
total 0.00 0.00 0.00 0.00 0.00 0.00 0 0 0
average #DIV/0! #DIV/0! SSLOF SSPE
4 The linearity of the results is automatically checked with a Lack-of-Fit test (the correlation coefficient nr of levels 0
which is normally used is a poor measure of linearity). r: #DIV/0!
b:(slope) #DIV/0!
RESULT LACK-OF-FIT TEST a:(intercept) #DIV/0! F= 0
Conclusion
F 0.00 Err:502
Fcritical Err:502 please note that this is only valid if you meet the requirements under point 5
This table is derived from: Statistics for Analytical Chemistry
5 It should be checked if the standard deviation of this analysis is not deviating significantly from the results of the precision study 3rd edition
This can be checked by the following test: J.C. Miller and J.N. Miller
Fill in the next fields the pooled repeatability and degrees of freedom (df) to match found in the precision study
Pooled repeatability
df Fcritical for s test Err:502
result test #DIV/0!
If this test shows that "LOF is valid" continue with point 6. If this test shows that "LOF is NOT valid" investigate
the difference in standard deviation between this analysis and the precision study before continuing
6 If the lack-of-fit test shows that "the method is linear over the investigated range" the test can be stopped. However
when the range was not chosen well, i.e. the investigated range was not wider then the range where samples may
be expected under normal conditions, the range should be extended. In that case add a point at the upper or
lower end of the inspected range and repeat procedure step 2 (the duplicate analysis). Next repeat the lack-of fit
test.
In certain situations it is necessary to define the boundaries of the range in between its behaviour is still linear. In
those situations new samples should be added at either the upper or lower end of the range untill the lack-of-fit
test fails.
If the lack-of-fit test shows that "the method is NOT linear over the investigated range", remove a point at the
upper or lower end of the inspected range (see graph!). Continue the removal of a point until the Lack-of-fit
test indicates that "the method is linear over the investigated range". If 2 or more observations were deleted
it is advised to analyse additional samples in the reduced concentration range.
Validation of this software package
This program was developed by Quality Systems, the research programme of the Foods
Quality Assurance Group (FQAG) in 2002.
Responsibility
Microsoft Excel was used for pragmatic reasons: it is easy to use and available on all
Unilever computers. Although a lot of effort has been put in testing to ensure that it
works properly, the developers of this package can not be held responsible for potential
malfunctioning and related consequences.
Testing
To provide some assurance for proper functioning of the calculations performed in this
program, several data sets are provided for testing. Testing must be performed at least
once, after installation of this program on your computer and prior to using the program
on real data.
Testdatasets
OUTPUT TEST DATASET 1 (for 2. Trueness with a blank sample.....) OUTPUT TEST DATASET 2 (for 2. Trueness with a blank sample.....)
intercept 0.3558 intercept 6.0024
95% Confidence interval intercept/2 1.1246 95% Confidence interval intercept/2 1.2251
slope 0.9945 slope 1.0540
95% Confidence interval slope/2 0.0224 95% Confidence interval slope/2 0.0244
GENERAL CONCLUSION no bias detected GENERAL CONCLUSION both a proportional and off-set
(proportional as well as off-set) bias are detected
The maximum off-set bias 1.4804 The maximum off-set bias % 7.2274
The maximum proportional bias 0.0279 The maximum proportional bias % 0.0783
OUTPUT TEST DATASET 1 (for 3. Trueness with a test sample.....) OUTPUT TEST DATASET 2 (for 3. Trueness with a test sample.....)
intercept 0.3558 intercept 6.0024
slope 0.9945 slope 1.0540
95% Confidence interval slope/2 0.0224 95% Confidence interval slope/2 0.0244
GENERAL CONCLUSION no proportional bias detected GENERAL CONCLUSION a proportional bias is detected
The maximum proportional bias % 2.7858% The maximum proportional bias % 7.8347%
Recovery at low concentration (%) 113.50% Recovery at low concentration (%) 115.00%
Recovery at intermediate concentration (%) 108.85% Recovery at intermediate concentration (%) 128.50%
Recovery at high concentration (%) 99.74% Recovery at high concentration (%) 106.00%
OUTPUT TEST DATASET 1 (for 4. Trueness with a CRM.....) OUTPUT TEST DATASET 2 (for 4. Trueness with a CRM.....)
intercept -4.6168 intercept 0.7325
95% Confidence interval intercept/2 1.1900 95% Confidence interval intercept/2 1.2964
slope 0.9945 slope 1.0540
95% Confidence interval slope/2 0.0224 95% Confidence interval slope/2 0.0244
GENERAL CONCLUSION an off-set bias is detected GENERAL CONCLUSION a proportional bias is detected
(no proportional bias) (no off-set bias)
The maximum off-set bias 5.8068 The maximum off-set bias 2.0289
The maximum proportional bias 0.0279 The maximum proportional bias 0.0783
Recovery at low concentration (%) 113.50% Recovery at low concentration (%) 115.00%
Recovery at intermediate concentration (%) 108.85% Recovery at intermediate concentration (%) 128.50%
Recovery at high concentration (%) 99.74% Recovery at high concentration (%) 106.00%
Conclusion: no bias detected (proportional Conclusion: an off-set bias is detected (conc Conclusion: a proportional bias is detected
as well as off-set) independent) (off-set cannot be tested)
Biasoffset -0.0167+/-0.1682 Biasoffset 0.2217+/-0.0854 Biasoffset -0.1550+/-0.1305
Max(Biasoffset) 0.1848 Max(Biasoffset) 0.3070 Max(Biasoffset) 0.2855
Biasprop 1.0067+/-0.1056 Biasprop 1.0325+/-0.0373 Biasprop 0.9381+/-0.0095
Max(Biasprop) (%) 11.2293 Max(Biasprop) (%) 6.9807 Max(Biasprop) (%) 7.1442