
can we dumb it down just a
teeny bit more?
Perhaps this can help. Of course, it is general.
The basic simplest idea of validation for a DNA profile test for forensic criminal work:
Accumulate a number of DNA specimens of the various DNA types - with variations in the STRs typical of what would be encountered.
Subject a given number of each type to all the processes involved in the test.
(The number tested should be determined based upon statistical model concepts of how many should be tested to assure that potential error rates of less than a certain level can be estimated with some level of confidence.)
Compare the results, including observed variations, to the expectations based on other testing or other information known with confidence. Determine and characterize variation in the results; determine error rates and compare them to the predetermined maximum error rate considered allowable. Determine if there are any limitations for the test methods, such as minimum and maximum amounts of DNA required to produce acceptable (interpretable) results.
http://en.wikipedia.org/wiki/Test_method
Test Method Validation
Test methods are often scrutinized for their validity, applicability, and accuracy. It is very important that the scope of the test method be clearly defined, and any aspect included in the scope is shown to be accurate and repeatable through validation.
Test method validations often encompass the following considerations:
Accuracy and precision: Demonstration of accuracy may require the creation of a reference value if none is yet available.
Repeatability and Reproducibility, sometimes in the form of a Gauge R&R.
Range, or a continuum scale over which the test method would be considered accurate. Example: 10 N to 100 N force test.
Measurement resolution, be it spatial, temporal, or otherwise.
Curve fitting, typically for linearity, which justifies interpolation between calibrated reference points.
Robustness, or the insensitivity to potentially subtle variables in the test environment or setup which may be difficult to control.
Usefulness to predict end-use characteristics and performance
Measurement uncertainty
Interlaboratory or round robin tests
other types of measurement systems analysis
Content of a Test Method
Quality management systems usually require full documentation of the procedures used in a test. The document for a test method might include:
Descriptive title
Scope over which class(es) of materials or articles may be evaluated
Date of last effective revision and revision designation
Reference to most recent test method validation
Person, office, or agency responsible for questions on the test method, updates, and deviations.
The significance or importance of the test method and its intended use.
Terminology and definitions to clarify the meanings of the test method
A listing of the types of apparatus and measuring instrument (sometimes the specific device) required to conduct the test
Safety precautions
Required calibrations and metrology systems
Environmental concerns and considerations
Sampling procedures: How samples are to be obtained, and Number of samples (sample size).
Conditioning or required environmental chamber: temperature, humidity, etc., including tolerances
Preparation of samples for the test and test fixtures
Detailed procedure for conducting the test
Calculations and analysis of data
Interpretation of data and test method output
Report: format, content, data, etc.