Home   Resources   QC Articles   Recovering From an Out-of-Control Condition

Recovering From an Out-of-Control Condition

The laboratory must assess the impact and have a corrective action strategy

By Curtis A. Parvin, PhD, John Yundt-Pacheco and Max Williams

Quality Assurance Series

Editor's note: This is the fifth in a multi-part quality assurance series that began in the January 2011 issue.

Consider this scenario: You just had a QC rule violation for your sodium assay. After some additional investigation you confirm that the sodium assay is, indeed, out-of-control and has been running high. Prior control results were high, but not unacceptably so. Now they are. What should you do?

CLIA says (§493.1282(b)(2): "All patient test results obtained in the unacceptable test run and since the last acceptable test run must be evaluated to determine if patient test results have been adversely affected. The laboratory must take the corrective action necessary to ensure the reporting of accurate and reliable patient test results."1

Preparation is Key

Recovering from an out-of-control condition always has an element of difficulty, but it can be much easier with some preparation. One of the most important things you can do in preparation for analytical problems is to establish how much error in a patient's result can be tolerated before it is considered unacceptable for its intended use, and how many unacceptable patient results are likely to be produced as a result of the test system experiencing an out-of-control condition of a given size.

One way to characterize the amount of patient result error that can be tolerated is the use of total allowable error (TEa) limits. If the error in a patient's result is less than the specified TEa, the result is considered acceptable for its intended use. Conversely, if the error in a patient's result is greater than TEa the result is considered unreliable.2

If TEa limits have not been specified it is hard to determine whether a given set of patient results are reliable. Test method performance (imprecision and bias) coupled with TEa limits dictate the capability of a test system to tolerate error. The ratio of TEa to analytical imprecision (or when bias is considered, (TEa - bias ) / imprecision) has been referred to as the sigma metric of the process.3 Test methods with low sigma metrics have lower error tolerance than high sigma test methods.

What to Do With Unreliable Results

Unreliable patient results produced during the existence of an out-of-control condition can be divided into two intervals-those generated before the last acceptable QC event (pre good QC) and those generated between the last acceptable QC event and the QC rejection (post good QC). Based on the TEa specification, test method performance, power of the QC rules employed and the frequency of QC testing, the expected number of unreliable patient results pre and post good QC can be estimated for any possible size out-of-control condition.

Fig. 1 illustrates an analytical process where the number of unreliable results generated prior to the last good QC is about twice as large as the number of unreliable results generated after the last good QC.

The vertical strokes represent patient specimens being examined, the green diamonds represent acceptable QC events and the red diamond is a QC rejection. The asterisk (*) represents an unreliable patient result. The vertical shift in the analytical process represents a persistent error condition that is resolved after it was detected by the QC rejection.

Note that in Fig. 1, it takes three QC events to finally reject and identify the error. While unreliable patient results were produced during the out-of-control condition prior to the last accepted QC event, a significant amount of time has likely passed, making them difficult to identify and correct. For all practical purposes, patient results produced prior to the last accepted QC event are final. However, the unreliable patient results produced between the last accepted QC event and the QC rejection are recent and should be regarded as correctable. Patient results produced after the last accepted QC need to be evaluated, possibly re-examined, and corrected if necessary. These are also the results addressed in CLIA §493.1282(b)(2). Limiting the number of correctable unreliable patient results is critical to recovery.

Figure 1

Predictions

It is possible to predict the expected number of unreliable results produced for any magnitude of out-of-control condition.4 An example is plotted in Fig. 2.

Figure 2

Small out-of-control conditions are difficult to detect; they may persist for a long time before they are finally identified and corrected. As a consequence, most of the unreliable patient results produced during the existence of a small out-of-control condition will have been reported prior to the last acceptable QC. Fortunately, because the out-of-control condition is small, the number of unreliable patient results produced is relatively small.

Large out-of-control conditions can produce a large number of unreliable patient results. However, large out-of-control conditions are relatively easy to detect. Therefore, for large out-of-control conditions, virtually all of the unreliable patient results are correctable because they were produced between the last acceptable QC and the QC rejection. Fig. 3 is an example of an analytical process during a malfunction that creates a large out-of-control condition.

Figure 3

When a very large out-of-control condition occurs, half the number of patient results tested between QC events can be expected to be unreliable.5 It is prudent to make sure that your laboratory would not be overwhelmed by such an occurrence.

Dr. Parvin is manager of Advanced Statistical Research; John Yundt-Pacheco is Scientific Fellow; and Max Williams is Global Scientific and Professional Affairs Manager, Bio-Rad.

References

  1. US Centers for Medicare & Medicaid Services (CMS). Medicare, Medicaid, and CLIA programs: laboratory requirements relating to quality systems and certain personnel qualifications. Final Rule. Fed Regist Jan 24, 2003;16:3640-714.
  2. Parvin CA, Yundt-Pacheco J, Williams M. The focus of laboratory quality control: Why QC strategies should be designed around the patient, not the instrument. ADVANCE for Administrators of the Laboratory 2011;20(3):48-9.
  3. Westgard JO. Six sigma quality design & control, 2nd ed. Madison WI: Westgard QC Inc., 2006.
  4. Parvin CA. Assessing the impact of the frequency of quality control testing on the quality of reported patient results. Clin Chem 2008;54:2049-54.
  5. Parvin CA, Yundt-Pacheco J, Williams M. Designing a quality control strategy: In the modern laboratory three questions must be answered. ADVANCE for Administrators of the Laboratory 2011;20(5):53-4.

Your Privacy Matters

Before you visit, we want to let you know we use cookies to offer you a better browsing experience. To learn more about how we use cookies, please review our Cookie Policy, accessible from the Manage Preferences link below. We would appreciate your confirmation by either accepting all cookies or by declining and managing your cookie preferences under the Manage Preferences link below.

Back

Cookie Preferences

We use various types of cookies to enhance and personalize your browsing experience on our website. You may review the various types in the descriptions below and decide which cookie preferences you wish to enable. If you wish to decline all non-essential cookies, you may browse our site using strictly-necessary cookies. To learn more about how we use cookies, please visit our Cookie Policy.

Strictly-Necessary Cookies

These cookies are essential for our website to function properly. They either serve as the sole purpose of carrying out network transmissions or they allow you to browse and use features, such as accessing secure areas of the site. These cookies are strictly necessary because services like the shopping cart and invoicing cannot be provided without these cookies. Since these cookies are strictly necessary in order for our website to function, no consent is required to enable them. If you wish to disable these cookies, please update your settings under your browser’s preferences. If these cookies are disabled, please be aware that you will not be able to access certain features of the site like purchasing online.

Functionality Cookies

These cookies improve your browsing experience and provide useful, personalized features. They are used to remember selections that you have made such as your preferred language, region, and username. They also remember changes that you made in text sizes, fonts, and other customizable parts of the Web. Together, this information allows us to personalize features on our website in order to provide you with the best possible browsing experience. The information that these cookies collect is anonymous and cannot track your activity on other websites.

Analytics Cookies

These cookies are used to help ensure that your browsing experience is optimal. They collect anonymous data on how you use our website in order to build better, more useful pages. For instance, we can recognize and count the number of visitors, see how visitors moved around the site, and we can identify which pages returned error messages. This information enables us to enhance your experience and helps us troubleshoot any issues that prevented you from reaching the content that you needed. In order to improve the performance of our site, we use products such as WebTrends OnDemand and Google Analytics to track site usage. You can find the list of products that we use to collect information that is relevant to Analytics Cookies here:

  • Google Analytics
  • Adobe Analytics
  • SessionCam
  • ForeSee
  • WebTrends On Demand

Targeting or Advertising Cookies

These cookies are used to deliver personalized content based on your interests through third-party ad services. This allows us to improve your online experience by helping you find products that are relevant to your interests faster. They remember websites that you have visited and the information is shared with other organizations such as advertisers. These cookies are also used to limit the number of times you see an ad and help measure the effectiveness of a marketing campaign. You can find the list of products that we use to collect information that is relevant to Advertising Cookies here:

  • Marketo
  • Kenshoo
  • Doubleclick
An error has occurred. Error: AdobeAnalyticsModule2 is currently unavailable.