LaShondra Berman, MSc.
Transcription
LaShondra Berman, MSc.
LaShondra Berman, MSc. Influenza Division, Centers for Disease Control and Prevention Respiratory Disease Surveillance in the Americas– SARInet Inaugural Meeting May 29-30, 2014 Quality Assessment Background…. o Due the limited number of proficiency testing programs available to US PHLs, the CDC Influenza division diagnostic team decided to make available a means for laboratories to assess their performance using the CDC Human Influenza Virus RealTime RT-PCR Diagnostic Panel. o The Molecular Diagnostic Performance Evaluation Panel has been offered in 2011, 2012, and 2013 to US PHLs that received the CDC Human Influenza Virus Real-Time RT-PCR Diagnostic Panel (FluIVD03). o Laboratories representing all 50 states, Washington, D.C., and Puerto Rico have participated in this exercise. o The performance of individual laboratories was assessed based on the laboratory’s ability to detect and correctly identify the included viruses. Method… All evaluation panels have been composed of 9 simulated human specimens that included 8 evaluation samples and 1 challenge sample. Simulated specimens contained inactivated influenza viruses and/or cultured human cells, including influenza A samples (A/H3N2, A/H3N2v, A/H1N1pdm09, A/H5N1, A/H7N9), influenza B samples, and negative samples. While Ct values were collected and evaluated, reported Ct values were not considered in the assessment of laboratory performance, and no grades or rankings were assigned. Evaluation of Ct values did allow us to assess the participant’s algorithm for processing samples within their laboratory. Summary of Participation… October – December 2011 Sample ID Sample 1 Sample 2 Sample 3 Sample 4 Sample 5 Sample 6 Sample 7 Sample 8 Sample 9 Virus Influenza A/H3 Influenza A/H1pdm09 Influenza A/H3 Negative Control Influenza B Influenza A/H1 Influenza B Negative Influenza A/H1pdm09 80 labs October 2012 – January 2013 No. (%) of participants with correct results 80 (100) 80 (100) 61 (76) 80 (100) 80 (100) 78 (98) 76 (95) 80 (100) 80 (100) Sample ID Virus Sample 2 Influenza A/H1pdm09 Influenza B Sample 3 Influenza A/H3 Sample 1 Negative Control Influenza Sample 5 A/H3v Sample 6 Influenza B Influenza Sample 7 A/H1pdm09 Sample 4 No. (%) of participants with correct results 89 (100) 89 (100) 89 (100) 89 (100) 80 (90) 88 (98.9) 88 (98.9) Sample 8 Influenza A/H3 89 (100) Sample 9 Influenza A/H1 88 (98.9) 89 labs Challenge samples… In 2011 Sample 3, which was an H3N2 virus with a high expected Ct value, was included in the panel as a challenge sample. Sixtyone laboratories were able to successfully identify this sample, with eleven laboratories reporting negative results, and eight laboratories reporting an unsubtypeable or inconclusive results. In 2012 eighty laboratories were able to successfully identify the challenge sample, a variant H3N2 virus (H3v)that was included in the panel. For this sample, an identification of Influenza A/H3v or Inconclusive was accepted as a correct answer if the laboratories reported Ct values less than 38 for the InfA, pdmInfA, H3, and RP targets only. Either identification was considered incorrect if Ct values less than 38 were reported for any other targets. Summary of Participation… August 2013 – October 2013 Sample ID Virus No. (%) of participants with correct results Sample 1 Sample 2 Influenza B Influenza A/H3v 89 (100) 82 (92.1) Sample 3 Negative Control 88 (98.9) Sample 5 Sample 6* Influenza A/H1pdm09 Influenza A/H3 Influenza A/H7** 85 (95.5) 49 (55.1) Sample 7 Influenza B 88 (98.9) Sample 4 Sample 8 Sample 9 Influenza A/H5*** Influenza A/H1pdm09 89 (100) 86 (96.6) 89 (100) • *Indicates challenge sample. • **2/49 laboratories detected Influenza A but did not test with the A/H7 Assay • ***11/86 laboratories detected Influenza A but did not test with the A/H5 Assay 89 labs Challenge samples(cont’d)… In 2013, Forty-nine laboratories were able to successfully identify the challenge sample (Sample 6), a low titer H7N9 virus that was included in the panel. For samples 6 and 8(A/H5N1), an identification of Influenza A/Unsubtypable or Inconclusive was accepted as correct if the laboratories did not test with the Influenza A/H7 (Eurasian Lineage) Assay or Influenza A/H5 Subtyping Kit. Overall Performance … Table 3. Overall laboratory performance Number of Correct Number (%) of Results (Max=8) Participants 8 75 (94) 7 4 (5) 6 1 (1) Table 3. Overall laboratory performance on evaluation samples Number of Correct Number (%) of Results (Max=8) Participants 8 87 (97.8) 7 1 (1.1) 6 1 (1.1) 2011 2012 Table 3. Overall laboratory performance on evaluation samples Number of Correct Number (%) of Results (Max=8) Participants 8 76 (85.4) 7 10 (11.2) 6 3 (3.4) 2013 Molecular Diagnostic Performance Evaluation Panel Results 2013 M* InfA R* *E M InfB R E 27.3 22-33 23.9 Primers/Probe pdmInfA M R E M AH3 R E 26.7 23-33 23.5 M pdmH1 R E Sample ID Sample 1 Sample 2 24.0 20-29 19.5 25.5 20-31 22.1 Sample 4 26.8 22-35 19.2 26.5 21-34 19.3 Sample 5 34.8 30-38 31.9 Sample 6 Sample 7 Sample 8 35.7 24-42 31.7 28.0 22-33 25.1 Sample 9 31.5 26-36 29.2 Sample 3 34.8 30-38 28.3 22-36 22.9 33.0 28-41 33.9 29.2 25-33 26.0 31.1 25-35 29.0 *M=Mean *R=Range *E=Expected Mean & Range values exclude Ct values that were reported as 0 31.7 Problems encountered… Transcription errors: Giving Ct values for the wrong primer/probe target Final results interpretation: Misinterpretation of obtained results (A/H3≠ A/H3v) Specimen handling/processing: mislabeling of processed samples. Testing of incorrect panel(previous year panel) and reporting the results Molecular Diagnostic Performance Evaluation Panel 2014 o As of now, we plan to offer 2 US quality assessment panels in 2014. o Many PHLs have requested that this be an ongoing activity to use as a proficiency test for their diagnostic influenza clinical reporting. o Although we are not a accrediting authority, laboratories are able to use these assessments as split sample PT testing. Conclusions…. o Overall, US PHLs using the CDC Influenza Dx assay performed at a very high level and performed testing in accordance with the package insert. o As a result of the QA exercise we were able to provide PHLs with an assessment of their performance at the beginning of the upcoming influenza diagnostic and surveillance season and understand the current influenza testing capabilities of US PHLs. Data usage… Information gathered from this activity was used to address technical issues faced by participating countries such as RNA recovery, real-time RT-PCR assay issues, and platform specific data analysis issues. This has helped us gain a better understanding of what instruments and testing algorithms are being used in the countries that we cooperatively support. Ultimate goal is to improve the quality and confidence of results obtained from laboratories that provide seasonal influenza surveillance. CDC/PAHO Quality Assessment In 2013 following the PAHO annual meeting in Brazil, it was decided that a quality assessment of the PAHO region laboratories was necessary. A letter of intent was sent to laboratories stating the purpose of the panel exercise and the type of information that we hope to obtain. This exercise was strictly voluntary. Panel composition…. Sample 1 Influenza A/H3 Sample 2 Influenza A/pdmH1N1 Sample 3 Influenza B Sample 4 Negative Sample 5 Influenza A/H3 Sample 6 Influenza A/H3N2 variant Sample 7 Influenza B Sample 8 Influenza A/H3 Sample 9 Negative Sample 10 Influenza A/pdmH1N1 Participating countries/laboratories Colombia- 4 laboratories Haiti Paraguay Guatemala Bolivia- 2 laboratories Costa Rica- 2 laboratories Overall performance.. Sample ID Virus Number Answered Correctly (% ) Sample 1 Influenza A/H3 11(100) Sample 2 Influenza A/pdmH1N1 7(63.6) Sample 3 Influenza B 7(63.6) Sample 4 Negative 11(100) Sample 5 Influenza A/H3 10(90.0) Sample 6 Influenza A/H3N2 variant 8(72.7) Sample 7 Influenza B 7(63.6) Sample 8 Influenza A/H3 7(63.6) Sample 9 Negative 11(100) Sample 10 Influenza A/pdmH1N1 3(27.2) Sample 10….. Low titer Influenza A/pdm H1N1 virus with Ct values low to mid 30s Efficiency of extraction method displayed Low recovery of RNA yields high or no Ct values QA for Chile and Brazil… Received QA panels for evaluation of their regional laboratories. Panels were tested for quality control measures. Panel results along with results reporting worksheets were forwarded. Countries received results and assessed their participants Future QA Panels Currently planning to provide another QA exercise for the PAHO region Please inform Rahkee if participation is desired. CDC Laboratory Support for Influenza Surveillance Sharepoint Site! Alias ( C-L-S-I-S ) CLSIS is a standalone registration support system for US domestic and international laboratories to provide access to all documents and protocols. Serves as a communication channel that allows users to send questions regarding the CDC real-time protocols and assays and receive FAQ based help. In the future: Provide mechanism to record and evaluate quality assessment panel results- (phase II release) CDC Laboratory Support for Influenza Surveillance Sharepoint Site! Request Access to CLSIS www.cdc.gov/flu/clsis • • • Filling out general information takes less than 3 mins. Information is used to create CDCJOIN external partner profile. General questions about this page can be asked by clicking CDC Laboratory Support for Influenza Surveillance Sharepoint Site! • CDCJOIN invitation is sent out to requester to establish their account. External Partner Invitation • Username cannot be Hello Jane Doe, You have been invited to register your account with CDC JOIN, a 'gateway' for you to collaborate with CDC. CDC JOIN registration instructions are provided below. Note that you must complete your account registration within 90 days of receiving this email. Step 1 To activate your account with CDC JOIN, navigate to https://epea.cdc.gov/Login.aspx and follow the steps below: • Enter your Username: jane.doe.hotmail.com • Enter your Initial Password: El20237611111 • Click I ACCEPT all of the above and previously presented conditions to complete your account activation. Step 2 Once you have completed Step 1, the system will require you to confirm your username prior to establishing your new password. You must establish your new password before you can use your CDC JOIN account. If the system does not allow you to establish your new password, please navigate to https://epeaqpm.cdc.gov/QPM/User/Identification/. • Send email to Step 3 Inform [email protected] when you have successfully completed account registration. If you are unable to successfully complete the registration process, contact [email protected] or [email protected]. ***Note: This email has been sent from an unmonitored mailbox. DO NOT REPLY TO THIS EMAIL. • Need to login to confirm Username and reset password. changed. [email protected] to confirm completion of registration. CDC Laboratory Support for Influenza Surveillance Sharepoint Site! Please type in password Do not copy/paste!! * User registration process requires Facility code or Facility name to register. CDC Laboratory Support for Influenza Surveillance Sharepoint Site! After successful password change and notification of completion sent to [email protected]… There a small activation period (~1 day) that is needed to allow external partner access. You will receive a welcome message from [email protected]. Subject heading: Welcome to the SharePoint group: WHO:NIC for site: CLSIS You will now have access to CDC rRT-PCR assay protocols, package inserts, and/or primer-probe sequences. NICs will generally not have access to primer-probe sequences if they are able to receive reagent support from CDC via the influenza reagent resource(IRR). CLSIS passwords expire every three months!!! Please keep Username and Password at hand to reset whenever necessary. CDC Laboratory Support for Influenza Surveillance Sharepoint Site! Disclaimer: states that CDC is not responsible for misuse of listed information. CDC Laboratory Support for Influenza Surveillance Sharepoint Site! Document tabs show the following folders which you can explore by click on each individual folder. CDC Laboratory Support for Influenza Surveillance Sharepoint Site! We are currently in the process of adding Spanish and Portuguese translations to the CLSIS Sharepoint site. CDC Laboratory Support for Influenza Surveillance Sharepoint Site! CDC Laboratory Support for Influenza Surveillance Site! CDC Laboratory Support for Influenza Surveillance Sharepoint Site! Feedback/ Help page - Users can email a problem and describe the nature of his/her problem to CLSIS @cdc.gov by clicking on contact us link Current CLSIS Registered Users by Country: Argentina: 3 users Brazil: 4 users Chile: 1 user Costa Rica: 1 user El Salvador: 2 users Guatemala: 4 users Mexico: 3 users Trinidad & Tobago: 1 user Venezuela: 1 user