Browsing by Subject "Laboratories"

Now showing 1 - 9 of 9

Open Access
Comparison of interlaboratory variation in absolute T-cell counts by single-platform and optimized dual-platform methods.
(Cytometry B Clin Cytom, 2010-05) Hultin, Lance E; Chow, Marianne; Jamieson, Beth D; O'Gorman, Maurice RG; Menendez, Frederick A; Borowski, Luann; Denny, Thomas N; Margolick, Joseph B
BACKGROUND: Previous studies have reported that the adoption of a single-platform flow cytometry cell counting method resulted in lower interlaboratory variation in absolute T cell counts as compared to predicate dual-platform flow cytometry methods which incorporate independent automated lymphocyte counts (Schnizlein-Bick et al., Clin Diagn Lab Immunol 2000;7:336-343; Reimann et al., Clin Diagn Lab Immunol 2000;7:344-351). In the present study, we asked whether use of a single-platform method could reduce variation in absolute cell counts across the laboratories in the Multicenter AIDS Cohort Study (MACS) (n = 4), as suggested by the studies cited. METHODS: Identical study samples were shipped overnight to the MACS laboratories either by the National Institute of Allergy and Infectious Diseases, Division of AIDS Immunology Quality Assessment (NIAID- IQA) proficiency-testing program (n = 14), or by the Los Angeles site of the MACS (n = 10). For each sample, two tubes of blood were received; one was used for an automated complete blood count and differential, and the other for flow cytometry. The latter was performed using both our current dual-platform method (three-color CD45 gating and automated hematology) and the single-platform method (with TruCOUNT beads to generate the absolute counts). RESULTS: The median percent coefficients of variation (%CVs) for the dual-platform and single-platform methods were 6.6 and 9.9, respectively, for CD4 T cell counts, and 5.9 and 8.5, respectively, for CD8 T cell counts (n = 24). These differences were not statistically significant. The differences in absolute T-cell counts between the MACS sites and the median of all laboratories participating in the NIAID-IQA were smaller for the dual-platform than for single-platform absolute count method. CONCLUSION: In contrast to previous reports, we did not observe lower interlaboratory variation across the MACS sites for single-platform absolute lymphocyte subset counting relative to dual-platform methods. This result may be at least partly explained by the lower interlaboratory variation with the optimized dual-platform method in this study relative to the previous reports.
Open Access
Development and implementation of a proficiency testing program for Luminex bead-based cytokine assays.
(Journal of Immunological Methods, 2014-07) Lynch, Heather E; Sanchez, Ana M; D'Souza, M Patricia; Rountree, Wes; Denny, Thomas N; Kalos, Michael; Sempowski, Gregory D
Luminex bead array assays are widely used for rapid biomarker quantification due to the ability to measure up to 100 unique analytes in a single well of a 96-well plate. There has been, however, no comprehensive analysis of variables impacting assay performance, nor development of a standardized proficiency testing program for laboratories performing these assays. To meet this need, the NIH/NIAID and the Cancer Immunotherapy Consortium of the Cancer Research Institute collaborated to develop and implement a Luminex assay proficiency testing program as part of the NIH/NIAID-sponsored External Quality Assurance Program Oversight Laboratory (EQAPOL) at Duke University. The program currently monitors 25 domestic and international sites with two external proficiency panels per year. Each panel includes a de-identified commercial Luminex assay kit with standards to quantify human IFNγ, TNFα, IL-6, IL-10 and IL-2, and a series of recombinant cytokine-spiked human serum samples. All aspects of panel development, testing and shipping are performed under GCLP by EQAPOL support teams. Following development testing, a comprehensive site proficiency scoring system comprised of timeliness, protocol adherence, accuracy and precision was implemented. The overall mean proficiency score across three rounds of testing has remained stable (EP3: 76%, EP4: 75%, EP5: 77%); however, a more detailed analysis of site reported results indicates a significant improvement of intra- (within) and inter- (between) site variation, suggesting that training and remediation for poor performing sites may be having a positive impact on proficiency. Through continued proficiency testing, identification of variables affecting Luminex assay outcomes will strengthen efforts to bring standardization to the field.
Open Access
Introduction to a Special Issue of the Journal of Immunological Methods: Building global resource programs to support HIV/AIDS clinical trial studies.
(J Immunol Methods, 2014-07) Sanchez, Ana M; Denny, Thomas N; O'Gorman, Maurice
This Special Issue of the Journal of Immunological Methods includes 16 manuscripts describing quality assurance activities related to virologic and immunologic monitoring of six global laboratory resource programs that support international HIV/AIDS clinical trial studies: Collaboration for AIDS Vaccine Discovery (CAVD); Center for HIV/AIDS Vaccine Immunology (CHAVI); External Quality Assurance Program Oversight Laboratory (EQAPOL); HIV Vaccine Trial Network (HVTN); International AIDS Vaccine Initiative (IAVI); and Immunology Quality Assessment (IQA). The reports from these programs address the many components required to develop comprehensive quality control activities and subsequent quality assurance programs for immune monitoring in global clinical trials including: all aspects of processing, storing, and quality assessment of PBMC preparations used ubiquitously in HIV clinical trials, the development and optimization of assays for CD8 HIV responses and HIV neutralization, a comprehensive global HIV virus repository, and reports on the development and execution of novel external proficiency testing programs for immunophenotyping, intracellular cytokine staining, ELISPOT and luminex based cytokine measurements. In addition, there are articles describing the implementation of Good Clinical Laboratory Practices (GCLP) in a large quality assurance laboratory, the development of statistical methods specific for external proficiency testing assessment, a discussion on the ability to set objective thresholds for measuring rare events by flow cytometry, and finally, a manuscript which addresses a framework for the structured reporting of T cell immune function based assays. It is anticipated that this series of manuscripts covering a wide range of quality assurance activities associated with the conduct of global clinical trials will provide a resource for individuals and programs involved in improving the harmonization, standardization, accuracy, and sensitivity of virologic and immunologic testing.
Open Access
Point-of-Care Laboratory Data Collection During Critical Care Transport.
(Air medical journal, 2021-01) Eastman, Jamie; Allen, Deborah; Mumma, Kevin; Almond, Andrew; Theiling, Jason
Objective
Critical care transport involves a high level of intensive clinical care in a resource-limited environment. These patients require multiple assessments guiding specialty treatments, including blood product administration, intravenous electrolyte replacement, ventilator management, and extracorporeal membrane oxygenation. This study aims to measure the usage of point-of-care (POC) laboratory data during critical care transport.
Methods
Data were collected via electronic medical record review over 1 year of use in a hospital-based critical care rotor wing, fixed wing, and ground critical care transport team in the Southeastern United States.
Results
One hundred twenty POC tests were performed during 1,075 critical care transports over the 1-year period (8.9%). Patient transportations involved 35 extracorporeal membrane oxygenation, 21 medical, 17 cardiac, 13 neonatal, 11 respiratory failure, 8 gastrointestinal bleeding, 6 neurologic, 5 pediatrics, 3 trauma, and 1 organ donor. Seventy-eight POC laboratory tests (65%) required intervention, including ventilator changes (39.7%), electrolyte replacement (35.8%), blood products (7.6%), and other (12.8%). The remaining 42 (35%) POC laboratory tests confirmed no intervention was necessary (n = 35) and that ongoing treatments were effective (n = 7).
Conclusion
POC laboratory testing performed during critical care transport guides providers in performing essential emergent interventions in a timelier manner that may benefit critically ill patients.
Open Access
Setting objective thresholds for rare event detection in flow cytometry.
(J Immunol Methods, 2014-07) Richards, Adam J; Staats, Janet; Enzor, Jennifer; McKinnon, Katherine; Frelinger, Jacob; Denny, Thomas N; Weinhold, Kent J; Chan, Cliburn
The accurate identification of rare antigen-specific cytokine positive cells from peripheral blood mononuclear cells (PBMC) after antigenic stimulation in an intracellular staining (ICS) flow cytometry assay is challenging, as cytokine positive events may be fairly diffusely distributed and lack an obvious separation from the negative population. Traditionally, the approach by flow operators has been to manually set a positivity threshold to partition events into cytokine-positive and cytokine-negative. This approach suffers from subjectivity and inconsistency across different flow operators. The use of statistical clustering methods does not remove the need to find an objective threshold between between positive and negative events since consistent identification of rare event subsets is highly challenging for automated algorithms, especially when there is distributional overlap between the positive and negative events ("smear"). We present a new approach, based on the Fβ measure, that is similar to manual thresholding in providing a hard cutoff, but has the advantage of being determined objectively. The performance of this algorithm is compared with results obtained by expert visual gating. Several ICS data sets from the External Quality Assurance Program Oversight Laboratory (EQAPOL) proficiency program were used to make the comparisons. We first show that visually determined thresholds are difficult to reproduce and pose a problem when comparing results across operators or laboratories, as well as problems that occur with the use of commonly employed clustering algorithms. In contrast, a single parameterization for the Fβ method performs consistently across different centers, samples, and instruments because it optimizes the precision/recall tradeoff by using both negative and positive controls.
Open Access
Statistical methods for the assessment of EQAPOL proficiency testing: ELISpot, Luminex, and Flow Cytometry.
(Journal of Immunological Methods, 2014-07) Rountree, Wes; Vandergrift, Nathan; Bainbridge, John; Sanchez, Ana M; Denny, Thomas N
In September 2011 Duke University was awarded a contract to develop the National Institutes of Health/National Institute of Allergy and Infectious Diseases (NIH/NIAID) External Quality Assurance Program Oversight Laboratory (EQAPOL). Through EQAPOL, proficiency testing programs are administered for Interferon-γ (IFN-γ) Enzyme-linked immunosorbent spot (ELISpot), Intracellular Cytokine Staining Flow Cytometry (ICS) and Luminex-based cytokine assays. One of the charges of the EQAPOL program was to apply statistical methods to determine overall site performance. We utilized various statistical methods for each program to find the most appropriate for assessing laboratory performance using the consensus average as the target value. Accuracy ranges were calculated based on Wald-type confidence intervals, exact Poisson confidence intervals, or via simulations. Given the nature of proficiency testing data, which has repeated measures within donor/sample made across several laboratories; the use of mixed effects models with alpha adjustments for multiple comparisons was also explored. Mixed effects models were found to be the most useful method to assess laboratory performance with respect to accuracy to the consensus. Model based approaches to the proficiency testing data in EQAPOL will continue to be utilized. Mixed effects models also provided a means of performing more complex analyses that would address secondary research questions regarding within and between laboratory variability as well as longitudinal analyses.
Open Access
The Center for HIV/AIDS Vaccine Immunology (CHAVI) multi-site quality assurance program for cryopreserved human peripheral blood mononuclear cells.
(J Immunol Methods, 2014-07) Sarzotti-Kelsoe, Marcella; Needham, Leila K; Rountree, Wes; Bainbridge, John; Gray, Clive M; Fiscus, Susan A; Ferrari, Guido; Stevens, Wendy S; Stager, Susan L; Binz, Whitney; Louzao, Raul; Long, Kristy O; Mokgotho, Pauline; Moodley, Niranjini; Mackay, Melanie; Kerkau, Melissa; McMillion, Takesha; Kirchherr, Jennifer; Soderberg, Kelly A; Haynes, Barton F; Denny, Thomas N
The Center for HIV/AIDS Vaccine Immunology (CHAVI) consortium was established to determine the host and virus factors associated with HIV transmission, infection and containment of virus replication, with the goal of advancing the development of an HIV protective vaccine. Studies to meet this goal required the use of cryopreserved Peripheral Blood Mononuclear Cell (PBMC) specimens, and therefore it was imperative that a quality assurance (QA) oversight program be developed to monitor PBMC samples obtained from study participants at multiple international sites. Nine site-affiliated laboratories in Africa and the USA collected and processed PBMCs, and cryopreserved PBMC were shipped to CHAVI repositories in Africa and the USA for long-term storage. A three-stage program was designed, based on Good Clinical Laboratory Practices (GCLP), to monitor PBMC integrity at each step of this process. The first stage evaluated the integrity of fresh PBMCs for initial viability, overall yield, and processing time at the site-affiliated laboratories (Stage 1); for the second stage, the repositories determined post-thaw viability and cell recovery of cryopreserved PBMC, received from the site-affiliated laboratories (Stage 2); the third stage assessed the long-term specimen storage at each repository (Stage 3). Overall, the CHAVI PBMC QA oversight program results highlight the relative importance of each of these stages to the ultimate goal of preserving specimen integrity from peripheral blood collection to long-term repository storage.
Open Access
The External Quality Assurance Oversight Laboratory (EQAPOL) proficiency program for IFN-gamma enzyme-linked immunospot (IFN-γ ELISpot) assay.
(Journal of Immunological Methods, 2014-07) Sanchez, Ana M; Rountree, Wes; Berrong, Mark; Garcia, Ambrosia; Schuetz, Alexandra; Cox, Josephine; Frahm, Nicole; Manak, Mark; Sarzotti-Kelsoe, Marcella; D'Souza, M Patricia; Denny, Thomas; Ferrari, Guido
The interferon-gamma enzyme-linked immunospot (IFN-γ ELISpot) assay has been developed and used as an end-point assay in clinical trials for infectious diseases and cancer to detect the magnitude of antigen-specific immune responses. The ability to compare data generated by different laboratories across organizations is pivotal to understand the relative potency of different therapeutic and vaccine strategies. We developed an external proficiency program for the IFN-γ ELISpot assay that evaluates laboratory performance based on five parameters: timeliness for data reporting; ability to handle cellular samples; detection of background (non-specific) responses; accuracy to consensus of the results; and precision of the measurements. Points are awarded for each criterion, and the sum of the points is used to determine a numeric and adjectival performance rating. Importantly, the evaluation of the accuracy to the consensus mean for the detection of antigen-specific responses using laboratory-specific procedures informs each laboratory and its sponsor on the degree of concordance of its results with those obtained by other laboratories. This study will ultimately provide the scientific community with information on how to organize and implement an external proficiency program to evaluate longitudinally the performance of the participating laboratories and, therefore, fulfill the requirements of the GCLP guidelines for laboratories performing end-point IFN-γ ELISpot assay for clinical trials.
Open Access
The Immunology Quality Assessment Proficiency Testing Program for CD3⁺4⁺ and CD3⁺8⁺ lymphocyte subsets: a ten year review via longitudinal mixed effects modeling.
(Journal of Immunological Methods, 2014-07) Bainbridge, J; Wilkening, CL; Rountree, W; Louzao, R; Wong, J; Perza, N; Garcia, A; Denny, TN
Since 1999, the National Institute of Allergy and Infectious Diseases Division of AIDS (NIAID DAIDS) has funded the Immunology Quality Assessment (IQA) Program with the goal of assessing proficiency in basic lymphocyte subset immunophenotyping for each North American laboratory supporting the NIAID DAIDS HIV clinical trial networks. Further, the purpose of this program is to facilitate an increase in the consistency of interlaboratory T-cell subset measurement (CD3(+)4(+)/CD3(+)8(+) percentages and absolute counts) and likewise, a decrease in intralaboratory variability. IQA T-cell subset measurement proficiency testing was performed over a ten-year period (January 2003-July 2012), and the results were analyzed via longitudinal analysis using mixed effects models. The goal of this analysis was to describe how a typical laboratory (a statistical modeling construct) participating in the IQA Program performed over time. Specifically, these models were utilized to examine trends in interlaboratory agreement, as well as successful passing of proficiency testing. Intralaboratory variability (i.e., precision) was determined by the repeated measures variance, while fixed and random effects were taken into account for changes in interlaboratory agreement (i.e., accuracy) over time. A flow cytometer (single-platform technology, SPT) or a flow cytometer/hematology analyzer (dual-platform technology, DPT) was also examined as a factor for accuracy and precision. The principal finding of this analysis was a significant (p<0.001) increase in accuracy of T-cell subset measurements over time, regardless of technology type (SPT or DPT). Greater precision was found in SPT measurements of all T-cell subset measurements (p<0.001), as well as greater accuracy of SPT on CD3(+)4(+)% and CD3(+)8(+)% assessments (p<0.05 and p<0.001, respectively). However, the interlaboratory random effects variance in DPT results indicates that for some cases DPT can have increased accuracy compared to SPT. Overall, these findings demonstrate that proficiency in and among IQA laboratories have, in general, improved over time and that platform type differences in performance do exist.

Browsing by Subject "Laboratories"

Objective

Methods

Results

Conclusion