Browsing by Subject "Reference Standards"

Now showing 1 - 11 of 11
  • Thumbnail Image
    ItemOpen Access
    American Association of Physicists in Medicine Task Group 263: Standardizing Nomenclatures in Radiation Oncology.
    (International journal of radiation oncology, biology, physics, 2018-03) Mayo, Charles S; Moran, Jean M; Bosch, Walter; Xiao, Ying; McNutt, Todd; Popple, Richard; Michalski, Jeff; Feng, Mary; Marks, Lawrence B; Fuller, Clifton D; Yorke, Ellen; Palta, Jatinder; Gabriel, Peter E; Molineu, Andrea; Matuszak, Martha M; Covington, Elizabeth; Masi, Kathryn; Richardson, Susan L; Ritter, Timothy; Morgas, Tomasz; Flampouri, Stella; Santanam, Lakshmi; Moore, Joseph A; Purdie, Thomas G; Miller, Robert C; Hurkmans, Coen; Adams, Judy; Jackie Wu, Qing-Rong; Fox, Colleen J; Siochi, Ramon Alfredo; Brown, Norman L; Verbakel, Wilko; Archambault, Yves; Chmura, Steven J; Dekker, Andre L; Eagle, Don G; Fitzgerald, Thomas J; Hong, Theodore; Kapoor, Rishabh; Lansing, Beth; Jolly, Shruti; Napolitano, Mary E; Percy, James; Rose, Mark S; Siddiqui, Salim; Schadt, Christof; Simon, William E; Straube, William L; St James, Sara T; Ulin, Kenneth; Yom, Sue S; Yock, Torunn I
    A substantial barrier to the single- and multi-institutional aggregation of data to supporting clinical trials, practice quality improvement efforts, and development of big data analytics resource systems is the lack of standardized nomenclatures for expressing dosimetric data. To address this issue, the American Association of Physicists in Medicine (AAPM) Task Group 263 was charged with providing nomenclature guidelines and values in radiation oncology for use in clinical trials, data-pooling initiatives, population-based studies, and routine clinical care by standardizing: (1) structure names across image processing and treatment planning system platforms; (2) nomenclature for dosimetric data (eg, dose-volume histogram [DVH]-based metrics); (3) templates for clinical trial groups and users of an initial subset of software platforms to facilitate adoption of the standards; (4) formalism for nomenclature schema, which can accommodate the addition of other structures defined in the future. A multisociety, multidisciplinary, multinational group of 57 members representing stake holders ranging from large academic centers to community clinics and vendors was assembled, including physicists, physicians, dosimetrists, and vendors. The stakeholder groups represented in the membership included the AAPM, American Society for Radiation Oncology (ASTRO), NRG Oncology, European Society for Radiation Oncology (ESTRO), Radiation Therapy Oncology Group (RTOG), Children's Oncology Group (COG), Integrating Healthcare Enterprise in Radiation Oncology (IHE-RO), and Digital Imaging and Communications in Medicine working group (DICOM WG); A nomenclature system for target and organ at risk volumes and DVH nomenclature was developed and piloted to demonstrate viability across a range of clinics and within the framework of clinical trials. The final report was approved by AAPM in October 2017. The approval process included review by 8 AAPM committees, with additional review by ASTRO, European Society for Radiation Oncology (ESTRO), and American Association of Medical Dosimetrists (AAMD). This Executive Summary of the report highlights the key recommendations for clinical practice, research, and trials.
  • Thumbnail Image
    ItemOpen Access
    Clinically Adjudicated Reference Standards for Evaluation of Infectious Diseases Diagnostics.
    (Clinical infectious diseases : an official publication of the Infectious Diseases Society of America, 2023-03) Patel, Robin; Tsalik, Ephraim L; Evans, Scott; Fowler, Vance G; Doernberg, Sarah B; Antibacterial Resistance Leadership Group
    Lack of a gold standard can present a challenge for evaluation of diagnostic test accuracy of some infectious diseases tests, particularly when the test's accuracy potentially exceeds that of its predecessors. This approach may measure agreement with an imperfect reference, rather than correctness, because the right answer is unknown. Solutions consist of multitest comparators, including those that involve a test under evaluation if multiple new tests are being evaluated together, using latent class modeling, and clinically adjudicated reference standards. Clinically adjudicated reference standards may be considered as comparator methods when no predefined test or composite of tests is sufficiently accurate; they emulate clinical practice in that multiple data pieces are clinically assessed together.
  • Thumbnail Image
    ItemOpen Access
    Co-Clinical Imaging Metadata Information (CIMI) for Cancer Research to Promote Open Science, Standardization, and Reproducibility in Preclinical Imaging.
    (Tomography (Ann Arbor, Mich.), 2023-05) Moore, Stephen M; Quirk, James D; Lassiter, Andrew W; Laforest, Richard; Ayers, Gregory D; Badea, Cristian T; Fedorov, Andriy Y; Kinahan, Paul E; Holbrook, Matthew; Larson, Peder EZ; Sriram, Renuka; Chenevert, Thomas L; Malyarenko, Dariya; Kurhanewicz, John; Houghton, A McGarry; Ross, Brian D; Pickup, Stephen; Gee, James C; Zhou, Rong; Gammon, Seth T; Manning, Henry Charles; Roudi, Raheleh; Daldrup-Link, Heike E; Lewis, Michael T; Rubin, Daniel L; Yankeelov, Thomas E; Shoghi, Kooresh I
    Preclinical imaging is a critical component in translational research with significant complexities in workflow and site differences in deployment. Importantly, the National Cancer Institute's (NCI) precision medicine initiative emphasizes the use of translational co-clinical oncology models to address the biological and molecular bases of cancer prevention and treatment. The use of oncology models, such as patient-derived tumor xenografts (PDX) and genetically engineered mouse models (GEMMs), has ushered in an era of co-clinical trials by which preclinical studies can inform clinical trials and protocols, thus bridging the translational divide in cancer research. Similarly, preclinical imaging fills a translational gap as an enabling technology for translational imaging research. Unlike clinical imaging, where equipment manufacturers strive to meet standards in practice at clinical sites, standards are neither fully developed nor implemented in preclinical imaging. This fundamentally limits the collection and reporting of metadata to qualify preclinical imaging studies, thereby hindering open science and impacting the reproducibility of co-clinical imaging research. To begin to address these issues, the NCI co-clinical imaging research program (CIRP) conducted a survey to identify metadata requirements for reproducible quantitative co-clinical imaging. The enclosed consensus-based report summarizes co-clinical imaging metadata information (CIMI) to support quantitative co-clinical imaging research with broad implications for capturing co-clinical data, enabling interoperability and data sharing, as well as potentially leading to updates to the preclinical Digital Imaging and Communications in Medicine (DICOM) standard.
  • Thumbnail Image
    ItemOpen Access
    Comparison of interlaboratory variation in absolute T-cell counts by single-platform and optimized dual-platform methods.
    (Cytometry B Clin Cytom, 2010-05) Hultin, Lance E; Chow, Marianne; Jamieson, Beth D; O'Gorman, Maurice RG; Menendez, Frederick A; Borowski, Luann; Denny, Thomas N; Margolick, Joseph B
    BACKGROUND: Previous studies have reported that the adoption of a single-platform flow cytometry cell counting method resulted in lower interlaboratory variation in absolute T cell counts as compared to predicate dual-platform flow cytometry methods which incorporate independent automated lymphocyte counts (Schnizlein-Bick et al., Clin Diagn Lab Immunol 2000;7:336-343; Reimann et al., Clin Diagn Lab Immunol 2000;7:344-351). In the present study, we asked whether use of a single-platform method could reduce variation in absolute cell counts across the laboratories in the Multicenter AIDS Cohort Study (MACS) (n = 4), as suggested by the studies cited. METHODS: Identical study samples were shipped overnight to the MACS laboratories either by the National Institute of Allergy and Infectious Diseases, Division of AIDS Immunology Quality Assessment (NIAID- IQA) proficiency-testing program (n = 14), or by the Los Angeles site of the MACS (n = 10). For each sample, two tubes of blood were received; one was used for an automated complete blood count and differential, and the other for flow cytometry. The latter was performed using both our current dual-platform method (three-color CD45 gating and automated hematology) and the single-platform method (with TruCOUNT beads to generate the absolute counts). RESULTS: The median percent coefficients of variation (%CVs) for the dual-platform and single-platform methods were 6.6 and 9.9, respectively, for CD4 T cell counts, and 5.9 and 8.5, respectively, for CD8 T cell counts (n = 24). These differences were not statistically significant. The differences in absolute T-cell counts between the MACS sites and the median of all laboratories participating in the NIAID-IQA were smaller for the dual-platform than for single-platform absolute count method. CONCLUSION: In contrast to previous reports, we did not observe lower interlaboratory variation across the MACS sites for single-platform absolute lymphocyte subset counting relative to dual-platform methods. This result may be at least partly explained by the lower interlaboratory variation with the optimized dual-platform method in this study relative to the previous reports.
  • Thumbnail Image
    ItemOpen Access
    Development and implementation of a proficiency testing program for Luminex bead-based cytokine assays.
    (Journal of Immunological Methods, 2014-07) Lynch, Heather E; Sanchez, Ana M; D'Souza, M Patricia; Rountree, Wes; Denny, Thomas N; Kalos, Michael; Sempowski, Gregory D
    Luminex bead array assays are widely used for rapid biomarker quantification due to the ability to measure up to 100 unique analytes in a single well of a 96-well plate. There has been, however, no comprehensive analysis of variables impacting assay performance, nor development of a standardized proficiency testing program for laboratories performing these assays. To meet this need, the NIH/NIAID and the Cancer Immunotherapy Consortium of the Cancer Research Institute collaborated to develop and implement a Luminex assay proficiency testing program as part of the NIH/NIAID-sponsored External Quality Assurance Program Oversight Laboratory (EQAPOL) at Duke University. The program currently monitors 25 domestic and international sites with two external proficiency panels per year. Each panel includes a de-identified commercial Luminex assay kit with standards to quantify human IFNγ, TNFα, IL-6, IL-10 and IL-2, and a series of recombinant cytokine-spiked human serum samples. All aspects of panel development, testing and shipping are performed under GCLP by EQAPOL support teams. Following development testing, a comprehensive site proficiency scoring system comprised of timeliness, protocol adherence, accuracy and precision was implemented. The overall mean proficiency score across three rounds of testing has remained stable (EP3: 76%, EP4: 75%, EP5: 77%); however, a more detailed analysis of site reported results indicates a significant improvement of intra- (within) and inter- (between) site variation, suggesting that training and remediation for poor performing sites may be having a positive impact on proficiency. Through continued proficiency testing, identification of variables affecting Luminex assay outcomes will strengthen efforts to bring standardization to the field.
  • Thumbnail Image
    ItemOpen Access
    Development of a TaqMan Array Card for Acute-Febrile-Illness Outbreak Investigation and Surveillance of Emerging Pathogens, Including Ebola Virus.
    (J Clin Microbiol, 2016-01) Liu, Jie; Ochieng, Caroline; Wiersma, Steve; Ströher, Ute; Towner, Jonathan S; Whitmer, Shannon; Nichol, Stuart T; Moore, Christopher C; Kersh, Gilbert J; Kato, Cecilia; Sexton, Christopher; Petersen, Jeannine; Massung, Robert; Hercik, Christine; Crump, John A; Kibiki, Gibson; Maro, Athanasia; Mujaga, Buliga; Gratz, Jean; Jacob, Shevin T; Banura, Patrick; Scheld, W Michael; Juma, Bonventure; Onyango, Clayton O; Montgomery, Joel M; Houpt, Eric; Fields, Barry
    Acute febrile illness (AFI) is associated with substantial morbidity and mortality worldwide, yet an etiologic agent is often not identified. Convalescent-phase serology is impractical, blood culture is slow, and many pathogens are fastidious or impossible to cultivate. We developed a real-time PCR-based TaqMan array card (TAC) that can test six to eight samples within 2.5 h from sample to results and can simultaneously detect 26 AFI-associated organisms, including 15 viruses (chikungunya, Crimean-Congo hemorrhagic fever [CCHF] virus, dengue, Ebola virus, Bundibugyo virus, Sudan virus, hantaviruses [Hantaan and Seoul], hepatitis E, Marburg, Nipah virus, o'nyong-nyong virus, Rift Valley fever virus, West Nile virus, and yellow fever virus), 8 bacteria (Bartonella spp., Brucella spp., Coxiella burnetii, Leptospira spp., Rickettsia spp., Salmonella enterica and Salmonella enterica serovar Typhi, and Yersinia pestis), and 3 protozoa (Leishmania spp., Plasmodium spp., and Trypanosoma brucei). Two extrinsic controls (phocine herpesvirus 1 and bacteriophage MS2) were included to ensure extraction and amplification efficiency. Analytical validation was performed on spiked specimens for linearity, intra-assay precision, interassay precision, limit of detection, and specificity. The performance of the card on clinical specimens was evaluated with 1,050 blood samples by comparison to the individual real-time PCR assays, and the TAC exhibited an overall 88% (278/315; 95% confidence interval [CI], 84% to 92%) sensitivity and a 99% (5,261/5,326, 98% to 99%) specificity. This TaqMan array card can be used in field settings as a rapid screen for outbreak investigation or for the surveillance of pathogens, including Ebola virus.
  • Thumbnail Image
    ItemOpen Access
    Diagnostic performance of short portable mental status questionnaire for screening dementia among patients attending cognitive assessment clinics in Singapore.
    (Annals of the Academy of Medicine, Singapore, 2013-07) Malhotra, Chetna; Chan, Angelique; Matchar, David; Seow, Dennis; Chuo, Adeline; Do, Young Kyung

    Introduction

    The Short Portable Mental Status Questionnaire (SPMSQ) is a brief cognitive screening instrument, which is easy to use by a healthcare worker with little training. However, the validity of this instrument has not been established in Singapore. Thus, the primary aim of this study was to determine the diagnostic performance of SPMSQ for screening dementia among patients attending outpatient cognitive assessment clinics and to assess whether the appropriate cut-off score varies by patient's age and education. A secondary aim of the study was to map the SPMSQ scores with Mini-Mental State Examination (MMSE) scores.

    Materials and methods

    SPMSQ and MMSE were administered by a trained interviewer to 127 patients visiting outpatient cognitive assessment clinics at the Singapore General Hospital, Changi General Hospital and Tan Tock Seng Hospital. The geriatricians at these clinics then diagnosed these patients with dementia or no dementia (reference standard). Sensitivity and specificity of SPMSQ with different cut-off points (number of errors) were calculated and compared to the reference standard using the Receiver Operator Characteristic (ROC) analysis. Correlation coefficient was also calculated between MMSE and SPMSQ scores.

    Results

    Based on the ROC analysis and a balance of sensitivity and specificity, the appropriate cut-off for SPMSQ was found to be 5 or more errors (sensitivity 78%, specificity 75%). The cut-off varied by education, but not by patient's age. There was a high correlation between SPMSQ and MMSE scores (r = 0.814, P <0.0001).

    Conclusion

    Despite the advantage of being a brief screening instrument for dementia, the use of SPMSQ is limited by its low sensitivity and specificity, especially among patients with less than 6 years of education.
  • Thumbnail Image
    ItemOpen Access
    Finding our way through phenotypes.
    (PLoS Biol, 2015-01) Deans, Andrew R; Lewis, Suzanna E; Huala, Eva; Anzaldo, Salvatore S; Ashburner, Michael; Balhoff, James P; Blackburn, David C; Blake, Judith A; Burleigh, J Gordon; Chanet, Bruno; Cooper, Laurel D; Courtot, Mélanie; Csösz, Sándor; Cui, Hong; Dahdul, Wasila; Das, Sandip; Dececchi, T Alexander; Dettai, Agnes; Diogo, Rui; Druzinsky, Robert E; Dumontier, Michel; Franz, Nico M; Friedrich, Frank; Gkoutos, George V; Haendel, Melissa; Harmon, Luke J; Hayamizu, Terry F; He, Yongqun; Hines, Heather M; Ibrahim, Nizar; Jackson, Laura M; Jaiswal, Pankaj; James-Zorn, Christina; Köhler, Sebastian; Lecointre, Guillaume; Lapp, Hilmar; Lawrence, Carolyn J; Le Novère, Nicolas; Lundberg, John G; Macklin, James; Mast, Austin R; Midford, Peter E; Mikó, István; Mungall, Christopher J; Oellrich, Anika; Osumi-Sutherland, David; Parkinson, Helen; Ramírez, Martín J; Richter, Stefan; Robinson, Peter N; Ruttenberg, Alan; Schulz, Katja S; Segerdell, Erik; Seltmann, Katja C; Sharkey, Michael J; Smith, Aaron D; Smith, Barry; Specht, Chelsea D; Squires, R Burke; Thacker, Robert W; Thessen, Anne; Fernandez-Triana, Jose; Vihinen, Mauno; Vize, Peter D; Vogt, Lars; Wall, Christine E; Walls, Ramona L; Westerfeld, Monte; Wharton, Robert A; Wirkner, Christian S; Woolley, James B; Yoder, Matthew J; Zorn, Aaron M; Mabee, Paula
    Despite a large and multifaceted effort to understand the vast landscape of phenotypic data, their current form inhibits productive data analysis. The lack of a community-wide, consensus-based, human- and machine-interpretable language for describing phenotypes and their genomic and environmental contexts is perhaps the most pressing scientific bottleneck to integration across many key fields in biology, including genomics, systems biology, development, medicine, evolution, ecology, and systematics. Here we survey the current phenomics landscape, including data resources and handling, and the progress that has been made to accurately capture relevant data descriptions for phenotypes. We present an example of the kind of integration across domains that computable phenotypes would enable, and we call upon the broader biology community, publishers, and relevant funding agencies to support efforts to surmount today's data barriers and facilitate analytical reproducibility.
  • Thumbnail Image
    ItemOpen Access
    Standardization and validation of a novel and simple method to assess lumbar dural sac size.
    (Clinical radiology, 2015-02) Daniels, MLA; Lowe, JR; Roy, P; Patrone, MV; Conyers, JM; Fine, JP; Knowles, MR; Birchard, KR
    To develop and validate a simple, reproducible method to assess dural sac size using standard imaging technology.This study was institutional review board-approved. Two readers, blinded to the diagnoses, measured anterior-posterior (AP) and transverse (TR) dural sac diameter (DSD), and AP vertebral body diameter (VBD) of the lumbar vertebrae using MRI images from 53 control patients with pre-existing MRI examinations, 19 prospectively MRI-imaged healthy controls, and 24 patients with Marfan syndrome with prior MRI or CT lumbar spine imaging. Statistical analysis utilized linear and logistic regression, Pearson correlation, and receiver operating characteristic (ROC) curves.AP-DSD and TR-DSD measurements were reproducible between two readers (r = 0.91 and 0.87, respectively). DSD (L1-L5) was not different between male and female controls in the AP or TR plane (p = 0.43; p = 0.40, respectively), and did not vary by age (p = 0.62; p = 0.25) or height (p = 0.64; p = 0.32). AP-VBD was greater in males versus females (p = 1.5 × 10(-8)), resulting in a smaller dural sac ratio (DSR) (DSD/VBD) in males (p = 5.8 × 10(-6)). Marfan patients had larger AP-DSDs and TR-DSDs than controls (p = 5.9 × 10(-9); p = 6.5 × 10(-9), respectively). Compared to DSR, AP-DSD and TR-DSD better discriminate Marfan from control subjects based on area under the curve (AUC) values from unadjusted ROCs (AP-DSD p < 0.01; TR-DSD p = 0.04).Individual vertebrae and L1-L5 (average) AP-DSD and TR-DSD measurements are simple, reliable, and reproducible for quantitating dural sac size without needing to control for gender, age, or height.
  • Thumbnail Image
    ItemOpen Access
    Standardization, workforce development and advocacy in cell and gene therapies: a summary of the 2020 Regenerative Medicine InterCHANGE.
    (Cytotherapy, 2021-10) McNiece, Ian K; Wacker, Kara K; Kurtzberg, Joanne; Warkentin, Phyllis I
    Cell and gene therapy is a promising and disruptive new field of medicine for diseases lacking effective treatments. Collaboration among stakeholders has become critically important as investigators, health care providers, manufacturers, couriers, data registries, regulators and payers all become more invested in the success of this field. Many organizations have collaborated with each other to increase clarity, advocate for improvements and share lessons learned. These efforts appear to be making an impact, although the potential for duplicative efforts could slow progress. The second Regenerative Medicine InterCHANGE, hosted by the Foundation for the Accreditation of Cellular Therapy, took place at the Phacilitate Leaders World/World Stem Cell Summit conference in Miami, Florida, on January 24, 2020. Participants from several organizations outlined needs to advance cell and gene therapies. Efforts to address these include standardization, workforce development and advocacy. This article summarizes the major challenges and opportunities discussed during the InterCHANGE.
  • Thumbnail Image
    ItemOpen Access
    Standardizing clinical trials workflow representation in UML for international site comparison.
    (PLoS One, 2010-11-09) de Carvalho, Elias Cesar Araujo; Jayanti, Madhav Kishore; Batilana, Adelia Portero; Kozan, Andreia MO; Rodrigues, Maria J; Shah, Jatin; Loures, Marco R; Patil, Sunita; Payne, Philip; Pietrobon, Ricardo
    BACKGROUND: With the globalization of clinical trials, a growing emphasis has been placed on the standardization of the workflow in order to ensure the reproducibility and reliability of the overall trial. Despite the importance of workflow evaluation, to our knowledge no previous studies have attempted to adapt existing modeling languages to standardize the representation of clinical trials. Unified Modeling Language (UML) is a computational language that can be used to model operational workflow, and a UML profile can be developed to standardize UML models within a given domain. This paper's objective is to develop a UML profile to extend the UML Activity Diagram schema into the clinical trials domain, defining a standard representation for clinical trial workflow diagrams in UML. METHODS: Two Brazilian clinical trial sites in rheumatology and oncology were examined to model their workflow and collect time-motion data. UML modeling was conducted in Eclipse, and a UML profile was developed to incorporate information used in discrete event simulation software. RESULTS: Ethnographic observation revealed bottlenecks in workflow: these included tasks requiring full commitment of CRCs, transferring notes from paper to computers, deviations from standard operating procedures, and conflicts between different IT systems. Time-motion analysis revealed that nurses' activities took up the most time in the workflow and contained a high frequency of shorter duration activities. Administrative assistants performed more activities near the beginning and end of the workflow. Overall, clinical trial tasks had a greater frequency than clinic routines or other general activities. CONCLUSIONS: This paper describes a method for modeling clinical trial workflow in UML and standardizing these workflow diagrams through a UML profile. In the increasingly global environment of clinical trials, the standardization of workflow modeling is a necessary precursor to conducting a comparative analysis of international clinical trials workflows.