• search hit 2 of 8
Back to Result List

Bridging big data: procedures for combining non-equivalent cognitive measures from the ENIGMA Consortium

Eamonn Kennedy, Shashank Vadlamani, Hannah M. Lindsey, Pui-Wa Lei, Mary Jo-Pugh, Maheen Adamson, Martin Alda, Silvia Alonso-Lana, Sonia Ambrogi, Tim J. Anderson, Celso Arango, Robert F. Asarnow, Mihai Avram, Rosa Ayesa-Arriola, Talin Babikian, Nerisa Banaj, Laura J. Bird, Stefan Borgwardt, Amy Brodtmann, Katharina Brosch, Karen Caeyenberghs, Vince D. Calhoun, Nancy D. Chiaravalloti, David X. Cifu, Benedicto Crespo-Facorro, John C. Dalrymple-Alford, Kristen Dams-O’Connor, Udo Dannlowski, David Darby, Nicholas Davenport, John DeLuca, Covadonga M. Díaz-Caneja, Seth G. Disner, Ekaterina Dobryakova, Stefan Ehrlich, Carrie Esopenko, Fabio Ferrarelli, Lea E. Frank, Carol Franz, Paola Fuentes-Claramonte, Helen Genova, Christopher C. Giza, Janik Goltermann, Dominik Grotegerd, Marius Gruber, Alfonso Gutiérrez-Zotes, Minji Ha, Jan Haavik, Charles Hinkin, Kristen R. Hoskinson, Daniela Hubl, Andrei Irimia, Andreas Jansen, Michael Kaess, Xiaojian Kang, Kimbra Kenney, Barbora Keřková, Mohamed Salah Khlif, Minah Kim, Jochen Kindler, Tilo Kircher, Karolina Knı́žková, Knut K. Kolskår, Denise Krch, William S. Kremen, Taylor Kuhn, Veena Kumari, Jun Soo Kwon, Roberto Langella, Sarah Laskowitz, Jungha Lee, Jean Lengenfelder, Spencer W. Liebel, Victoria Liou-Johnson, Sara M. Lippa, Marianne Løvstad, Astri Lundervold, Cassandra Marotta, Craig A. Marquardt, Paulo Mattos, Ahmad Mayeli, Carrie R. McDonald, Susanne Meinert, Tracy R. Melzer, Jessica Merchán Naranjo, Chantal Michel, Rajendra A. Morey, Benson Mwangi, Daniel J. Myall, Igor Nenadić, Mary R. Newsome, Abraham Nunes, Terence J. O’Brien, Viola Oertel, John Ollinger, Alexander Olsen, Victor Ortiz Garcı́a de la Foz, Mustafa Ozmen, Heath Pardoe, Marise Parent, Fabrizio Piras, Federica Piras, Edith Pomarol-Clotet, Jonathan Repple, Geneviève Richard, Jonathan Rodriguez, Mabel Rodriguez, Kelly Rootes-Murdy, Jared Rowland, Nicholas P. Ryan, Raymond Salvador, Anne-Marthe Sanders, André Schmidt, Jair C. Soares, Gianfranco Spalleta, Filip Španiel, Alena Stasenko, Frederike Stein, Benjamin Straube, April Thames, Florian Thomas-Odenthal, Sophia I. Thomopoulos, Erin Tone, Ivan Torres, Maya Troyanskaya, Jessica A. Turner, Kristine M. Ulrichsen, Guillermo Umpierrez, Elisabet Vilella, Lucy Vivash, William C. Walker, Emilio Werden, Lars T. Westlye, Krista Wild, Adrian Wroblewski, Mon-Ju Wu, Glenn R. Wylie, Lakshmi N. Yatham, Giovana B. Zunta-Soares, Paul M. Thompson, David F. Tate, Frank G. Hillary, Emily L. Dennis, Elisabeth A. Wilde

  • Investigators in the cognitive neurosciences have turned to Big Data to address persistent replication and reliability issues by increasing sample sizes, statistical power, and representativeness of data. While there is tremendous potential to advance science through open data sharing, these efforts unveil a host of new questions about how to integrate data arising from distinct sources and instruments. We focus on the most frequently assessed area of cognition - memory testing - and demonstrate a process for reliable data harmonization across three common measures. We aggregated raw data from 53 studies from around the world which measured at least one of three distinct verbal learning tasks, totaling N = 10,505 healthy and brain-injured individuals. A mega analysis was conducted using empirical bayes harmonization to isolate and remove site effects, followed by linear models which adjusted for common covariates. After corrections, a continuous item response theory (IRT) model estimated each individual subject’s latent verbal learning ability while accounting for item difficulties. Harmonization significantly reduced inter-site variance by 37% while preserving covariate effects. The effects of age, sex, and education on scores were found to be highly consistent across memory tests. IRT methods for equating scores across AVLTs agreed with held-out data of dually-administered tests, and these tools are made available for free online. This work demonstrates that large-scale data sharing and harmonization initiatives can offer opportunities to address reproducibility and integration challenges across the behavioral sciences.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Metadaten
Author:Eamonn KennedyORCiD, Shashank Vadlamani, Hannah M. LindseyORCiD, Pui-Wa LeiORCiD, Mary Jo-PughORCiD, Maheen AdamsonORCiD, Martin AldaORCiD, Silvia Alonso-LanaORCiD, Sonia AmbrogiORCiD, Tim J. AndersonORCiD, Celso ArangoORCiD, Robert F. AsarnowORCiDGND, Mihai AvramORCiD, Rosa Ayesa-ArriolaORCiD, Talin BabikianORCiD, Nerisa BanajORCiD, Laura J. BirdORCiD, Stefan BorgwardtORCiDGND, Amy BrodtmannORCiD, Katharina BroschORCiDGND, Karen CaeyenberghsORCiD, Vince D. CalhounORCiD, Nancy D. ChiaravallotiORCiD, David X. CifuORCiD, Benedicto Crespo-FacorroORCiD, John C. Dalrymple-AlfordORCiD, Kristen Dams-O’ConnorORCiD, Udo DannlowskiORCiDGND, David DarbyORCiD, Nicholas DavenportORCiD, John DeLucaORCiDGND, Covadonga M. Díaz-CanejaORCiD, Seth G. DisnerORCiD, Ekaterina Dobryakova, Stefan EhrlichORCiDGND, Carrie EsopenkoORCiD, Fabio Ferrarelli, Lea E. FrankORCiD, Carol FranzORCiD, Paola Fuentes-ClaramonteORCiD, Helen GenovaORCiD, Christopher C. GizaORCiDGND, Janik GoltermannORCiDGND, Dominik GrotegerdORCiDGND, Marius GruberORCiD, Alfonso Gutiérrez-ZotesORCiD, Minji Ha, Jan HaavikORCiD, Charles Hinkin, Kristen R. HoskinsonORCiD, Daniela Hubl, Andrei IrimiaORCiD, Andreas JansenORCiDGND, Michael KaessORCiDGND, Xiaojian KangORCiD, Kimbra KenneyORCiD, Barbora KeřkováORCiDGND, Mohamed Salah Khlif, Minah KimORCiD, Jochen KindlerORCiDGND, Tilo KircherORCiDGND, Karolina Knı́žkováORCiD, Knut K. KolskårORCiD, Denise KrchORCiD, William S. KremenORCiD, Taylor KuhnORCiD, Veena KumariGND, Jun Soo KwonORCiD, Roberto Langella, Sarah LaskowitzORCiD, Jungha Lee, Jean LengenfelderORCiD, Spencer W. LiebelORCiD, Victoria Liou-JohnsonORCiD, Sara M. Lippa, Marianne LøvstadORCiD, Astri LundervoldORCiDGND, Cassandra Marotta, Craig A. MarquardtORCiD, Paulo MattosORCiD, Ahmad MayeliORCiD, Carrie R. McDonald, Susanne MeinertORCiDGND, Tracy R. MelzerORCiD, Jessica Merchán NaranjoORCiD, Chantal MichelORCiD, Rajendra A. MoreyORCiD, Benson MwangiORCiD, Daniel J. MyallORCiD, Igor NenadićORCiDGND, Mary R. Newsome, Abraham NunesORCiDGND, Terence J. O’BrienORCiD, Viola OertelGND, John OllingerORCiD, Alexander OlsenORCiD, Victor Ortiz Garcı́a de la FozORCiD, Mustafa OzmenORCiD, Heath PardoeORCiD, Marise Parent, Fabrizio PirasORCiDGND, Federica PirasORCiD, Edith Pomarol-ClotetORCiDGND, Jonathan ReppleORCiDGND, Geneviève RichardORCiD, Jonathan Rodriguez, Mabel RodriguezORCiD, Kelly Rootes-MurdyORCiD, Jared Rowland, Nicholas P. RyanORCiD, Raymond Salvador, Anne-Marthe SandersORCiD, André SchmidtORCiD, Jair C. SoaresORCiDGND, Gianfranco SpalletaORCiDGND, Filip ŠpanielORCiD, Alena StasenkoORCiD, Frederike SteinORCiD, Benjamin StraubeORCiDGND, April ThamesORCiD, Florian Thomas-OdenthalORCiD, Sophia I. ThomopoulosORCiD, Erin ToneORCiD, Ivan TorresORCiD, Maya TroyanskayaORCiD, Jessica A. TurnerORCiD, Kristine M. UlrichsenORCiD, Guillermo UmpierrezORCiD, Elisabet VilellaORCiD, Lucy VivashORCiD, William C. WalkerORCiD, Emilio WerdenORCiD, Lars T. WestlyeORCiD, Krista Wild, Adrian WroblewskiORCiDGND, Mon-Ju WuORCiD, Glenn R. WylieORCiD, Lakshmi N. Yatham, Giovana B. Zunta-Soares, Paul M. ThompsonORCiD, David F. Tate, Frank G. Hillary, Emily L. DennisORCiD, Elisabeth A. WildeORCiD
URN:urn:nbn:de:hebis:30:3-731606
DOI:https://doi.org/10.1101/2023.01.16.524331
Parent Title (English):bioRxiv
Document Type:Preprint
Language:English
Date of Publication (online):2023/01/19
Date of first Publication:2023/01/19
Publishing Institution:Universitätsbibliothek Johann Christian Senckenberg
Contributing Corporation:ENIGMA Consortium
Release Date:2023/03/17
Issue:2023.01.16.524331 Version 1
Edition:Version 1
Page Number:25
HeBIS-PPN:509389058
Institutes:Medizin / Medizin
Dewey Decimal Classification:6 Technik, Medizin, angewandte Wissenschaften / 61 Medizin und Gesundheit / 610 Medizin und Gesundheit
Sammlungen:Universitätspublikationen
Licence (German):License LogoCreative Commons - Namensnennung-Nicht kommerziell - Keine Bearbeitung 4.0