Tractography dissection variability: What happens when 42 groups dissect 14 white matter bundles on the same dataset?
Authors
SCHILLING, K. G. (guarantor), F. RHEAULT, L. PETIT, C. B. HANSEN, V. NATH, F. C. YEH, G. GIRARD, M. BARAKOVIC, J. RAFAEL-PATINO, T. YU, E. FISCHI-GOMEZ, M. PIZZOLATO, M. OCAMPO-PINEDA, S. SCHIAVI, E. J. CANALES-RODRIGUEZ, A. DADUCCI, C. GRANZIERA, G. INNOCENTI, J. P. THIRAN, L. MANCINI, S. WASTLING, S. COCOZZA, M. PETRACCA, G. PONTILLO, M. MANCINI, S. B. VOS, V. N. VAKHARIA, J. S. DUNCAN, H. MELERO, L. MANZANEDO, E. SANZ-MORALES, A. PENA-MELIAN, F. CALAMANTE, A. ATTYE, R. P. CABEEN, L. KOROBOVA, A. W. TOGA, A. A. VIJAYAKUMARI, D. PARKER, R. VERMA, A. RADWAN, S. SUNAERT, L. EMSELL, A. DE LUCA, A. LEEMANS, C. J. BAJADA, H. HAROON, H. AZADBAKHT, M. CHAMBERLAND, S. GENC, C. M. W. TAX, P. H. YEH, R. SRIKANCHANA, C. D. MCKNIGHT, J. Y. M. YANG, J. CHEN, C. E. KELLY, C. H. YEH, J. COCHEREAU, J.J . MALLER, T. WELTON, F. ALMAIRAC, K. K. SEUNARINE, C. A. CLARK, F. ZHANG, N. MAKRIS, A. GOLBY, Y. RATHI, L. J. O DONNELL, Y. H. XIA, D. B. AYDOGAN, Y. G. SHI, F. G. FERNANDES, M. RAEMAEKERS, S. WARRINGTON, S. MICHIELSE, A. RAMIREZ-MANZANARES, L. CONCHA, R. ARANDA, M. R. MERAZ, G. LERMA-USABIAGA, L. ROITMAN, L. S. FEKONJA, N. CALARCO, M.. JOSEPH, H. NAKUA, A. N. VOINESKOS, P. KARAN, G. GRENIER, J. H. LEGARRETA, N. ADLURU, V. A. NAIR, V. PRABHAKARAN, A. L. ALEXANDER, K. KAMAGATA, Y. SAITO, W. UCHIDA, C. ANDICA, M. ABE, R. G. BAYRAK, C. A. M. G. WHEELER-KINGSHOTT, E. D ANGELO, F. PALESI, G. SAVINI, N. ROLANDI, P. GUEVARA, J. HOUENOU, N. LOPEZ-LOPEZ, J. F. MANGIN, C. POUPON, C. ROMAN, A. VAZQUEZ, C. MAFFEI, M. ARANTES, J. P. ANDRADE, S. M. SILVA, V. D. CALHOUN, E. CAVERZASI, S. SACCO, M. LAURICELLA, F. PESTILLI, D. BULLOCK, Y. ZHAN, E. BRIGNONI-PEREZ, C. LEBEL, J. E. REYNOLDS, I. NESTRASIL, R. LABOUNEK, C. LENGLET, A. PAULSON, Štefánia AULICKÁ (703 Slovakia, belonging to the institution), S. R. HEILBRONNER, K. HEUER, B. Q. CHANDIO, J. GUAJE, W. TANG, E. GARYFALLIDIS, R. RAJA, A. W. ANDERSON, B. A. LANDMAN and M. DESCOTEAUX
Edition
Neuroimage, San Diego, ACADEMIC PRESS INC ELSEVIER SCIENCE, 2021, 1053-8119
White matter bundle segmentation using diffusion MRI fiber tractography has become the method of choice to identify white matter fiber pathways in vivo in human brains. However, like other analyses of complex data, there is considerable variability in segmentation protocols and techniques. This can result in different reconstructions of the same intended white matter pathways, which directly affects tractography results, quantification, and interpretation. In this study, we aim to evaluate and quantify the variability that arises from different protocols for bundle segmentation. Through an open call to users of fiber tractography, including anatomists, clinicians, and algorithm developers, 42 independent teams were given processed sets of human whole-brain streamlines and asked to segment 14 white matter fascicles on six subjects. In total, we received 57 different bundle segmentation protocols, which enabled detailed volume-based and streamline-based analyses of agreement and disagreement among protocols for each fiber pathway. Results show that even when given the exact same sets of underlying streamlines, the variability across protocols for bundle segmentation is greater than all other sources of variability in the virtual dissection process, including variability within protocols and variability across subjects. In order to foster the use of tractography bundle dissection in routine clinical settings, and as a fundamental analytical tool, future endeavors must aim to resolve and reduce this heterogeneity. Although external validation is needed to verify the anatomical accuracy of bundle dissections, reducing heterogeneity is a step towards reproducible research and may be achieved through the use of standard nomenclature and definitions of white matter bundles and well-chosen constraints and decisions in the dissection process.
SCHILLING, K. G., F. RHEAULT, L. PETIT, C. B. HANSEN, V. NATH, F. C. YEH, G. GIRARD, M. BARAKOVIC, J. RAFAEL-PATINO, T. YU, E. FISCHI-GOMEZ, M. PIZZOLATO, M. OCAMPO-PINEDA, S. SCHIAVI, E. J. CANALES-RODRIGUEZ, A. DADUCCI, C. GRANZIERA, G. INNOCENTI, J. P. THIRAN, L. MANCINI, S. WASTLING, S. COCOZZA, M. PETRACCA, G. PONTILLO, M. MANCINI, S. B. VOS, V. N. VAKHARIA, J. S. DUNCAN, H. MELERO, L. MANZANEDO, E. SANZ-MORALES, A. PENA-MELIAN, F. CALAMANTE, A. ATTYE, R. P. CABEEN, L. KOROBOVA, A. W. TOGA, A. A. VIJAYAKUMARI, D. PARKER, R. VERMA, A. RADWAN, S. SUNAERT, L. EMSELL, A. DE LUCA, A. LEEMANS, C. J. BAJADA, H. HAROON, H. AZADBAKHT, M. CHAMBERLAND, S. GENC, C. M. W. TAX, P. H. YEH, R. SRIKANCHANA, C. D. MCKNIGHT, J. Y. M. YANG, J. CHEN, C. E. KELLY, C. H. YEH, J. COCHEREAU, J.J . MALLER, T. WELTON, F. ALMAIRAC, K. K. SEUNARINE, C. A. CLARK, F. ZHANG, N. MAKRIS, A. GOLBY, Y. RATHI, L. J. O DONNELL, Y. H. XIA, D. B. AYDOGAN, Y. G. SHI, F. G. FERNANDES, M. RAEMAEKERS, S. WARRINGTON, S. MICHIELSE, A. RAMIREZ-MANZANARES, L. CONCHA, R. ARANDA, M. R. MERAZ, G. LERMA-USABIAGA, L. ROITMAN, L. S. FEKONJA, N. CALARCO, M.. JOSEPH, H. NAKUA, A. N. VOINESKOS, P. KARAN, G. GRENIER, J. H. LEGARRETA, N. ADLURU, V. A. NAIR, V. PRABHAKARAN, A. L. ALEXANDER, K. KAMAGATA, Y. SAITO, W. UCHIDA, C. ANDICA, M. ABE, R. G. BAYRAK, C. A. M. G. WHEELER-KINGSHOTT, E. D ANGELO, F. PALESI, G. SAVINI, N. ROLANDI, P. GUEVARA, J. HOUENOU, N. LOPEZ-LOPEZ, J. F. MANGIN, C. POUPON, C. ROMAN, A. VAZQUEZ, C. MAFFEI, M. ARANTES, J. P. ANDRADE, S. M. SILVA, V. D. CALHOUN, E. CAVERZASI, S. SACCO, M. LAURICELLA, F. PESTILLI, D. BULLOCK, Y. ZHAN, E. BRIGNONI-PEREZ, C. LEBEL, J. E. REYNOLDS, I. NESTRASIL, R. LABOUNEK, C. LENGLET, A. PAULSON, Štefánia AULICKÁ, S. R. HEILBRONNER, K. HEUER, B. Q. CHANDIO, J. GUAJE, W. TANG, E. GARYFALLIDIS, R. RAJA, A. W. ANDERSON, B. A. LANDMAN and M. DESCOTEAUX. Tractography dissection variability: What happens when 42 groups dissect 14 white matter bundles on the same dataset? Neuroimage. San Diego: ACADEMIC PRESS INC ELSEVIER SCIENCE, 2021, vol. 243, November 2021, p. 1-18. ISSN 1053-8119. Available from: https://dx.doi.org/10.1016/j.neuroimage.2021.118502.
@article{1744198, author = {Schilling, K. G. and Rheault, F. and Petit, L. and Hansen, C. B. and Nath, V. and Yeh, F. C. and Girard, G. and Barakovic, M. and RafaelandPatino, J. and Yu, T. and FischiandGomez, E. and Pizzolato, M. and OcampoandPineda, M. and Schiavi, S. and CanalesandRodriguez, E. J. and Daducci, A. and Granziera, C. and Innocenti, G. and Thiran, J. P. and Mancini, L. and Wastling, S. and Cocozza, S. and Petracca, M. and Pontillo, G. and Mancini, M. and Vos, S. B. and Vakharia, V. N. and Duncan, J. S. and Melero, H. and Manzanedo, L. and SanzandMorales, E. and PenaandMelian, A. and Calamante, F. and Attye, A. and Cabeen, R. P. and Korobova, L. and Toga, A. W. and Vijayakumari, A. A. and Parker, D. and Verma, R. and Radwan, A. and Sunaert, S. and Emsell, L. and De Luca, A. and Leemans, A. and Bajada, C. J. and Haroon, H. and Azadbakht, H. and Chamberland, M. and Genc, S. and Tax, C. M. W. and Yeh, P. H. and Srikanchana, R. and Mcknight, C. D. and Yang, J. Y. M. and Chen, J. and Kelly, C. E. and Yeh, C. H. and Cochereau, J. and Maller, J.J . and Welton, T. and Almairac, F. and Seunarine, K. K. and Clark, C. A. and Zhang, F. and Makris, N. and Golby, A. and Rathi, Y. and O Donnell, L. J. and Xia, Y. H. and Aydogan, D. B. and Shi, Y. G. and Fernandes, F. G. and Raemaekers, M. and Warrington, S. and Michielse, S. and RamirezandManzanares, A. and Concha, L. and Aranda, R. and Meraz, M. R. and LermaandUsabiaga, G. and Roitman, L. and Fekonja, L. S. and Calarco, N. and Joseph, M.. and Nakua, H. and Voineskos, A. N. and Karan, P. and Grenier, G. and Legarreta, J. H. and Adluru, N. and Nair, V. A. and Prabhakaran, V. and Alexander, A. L. and Kamagata, K. and Saito, Y. and Uchida, W. and Andica, C. and Abe, M. and Bayrak, R. G. and WheelerandKingshott, C. A. M. G. and D Angelo, E. and Palesi, F. and Savini, G. and Rolandi, N. and Guevara, P. and Houenou, J. and LopezandLopez, N. and Mangin, J. F. and Poupon, C. and Roman, C. and Vazquez, A. and Maffei, C. and Arantes, M. and Andrade, J. P. and Silva, S. M. and Calhoun, V. D. and Caverzasi, E. and Sacco, S. and Lauricella, M. and Pestilli, F. and Bullock, D. and Zhan, Y. and BrignoniandPerez, E. and Lebel, C. and Reynolds, J. E. and Nestrasil, I. and Labounek, R. and Lenglet, C. and Paulson, A. and Aulická, Štefánia and Heilbronner, S. R. and Heuer, K. and Chandio, B. Q. and Guaje, J. and Tang, W. and Garyfallidis, E. and Raja, R. and Anderson, A. W. and Landman, B. A. and Descoteaux, M.}, article_location = {San Diego}, article_number = {November 2021}, doi = {http://dx.doi.org/10.1016/j.neuroimage.2021.118502}, keywords = {Tractography; Bundle segmentation; White matter; Fiber pathways; Dissection}, language = {eng}, issn = {1053-8119}, journal = {Neuroimage}, title = {Tractography dissection variability: What happens when 42 groups dissect 14 white matter bundles on the same dataset?}, url = {https://www.sciencedirect.com/science/article/pii/S1053811921007758?via%3Dihub}, volume = {243}, year = {2021} }
TY - JOUR ID - 1744198 AU - Schilling, K. G. - Rheault, F. - Petit, L. - Hansen, C. B. - Nath, V. - Yeh, F. C. - Girard, G. - Barakovic, M. - Rafael-Patino, J. - Yu, T. - Fischi-Gomez, E. - Pizzolato, M. - Ocampo-Pineda, M. - Schiavi, S. - Canales-Rodriguez, E. J. - Daducci, A. - Granziera, C. - Innocenti, G. - Thiran, J. P. - Mancini, L. - Wastling, S. - Cocozza, S. - Petracca, M. - Pontillo, G. - Mancini, M. - Vos, S. B. - Vakharia, V. N. - Duncan, J. S. - Melero, H. - Manzanedo, L. - Sanz-Morales, E. - Pena-Melian, A. - Calamante, F. - Attye, A. - Cabeen, R. P. - Korobova, L. - Toga, A. W. - Vijayakumari, A. A. - Parker, D. - Verma, R. - Radwan, A. - Sunaert, S. - Emsell, L. - De Luca, A. - Leemans, A. - Bajada, C. J. - Haroon, H. - Azadbakht, H. - Chamberland, M. - Genc, S. - Tax, C. M. W. - Yeh, P. H. - Srikanchana, R. - Mcknight, C. D. - Yang, J. Y. M. - Chen, J. - Kelly, C. E. - Yeh, C. H. - Cochereau, J. - Maller, J.J . - Welton, T. - Almairac, F. - Seunarine, K. K. - Clark, C. A. - Zhang, F. - Makris, N. - Golby, A. - Rathi, Y. - O Donnell, L. J. - Xia, Y. H. - Aydogan, D. B. - Shi, Y. G. - Fernandes, F. G. - Raemaekers, M. - Warrington, S. - Michielse, S. - Ramirez-Manzanares, A. - Concha, L. - Aranda, R. - Meraz, M. R. - Lerma-Usabiaga, G. - Roitman, L. - Fekonja, L. S. - Calarco, N. - Joseph, M.. - Nakua, H. - Voineskos, A. N. - Karan, P. - Grenier, G. - Legarreta, J. H. - Adluru, N. - Nair, V. A. - Prabhakaran, V. - Alexander, A. L. - Kamagata, K. - Saito, Y. - Uchida, W. - Andica, C. - Abe, M. - Bayrak, R. G. - Wheeler-Kingshott, C. A. M. G. - D Angelo, E. - Palesi, F. - Savini, G. - Rolandi, N. - Guevara, P. - Houenou, J. - Lopez-Lopez, N. - Mangin, J. F. - Poupon, C. - Roman, C. - Vazquez, A. - Maffei, C. - Arantes, M. - Andrade, J. P. - Silva, S. M. - Calhoun, V. D. - Caverzasi, E. - Sacco, S. - Lauricella, M. - Pestilli, F. - Bullock, D. - Zhan, Y. - Brignoni-Perez, E. - Lebel, C. - Reynolds, J. E. - Nestrasil, I. - Labounek, R. - Lenglet, C. - Paulson, A. - Aulická, Štefánia - Heilbronner, S. R. - Heuer, K. - Chandio, B. Q. - Guaje, J. - Tang, W. - Garyfallidis, E. - Raja, R. - Anderson, A. W. - Landman, B. A. - Descoteaux, M. PY - 2021 TI - Tractography dissection variability: What happens when 42 groups dissect 14 white matter bundles on the same dataset? JF - Neuroimage VL - 243 IS - November 2021 SP - 1-18 EP - 1-18 PB - ACADEMIC PRESS INC ELSEVIER SCIENCE SN - 10538119 KW - Tractography KW - Bundle segmentation KW - White matter KW - Fiber pathways KW - Dissection UR - https://www.sciencedirect.com/science/article/pii/S1053811921007758?via%3Dihub N2 - White matter bundle segmentation using diffusion MRI fiber tractography has become the method of choice to identify white matter fiber pathways in vivo in human brains. However, like other analyses of complex data, there is considerable variability in segmentation protocols and techniques. This can result in different reconstructions of the same intended white matter pathways, which directly affects tractography results, quantification, and interpretation. In this study, we aim to evaluate and quantify the variability that arises from different protocols for bundle segmentation. Through an open call to users of fiber tractography, including anatomists, clinicians, and algorithm developers, 42 independent teams were given processed sets of human whole-brain streamlines and asked to segment 14 white matter fascicles on six subjects. In total, we received 57 different bundle segmentation protocols, which enabled detailed volume-based and streamline-based analyses of agreement and disagreement among protocols for each fiber pathway. Results show that even when given the exact same sets of underlying streamlines, the variability across protocols for bundle segmentation is greater than all other sources of variability in the virtual dissection process, including variability within protocols and variability across subjects. In order to foster the use of tractography bundle dissection in routine clinical settings, and as a fundamental analytical tool, future endeavors must aim to resolve and reduce this heterogeneity. Although external validation is needed to verify the anatomical accuracy of bundle dissections, reducing heterogeneity is a step towards reproducible research and may be achieved through the use of standard nomenclature and definitions of white matter bundles and well-chosen constraints and decisions in the dissection process. ER -
SCHILLING, K. G., F. RHEAULT, L. PETIT, C. B. HANSEN, V. NATH, F. C. YEH, G. GIRARD, M. BARAKOVIC, J. RAFAEL-PATINO, T. YU, E. FISCHI-GOMEZ, M. PIZZOLATO, M. OCAMPO-PINEDA, S. SCHIAVI, E. J. CANALES-RODRIGUEZ, A. DADUCCI, C. GRANZIERA, G. INNOCENTI, J. P. THIRAN, L. MANCINI, S. WASTLING, S. COCOZZA, M. PETRACCA, G. PONTILLO, M. MANCINI, S. B. VOS, V. N. VAKHARIA, J. S. DUNCAN, H. MELERO, L. MANZANEDO, E. SANZ-MORALES, A. PENA-MELIAN, F. CALAMANTE, A. ATTYE, R. P. CABEEN, L. KOROBOVA, A. W. TOGA, A. A. VIJAYAKUMARI, D. PARKER, R. VERMA, A. RADWAN, S. SUNAERT, L. EMSELL, A. DE LUCA, A. LEEMANS, C. J. BAJADA, H. HAROON, H. AZADBAKHT, M. CHAMBERLAND, S. GENC, C. M. W. TAX, P. H. YEH, R. SRIKANCHANA, C. D. MCKNIGHT, J. Y. M. YANG, J. CHEN, C. E. KELLY, C. H. YEH, J. COCHEREAU, J.J . MALLER, T. WELTON, F. ALMAIRAC, K. K. SEUNARINE, C. A. CLARK, F. ZHANG, N. MAKRIS, A. GOLBY, Y. RATHI, L. J. O DONNELL, Y. H. XIA, D. B. AYDOGAN, Y. G. SHI, F. G. FERNANDES, M. RAEMAEKERS, S. WARRINGTON, S. MICHIELSE, A. RAMIREZ-MANZANARES, L. CONCHA, R. ARANDA, M. R. MERAZ, G. LERMA-USABIAGA, L. ROITMAN, L. S. FEKONJA, N. CALARCO, M.. JOSEPH, H. NAKUA, A. N. VOINESKOS, P. KARAN, G. GRENIER, J. H. LEGARRETA, N. ADLURU, V. A. NAIR, V. PRABHAKARAN, A. L. ALEXANDER, K. KAMAGATA, Y. SAITO, W. UCHIDA, C. ANDICA, M. ABE, R. G. BAYRAK, C. A. M. G. WHEELER-KINGSHOTT, E. D ANGELO, F. PALESI, G. SAVINI, N. ROLANDI, P. GUEVARA, J. HOUENOU, N. LOPEZ-LOPEZ, J. F. MANGIN, C. POUPON, C. ROMAN, A. VAZQUEZ, C. MAFFEI, M. ARANTES, J. P. ANDRADE, S. M. SILVA, V. D. CALHOUN, E. CAVERZASI, S. SACCO, M. LAURICELLA, F. PESTILLI, D. BULLOCK, Y. ZHAN, E. BRIGNONI-PEREZ, C. LEBEL, J. E. REYNOLDS, I. NESTRASIL, R. LABOUNEK, C. LENGLET, A. PAULSON, Štefánia AULICKÁ, S. R. HEILBRONNER, K. HEUER, B. Q. CHANDIO, J. GUAJE, W. TANG, E. GARYFALLIDIS, R. RAJA, A. W. ANDERSON, B. A. LANDMAN and M. DESCOTEAUX. Tractography dissection variability: What happens when 42 groups dissect 14 white matter bundles on the same dataset? \textit{Neuroimage}. San Diego: ACADEMIC PRESS INC ELSEVIER SCIENCE, 2021, vol.~243, November 2021, p.~1-18. ISSN~1053-8119. Available from: https://dx.doi.org/10.1016/j.neuroimage.2021.118502.