Towards fair decentralized benchmarking of healthcare AI algorithms with the Federated Tumor Segmentation (FeTS) challenge
Autoři
ZENK, Maximilian; Ujjwal BAID; Sarthak PATI; Akis LINARDOS; Brandon EDWARDS; Micah SHELLER; Patrick FOLEY; Alejandro ARISTIZABAL; David ZIMMERER; Alexey GRUZDEV; Jason MARTIN; Russell T SHINOHARA; Annika REINKE; Fabian ISENSEE; Santhosh PARAMPOTTUPADAM; Kaushal PAREKH; Ralf FLOCA; Hasan KASSEM; Bhakti BAHETI; Siddhesh THAKUR; Verena CHUNG; Kaisar KUSHIBAR; Karim LEKADIR; Meirui JIANG; Youtan YIN; Hongzheng YANG; Quande LIU; Cheng CHEN; Qi DOU; Pheng-Ann HENG; Xiaofan ZHANG; Shaoting ZHANG; Muhammad Irfan KHAN; Mohammad Ayyaz AZEEM; Mojtaba JAFARITADI; Esa ALHONIEMI; Elina KONTIO; Suleiman A KHAN; Leon MAECHLER; Ivan EZHOV; Florian KOFLER; Suprosanna SHIT; Johannes C PAETZOLD; Timo LOEHR; Benedikt WIESTLER; Himashi PEIRIS; Kamlesh PAWAR; Shenjun ZHONG; Zhaolin CHEN; Munawar HAYAT; Gary EGAN; Mehrtash HARANDI; Isik Polat ECE; Gorkem POLAT; Altan KOCYIGIT; Alptekin TEMIZEL; Anup TULADHAR; Lakshay TYAGI; Raissa SOUZA; Nils D FORKERT; Pauline MOUCHES; Matthias WILMS; Vishruth SHAMBHAT; Akansh MAURYA; Shubham Subhas DANANNAVAR; Rohit KALLA; Vikas Kumar ANAND; Ganapathy KRISHNAMURTHI; Sahil NALAWADE; Chandan GANESH; Ben WAGNER; Divya REDDY; Yudhajit DAS; Fang F YU; Baowei FEI; Ananth J MADHURANTHAKAM; Joseph MALDJIAN; Gaurav SINGH; Jianxun REN; Wei ZHANG; Ning AN; Qingyu HU; Youjia ZHANG; Ying ZHOU; Vasilis SIOMOS; Giacomo TARRONI; Jonathan PASSERRAT-PALMBACH; Ambrish RAWAT; Giulio ZIZZO; Swanand Ravindra KADHE; Jonathan P EPPERLEIN; Stefano BRAGHIN; Yuan WANG; Renuga KANAGAVELU; Qingsong WEI; Yechao YANG; Yong LIU; Krzysztof KOTOWSKI; Szymon ADAMSKI; Bartosz MACHURA; Wojciech MALARA; Lukasz ZARUDZKI; Jakub NALEPA; Yaying SHI; Hongjian GAO; Salman AVESTIMEHR; Yonghong YAN; Agus S AKBAR; Ekaterina KONDRATEVA; Hua YANG; Zhaopei LI; Hung-Yu WU; Johannes ROTH; Camillo SAUERESSIG; Alexandre MILESI; Quoc D NGUYEN; Nathan J GRUENHAGEN; Tsung-Ming HUANG; Jun MA; Har Shwinder H SINGH; Nai-Yu PAN; Dingwen ZHANG; Ramy A ZEINELDIN; Michal FUTREGA; Yading YUAN; Gian Marco CONTE; Xue FENG; Quan D PHAM; Yong XIA; Zhifan JIANG; Huan Minh LUU; Mariia DOBKO; Alexandre CARRE; Bair TUCHINOV; Hassan MOHY-UD-DIN; Saruar ALAM; Anup SINGH; Nameeta SHAH; Weichung WANG; Chiharu SAKO; Michel BILELLO; Satyam GHODASARA; Suyash MOHAN; Christos DAVATZIKOS; Evan CALABRESE; Jeffrey RUDIE; Javier VILLANUEVA-MEYER; Soonmee CHA; Christopher HESS; John MONGAN; Madhura INGALHALIKAR; Manali JADHAV; Umang PANDEY; Jitender SAINI; Raymond Y HUANG; Ken CHANG; Minh-Son TO; Sargam BHARDWAJ; Chee CHONG; Marc AGZARIAN; Michal KOZUBEK; Filip LUX; Jan MICHÁLEK ORCID; Petr MATULA; Miloš KEŘKOVSKÝ; Tereza KOPŘIVOVÁ; Marek DOSTÁL; Václav VYBÍHAL; Marco C PINHO; James HOLCOMB; Marie METZ; Rajan JAIN; Matthew D LEE; Yvonne W LUI; Pallavi TIWARI; Ruchika VERMA; Rohan BAREJA; Ipsa YADAV; Jonathan CHEN; Neeraj KUMAR; Yuriy GUSEV; Krithika BHUVANESHWAR; Anousheh SAYAH; Camelia BENCHEQROUN; Anas BELOUALI; Subha MADHAVAN; Rivka R COLEN; Aikaterini KOTROTSOU; Philipp VOLLMUTH; Gianluca BRUGNARA; Chandrakanth J PREETHA; Felix SAHM; Martin BENDSZUS; Wolfgang WICK; Abhishek MAHAJAN; Carmen BALANA; Jaume CAPELLADES; Josep PUIG; Yoon Seong CHOI; Seung-Koo LEE; Jong Hee CHANG; Sung Soo AHN; Hassan F SHAYKH; Alejandro HERRERA-TRUJILLO; Maria TRUJILLO; William ESCOBAR; Ana ABELLO; Jose BERNAL; Jhon GOMEZ; Pamela LAMONTAGNE; Daniel S MARCUS; Mikhail MILCHENKO; Arash NAZERI; Bennett LANDMAN; Karthik RAMADASS; Kaiwen XU; Silky CHOTAI; Lola B CHAMBLESS; Akshitkumar MISTRY; Reid C THOMPSON; Ashok SRINIVASAN; J Rajiv BAPURAJ; Arvind RAO; Nicholas WANG; Ota YOSHIAKI; Toshio MORITANI; Sevcan TURK; Joonsang LEE; Snehal PRABHUDESAI; John GARRETT; Matthew LARSON; Robert JERAJ; Hongwei LI; Tobias WEISS; Michael WELLER; Andrea BINK; Bertrand POUYMAYOU; Sonam SHARMA; Tzu-Chi TSENG; Saba ADABI; Xavier Falcao ALEXANDRE; Samuel B MARTINS; Bernardo C A TEIXEIRA; Flavia SPRENGER; David MENOTTI; Diego R LUCIO; Simone P NICLOU; Olivier KEUNEN; Ann-Christin HAU; Enrique PELAEZ; Heydy FRANCO-MALDONADO; Francis LOAYZA; Sebastian QUEVEDO; Richard MCKINLEY; Johannes SLOTBOOM; Piotr RADOJEWSKI; Raphael MEIER; Roland WIEST; Johannes TRENKLER; Josef PICHLER; Georg NECKER; Andreas HAUNSCHMIDT; Stephan MECKEL; Pamela GUEVARA; Esteban TORCHE; Cristobal MENDOZA; Vera FRANCO; Elvis RIOS; Eduardo LOPEZ; Sergio A VELASTIN; Joseph CHOI; Stephen BAEK; Yusung KIM; Heba ISMAEL; Bryan ALLEN; John M BUATTI; Peter ZAMPAKIS; Vasileios PANAGIOTOPOULOS; Panagiotis TSIGANOS; Sotiris ALEXIOU; Ilias HALIASSOS; Evangelia I ZACHARAKI; Konstantinos MOUSTAKAS; Christina KALOGEROPOULOU; Dimitrios M KARDAMAKIS; Bing LUO; Laila M POISSON; Ning WEN; Martin VALLIERES; Mahdi Ait Lhaj LOUTFI; David FORTIN; Martin LEPAGE; Fanny MORON; Jacob MANDEL; Gaurav SHUKLA; Spencer LIEM; Gregory S ALEXANDRE; Joseph LOMBARDO; Joshua D PALMER; Adam E FLANDERS; Adam P DICKER; Godwin OGBOLE; Dotun OYEKUNLE; Olubunmi ODAFE-OYIBOTHA; Babatunde OSOBU; Hikima Mustapha SHU'AIBU; Mayowa SONEYE; Farouk DAKO; Adeleye DORCAS; Derrick MURCIA; Eric FU; Rourke HAAS; John A THOMPSON; David Ryan ORMOND; Stuart CURRIE; Kavi FATANIA; Russell FROOD; Amber L SIMPSON; Jacob J PEOPLES; Ricky HU; Danielle CUTLER; Fabio Y MORAES; Anh TRAN; Mohammad HAMGHALAM; Michael A BOSS; James GIMPEL; Kattil Veettil DEEPAK; Kendall SCHMIDT; Lisa CIMINO; Cynthia PRICE; Brian BIALECKI; Sailaja MARELLA; Charles APGAR; Andras JAKAB; Marc-Andre WEBER; Errol COLAK; Jens KLEESIEK; John B FREYMANN; Justin S KIRBY; Lena MAIER-HEIN; Jake ALBRECHT; Peter MATTSON; Alexandros KARARGYRIS; Prashant SHAH; Bjoern MENZE; Klaus MAIER-HEIN a Spyridon BAKAS
Computational competitions are the standard for benchmarking medical image analysis algorithms, but they typically use small curated test datasets acquired at a few centers, leaving a gap to the reality of diverse multicentric patient data. To this end, the Federated Tumor Segmentation (FeTS) Challenge represents the paradigm for real-world algorithmic performance evaluation. The FeTS challenge is a competition to benchmark (i) federated learning aggregation algorithms and (ii) state-of-the-art segmentation algorithms, across multiple international sites. Weight aggregation and client selection techniques were compared using a multicentric brain tumor dataset in realistic federated learning simulations, yielding benefits for adaptive weight aggregation, and efficiency gains through client sampling. Quantitative performance evaluation of state-of-the-art segmentation algorithms on data distributed internationally across 32 institutions yielded good generalization on average, albeit the worst-case performance revealed data-specific modes of failure. Similar multi-site setups can help validate the real-world utility of healthcare AI algorithms in the future.
Návaznosti
LM2023050, projekt VaV
Název: Národní infrastruktura pro biologické a medicínské zobrazování
Investor: Ministerstvo školství, mládeže a tělovýchovy ČR, Czech BioImaging: Národní výzkumná infrastruktura pro biologické a medicínské zobrazování
NU21-08-00359, projekt VaV
Název: Klasifikace mozkových tumorů pomocí pokročilých metod analýzy dat multimodálního MR zobrazení difuze
Investor: Ministerstvo zdravotnictví ČR, Klasifikace mozkových tumorů pomocí pokročilých metod analýzy dat multimodálního MR zobrazení difuze, Podprogram 1 - standardní
ZENK, Maximilian; Ujjwal BAID; Sarthak PATI; Akis LINARDOS; Brandon EDWARDS; Micah SHELLER; Patrick FOLEY; Alejandro ARISTIZABAL; David ZIMMERER; Alexey GRUZDEV; Jason MARTIN; Russell T SHINOHARA; Annika REINKE; Fabian ISENSEE; Santhosh PARAMPOTTUPADAM; Kaushal PAREKH; Ralf FLOCA; Hasan KASSEM; Bhakti BAHETI; Siddhesh THAKUR; Verena CHUNG; Kaisar KUSHIBAR; Karim LEKADIR; Meirui JIANG; Youtan YIN; Hongzheng YANG; Quande LIU; Cheng CHEN; Qi DOU; Pheng-Ann HENG; Xiaofan ZHANG; Shaoting ZHANG; Muhammad Irfan KHAN; Mohammad Ayyaz AZEEM; Mojtaba JAFARITADI; Esa ALHONIEMI; Elina KONTIO; Suleiman A KHAN; Leon MAECHLER; Ivan EZHOV; Florian KOFLER; Suprosanna SHIT; Johannes C PAETZOLD; Timo LOEHR; Benedikt WIESTLER; Himashi PEIRIS; Kamlesh PAWAR; Shenjun ZHONG; Zhaolin CHEN; Munawar HAYAT; Gary EGAN; Mehrtash HARANDI; Isik Polat ECE; Gorkem POLAT; Altan KOCYIGIT; Alptekin TEMIZEL; Anup TULADHAR; Lakshay TYAGI; Raissa SOUZA; Nils D FORKERT; Pauline MOUCHES; Matthias WILMS; Vishruth SHAMBHAT; Akansh MAURYA; Shubham Subhas DANANNAVAR; Rohit KALLA; Vikas Kumar ANAND; Ganapathy KRISHNAMURTHI; Sahil NALAWADE; Chandan GANESH; Ben WAGNER; Divya REDDY; Yudhajit DAS; Fang F YU; Baowei FEI; Ananth J MADHURANTHAKAM; Joseph MALDJIAN; Gaurav SINGH; Jianxun REN; Wei ZHANG; Ning AN; Qingyu HU; Youjia ZHANG; Ying ZHOU; Vasilis SIOMOS; Giacomo TARRONI; Jonathan PASSERRAT-PALMBACH; Ambrish RAWAT; Giulio ZIZZO; Swanand Ravindra KADHE; Jonathan P EPPERLEIN; Stefano BRAGHIN; Yuan WANG; Renuga KANAGAVELU; Qingsong WEI; Yechao YANG; Yong LIU; Krzysztof KOTOWSKI; Szymon ADAMSKI; Bartosz MACHURA; Wojciech MALARA; Lukasz ZARUDZKI; Jakub NALEPA; Yaying SHI; Hongjian GAO; Salman AVESTIMEHR; Yonghong YAN; Agus S AKBAR; Ekaterina KONDRATEVA; Hua YANG; Zhaopei LI; Hung-Yu WU; Johannes ROTH; Camillo SAUERESSIG; Alexandre MILESI; Quoc D NGUYEN; Nathan J GRUENHAGEN; Tsung-Ming HUANG; Jun MA; Har Shwinder H SINGH; Nai-Yu PAN; Dingwen ZHANG; Ramy A ZEINELDIN; Michal FUTREGA; Yading YUAN; Gian Marco CONTE; Xue FENG; Quan D PHAM; Yong XIA; Zhifan JIANG; Huan Minh LUU; Mariia DOBKO; Alexandre CARRE; Bair TUCHINOV; Hassan MOHY-UD-DIN; Saruar ALAM; Anup SINGH; Nameeta SHAH; Weichung WANG; Chiharu SAKO; Michel BILELLO; Satyam GHODASARA; Suyash MOHAN; Christos DAVATZIKOS; Evan CALABRESE; Jeffrey RUDIE; Javier VILLANUEVA-MEYER; Soonmee CHA; Christopher HESS; John MONGAN; Madhura INGALHALIKAR; Manali JADHAV; Umang PANDEY; Jitender SAINI; Raymond Y HUANG; Ken CHANG; Minh-Son TO; Sargam BHARDWAJ; Chee CHONG; Marc AGZARIAN; Michal KOZUBEK; Filip LUX; Jan MICHÁLEK; Petr MATULA; Miloš KEŘKOVSKÝ; Tereza KOPŘIVOVÁ; Marek DOSTÁL; Václav VYBÍHAL; Marco C PINHO; James HOLCOMB; Marie METZ; Rajan JAIN; Matthew D LEE; Yvonne W LUI; Pallavi TIWARI; Ruchika VERMA; Rohan BAREJA; Ipsa YADAV; Jonathan CHEN; Neeraj KUMAR; Yuriy GUSEV; Krithika BHUVANESHWAR; Anousheh SAYAH; Camelia BENCHEQROUN; Anas BELOUALI; Subha MADHAVAN; Rivka R COLEN; Aikaterini KOTROTSOU; Philipp VOLLMUTH; Gianluca BRUGNARA; Chandrakanth J PREETHA; Felix SAHM; Martin BENDSZUS; Wolfgang WICK; Abhishek MAHAJAN; Carmen BALANA; Jaume CAPELLADES; Josep PUIG; Yoon Seong CHOI; Seung-Koo LEE; Jong Hee CHANG; Sung Soo AHN; Hassan F SHAYKH; Alejandro HERRERA-TRUJILLO; Maria TRUJILLO; William ESCOBAR; Ana ABELLO; Jose BERNAL; Jhon GOMEZ; Pamela LAMONTAGNE; Daniel S MARCUS; Mikhail MILCHENKO; Arash NAZERI; Bennett LANDMAN; Karthik RAMADASS; Kaiwen XU; Silky CHOTAI; Lola B CHAMBLESS; Akshitkumar MISTRY; Reid C THOMPSON; Ashok SRINIVASAN; J Rajiv BAPURAJ; Arvind RAO; Nicholas WANG; Ota YOSHIAKI; Toshio MORITANI; Sevcan TURK; Joonsang LEE; Snehal PRABHUDESAI; John GARRETT; Matthew LARSON; Robert JERAJ; Hongwei LI; Tobias WEISS; Michael WELLER; Andrea BINK; Bertrand POUYMAYOU; Sonam SHARMA; Tzu-Chi TSENG; Saba ADABI; Xavier Falcao ALEXANDRE; Samuel B MARTINS; Bernardo C A TEIXEIRA; Flavia SPRENGER; David MENOTTI; Diego R LUCIO; Simone P NICLOU; Olivier KEUNEN; Ann-Christin HAU; Enrique PELAEZ; Heydy FRANCO-MALDONADO; Francis LOAYZA; Sebastian QUEVEDO; Richard MCKINLEY; Johannes SLOTBOOM; Piotr RADOJEWSKI; Raphael MEIER; Roland WIEST; Johannes TRENKLER; Josef PICHLER; Georg NECKER; Andreas HAUNSCHMIDT; Stephan MECKEL; Pamela GUEVARA; Esteban TORCHE; Cristobal MENDOZA; Vera FRANCO; Elvis RIOS; Eduardo LOPEZ; Sergio A VELASTIN; Joseph CHOI; Stephen BAEK; Yusung KIM; Heba ISMAEL; Bryan ALLEN; John M BUATTI; Peter ZAMPAKIS; Vasileios PANAGIOTOPOULOS; Panagiotis TSIGANOS; Sotiris ALEXIOU; Ilias HALIASSOS; Evangelia I ZACHARAKI; Konstantinos MOUSTAKAS; Christina KALOGEROPOULOU; Dimitrios M KARDAMAKIS; Bing LUO; Laila M POISSON; Ning WEN; Martin VALLIERES; Mahdi Ait Lhaj LOUTFI; David FORTIN; Martin LEPAGE; Fanny MORON; Jacob MANDEL; Gaurav SHUKLA; Spencer LIEM; Gregory S ALEXANDRE; Joseph LOMBARDO; Joshua D PALMER; Adam E FLANDERS; Adam P DICKER; Godwin OGBOLE; Dotun OYEKUNLE; Olubunmi ODAFE-OYIBOTHA; Babatunde OSOBU; Hikima Mustapha SHU'AIBU; Mayowa SONEYE; Farouk DAKO; Adeleye DORCAS; Derrick MURCIA; Eric FU; Rourke HAAS; John A THOMPSON; David Ryan ORMOND; Stuart CURRIE; Kavi FATANIA; Russell FROOD; Amber L SIMPSON; Jacob J PEOPLES; Ricky HU; Danielle CUTLER; Fabio Y MORAES; Anh TRAN; Mohammad HAMGHALAM; Michael A BOSS; James GIMPEL; Kattil Veettil DEEPAK; Kendall SCHMIDT; Lisa CIMINO; Cynthia PRICE; Brian BIALECKI; Sailaja MARELLA; Charles APGAR; Andras JAKAB; Marc-Andre WEBER; Errol COLAK; Jens KLEESIEK; John B FREYMANN; Justin S KIRBY; Lena MAIER-HEIN; Jake ALBRECHT; Peter MATTSON; Alexandros KARARGYRIS; Prashant SHAH; Bjoern MENZE; Klaus MAIER-HEIN a Spyridon BAKAS. Towards fair decentralized benchmarking of healthcare AI algorithms with the Federated Tumor Segmentation (FeTS) challenge. Nature communications. BERLIN: NATURE PORTFOLIO, 2025, roč. 16, č. 1, s. 1-20. ISSN 2041-1723. Dostupné z: https://doi.org/10.1038/s41467-025-60466-1.
@article{2511767, author = {Zenk, Maximilian and Baid, Ujjwal and Pati, Sarthak and Linardos, Akis and Edwards, Brandon and Sheller, Micah and Foley, Patrick and Aristizabal, Alejandro and Zimmerer, David and Gruzdev, Alexey and Martin, Jason and Shinohara, Russell T and Reinke, Annika and Isensee, Fabian and Parampottupadam, Santhosh and Parekh, Kaushal and Floca, Ralf and Kassem, Hasan and Baheti, Bhakti and Thakur, Siddhesh and Chung, Verena and Kushibar, Kaisar and Lekadir, Karim and Jiang, Meirui and Yin, Youtan and Yang, Hongzheng and Liu, Quande and Chen, Cheng and Dou, Qi and Heng, PhengandAnn and Zhang, Xiaofan and Zhang, Shaoting and Khan, Muhammad Irfan and Azeem, Mohammad Ayyaz and Jafaritadi, Mojtaba and Alhoniemi, Esa and Kontio, Elina and Khan, Suleiman A and Maechler, Leon and Ezhov, Ivan and Kofler, Florian and Shit, Suprosanna and Paetzold, Johannes C and Loehr, Timo and Wiestler, Benedikt and Peiris, Himashi and Pawar, Kamlesh and Zhong, Shenjun and Chen, Zhaolin and Hayat, Munawar and Egan, Gary and Harandi, Mehrtash and Ece, Isik Polat and Polat, Gorkem and Kocyigit, Altan and Temizel, Alptekin and Tuladhar, Anup and Tyagi, Lakshay and Souza, Raissa and Forkert, Nils D and Mouches, Pauline and Wilms, Matthias and Shambhat, Vishruth and Maurya, Akansh and Danannavar, Shubham Subhas and Kalla, Rohit and Anand, Vikas Kumar and Krishnamurthi, Ganapathy and Nalawade, Sahil and Ganesh, Chandan and Wagner, Ben and Reddy, Divya and Das, Yudhajit and Yu, Fang F and Fei, Baowei and Madhuranthakam, Ananth J and Maldjian, Joseph and Singh, Gaurav and Ren, Jianxun and Zhang, Wei and An, Ning and Hu, Qingyu and Zhang, Youjia and Zhou, Ying and Siomos, Vasilis and Tarroni, Giacomo and PasserratandPalmbach, Jonathan and Rawat, Ambrish and Zizzo, Giulio and Kadhe, Swanand Ravindra and Epperlein, Jonathan P and Braghin, Stefano and Wang, Yuan and Kanagavelu, Renuga and Wei, Qingsong and Yang, Yechao and Liu, Yong and Kotowski, Krzysztof and Adamski, Szymon and Machura, Bartosz and Malara, Wojciech and Zarudzki, Lukasz and Nalepa, Jakub and Shi, Yaying and Gao, Hongjian and Avestimehr, Salman and Yan, Yonghong and Akbar, Agus S and Kondrateva, Ekaterina and Yang, Hua and Li, Zhaopei and Wu, HungandYu and Roth, Johannes and Saueressig, Camillo and Milesi, Alexandre and Nguyen, Quoc D and Gruenhagen, Nathan J and Huang, TsungandMing and Ma, Jun and Singh, Har Shwinder H and Pan, NaiandYu and Zhang, Dingwen and Zeineldin, Ramy A and Futrega, Michal and Yuan, Yading and Conte, Gian Marco and Feng, Xue and Pham, Quan D and Xia, Yong and Jiang, Zhifan and Luu, Huan Minh and Dobko, Mariia and Carre, Alexandre and Tuchinov, Bair and MohyandudandDin, Hassan and Alam, Saruar and Singh, Anup and Shah, Nameeta and Wang, Weichung and Sako, Chiharu and Bilello, Michel and Ghodasara, Satyam and Mohan, Suyash and Davatzikos, Christos and Calabrese, Evan and Rudie, Jeffrey and VillanuevaandMeyer, Javier and Cha, Soonmee and Hess, Christopher and Mongan, John and Ingalhalikar, Madhura and Jadhav, Manali and Pandey, Umang and Saini, Jitender and Huang, Raymond Y and Chang, Ken and To, MinhandSon and Bhardwaj, Sargam and Chong, Chee and Agzarian, Marc and Kozubek, Michal and Lux, Filip and Michálek, Jan and Matula, Petr and Keřkovský, Miloš and Kopřivová, Tereza and Dostál, Marek and Vybíhal, Václav and Pinho, Marco C and Holcomb, James and Metz, Marie and Jain, Rajan and Lee, Matthew D and Lui, Yvonne W and Tiwari, Pallavi and Verma, Ruchika and Bareja, Rohan and Yadav, Ipsa and Chen, Jonathan and Kumar, Neeraj and Gusev, Yuriy and Bhuvaneshwar, Krithika and Sayah, Anousheh and Bencheqroun, Camelia and Belouali, Anas and Madhavan, Subha and Colen, Rivka R and Kotrotsou, Aikaterini and Vollmuth, Philipp and Brugnara, Gianluca and Preetha, Chandrakanth J and Sahm, Felix and Bendszus, Martin and Wick, Wolfgang and Mahajan, Abhishek and Balana, Carmen and Capellades, Jaume and Puig, Josep et al.}, article_location = {BERLIN}, article_number = {1}, doi = {https://doi.org/10.1038/s41467-025-60466-1}, keywords = {BRAIN; PERFORMANCE; CNN}, language = {eng}, issn = {2041-1723}, journal = {Nature communications}, title = {Towards fair decentralized benchmarking of healthcare AI algorithms with the Federated Tumor Segmentation (FeTS) challenge}, url = {https://www.nature.com/articles/s41467-025-60466-1}, volume = {16}, year = {2025} }
TY - JOUR ID - 2511767 AU - Zenk, Maximilian - Baid, Ujjwal - Pati, Sarthak - Linardos, Akis - Edwards, Brandon - Sheller, Micah - Foley, Patrick - Aristizabal, Alejandro - Zimmerer, David - Gruzdev, Alexey - Martin, Jason - Shinohara, Russell T - Reinke, Annika - Isensee, Fabian - Parampottupadam, Santhosh - Parekh, Kaushal - Floca, Ralf - Kassem, Hasan - Baheti, Bhakti - Thakur, Siddhesh - Chung, Verena - Kushibar, Kaisar - Lekadir, Karim - Jiang, Meirui - Yin, Youtan - Yang, Hongzheng - Liu, Quande - Chen, Cheng - Dou, Qi - Heng, Pheng-Ann - Zhang, Xiaofan - Zhang, Shaoting - Khan, Muhammad Irfan - Azeem, Mohammad Ayyaz - Jafaritadi, Mojtaba - Alhoniemi, Esa - Kontio, Elina - Khan, Suleiman A - Maechler, Leon - Ezhov, Ivan - Kofler, Florian - Shit, Suprosanna - Paetzold, Johannes C - Loehr, Timo - Wiestler, Benedikt - Peiris, Himashi - Pawar, Kamlesh - Zhong, Shenjun - Chen, Zhaolin - Hayat, Munawar - Egan, Gary - Harandi, Mehrtash - Ece, Isik Polat - Polat, Gorkem - Kocyigit, Altan - Temizel, Alptekin - Tuladhar, Anup - Tyagi, Lakshay - Souza, Raissa - Forkert, Nils D - Mouches, Pauline - Wilms, Matthias - Shambhat, Vishruth - Maurya, Akansh - Danannavar, Shubham Subhas - Kalla, Rohit - Anand, Vikas Kumar - Krishnamurthi, Ganapathy - Nalawade, Sahil - Ganesh, Chandan - Wagner, Ben - Reddy, Divya - Das, Yudhajit - Yu, Fang F - Fei, Baowei - Madhuranthakam, Ananth J - Maldjian, Joseph - Singh, Gaurav - Ren, Jianxun - Zhang, Wei - An, Ning - Hu, Qingyu - Zhang, Youjia - Zhou, Ying - Siomos, Vasilis - Tarroni, Giacomo - Passerrat-Palmbach, Jonathan - Rawat, Ambrish - Zizzo, Giulio - Kadhe, Swanand Ravindra - Epperlein, Jonathan P - Braghin, Stefano - Wang, Yuan - Kanagavelu, Renuga - Wei, Qingsong - Yang, Yechao - Liu, Yong - Kotowski, Krzysztof - Adamski, Szymon - Machura, Bartosz - Malara, Wojciech - Zarudzki, Lukasz - Nalepa, Jakub - Shi, Yaying - Gao, Hongjian - Avestimehr, Salman - Yan, Yonghong - Akbar, Agus S - Kondrateva, Ekaterina - Yang, Hua - Li, Zhaopei - Wu, Hung-Yu - Roth, Johannes - Saueressig, Camillo - Milesi, Alexandre - Nguyen, Quoc D - Gruenhagen, Nathan J - Huang, Tsung-Ming - Ma, Jun - Singh, Har Shwinder H - Pan, Nai-Yu - Zhang, Dingwen - Zeineldin, Ramy A - Futrega, Michal - Yuan, Yading - Conte, Gian Marco - Feng, Xue - Pham, Quan D - Xia, Yong - Jiang, Zhifan - Luu, Huan Minh - Dobko, Mariia - Carre, Alexandre - Tuchinov, Bair - Mohy-ud-Din, Hassan - Alam, Saruar - Singh, Anup - Shah, Nameeta - Wang, Weichung - Sako, Chiharu - Bilello, Michel - Ghodasara, Satyam - Mohan, Suyash - Davatzikos, Christos - Calabrese, Evan - Rudie, Jeffrey - Villanueva-Meyer, Javier - Cha, Soonmee - Hess, Christopher - Mongan, John - Ingalhalikar, Madhura - Jadhav, Manali - Pandey, Umang - Saini, Jitender - Huang, Raymond Y - Chang, Ken - To, Minh-Son - Bhardwaj, Sargam - Chong, Chee - Agzarian, Marc - Kozubek, Michal - Lux, Filip - Michálek, Jan - Matula, Petr - Keřkovský, Miloš - Kopřivová, Tereza - Dostál, Marek - Vybíhal, Václav - Pinho, Marco C - Holcomb, James - Metz, Marie - Jain, Rajan - Lee, Matthew D - Lui, Yvonne W - Tiwari, Pallavi - Verma, Ruchika - Bareja, Rohan - Yadav, Ipsa - Chen, Jonathan - Kumar, Neeraj - Gusev, Yuriy - Bhuvaneshwar, Krithika - Sayah, Anousheh - Bencheqroun, Camelia - Belouali, Anas - Madhavan, Subha - Colen, Rivka R - Kotrotsou, Aikaterini - Vollmuth, Philipp - Brugnara, Gianluca - Preetha, Chandrakanth J - Sahm, Felix - Bendszus, Martin - Wick, Wolfgang - Mahajan, Abhishek - Balana, Carmen - Capellades, Jaume - Puig, Josep et al. PY - 2025 TI - Towards fair decentralized benchmarking of healthcare AI algorithms with the Federated Tumor Segmentation (FeTS) challenge JF - Nature communications VL - 16 IS - 1 SP - 1-20 EP - 1-20 PB - NATURE PORTFOLIO SN - 20411723 KW - BRAIN KW - PERFORMANCE KW - CNN UR - https://www.nature.com/articles/s41467-025-60466-1 N2 - Computational competitions are the standard for benchmarking medical image analysis algorithms, but they typically use small curated test datasets acquired at a few centers, leaving a gap to the reality of diverse multicentric patient data. To this end, the Federated Tumor Segmentation (FeTS) Challenge represents the paradigm for real-world algorithmic performance evaluation. The FeTS challenge is a competition to benchmark (i) federated learning aggregation algorithms and (ii) state-of-the-art segmentation algorithms, across multiple international sites. Weight aggregation and client selection techniques were compared using a multicentric brain tumor dataset in realistic federated learning simulations, yielding benefits for adaptive weight aggregation, and efficiency gains through client sampling. Quantitative performance evaluation of state-of-the-art segmentation algorithms on data distributed internationally across 32 institutions yielded good generalization on average, albeit the worst-case performance revealed data-specific modes of failure. Similar multi-site setups can help validate the real-world utility of healthcare AI algorithms in the future. ER -
ZENK, Maximilian; Ujjwal BAID; Sarthak PATI; Akis LINARDOS; Brandon EDWARDS; Micah SHELLER; Patrick FOLEY; Alejandro ARISTIZABAL; David ZIMMERER; Alexey GRUZDEV; Jason MARTIN; Russell T SHINOHARA; Annika REINKE; Fabian ISENSEE; Santhosh PARAMPOTTUPADAM; Kaushal PAREKH; Ralf FLOCA; Hasan KASSEM; Bhakti BAHETI; Siddhesh THAKUR; Verena CHUNG; Kaisar KUSHIBAR; Karim LEKADIR; Meirui JIANG; Youtan YIN; Hongzheng YANG; Quande LIU; Cheng CHEN; Qi DOU; Pheng-Ann HENG; Xiaofan ZHANG; Shaoting ZHANG; Muhammad Irfan KHAN; Mohammad Ayyaz AZEEM; Mojtaba JAFARITADI; Esa ALHONIEMI; Elina KONTIO; Suleiman A KHAN; Leon MAECHLER; Ivan EZHOV; Florian KOFLER; Suprosanna SHIT; Johannes C PAETZOLD; Timo LOEHR; Benedikt WIESTLER; Himashi PEIRIS; Kamlesh PAWAR; Shenjun ZHONG; Zhaolin CHEN; Munawar HAYAT; Gary EGAN; Mehrtash HARANDI; Isik Polat ECE; Gorkem POLAT; Altan KOCYIGIT; Alptekin TEMIZEL; Anup TULADHAR; Lakshay TYAGI; Raissa SOUZA; Nils D FORKERT; Pauline MOUCHES; Matthias WILMS; Vishruth SHAMBHAT; Akansh MAURYA; Shubham Subhas DANANNAVAR; Rohit KALLA; Vikas Kumar ANAND; Ganapathy KRISHNAMURTHI; Sahil NALAWADE; Chandan GANESH; Ben WAGNER; Divya REDDY; Yudhajit DAS; Fang F YU; Baowei FEI; Ananth J MADHURANTHAKAM; Joseph MALDJIAN; Gaurav SINGH; Jianxun REN; Wei ZHANG; Ning AN; Qingyu HU; Youjia ZHANG; Ying ZHOU; Vasilis SIOMOS; Giacomo TARRONI; Jonathan PASSERRAT-PALMBACH; Ambrish RAWAT; Giulio ZIZZO; Swanand Ravindra KADHE; Jonathan P EPPERLEIN; Stefano BRAGHIN; Yuan WANG; Renuga KANAGAVELU; Qingsong WEI; Yechao YANG; Yong LIU; Krzysztof KOTOWSKI; Szymon ADAMSKI; Bartosz MACHURA; Wojciech MALARA; Lukasz ZARUDZKI; Jakub NALEPA; Yaying SHI; Hongjian GAO; Salman AVESTIMEHR; Yonghong YAN; Agus S AKBAR; Ekaterina KONDRATEVA; Hua YANG; Zhaopei LI; Hung-Yu WU; Johannes ROTH; Camillo SAUERESSIG; Alexandre MILESI; Quoc D NGUYEN; Nathan J GRUENHAGEN; Tsung-Ming HUANG; Jun MA; Har Shwinder H SINGH; Nai-Yu PAN; Dingwen ZHANG; Ramy A ZEINELDIN; Michal FUTREGA; Yading YUAN; Gian Marco CONTE; Xue FENG; Quan D PHAM; Yong XIA; Zhifan JIANG; Huan Minh LUU; Mariia DOBKO; Alexandre CARRE; Bair TUCHINOV; Hassan MOHY-UD-DIN; Saruar ALAM; Anup SINGH; Nameeta SHAH; Weichung WANG; Chiharu SAKO; Michel BILELLO; Satyam GHODASARA; Suyash MOHAN; Christos DAVATZIKOS; Evan CALABRESE; Jeffrey RUDIE; Javier VILLANUEVA-MEYER; Soonmee CHA; Christopher HESS; John MONGAN; Madhura INGALHALIKAR; Manali JADHAV; Umang PANDEY; Jitender SAINI; Raymond Y HUANG; Ken CHANG; Minh-Son TO; Sargam BHARDWAJ; Chee CHONG; Marc AGZARIAN; Michal KOZUBEK; Filip LUX; Jan MICHÁLEK; Petr MATULA; Miloš KEŘKOVSKÝ; Tereza KOPŘIVOVÁ; Marek DOSTÁL; Václav VYBÍHAL; Marco C PINHO; James HOLCOMB; Marie METZ; Rajan JAIN; Matthew D LEE; Yvonne W LUI; Pallavi TIWARI; Ruchika VERMA; Rohan BAREJA; Ipsa YADAV; Jonathan CHEN; Neeraj KUMAR; Yuriy GUSEV; Krithika BHUVANESHWAR; Anousheh SAYAH; Camelia BENCHEQROUN; Anas BELOUALI; Subha MADHAVAN; Rivka R COLEN; Aikaterini KOTROTSOU; Philipp VOLLMUTH; Gianluca BRUGNARA; Chandrakanth J PREETHA; Felix SAHM; Martin BENDSZUS; Wolfgang WICK; Abhishek MAHAJAN; Carmen BALANA; Jaume CAPELLADES; Josep PUIG; Yoon Seong CHOI; Seung-Koo LEE; Jong Hee CHANG; Sung Soo AHN; Hassan F SHAYKH; Alejandro HERRERA-TRUJILLO; Maria TRUJILLO; William ESCOBAR; Ana ABELLO; Jose BERNAL; Jhon GOMEZ; Pamela LAMONTAGNE; Daniel S MARCUS; Mikhail MILCHENKO; Arash NAZERI; Bennett LANDMAN; Karthik RAMADASS; Kaiwen XU; Silky CHOTAI; Lola B CHAMBLESS; Akshitkumar MISTRY; Reid C THOMPSON; Ashok SRINIVASAN; J Rajiv BAPURAJ; Arvind RAO; Nicholas WANG; Ota YOSHIAKI; Toshio MORITANI; Sevcan TURK; Joonsang LEE; Snehal PRABHUDESAI; John GARRETT; Matthew LARSON; Robert JERAJ; Hongwei LI; Tobias WEISS; Michael WELLER; Andrea BINK; Bertrand POUYMAYOU; Sonam SHARMA; Tzu-Chi TSENG; Saba ADABI; Xavier Falcao ALEXANDRE; Samuel B MARTINS; Bernardo C A TEIXEIRA; Flavia SPRENGER; David MENOTTI; Diego R LUCIO; Simone P NICLOU; Olivier KEUNEN; Ann-Christin HAU; Enrique PELAEZ; Heydy FRANCO-MALDONADO; Francis LOAYZA; Sebastian QUEVEDO; Richard MCKINLEY; Johannes SLOTBOOM; Piotr RADOJEWSKI; Raphael MEIER; Roland WIEST; Johannes TRENKLER; Josef PICHLER; Georg NECKER; Andreas HAUNSCHMIDT; Stephan MECKEL; Pamela GUEVARA; Esteban TORCHE; Cristobal MENDOZA; Vera FRANCO; Elvis RIOS; Eduardo LOPEZ; Sergio A VELASTIN; Joseph CHOI; Stephen BAEK; Yusung KIM; Heba ISMAEL; Bryan ALLEN; John M BUATTI; Peter ZAMPAKIS; Vasileios PANAGIOTOPOULOS; Panagiotis TSIGANOS; Sotiris ALEXIOU; Ilias HALIASSOS; Evangelia I ZACHARAKI; Konstantinos MOUSTAKAS; Christina KALOGEROPOULOU; Dimitrios M KARDAMAKIS; Bing LUO; Laila M POISSON; Ning WEN; Martin VALLIERES; Mahdi Ait Lhaj LOUTFI; David FORTIN; Martin LEPAGE; Fanny MORON; Jacob MANDEL; Gaurav SHUKLA; Spencer LIEM; Gregory S ALEXANDRE; Joseph LOMBARDO; Joshua D PALMER; Adam E FLANDERS; Adam P DICKER; Godwin OGBOLE; Dotun OYEKUNLE; Olubunmi ODAFE-OYIBOTHA; Babatunde OSOBU; Hikima Mustapha SHU'AIBU; Mayowa SONEYE; Farouk DAKO; Adeleye DORCAS; Derrick MURCIA; Eric FU; Rourke HAAS; John A THOMPSON; David Ryan ORMOND; Stuart CURRIE; Kavi FATANIA; Russell FROOD; Amber L SIMPSON; Jacob J PEOPLES; Ricky HU; Danielle CUTLER; Fabio Y MORAES; Anh TRAN; Mohammad HAMGHALAM; Michael A BOSS; James GIMPEL; Kattil Veettil DEEPAK; Kendall SCHMIDT; Lisa CIMINO; Cynthia PRICE; Brian BIALECKI; Sailaja MARELLA; Charles APGAR; Andras JAKAB; Marc-Andre WEBER; Errol COLAK; Jens KLEESIEK; John B FREYMANN; Justin S KIRBY; Lena MAIER-HEIN; Jake ALBRECHT; Peter MATTSON; Alexandros KARARGYRIS; Prashant SHAH; Bjoern MENZE; Klaus MAIER-HEIN a Spyridon BAKAS. Towards fair decentralized benchmarking of healthcare AI algorithms with the Federated Tumor Segmentation (FeTS) challenge. \textit{Nature communications}. BERLIN: NATURE PORTFOLIO, 2025, roč.~16, č.~1, s.~1-20. ISSN~2041-1723. Dostupné z: https://doi.org/10.1038/s41467-025-60466-1.