Picture for Bahar Rahsepar

Bahar Rahsepar

Improved statistical benchmarking of digital pathology models using pairwise frames evaluation

Add code
Jun 07, 2023
Ylaine Gerardin, John Shamshoian, Judy Shen, Nhat Le, Jamie Prezioso, John Abel, Isaac Finberg, Daniel Borders, Raymond Biju, Michael Nercessian, Vaed Prasad, Joseph Lee, Spencer Wyman, Sid Gupta, Abigail Emerson, Bahar Rahsepar, Darpan Sanghavi, Ryan Leung, Limin Yu, Archit Khosla, Amaro Taylor-Weiner

Figure 1 for Improved statistical benchmarking of digital pathology models using pairwise frames evaluation
Figure 2 for Improved statistical benchmarking of digital pathology models using pairwise frames evaluation
Figure 3 for Improved statistical benchmarking of digital pathology models using pairwise frames evaluation
Figure 4 for Improved statistical benchmarking of digital pathology models using pairwise frames evaluation

Nested pairwise frames is a method for relative benchmarking of cell or tissue digital pathology models against manual pathologist annotations on a set of sampled patches. At a high level, the method compares agreement between a candidate model and pathologist annotations with agreement among pathologists' annotations. This evaluation framework addresses fundamental issues of data size and annotator variability in using manual pathologist annotations as a source of ground truth for model validation. We implemented nested pairwise frames evaluation for tissue classification, cell classification, and cell count prediction tasks and show results for cell and tissue models deployed on an H&E-stained melanoma dataset.

* 10 pages, 7 figures 
Viaarxiv icon
Github IconAccess Paper or Ask Questions
Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon