Active Globally Explainable Learning for Medical Images via Class Association Embedding and Cyclic Adversarial Generation: Paper and Code

Get our free extension to see links to code for papers anywhere online!Free add-on: code for papers everywhere!Free add-on: See code for papers anywhere!

Add to Chrome

Add to Firefox

Add to Edge

Active Globally Explainable Learning for Medical Images via Class Association Embedding and Cyclic Adversarial Generation

Jun 12, 2023
Ruitao Xie, Jingbang Chen, Limai Jiang, Rui Xiao, Yi Pan, Yunpeng Cai

Figure 1 for Active Globally Explainable Learning for Medical Images via Class Association Embedding and Cyclic Adversarial Generation

Figure 2 for Active Globally Explainable Learning for Medical Images via Class Association Embedding and Cyclic Adversarial Generation

Figure 3 for Active Globally Explainable Learning for Medical Images via Class Association Embedding and Cyclic Adversarial Generation

Figure 4 for Active Globally Explainable Learning for Medical Images via Class Association Embedding and Cyclic Adversarial Generation

Share this with someone who'll enjoy it:

Explainability poses a major challenge to artificial intelligence (AI) techniques. Current studies on explainable AI (XAI) lack the efficiency of extracting global knowledge about the learning task, thus suffer deficiencies such as imprecise saliency, context-aware absence and vague meaning. In this paper, we propose the class association embedding (CAE) approach to address these issues. We employ an encoder-decoder architecture to embed sample features and separate them into class-related and individual-related style vectors simultaneously. Recombining the individual-style code of a given sample with the class-style code of another leads to a synthetic sample with preserved individual characters but changed class assignment, following a cyclic adversarial learning strategy. Class association embedding distills the global class-related features of all instances into a unified domain with well separation between classes. The transition rules between different classes can be then extracted and further employed to individual instances. We then propose an active XAI framework which manipulates the class-style vector of a certain sample along guided paths towards the counter-classes, resulting in a series of counter-example synthetic samples with identical individual characters. Comparing these counterfactual samples with the original ones provides a global, intuitive illustration to the nature of the classification tasks. We adopt the framework on medical image classification tasks, which show that more precise saliency maps with powerful context-aware representation can be achieved compared with existing methods. Moreover, the disease pathology can be directly visualized via traversing the paths in the class-style space.

View paper on

Share this with someone who'll enjoy it: