Picture for Chung-Cheng Chang

Chung-Cheng Chang

Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems

Add code
Oct 11, 2021
Po-Nien Kung, Chung-Cheng Chang, Tse-Hsuan Yang, Hsin-Kai Hsu, Yu-Jia Liou, Yun-Nung Chen

Figure 1 for Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems
Figure 2 for Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems
Figure 3 for Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems
Figure 4 for Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems

Task-oriented dialogue systems have been a promising area in the NLP field. Previous work showed the effectiveness of using a single GPT-2 based model to predict belief states and responses via causal language modeling. In this paper, we leverage multi-task learning techniques to train a GPT-2 based model on a more challenging dataset with multiple domains, multiple modalities, and more diversity in output formats. Using only a single model, our method achieves better performance on all sub-tasks, across domains, compared to task and domain-specific models. Furthermore, we evaluated several proposed strategies for GPT-2 based dialogue systems with comprehensive ablation studies, showing that all techniques can further improve the performance.

Viaarxiv icon
Github IconAccess Paper or Ask Questions
Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon