Department
Statistics and Analytical Sciences
Document Type
Article
Submission Date
Spring 3-2022
Abstract
Recent advances in Natural Language Processing have led to powerful and sophisticated models like BERT (Bidirectional Encoder Representations from Transformers) that have bias. These models are mostly trained on text corpora that deviate in important ways from the text encountered by a chatbot in a problem-specific context. While a lot of research in the past has focused on measuring and mitigating bias with respect to protected attributes (stereotyping like gender, race, ethnicity, etc.), there is lack of research in model bias with respect to classification labels. We investigate whether a classification model hugely favors one class with respect to another. We introduce a bias evaluation method called directional pairwise class confusion bias that highlights the chatbot intent classification model’s bias on pairs of classes. Finally, we also present two strategies to mitigate this bias using example biased pairs.
Comments
This article was submitted to 2022 IEEE 16th International Conference on Semantic Computing (ICSC) and will soon be published in IEEE Xplore database with DOI 10.1109/ICSC52841.2022.00017.