DYNAMICQA Tracing Internal Knowledge Conflicts in Language Models
SV Marjanović, H Yu, P Atanasova, M Maistro, C Lioma, I Augenstein
Knowledge-intensive language understanding tasks require Language Models (LMs) to integrate relevant context, mitigating their inherent weaknesses, such as incomplete or outdated knowledge. However, conflicting knowledge can be present in the LM’s parameters, termed intra-memory conflict, which can affect a model’s propensity to accept contextual knowledge. To study the effect of...
[Read More]