Language Models' Internal Conflicts: Layer-wise Usable Information For Detecting Model (Un)answerability
Uncertainty;Question Answering
I have read and agree with the venue's withdrawal policy on behalf of myself and my co-authors.
@misc{
kim2024language,
title={Language Models' Internal Conflicts: Layer-wise Usable Information For Detecting Model (Un)answerability},
author={Hazel Kim and Philip Torr and Adel Bibi},
year={2024},
url={https://openreview.net/forum?id=pdl5qsMQS9}
}
We propose a new framework for detecting unanswerable questions. Large language models often sound overly convincing when providing inaccurate answers. We explore how language models behave when required to answer questions without relevant information in the provided context, a situation that is likely to result in hallucination. We state that unanswerable questions represent a deficiency of $\mathcal{V}$-usable information across the layers of a pre-trained language model $\mathcal{V}$. To capture this, we propose a layer-wise usable information ($\mathcal{L}$I), tracking how much information is usable by language models within their mechanism of updating layers. We empirically argue that information is not always monotonically gained or lost across layers, and hence tracking all the layers within the language models is far more informative than embracing the final layer as the complete form of computation. 
Our method does not require label annotations to fine-tune classifiers or modify model architectures. Hence it is computationally feasible to universal large language models.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
~Hazel_Kim1 ~Philip_Torr1 ~Adel_Bibi1
Hazel Kim Philip Torr Adel Bibi
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Uncertainty Question Answering
I certify that there is no acknowledgement section in this submission for double blind review.
kim|language_models_internal_conflicts_layerwise_usable_information_for_detecting_model_unanswerability
generative models
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
Language Models' Internal Conflicts: Layer-wise Usable Information For Detecting Model (Un)answerability
ICLR 2025 Conference Withdrawn Submission
ICLR.cc/2025/Conference/Withdrawn_Submission