LLM-Cite: Cheap Fact Verification with Attribution via URL Generation
Fact Verification;Attribution;Citation;Factuality
Yes
No ethics review needed.
1) While Google Custom Search is expensive at 5$ per 1000 queries, there are cheaper alternatives like https://serper.dev which offer a pricing varying from 1$ per 1000 queries to 0.3$ per 1000 queries. Given this, the authors should reconsider the claims made about 45x cost improvements.
1) The approach shows competitive performance on a variety of benchmarks, although performance is considerably lower on the more recent FreshQA dataset. 

2) The main strength of LLM-Cite is the cost savings compared to Google Search
The paper proposes LLM-Cite, a cheap and easy approach to leverage an LLM to directly generate potential citation URLs that can assist in verifying a given claim. The content corresponding to these URLs is obtained and then fed into an NLI model to verify the claim. 
The paper evaluates few-shot prompting strategies for obtaining the URL for LLM-Cite with a variety of LLMs. Experiments show that the approach is competitive and sometimes does even better than Google Search at identifying the relevant Wikipedia documents that can verify the claim. Further, given the high cost of Google Search, the approach is projected as a considerably cheaper alternative for identifying the URLs.
1) My main concern is the novelty of the paper. The primary contribution is to show that the LLM can identify the relevant Wikipedia URL given a claim. However, this has already been demonstrated in LLM-URL [1], which considers question-answering tasks in a very similar setting, and is also missing in the related work.

2) Further, the paper considers the narrow setting of generating only Wikipedia URLs. Wikipedia URLs follow an entity-based template of https://en.wikipedia.org/wiki/<entity_name> which simplifies the task of generating relevant URLs to mainly just identifying the relevant entity in the claim to be verified. The authors should investigate how well this approach would work for tasks that require generating URLs from other websites, such as generating paper IDs or Arxiv URLs to verify scientific claims or generating news article URLs for news question answering. 

3)  While the authors show cost comparison, there is no analysis done on latency comparison. Since the approach requires sampling or getting multiple URLs from an LLM such as GPT-4o, I would expect Google Search to be much faster in comparison.

[1] Large Language Models are Built-in Autoregressive Search Engines; Ziems et al ACL 2023
Yes
No ethics review needed.
Q-1: Lines 414-416 are not clear. Figure 4 (left) does not properly depict the description therein. In my understanding, the blue line depicts the % of URLs that are invalid among the generated k URLs, while the orange depicts the % of claims where all the URLs are invalid.
I have found the paper to be easy to read. The methodology is lucid and has been explained well. The experiment designs are adequate to establish the claim sufficiently. The findings are worth noting, and the overall framework can be of some value to developers during the selection of fact verification models. The work is original (regarding my limited scholarship in fact verification), given the use of the existing SOTA NLI model for fact (hypothesis) corroboration coupled with SOTA LLMs for URL generation to provide sources of the premises. Also, making the pipeline much cheaper (cost-wise) by avoiding retrieval-based NLI has a significant impact on the community.
The paper presents LLM-Cite - an LLM-based fact verifier that bypasses the need for expensive retrieval-based fact-checking to guarantee freshness and, at the same time, does not rely on the un-updated "frozen" learning by the model. It introduces a URL-generation step where the sources of the premises are fetched, such that those premises can be used further to entail the fact/claim as a hypothesis using an off-the-shelf NLI model.
Despite the idea being interesting, I have found some technical issues that weakened the overall soundness. I enumerate them as follows:

1. The assumption that generated URLs are always meaningfully related to the core content of the document from where the premises are to be fetched is not true by and large. It works for Wikipedia because the URLs are well-structured semantically. 

2. LLMs generating URLs on Wikidata have a significantly higher probability of being linked with a valid URL because extensive entity linking has already been done. This, however, is not the case for many other web sources.

3. There are several URLs that are not named according to the premise entities. In that case, those sources will never be fetched.

4. How to resolve contradictory entailment from premises belonging to different sources?

5. There can be many sources that are themselves false (particularly for the open Internet and also in cases of unverified Wiki pages). So assuming the premises to be true may lead to incorrect RTE.

6.  It is unclear how the prompt templates are designed, i.e., the rationale and methodology that would drive the demonstration example patterns in the few-shot cases.

7. A discussion on the prompt dataset (for the few-shot case) creation together with its source should be discussed.

8. The assumption that RTE (i.e. NLI) being true would imply that the hypothesis (fact/claim) is verified is bit tricky and may not always be true. A false statement can entail a hypothesis as well as its true version. Eg.:

$\textit{Apples come in many colors}$  $\implies$ $\textit{Apples can be blue (claim)}$.

$\textit{John was a follower of Jesus}$  $\implies$ $\textit{John was a Christian (claim)}$.

9. Line 253: What is citation threshold? I could not find the definition.

10. In the comparisons with the baselines and variants of LLM-Cite, what was the justification behind not keeping the model set fixed for all the experiments? I think this should be clear.

11. In sections 4.1 and 4.2, an analysis of why the verification models perform better on model-generated claims as compared to human-generated claims is very important to me. I could not find any adequate analysis for that.
 
12. The key success of LLM-Cite depends on the NLI model (given that at least one valid URL is generated that points to a valid premise). Hence, a discussion on the accuracy of SOTA NLI models (with citation) and the rationale behind choosing the Check Grounding NLI API and Gemini-1.5-Flash should be included.
Yes
No ethics review needed.
Weaknesses above.
1. New insights: This paper suggests using LLM's understanding of URLs during the pre-training phase for evidence querying. The underlying assumptions are: 1. The structure of evidence URLs usually follows a pattern; 2. LLMs have been exposed to a large number of URL training instances during pre-training, thus they can generate new URLs for fresh claims.
2. This paper is well-written and easy to follow.

3. The model's effectiveness has been validated on human-written, model-generated, and fresh claims.
This paper proposes a new method called LLM-CITE for factual verification tasks, aiming to leverage LLM's understanding of URLs during the pre-training phase to perform text factuality checking by utilizing generated URLs to retrieve evidence. Compared to existing methods, the proposed method is simple, cost-effective, and easy to deploy, without the need for complex external retrieval processes. The effectiveness of the proposed method has been validated on three datasets.
1. The paper's assumptions about URLs have limited generalizability. Although the paper clarifies that it can be applied to any web domain, intuitively, its application is primarily focused on verification that has a high degree of regularity in URL structure, such as Wikipedia. It is difficult to implement for real-world claim verification like PolitiFact or gossip, and it remains in an ideal stage.

2. Factual verification claims often exhibit high semantic complexity and typically require multi-hop evidence for verification, which the proposed method clearly struggles to achieve.

3. URLs are extremely sensitive to characters, and the paper does not handle invalid URLs reasonably and does not provide experimental results for valid URLs.

4. As a benchmark dataset for factual verification, why not validate on datasets like FEVER, HOVer, and FEVEROUS, which use Wikipedia as an external knowledge base?
Yes
No ethics review needed.
- NLI choice: For the NLI models, there are existing models that are designed to tackle the mismatch in granularity between premise and hypothesis, such as DocNLI and AlignScore. These are naturally more suited for the task. I was wondering why these were not considered?
- Citation threshold: What does this mean? Does it mean > 0.6 is entailment?
- The proposed method is neat, simple, and interesting.
- The paper is easy-to-read overall.
The paper introduces LLM-Cite, a novel method to address hallucinations in Large Language Models (LLMs) by verifying the factuality of their responses without reliance on costly external search systems or static knowledge bases. Instead of depending on frequent updates of knowledge bases or LLM's internal parametric knowledge—which lacks attribution—LLM-Cite leverages the LLM itself to generate potential citation URLs for claims. These URLs are fetched on-the-fly, and the claims are verified using entailment checks against the URL content. This approach ensures both attribution and the ability to verify current information, significantly reducing costs compared to traditional search methods. The authors evaluate LLM-Cite on three datasets encompassing both fresh and non-fresh claims from human and model-generated sources, demonstrating its competitive or superior performance compared to existing methods while being more than 45 times cheaper than a Google Search-based approach.
- Restricted to Wikipedia: Although the authors demonstrate the proposed fact verification approach is effective, the experiments are only conducted on Wikipedia. There are concerns whether this method could be extended to beyond this limited knowledge base.
- Dataset issue: First, while the author tested on three datasets, most of these dataset are relatively small. In particular, the FreshQA dataset only has 30 instances, which raises concerns about generalizability and whether the conclusion still holds if we increase the size of the testing data. Second, for the ASQA dataset, the author uses a NLI model to ensure data quality. However, as seen in Figure 4 right, the NLI model performance is only somewhere around 85%. The chances that the NLI model makes an error is higher than the performance gap between the proposed approach and the baseline methods (Figure 2 right). Hence, the conclusion from Figure 2 right may be questionable. Third, for the Biographies dataset, the author has transformed the data in a way that is more suitable for their own approach, which may lead to unfair comparisons with baselines (see below).
- Unfair baseline comparison: First of all, the authors did not use the same LLM for their method and baseline method, which is unfair. Additionally, for FactScore, the whole point of the paper is decomposing long texts into atomic facts and then evaluating factuality. However, due to the experimental setup, this decomposition part seems removed. Therefore, it may be unfair for the authors to say they “beat the current best method (FactScore) on Biographies”.
@inproceedings{
anonymous2024llmcite,
title={{LLM}-Cite: Cheap Fact Verification with Attribution via {URL} Generation},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=qb2QRoE4W3},
note={under review}
}
Hallucinations are one of the main issues with Large Language Models (LLMs). This has led to increased interest in automated ways to verify the factuality of LLMs' responses. Existing methods either rely on: (a) search over a knowledge base (KB), which is costly especially if the KB must be updated frequently to keep up with fresh content, (b) LLM's parametric knowledge to fact-check claims, which is cheaper but does not give attribution and is limited to verifying claims related to knowledge acquired during pretraining. In this work, we present LLM-Cite, a cheap and easy to implement method that does not rely on any external search system while still providing attribution and the ability to verify fresh claims. Our key insight is to leverage an LLM to directly generate potential citation URLs for a given claim, and then use entailment checks to verify the claim against content of the URLs (which are fetched on-the-fly). We benchmark LLM-Cite on three datasets containing fresh and non-fresh claims generated by humans and models. We show that LLM-Cite performs comparable or better than existing methods on all categories of claims --- importantly, without sacrificing attribution, or requiring costly external search --- overall LLM-Cite is more than 45x cheaper than a Google Search based approach.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Fact Verification Attribution Citation Factuality
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/6e0c248dd522ddcfd96135485058615e712b589a.pdf
interpretability and explainable AI
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
LLM-Cite: Cheap Fact Verification with Attribution via URL Generation
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission