Pub-Guard-Llama-8B

Pub-Guard-Llama-8B is a fine-tuned version of the Llama-3.1-8B model, specifically designed for detecting fraudulent papers in academic publications.

Benefits of using this model:

• the first LLM specifically designed for fraud detection in scientific articles
• integration of external resources for better analysis (Semantic Scholar, OpenAlex, Pubmed...)
• it offers uncertainty-aware predictions with faithful explanations

Datasets

• Pubmed Retraction
• Instruction

Zero-Shot Reasoning

Model	Breast Cancer	Lung Cancer
Llama-3.1-8B-Instruct	20.0	46.2
OpenScholar-8B	18.8	20.3
Bio-Medical-Llama-3-8B	40.7	56.7
PMC-LLaMA-13B	36.4	-
Pub-Guard-Llama-8B (Ours)	73.1	80.5
Pub-Guard-Llama-8B (RAG)	-	-
Pub-Guard-Llama-8B (Debate)	73.1	81.1

Examples

Naive Mode

Input:

Title: Changes and Influencing Factors of Cognitive Impairment in Patients with Breast Cancer.

Abstract: To investigate the changes in cognitive function and its influencing factors in patients with breast cancer after chemotherapy,
to provide a scientific basis for further cognitive correction therapy. In this study, general information on age,
marital status, and chemotherapy regimen was collected from 172 breast cancer chemotherapy patients.
172 patients with breast cancer undergoing chemotherapy were investigated by convenience sampling method,
and the subjects were tested one-on-one using the Chinese version of the MATRICS Consensus Cognitive Battery (MCCB) computer system.
...

Authors: Huixia Cui (author h-index: 6, Early Career Researcher);
Xiaoxiu Song (author h-index: 1, Emerging Researcher); Wenlu Zhang (author h-index: 7, Early Career Researcher)

Institutions: College of Nursing, Jinzhou Medical University, Jinzhou, Liaoning 121001, China. (institution average citation: 9.0, Emerging Institution);
Department of Intensive Care Medicine, Liaocheng People's Hospital, Liaocheng, Shandong 252000, China. (institution average citation: 10.0, Emerging Institution);

Journal: evidence-based complementary and alternative medicine : ecam (unknown journal)

Output:

Yes
The article should be retracted due to potential data fabrication or manipulation, as the reported linear regression results lack clarity and statistical validation.
 Additionally, the journal's reputation and peer review rigor are questionable, and the authors' affiliations are emerging with low citation averages,
raising concerns about research reliability.

Debate Mode