Vietnamese Text-to-SQL with Large Language Models: A Comprehensive Approach
Text-to-SQL;Large Language Models;Few-shot;Chain-of-thought;Mini Schema;ViText2SQL;SQL
The paper exceeds the page limit.
Submission Desk Rejected by Program Chairs
We use Vietnamese LLMs for text-to-SQL tasks, introducing few-shot learning, a chain-of-thought technique, and schema streamlining. Our method outperforms the state-of-the-art by 23% on ViText2SQL with one training epoch.
@misc{
hoang2024vietnamese,
title={Vietnamese Text-to-{SQL} with Large Language Models: A Comprehensive Approach},
author={Phu Nguyen Dac Hoang and Cuong Le Phuoc and Tri Doan Tran Cao and Nguyễn Minh Quang},
year={2024},
url={https://openreview.net/forum?id=cWFLrctwuE}
}
In the current era of Artificial Intelligence (AI), the realm of database querying is experiencing a profound evolution. With the recent emergence of Large Language Models (LLMs), with a particular emphasis on Vietnamese in this study, a promising opportunity arises to bridge the gap between human language and database interactions. In this paper, we embark on realizing this vision through a three-pronged approach. Firstly, we introduce a few-shot learning method designed to enhance the database schema comprehension of Vietnamese LLMs. Secondly, we employ a chain-of-thought technique to systematically guide LLMs in capturing complex natural language expressions for SQL generation. Thirdly, we introduce a novel method to streamline the input schema by removing redundant parts and retaining only the parts that are truly relevant to enhance the efficiency and accuracy of the SQL generation process. Finally, we experimented with a combination of few-shot, chain-of-thought learning, and schema-enhancing methods. Through experimentation with augmented datasets, we observe encouraging initial results. Our approach outperforms the current state-of-the-art model by 23% in exact matching on the Vietnamese ViText2SQL dataset. We achieved this result with a single pretraining step and one epoch of retraining, compared to the SoTA model's 10 epochs. These findings demonstrate the effectiveness of our method and its potential for Vietnamese text-to-SQL applications.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
~Phu_Nguyen_Dac_Hoang1 ~Cuong_Le_Phuoc1 ~Tri_Doan_Tran_Cao1 ~Nguyễn_Minh_Quang1
Phu Nguyen Dac Hoang Cuong Le Phuoc Tri Doan Tran Cao Nguyễn Minh Quang
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
Text-to-SQL Large Language Models Few-shot Chain-of-thought Mini Schema ViText2SQL SQL
I certify that there is no acknowledgement section in this submission for double blind review.
hoang|vietnamese_texttosql_with_large_language_models_a_comprehensive_approach
/pdf/1dff2e8b3685cec88299a9989d87bfee0ac4bd24.pdf
unsupervised, self-supervised, semi-supervised, and supervised representation learning
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/0a8ff397462b0287f1ada108df1504ed20007520.zip
Vietnamese Text-to-SQL with Large Language Models: A Comprehensive Approach
ICLR 2025 Conference Desk Rejected Submission
ICLR.cc/2025/Conference/Desk_Rejected_Submission