eglym commited on
Commit
7f5ee10
·
verified ·
1 Parent(s): 7d1d893

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -1
README.md CHANGED
@@ -10,4 +10,55 @@ pipeline_tag: text-generation
10
  library_name: transformers
11
  tags:
12
  - code
13
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  library_name: transformers
11
  tags:
12
  - code
13
+ ---
14
+
15
+ # Update notice
16
+ The model weights were updated at 3 AM UTC on Sep 12, 2024.
17
+
18
+ # Model Card for DR-TEXT2SQL-CodeLlama2-7B
19
+ A capable large language model for natural language to SQL generation.
20
+
21
+
22
+ ## Model Details
23
+ ### Model Description
24
+ This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
25
+
26
+ Developed by: eglym
27
+ Model type: [Text to SQL]
28
+ License: [CC-by-SA-4.0]
29
+ Finetuned from model: [CodeLlama-7B]
30
+
31
+ Uses
32
+ This model is intended to be used by non-technical users to understand data inside their SQL databases. It is meant as an analytics tool, and not as a database admin tool.
33
+
34
+ This model has not been trained to reject malicious requests from users with write access to databases, and should only be used by users with read-only access.
35
+
36
+ How to Get Started with the Model
37
+ Use the code here to get started with the model.
38
+
39
+ Prompt
40
+ Please use the following prompt for optimal results. Please remember to use do_sample=False and num_beams=4 for optimal results.
41
+
42
+ ### Task
43
+ Generate a SQL query to answer [QUESTION]{user_question}[/QUESTION]
44
+
45
+
46
+ ### Answer
47
+ Given the database schema, here is the SQL query that [QUESTION]{user_question}[/QUESTION]
48
+ [SQL]
49
+
50
+ Evaluation
51
+ This model was evaluated on SQL-Eval, a PostgreSQL based evaluation framework developed by Defog for testing and alignment of model capabilities.
52
+
53
+ You can read more about the methodology behind SQLEval here.
54
+
55
+ Results
56
+ We classified each generated question into one of 6 categories. The table displays the percentage of questions answered correctly by each model, broken down by category.
57
+ ```bash
58
+
59
+ easy medium hard extra all
60
+ count 250 440 174 170 1034
61
+ compare etype exec
62
+ ===================== EXECUTION ACCURACY =====================
63
+ exec 0.352 0.045 0.006 0.000 0.105
64
+ ```