cfahlgren1 HF staff commited on
Commit
46afb13
·
1 Parent(s): fa32dd4

update README.md

Browse files
Files changed (1) hide show
  1. README.md +147 -0
README.md CHANGED
@@ -19,6 +19,15 @@ language:
19
  - en
20
  ---
21
 
 
 
 
 
 
 
 
 
 
22
  # Model description
23
  **OpenHermes-Lllama_3B** is a finetune of the Hermes dataset that has a fully open source dataset!
24
  It was trained on 15,000 entries of primarily GPT-4 generated data, from open datasets across the AI landscape, including:
@@ -29,3 +38,141 @@ It was trained on 15,000 entries of primarily GPT-4 generated data, from open da
29
  - Camel-AI's domain expert datasets, by the Camel-AI Team
30
  - CodeAlpaca, by Sahil2801
31
  - GPT4-LLM and Unnatural Instructions, by Microsoft
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  - en
20
  ---
21
 
22
+ # OpenHermes-Llama-3B
23
+ *An OpenLlama-3B finetune for role-play, instruction following, and code generation*
24
+
25
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/648a374f00f7a3374ee64b99/bDQ8ybHVS--CibUf4rvFB.png" width="400" height="400">
26
+
27
+ *Logo AI Generated by Dalle*
28
+
29
+ For a guide on how this was fine tuned, check out this blog [post](https://calebfahlgren.com/post/how-to-finetune-a-large-language-model).
30
+
31
  # Model description
32
  **OpenHermes-Lllama_3B** is a finetune of the Hermes dataset that has a fully open source dataset!
33
  It was trained on 15,000 entries of primarily GPT-4 generated data, from open datasets across the AI landscape, including:
 
38
  - Camel-AI's domain expert datasets, by the Camel-AI Team
39
  - CodeAlpaca, by Sahil2801
40
  - GPT4-LLM and Unnatural Instructions, by Microsoft
41
+
42
+
43
+ **OpenHermes-Lllama-3B** has improved very much improved coding abilities and general instruction following than the OpenLlama-3B base model. You can see the before and after outputs comparison below.
44
+
45
+
46
+ # Example Outputs
47
+
48
+ ### Writing Code
49
+
50
+ **Q:** Write a Fast API endpoint with ratelimiting
51
+
52
+ **OpenHermes-Llama-3B Output**
53
+
54
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/648a374f00f7a3374ee64b99/ZZxphP0JN1Y6HfcGDRwJ1.png" width="600" height="600">
55
+
56
+ **Base Model Output**
57
+
58
+ *Create a new FastAPI app
59
+
60
+ *Create a new endpoint
61
+
62
+ *Create a new ratelimit middleware
63
+
64
+ *Create a new ratelimit rule
65
+
66
+ *Create a new ratelimit backend
67
+
68
+ *Create a new ratelimit backend
69
+
70
+ ### Planning an Itinerary
71
+
72
+ **Q:** Create a travel itinery for italy for 3 days for me.
73
+
74
+ **OpenHermes-Llama-3B Output**
75
+
76
+ Hi,
77
+
78
+ I am happy to help you create an itinery for Italy for 3 days.
79
+ Here is an example itinery:
80
+ Day 1:
81
+
82
+ Morning: Arrive in Rome, check into your hotel.
83
+
84
+ Afternoon: Visit the Colosseum, the Roman Forum, and the Pantheon.
85
+
86
+ Evening: Have a dinner at a local restaurant and enjoy the nightlife in Rome.
87
+
88
+ Day 2:
89
+
90
+ Morning: Visit the Vatican Museums, St. Peter's Basilica, and the Sistine Chapel.
91
+
92
+ Afternoon: Take a guided tour of the Italian capital.
93
+
94
+ Evening: Have a dinner at a local restaurant and enjoy the nightlife in Rome.
95
+
96
+ Day 3:
97
+
98
+ Morning: Visit the Fontana di Trevi, the Pantheon, and the Colosseum.
99
+
100
+ Afternoon: Take a guided tour of the Italian capital.
101
+
102
+ Evening: Have a dinner at a local restaurant and enjoy the nightlife in Rome.
103
+
104
+ You can also add visits to other attractions such as the Capitoline Museums, the Palatine Hill, and the Spanish Steps.
105
+
106
+ I hope this itinery helps you plan your trip to Italy. Let me know if you have any questions or if you need any further assistance.
107
+
108
+ **Base Model Output**
109
+
110
+ Hi,
111
+ I am a travel agent and I can help you with your travel itinerary.
112
+ I can help you with the following:
113
+ 1. Flight booking
114
+ 2. Hotel booking
115
+ 3. Car rental
116
+ 4. Tour booking
117
+ 5. Visa
118
+ 6. Travel insurance
119
+ 7. Airport transfers
120
+ 8. Airport pick up
121
+ 9. Airport drop off
122
+ 10. Airport lounge
123
+ 11. Airport lounge pick up
124
+ 12. Airport lounge drop off
125
+
126
+ ### Explaining Concepts
127
+
128
+ **Q:** Explain golang structs
129
+
130
+ **OpenHermes-Llama-3B Output**
131
+
132
+ A golang struct is a way to define a data type in Go. It is a collection of fields, each of which is a value of a specific type. The fields are arranged in a hierarchy and are connected using interfaces.
133
+ Example:
134
+
135
+ ```go
136
+ type User struct {
137
+ Name string
138
+ Age int
139
+ Email string
140
+ }
141
+ ```
142
+ In this example, the User struct contains a Name field, an Age field, an Email field, and a few other fields. The Name field is of type string, the Age field is of type int, and the Email field is of type string. The User struct is connected to other structs through interfaces, such as the interface for the User type.
143
+ The main advantage of structs in Go is that they can be used to represent data in a way that is more flexible and easier to use than traditional arrays or maps. Structs also allow for more complex data structures to be created without the need for nested arrays or maps.
144
+ Here's an example of how to use a User struct:
145
+ package main
146
+
147
+ ```go
148
+ import (
149
+ "fmt"
150
+ "strings"
151
+ )
152
+
153
+ type User struct {
154
+ Name string
155
+ Age int
156
+ Email string
157
+ }
158
+
159
+ func main() {
160
+ user1 := User{"John", 25, "[email protected]"}
161
+ user2 := User{"Mary", 22, "[email protected]"}
162
+
163
+ // Print the users' names and ages
164
+ fmt.Printf("User 1: %s (%d)\nUser 2: %s (%d)\n", user1.Name, user1.Age, user2.Name, user2.Age)
165
+
166
+ // Print the users' emails separated by commas
167
+ email1 := user1.Email
168
+ email2 := user2.Email
169
+ fmt.Printf("User 1's email: %s\nUser 2's email: %s\n", email1, email2)
170
+ }
171
+ ```
172
+ In this example, the User struct is used to represent two different users. The Name field is used to store the users' names, the Age field is used to store their ages, and the Email field is used to store their emails. The main function prints out the users' names and ages, along with their emails separated by commas.
173
+ In summary, a golang struct is a way to define data types in Go. It is a collection of fields, each of which is a value of a specific type. The fields are arranged in a hierarchy and are connected through interfaces. The main advantage of structs in Go is that they can be used to represent data in a way that is more flexible and easier to use than traditional arrays or maps.
174
+
175
+ **Base Model Output**
176
+
177
+ *A struct is a named collection of variables.
178
+