Spaces:
Runtime error
Runtime error
Update app.py
Browse files
app.py
CHANGED
@@ -85,9 +85,9 @@ Your specificied setting corresponds to the following training compute budget.
|
|
85 |
## Chinchilla optimal:
|
86 |
If you are optimizeing for model performance and ignore inference cost this is the optimal setting for training:
|
87 |
|
88 |
-
**Optimal model size: {N_opt/Bn:.2f}B**
|
89 |
|
90 |
-
**Optimal datset size
|
91 |
|
92 |
## Your setting trade-off:
|
93 |
In both cases 100% corresponds to the compute optimal model.
|
@@ -100,8 +100,8 @@ In both cases 100% corresponds to the compute optimal model.
|
|
100 |
with gr.Blocks() as demo:
|
101 |
gr.Markdown(INTRO)
|
102 |
with gr.Row():
|
103 |
-
N = gr.Number(value=
|
104 |
-
D = gr.Number(value=
|
105 |
|
106 |
button = gr.Button("Compute!")
|
107 |
|
|
|
85 |
## Chinchilla optimal:
|
86 |
If you are optimizeing for model performance and ignore inference cost this is the optimal setting for training:
|
87 |
|
88 |
+
**Optimal model size: {N_opt/Bn:.2f}B parametes**
|
89 |
|
90 |
+
**Optimal datset size: {D_opt/Bn:.2f}B tokens**
|
91 |
|
92 |
## Your setting trade-off:
|
93 |
In both cases 100% corresponds to the compute optimal model.
|
|
|
100 |
with gr.Blocks() as demo:
|
101 |
gr.Markdown(INTRO)
|
102 |
with gr.Row():
|
103 |
+
N = gr.Number(value=7, label="Model size (in B parameters):")
|
104 |
+
D = gr.Number(value=2000, label="Dataset size (in B tokens):")
|
105 |
|
106 |
button = gr.Button("Compute!")
|
107 |
|