Spaces:
Runtime error
Runtime error
Commit
·
d96cf44
1
Parent(s):
3c81363
remove unfinished sentence
Browse files
app.py
CHANGED
@@ -11,8 +11,7 @@ from charts import draw_current_progress
|
|
11 |
|
12 |
st.set_page_config(page_title="Training Transformers Together", layout="centered")
|
13 |
|
14 |
-
|
15 |
-
st.markdown("## Full demo content will be posted here on December 7th!")
|
16 |
|
17 |
make_header()
|
18 |
|
@@ -79,37 +78,33 @@ This may seem daunting at first, but in reality, DL researchers have already mad
|
|
79 |
</tbody></table>
|
80 |
""")
|
81 |
content_text("""
|
82 |
-
These techniques are already more than enough to cover 1000x slower communication
|
83 |
and choose which techniques to use. In this demo, we use parameter sharing to reduce the number of parameters by
|
84 |
roughly 12x. If you don’t want parameter sharing, you can instead use more advanced gradient compression or larger batches.
|
85 |
""")
|
86 |
|
87 |
-
content_title("How do I join?")
|
88 |
-
|
89 |
-
content_text(f"""
|
90 |
-
That's easy. First, make sure you're logged in at Hugging Face. If you don't have an account, create one {cite("here", "https://huggingface.co/join")}.<br>
|
91 |
-
|
92 |
-
<ul style="text-align: left; list-style-position: inside; margin-top: 12px; margin-left: -24px;">
|
93 |
-
|
94 |
-
|
95 |
-
|
96 |
-
|
97 |
-
|
98 |
-
|
99 |
-
|
100 |
-
|
101 |
-
</ul>
|
102 |
-
|
103 |
-
Please note that we currently limit the number of colab participants to <b>TODO</b> to make sure we do not interfere
|
104 |
-
with other users. If there are too many active peers, take a look at alternative starter kits here <b>TODO</b>
|
105 |
-
""")
|
106 |
-
|
107 |
-
content_title("How does
|
108 |
-
content_text("
|
109 |
-
"consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim"
|
110 |
-
" ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. "
|
111 |
-
"Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. "
|
112 |
-
"Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.")
|
113 |
|
114 |
make_tabs()
|
115 |
|
|
|
11 |
|
12 |
st.set_page_config(page_title="Training Transformers Together", layout="centered")
|
13 |
|
14 |
+
st.markdown("## Full demo will be posted here on December 7th!")
|
|
|
15 |
|
16 |
make_header()
|
17 |
|
|
|
78 |
</tbody></table>
|
79 |
""")
|
80 |
content_text("""
|
81 |
+
These techniques are already more than enough to cover 1000x slower communication.
|
82 |
and choose which techniques to use. In this demo, we use parameter sharing to reduce the number of parameters by
|
83 |
roughly 12x. If you don’t want parameter sharing, you can instead use more advanced gradient compression or larger batches.
|
84 |
""")
|
85 |
|
86 |
+
# content_title("How do I join?")
|
87 |
+
|
88 |
+
# content_text(f"""
|
89 |
+
# That's easy. First, make sure you're logged in at Hugging Face. If you don't have an account, create one {cite("here", "https://huggingface.co/join")}.<br>
|
90 |
+
#
|
91 |
+
# <ul style="text-align: left; list-style-position: inside; margin-top: 12px; margin-left: -24px;">
|
92 |
+
# <li style="margin-top: 4px;">
|
93 |
+
# Join our organization on Hugging Face here: <b>TODO</b>. </li>
|
94 |
+
# <li style="margin-top: 4px;">
|
95 |
+
# The simplest way to start is with colab <b>TODO</b>;</li>
|
96 |
+
# <li style="margin-top: 4px;">
|
97 |
+
# You can find other starter kits, evaluation and inference notebooks <b>TODO IN OUR ORGANIZATION</b>;</li>
|
98 |
+
# <li style="margin-top: 4px;">
|
99 |
+
# If you have any issues, <b>TODO DISCORD BADGE</b> </li>
|
100 |
+
# </ul>
|
101 |
+
#
|
102 |
+
# Please note that we currently limit the number of colab participants to <b>TODO</b> to make sure we do not interfere
|
103 |
+
# with other users. If there are too many active peers, take a look at alternative starter kits here <b>TODO</b>
|
104 |
+
# """)
|
105 |
+
|
106 |
+
content_title("How does collaborative training work?")
|
107 |
+
content_text("In order to train a model this way, you need to s")
|
|
|
|
|
|
|
|
|
108 |
|
109 |
make_tabs()
|
110 |
|