robot-bengali-2 commited on
Commit
8afcfb2
·
1 Parent(s): 027865c
Files changed (1) hide show
  1. app.py +4 -3
app.py CHANGED
@@ -78,9 +78,10 @@ This may seem daunting at first, but in reality, DL researchers have already mad
78
  </tbody></table>
79
  """)
80
  content_text("""
81
- These techniques are already more than enough to cover 1000x slower communication.
82
- and choose which techniques to use. In this demo, we use parameter sharing to reduce the number of parameters by
83
- roughly 12x. If you don’t want parameter sharing, you can instead use more advanced gradient compression or larger batches.
 
84
  """)
85
 
86
  content_title("How do I join?")
 
78
  </tbody></table>
79
  """)
80
  content_text("""
81
+ These techniques are already more than enough to cover 1000x slower communication (48 times over!).
82
+ This means that in practice you can pick and choose choose which of them you want in your training run.
83
+ For this demo, we use 8x larger batches, 4x compression, 12x parameter sharing and partial overlapping.
84
+ If you don’t want parameter sharing, you can trade it for more advanced gradient compression or larger batches.
85
  """)
86
 
87
  content_title("How do I join?")