Jack Monas
commited on
Commit
·
3294042
1
Parent(s):
3175ea5
gif
Browse files
app.py
CHANGED
@@ -293,13 +293,26 @@ def main():
|
|
293 |
st.markdown("---")
|
294 |
|
295 |
st.markdown("## FAQs")
|
296 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
297 |
display_faq("Do I have to participate in all challenges?",
|
298 |
"No, you may choose to participate in one or more challenges. However, participating in multiple challenges may improve your overall ranking.")
|
299 |
-
|
300 |
display_faq("Can I work in a team?",
|
301 |
"Yes, team submissions are welcome.")
|
302 |
-
|
303 |
display_faq("What are the submission deadlines?",
|
304 |
"Deadlines for challenges soon to be announced.")
|
305 |
|
|
|
293 |
st.markdown("---")
|
294 |
|
295 |
st.markdown("## FAQs")
|
296 |
+
display_faq("What preprocessing steps are applied to the raw data, and can we apply our own?",
|
297 |
+
"The raw data in the `world_model_raw_data` dataset includes unprocessed 512x512 MP4 video logs as collected from the EVE Android. No additional preprocessing (e.g., normalization, augmentation) is applied. You are free to apply your own preprocessing techniques—such as frame resizing, color normalization, etc.")
|
298 |
+
display_faq("How is the Cosmos tokenizer used in the Tokenized Data dataset, and can we use a different tokenizer?",
|
299 |
+
"The `world_model_tokenized_data dataset` uses NVIDIA’s Discrete Video 8x8x8 Cosmos Tokenizer to convert raw 256x256 video into compact tokens. For the Compression Challenge, this tokenizer is mandatory for a consistent benchmark. Alternative tokenizers are permitted for the Sampling and Evaluation Challenges")
|
300 |
+
display_faq("What metrics are used to evaluate the Sampling Challenge submissions?",
|
301 |
+
"Submissions are evaluated by comparing the predicted frame (2 seconds ahead) to the ground-truth frame using Peak Signal-to-Noise Ratio (PSNR).")
|
302 |
+
display_faq("Can we use generative models like diffusion models or GANs for the Sampling Challenge?",
|
303 |
+
"Yes, you are welcome to use generative models such as diffusion models, GANs, or autoregressive approaches for the Sampling Challenge, as long as they adhere to the rules (e.g., no use of actual future frames during inference). The challenge evaluates the quality of the predicted frame, not the method used, so feel free to experiment with cutting-edge techniques to achieve plausible and accurate predictions.")
|
304 |
+
display_faq("How are policies provided in the Evaluation Challenge, and what does ‘ranking’ entail?",
|
305 |
+
"In the Evaluation Challenge, policies are provided as pre-trained models for a specific task (More to come soon). Your task is to predict and rank these policies (e.g., Policy A > Policy B > Policy C) based on their expected success rate or efficiency in the real world. Your ranking is scored against the ground-truth ranking derived from physical deployments.")
|
306 |
+
display_faq("Are there constraints on model size or computational resources for submissions?",
|
307 |
+
"There are no strict limits on model size, parameter count, or inference time for any challenge.")
|
308 |
+
display_faq("Can we fine-tune pre-trained models, and how do we disclose this in our submission?",
|
309 |
+
"Yes, fine-tuning pre-trained models is allowed as long as they are publicly available (e.g., from Hugging Face, GitHub, or academic repositories) and not trained on private datasets. ")
|
310 |
+
display_faq("What happens if my Compression Challenge model achieves a loss below 8.0 with MAGVIT after March 1st?",
|
311 |
+
"If you submit a Compression Challenge solution using the MAGVIT tokenizer and achieve a loss below 8.0 on our held-out test set, you remain eligible for the original $10K award until August 31, 2025 (six months from March 1st). However, this submission will not qualify for the CVPR/ICCV leaderboard, which uses the Cosmos tokenizer as the new standard.")
|
312 |
display_faq("Do I have to participate in all challenges?",
|
313 |
"No, you may choose to participate in one or more challenges. However, participating in multiple challenges may improve your overall ranking.")
|
|
|
314 |
display_faq("Can I work in a team?",
|
315 |
"Yes, team submissions are welcome.")
|
|
|
316 |
display_faq("What are the submission deadlines?",
|
317 |
"Deadlines for challenges soon to be announced.")
|
318 |
|