Jack Monas commited on
Commit
bc53ed2
·
1 Parent(s): 0b37704
Files changed (1) hide show
  1. app.py +38 -38
app.py CHANGED
@@ -347,51 +347,51 @@ def main():
347
 
348
  st.markdown("## FAQs")
349
 
350
- st.markdown("**How should I preprocess the dataset?**")
351
- st.write(
352
- "The raw data in the `world_model_raw_data` dataset is provided as-is, with no additional preprocessing. "
353
- "You are free to apply your own steps—such as resizing, normalization, or augmentation—but please document all preprocessing methods in your technical report."
354
- )
355
 
356
- st.markdown("**What output format is expected for predictions?**")
357
- st.write(
358
- "For the Sampling Challenge, your model should output a predicted video frame in RGB format at a resolution of 512×512 pixels. "
359
- "For the Evaluation Challenge, you should submit a ranked list of the provided policies based on their expected real-world performance."
360
- )
361
 
362
- st.markdown("**What evaluation metrics will be used?**")
363
- st.write(
364
- "The Compression Challenge is evaluated by the model's loss (e.g., cross-entropy or mean squared error). "
365
- "The Sampling Challenge will use image quality metrics like PSNR and SSIM, while the Evaluation Challenge is assessed by comparing your ranking "
366
- "against the ground-truth ranking using correlation metrics such as Spearman's rho."
367
- )
368
 
369
- st.markdown("**Are there restrictions on using future frames or actions?**")
370
- st.write(
371
- "You are allowed to use future actions to condition your frame predictions, but you must not use any actual future frames during inference."
372
- )
373
 
374
- st.markdown("**Can I modify the baseline models?**")
375
- st.write(
376
- "Yes, you are encouraged to enhance the provided baseline models. However, any modifications must be thoroughly documented in your technical report, "
377
- "and your final submission must be fully reproducible."
378
- )
379
 
380
- st.markdown("**How do I ensure my submission is reproducible?**")
381
- st.write(
382
- "Include complete code, configuration files, and clear instructions for running your model. Non-reproducible submissions may be disqualified."
383
- )
384
 
385
- st.markdown("**Is there a limit on model size or inference time?**")
386
- st.write(
387
- "There are no strict limits on model size or inference time, but solutions will be evaluated on both performance and efficiency."
388
- )
389
 
390
- st.markdown("**What if I submit a Compression Challenge solution using the old tokenizer?**")
391
- st.write(
392
- "Solutions using the MAGVIT tokenizer that achieve a loss below 8.0 on our held-out test set will continue to be honored for the $10K award "
393
- "for six months from March 1, 2025. However, these submissions will not be eligible for the CVPR/ICCV competitions, which will use the Cosmos tokenizer as the standard."
394
- )
395
 
396
 
397
  st.markdown("---")
 
347
 
348
  st.markdown("## FAQs")
349
 
350
+ with st.expander("How should I preprocess the dataset?"):
351
+ st.write(
352
+ "The raw data in the `world_model_raw_data` dataset is provided as-is, with no additional preprocessing. "
353
+ "You are free to apply your own steps—such as resizing, normalization, or augmentation—but please document all preprocessing methods in your technical report."
354
+ )
355
 
356
+ with st.expander("What output format is expected for predictions?"):
357
+ st.write(
358
+ "For the Sampling Challenge, your model should output a predicted video frame in RGB format at a resolution of 512×512 pixels. "
359
+ "For the Evaluation Challenge, you should submit a ranked list of the provided policies based on their expected real-world performance."
360
+ )
361
 
362
+ with st.expander("What evaluation metrics will be used?"):
363
+ st.write(
364
+ "The Compression Challenge is evaluated by the model's loss (e.g., cross-entropy or mean squared error). "
365
+ "The Sampling Challenge will use image quality metrics like PSNR and SSIM, while the Evaluation Challenge is assessed by comparing your ranking "
366
+ "against the ground-truth ranking using correlation metrics such as Spearman's rho."
367
+ )
368
 
369
+ with st.expander("Are there restrictions on using future frames or actions?"):
370
+ st.write(
371
+ "You are allowed to use future actions to condition your frame predictions, but you must not use any actual future frames during inference."
372
+ )
373
 
374
+ with st.expander("Can I modify the baseline models?"):
375
+ st.write(
376
+ "Yes, you are encouraged to enhance the provided baseline models. However, any modifications must be thoroughly documented in your technical report, "
377
+ "and your final submission must be fully reproducible."
378
+ )
379
 
380
+ with st.expander("How do I ensure my submission is reproducible?"):
381
+ st.write(
382
+ "Include complete code, configuration files, and clear instructions for running your model. Non-reproducible submissions may be disqualified."
383
+ )
384
 
385
+ with st.expander("Is there a limit on model size or inference time?"):
386
+ st.write(
387
+ "There are no strict limits on model size or inference time, but solutions will be evaluated on both performance and efficiency."
388
+ )
389
 
390
+ with st.expander("What if I submit a Compression Challenge solution using the old tokenizer?"):
391
+ st.write(
392
+ "Solutions using the MAGVIT tokenizer that achieve a loss below 8.0 on our held-out test set will continue to be honored for the $10K award "
393
+ "for six months from March 1, 2025. However, these submissions will not be eligible for the CVPR/ICCV competitions, which will use the Cosmos tokenizer as the standard."
394
+ )
395
 
396
 
397
  st.markdown("---")