Jack Monas
rules
0291335
raw
history blame
4.89 kB
import streamlit as st
def main():
st.set_page_config(page_title="World Model Challenge")
st.title("World Model Challenge")
st.markdown("### Welcome")
st.write(
"Welcome to the World Model Challenge server. This platform hosts three challenges "
"designed to advance research in world models for robotics: Compression, Sampling, and Evaluation."
)
st.markdown("### Motivation")
st.write(
"Real-world robotics faces a fundamental challenge: environments are dynamic and change over time, "
"making consistent evaluation of robot performance difficult. World models offer a solution by "
"learning to simulate complex real-world interactions from raw sensor data. We believe these learned simulators will enable "
"robust evaluation and iterative improvement of robot policies without the constraints of a physical testbed."
)
st.markdown("### The Challenges")
st.markdown("#### Compression Challenge")
st.write(
"In the Compression Challenge, your task is to train a model to compress our robots logs effectively while preserving the critical details needed to understand and predict future interactions. Success in this challenge is measured by the loss of your model—the lower the loss, the better your model captures the complexities of real-world robot behavior."
)
st.markdown("#### Sampling Challenge")
st.write(
"In the Sampling Challenge, your task is to predict a future video frame two seconds in the future given a short clip of robot interactions. The goal is to produce a coherent and plausible continuation of the video, which accurately reflects the dynamics of the scene. Your submission will be judged on how closely it matches the actual frame."
)
st.markdown("#### Evaluation Challenge")
st.write(
"The Evaluation Challenge tackles the ultimate question: Can you predict a robot's performance in the real world without physically deploying it? In this challenge, you will be provided with many different policies for a specific task. Your task is to rank these policies according to their expected real-world performance. This ranking will be compared with the actual ranking of the policies."
)
st.markdown("### Datasets")
st.write(
)
st.markdown("### Scoring")
st.write(
"Our scoring system rewards strong performance across all challenges, with extra weight given to the Evaluation Challenge. "
"The breakdown is as follows:\n\n"
"**Compression Challenge**\n"
"- 1st Place: 10 points\n"
"- 2nd Place: 7 points\n"
"- 3rd Place: 5 points\n\n"
"**Sampling Challenge**\n"
"- 1st Place: 10 points\n"
"- 2nd Place: 7 points\n"
"- 3rd Place: 5 points\n\n"
"**Evaluation Challenge**\n"
"- 1st Place: 20 points\n"
"- 2nd Place: 14 points\n"
"- 3rd Place: 10 points\n\n"
"The overall winner will be the team with the highest total points. In the event of a tie, the following tie-breakers will be applied in order:\n\n"
"1. Highest Evaluation Challenge score\n"
"2. Highest Sampling Challenge score\n\n"
)
st.markdown("### Rules")
st.write(
"We recognize that many submissions may not progress through all three challenges. To account for this, we have implemented a points-based system. "
"Points will be allocated based on placements in the Compression, Sampling, and Evaluation challenges. The overall winner is determined by the total points earned. "
"Detailed rules, including point weightings and submission guidelines, will be provided. All participants are expected to adhere to our code of conduct."
)
st.markdown("### Already Started Working on These Challenges?")
st.write(
"If you've already begun work on any of the challenges, we encourage you to share your progress with the community. "
"Connect with other participants via our Discord channel or GitHub repository to exchange ideas, get feedback, and collaborate."
)
st.markdown("### FAQs")
st.write(
"**Do I have to do every task?** \n"
"No. You may choose to participate in one or more of the challenges. However, participating in multiple challenges could help you earn more points and improve your overall ranking.\n\n"
"**Can I work in a team?** \n"
"Yes, team submissions are welcome.\n\n"
"**What are the submission deadlines?** \n"
"Deadlines for each challenge will be announced on the website and through our official communications.\n\n"
"**Where can I find more information?** \n"
"Detailed guidelines, additional resources, and further FAQs are available on our website.\n\n"
"**Who do I contact if I have questions?** \n"
"Please reach out to our support team via the provided email or join our Discord community for assistance."
)
if __name__ == '__main__':
main()