MINGYISU commited on
Commit
0702221
·
verified ·
1 Parent(s): 5d787c9

Update utils.py

Browse files
Files changed (1) hide show
  1. utils.py +6 -3
utils.py CHANGED
@@ -113,9 +113,12 @@ SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction
113
  }
114
  }
115
  ```
116
- ## ⚠️ To submit, create a pull request and upload the generated JSON file to the ***scores*** folder, then inform us on [our discord server](https://discord.gg/njyKubdtry), or send us an email at [email protected], including your model's information.
117
- ## ⚠️ NEW Requirements!!! Please leave a simple message (simply @ us) in the PR to indicate that you are ready to merge your PR. We will not merge your PR without doing so since we might think you are still editing and not yet ready to merge.
118
- We will review your submission and update the leaderboard accordingly. \n
 
 
 
119
  We highly recommend joining our [discord server](https://discord.gg/njyKubdtry), which provides a convenient way to stay informed with latest updates, or share any feedback you have for improving the leaderboard experience. We appreciate your contributions to the MMEB community!
120
  """
121
 
 
113
  }
114
  }
115
  ```
116
+ ## ⚠️ To submit, create a pull request and upload the generated JSON file to the ***scores*** folder, then inform us on [our discord server](https://discord.gg/njyKubdtry), or send us an email at [email protected], including your model's information.\n
117
+ Please email us or leave a simple message (simply @ us) in the PR to indicate that you are ready to merge your PR. We will not merge your PR without informing us since we might think you are still editing and not yet ready to merge.
118
+ We will review your submission and update the leaderboard accordingly. \n\n
119
+ ## Special Instructions for submitting to MMEB Image (Previously MMEB-V1) Leaderboard
120
+ We understand that some researchers want to exclusively submit to the Image leaderboard. To do so, just run the 36 image datasets only and simply ignore the other datasets. The leaderboard will automatically assign a 0 to the missing datasets.
121
+ We might be able to hide your model from the other leaderboards in the next leaderboard updates, but for now your model might have a lower rank on the overall leaderboard.
122
  We highly recommend joining our [discord server](https://discord.gg/njyKubdtry), which provides a convenient way to stay informed with latest updates, or share any feedback you have for improving the leaderboard experience. We appreciate your contributions to the MMEB community!
123
  """
124