steffenc commited on
Commit
f842053
·
unverified ·
1 Parent(s): 2ebef64

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -10,14 +10,14 @@ Repo contents:
10
  1. [openvalidators](#validators) dashboard
11
  2. [openmetagraph](#metagraph) dashboard
12
 
13
- # Design Overview
14
 
15
  Both the constantly growing bittensor [blockchain](https://polkadot.js.org/apps/#/chainstate) and the openvalidators [community wandb project](https://wandb.ai/opentensor-dev/openvalidators?workspace=default) produce many GB per day. Storing, analyzing and visualizing such a large volume of data can be challenging, and in acknowledgement of this fact there are ongoing developments to the repo in the following way, which aligns with typical use-cases while remaining within reasonable data limits and performance expectations.
16
 
17
  - Recent data (24-48 hours) is stored in high resolution (raw) format. This is suitable for full introspection.
18
  - Historical data (30-90 days) is stored in low resolution (aggregated) format. This is suitable for high-level trend analysis.
19
 
20
- # Getting Started
21
 
22
  To install:
23
  ```
@@ -35,19 +35,20 @@ Alternatively, you can [deploy the app for free on streamlit](https://blog.strea
35
  This repo contains a streamlit [dashboard]([url](https://opendashboard-v110.streamlit.app/)) which can be used to inspect and analyze the live network. It works by pulling validator data from [wandb](https://wandb.ai/opentensor-dev/openvalidators?workspace=default) and using this data for **metric tracking** and **interactive data visualizations**.
36
 
37
  ## Screenshots
 
38
  ------
39
- *Overview metrics and run selection*
40
  ![Screenshot 2023-07-27 at 13 29 46](https://github.com/opentensor/dashboards/assets/6709103/f54b963e-b0c7-4333-be8c-800743ecf220)
41
 
42
 
43
  ------
44
- *UID health*
45
  ![Screenshot 2023-07-27 at 13 37 13](https://github.com/opentensor/dashboards/assets/6709103/e5b230f2-a21d-4e3e-9767-c787ec06944a)
46
 
47
  ![Screenshot 2023-07-27 at 13 37 18](https://github.com/opentensor/dashboards/assets/6709103/3b8cfe30-14a6-4493-adda-41c4f82c1025)
48
 
49
  ------
50
- *Completions*
51
  ![Screenshot 2023-07-27 at 13 38 19](https://github.com/opentensor/dashboards/assets/6709103/fa7f8f60-425e-4963-98a7-f8bd3641c3dc)
52
 
53
  ![Screenshot 2023-07-27 at 13 39 01](https://github.com/opentensor/dashboards/assets/6709103/968253ad-b869-46c7-adef-bdefc5ccfc33)
 
10
  1. [openvalidators](#validators) dashboard
11
  2. [openmetagraph](#metagraph) dashboard
12
 
13
+ ## Design Overview
14
 
15
  Both the constantly growing bittensor [blockchain](https://polkadot.js.org/apps/#/chainstate) and the openvalidators [community wandb project](https://wandb.ai/opentensor-dev/openvalidators?workspace=default) produce many GB per day. Storing, analyzing and visualizing such a large volume of data can be challenging, and in acknowledgement of this fact there are ongoing developments to the repo in the following way, which aligns with typical use-cases while remaining within reasonable data limits and performance expectations.
16
 
17
  - Recent data (24-48 hours) is stored in high resolution (raw) format. This is suitable for full introspection.
18
  - Historical data (30-90 days) is stored in low resolution (aggregated) format. This is suitable for high-level trend analysis.
19
 
20
+ ## Getting Started
21
 
22
  To install:
23
  ```
 
35
  This repo contains a streamlit [dashboard]([url](https://opendashboard-v110.streamlit.app/)) which can be used to inspect and analyze the live network. It works by pulling validator data from [wandb](https://wandb.ai/opentensor-dev/openvalidators?workspace=default) and using this data for **metric tracking** and **interactive data visualizations**.
36
 
37
  ## Screenshots
38
+
39
  ------
40
+ *Overview metrics and run selection* - Total participants and contributed knowledge are displayed as metrics at the top of the app. This shows the total dataset size and growth rate. By selecting one or more runs from the table, the app will download the respective source data from wandb or load from local storage.
41
  ![Screenshot 2023-07-27 at 13 29 46](https://github.com/opentensor/dashboards/assets/6709103/f54b963e-b0c7-4333-be8c-800743ecf220)
42
 
43
 
44
  ------
45
+ *UID health* - One or more UIDs can be inspected in terms of their succesful response rate, diversity of responses and uniqueness within the network. Leaderboards of top-performing UIDs are also included.
46
  ![Screenshot 2023-07-27 at 13 37 13](https://github.com/opentensor/dashboards/assets/6709103/e5b230f2-a21d-4e3e-9767-c787ec06944a)
47
 
48
  ![Screenshot 2023-07-27 at 13 37 18](https://github.com/opentensor/dashboards/assets/6709103/3b8cfe30-14a6-4493-adda-41c4f82c1025)
49
 
50
  ------
51
+ *Completions* - Individual completions can be analyzed. Leaderboards can be viewed based on rate or reward, and completion length-and-time statistics are shown. Taken together, these figures allow the reward mechanism to be better understood.
52
  ![Screenshot 2023-07-27 at 13 38 19](https://github.com/opentensor/dashboards/assets/6709103/fa7f8f60-425e-4963-98a7-f8bd3641c3dc)
53
 
54
  ![Screenshot 2023-07-27 at 13 39 01](https://github.com/opentensor/dashboards/assets/6709103/968253ad-b869-46c7-adef-bdefc5ccfc33)