Spaces:
Running
on
Zero
Running
on
Zero
Xiangjun Gao
commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,7 @@ arXiv preprint, 2024
|
|
| 26 |
</div>
|
| 27 |
|
| 28 |
## π Introduction
|
|
|
|
| 29 |
- [24-9-25] π€π€π€ Add huggingface online demo [DepthCrafter](https://huggingface.co/spaces/tencent/DepthCrafter).
|
| 30 |
- [24-9-19] Add scripts for preparing benchmark datasets.
|
| 31 |
- [24-9-18] Add point cloud sequence visualization.
|
|
@@ -83,7 +84,7 @@ gradio app.py
|
|
| 83 |
```
|
| 84 |
|
| 85 |
|
| 86 |
-
#### 2. Low-resolution inference
|
| 87 |
|
| 88 |
- Full inference (~2.3 fps on A100):
|
| 89 |
|
|
@@ -96,7 +97,21 @@ gradio app.py
|
|
| 96 |
python run.py --video-path examples/example_01.mp4 --max-res 512 --num-inference-steps 4 --guidance-scale 1.0
|
| 97 |
```
|
| 98 |
|
| 99 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 100 |
|
| 101 |
## π€ Contributing
|
| 102 |
- Welcome to open issues and pull requests.
|
|
|
|
| 26 |
</div>
|
| 27 |
|
| 28 |
## π Introduction
|
| 29 |
+
- [24-9-28] Add full dataset inference and evaluation scripts for better comparison use. :-)
|
| 30 |
- [24-9-25] π€π€π€ Add huggingface online demo [DepthCrafter](https://huggingface.co/spaces/tencent/DepthCrafter).
|
| 31 |
- [24-9-19] Add scripts for preparing benchmark datasets.
|
| 32 |
- [24-9-18] Add point cloud sequence visualization.
|
|
|
|
| 84 |
```
|
| 85 |
|
| 86 |
|
| 87 |
+
#### 2. Low-resolution inference requires a GPU with ~9GB memory for 512x256 resolution:
|
| 88 |
|
| 89 |
- Full inference (~2.3 fps on A100):
|
| 90 |
|
|
|
|
| 97 |
python run.py --video-path examples/example_01.mp4 --max-res 512 --num-inference-steps 4 --guidance-scale 1.0
|
| 98 |
```
|
| 99 |
|
| 100 |
+
## π Dataset Evaluation
|
| 101 |
+
Please check the `benchmark` folder.
|
| 102 |
+
- To create the dataset we use in the paper, you need to run `dataset_extract/dataset_extract_${dataset_name}.py`.
|
| 103 |
+
- Then you will get the `csv` files that save the relative root of extracted RGB video and depth npz files. We also provide these csv files.
|
| 104 |
+
- Inference for all datasets scripts:
|
| 105 |
+
```bash
|
| 106 |
+
bash benchmark/infer/infer.sh
|
| 107 |
+
```
|
| 108 |
+
(Remember to replace the `input_rgb_root` and `saved_root` with your own path.)
|
| 109 |
+
- Evaluation for all datasets scripts:
|
| 110 |
+
```bash
|
| 111 |
+
bash benchmark/eval/eval.sh
|
| 112 |
+
```
|
| 113 |
+
(Remember to replace the `pred_disp_root` and `gt_disp_root` with your own path.)
|
| 114 |
+
####
|
| 115 |
|
| 116 |
## π€ Contributing
|
| 117 |
- Welcome to open issues and pull requests.
|