Commit
·
802f6fb
1
Parent(s):
7f39788
Update README.md
Browse files
README.md
CHANGED
@@ -1,14 +1,82 @@
|
|
1 |
# Hypernerf Practice
|
2 |
|
3 |
-
This README contains overview on applyiing
|
4 |
- hand
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |

|
|
|
6 |

|
7 |
|
8 |
PSNR: <br>
|
9 |
coarse metrics: metric/psnr≈31.7468 <br>
|
10 |
fine metrics: metric/psnr≈32.5462
|
11 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
|
13 |
|
14 |
---
|
|
|
1 |
# Hypernerf Practice
|
2 |
|
3 |
+
This README contains overview on applyiing several custom scenes to reproduce the hypernerf project.
|
4 |
- hand
|
5 |
+
- dvd
|
6 |
+
- tomato-mark
|
7 |
+
|
8 |
+
|
9 |
+
## hand
|
10 |
+
|
11 |
+
most successful one, trained extensively on V100
|
12 |
+
|
13 |
+
### interpolation:
|
14 |

|
15 |
+
### novelview:
|
16 |

|
17 |
|
18 |
PSNR: <br>
|
19 |
coarse metrics: metric/psnr≈31.7468 <br>
|
20 |
fine metrics: metric/psnr≈32.5462
|
21 |
|
22 |
+
## dvd
|
23 |
+
|
24 |
+
not so great
|
25 |
+
|
26 |
+
### interpolation & novelview:
|
27 |
+

|
28 |
+
|
29 |
+
PSNR: <br>
|
30 |
+
coarse metrics: metric/psnr≈ <br>
|
31 |
+
fine metrics: metric/psnr≈
|
32 |
+
|
33 |
+
## tomato-mark
|
34 |
+
|
35 |
+
more artifacts
|
36 |
+
|
37 |
+

|
38 |
+
PSNR: <br>
|
39 |
+
coarse metrics: metric/psnr≈ <br>
|
40 |
+
fine metrics: metric/psnr≈
|
41 |
+
|
42 |
+
# reproduction steps
|
43 |
+
|
44 |
+
Due to deprecation, the hypernerf project doesn't work out of the box. <br>
|
45 |
+
We need code modifications to the environments, dependencies set up and rendering part. <br>
|
46 |
+
For this reproduction, I only used the notebooks. <br>
|
47 |
+
The provided instructions below are guaranteed to work.
|
48 |
+
|
49 |
+
## before getting started
|
50 |
+
|
51 |
+
Python 3.8 and Python 3.9 has been tested to work flawlessly. Python 3.10 will fail.
|
52 |
+
|
53 |
+
### Colab
|
54 |
+
|
55 |
+
Important Information: in May 2023, colab is updated to python 3.10, in order for this reproduction to work, select tools- command palatte - use fallback runtime.
|
56 |
+
This will change the runtime back to python 3.9. <br>
|
57 |
+
The fallback runtime is supported until mid May 2023, after that, we could only use other tricks to change the colab python version. <br>
|
58 |
+
Colab TPU doesnot work here anymore, GPU runs flawlessly.
|
59 |
+
|
60 |
+
|
61 |
+
### local machine
|
62 |
+
|
63 |
+
Start with python 3.8 or python 3.9
|
64 |
+
|
65 |
+
Install the following:
|
66 |
+
|
67 |
+
sudo apt-get install libilmbase-dev libopenexr-dev ffmpeg
|
68 |
+
|
69 |
+
Follow official colmap project to install with cuda support, or use default package manager to install colmap, but might only has cpu support.
|
70 |
+
|
71 |
+
Then install pip requirements:
|
72 |
+
|
73 |
+
wget https://raw.githubusercontent.com/xieyizheng/hypernerf/main/requirements.txt
|
74 |
+
pip install -r requirements.txt
|
75 |
+
|
76 |
+
With this, everything is set! The Processing, Training and Rendering notebooks should now work!
|
77 |
+
|
78 |
+
|
79 |
+
|
80 |
|
81 |
|
82 |
---
|