Hypernerf Practice

Huggingface Link

This README contains overview on applyiing several custom scenes to reproduce the hypernerf project.

  • hand
  • chess
  • laptop
  • dvd
  • tomato-mark

hand

most successful one, trained intensively, I cropped out wobbly artifacts from top

interpolation:
Image 1
novelview:
Image 2

PSNR:
coarse metrics: metric/psnr≈31.7468
fine metrics: metric/psnr≈32.5462

chess

minimal movement, trained intensively, lighting was varying a lot during capturing, causing flickering

interpolation:
Image 7
novelview:
Image 8

PSNR:
coarse metrics: metric/psnr≈28.4936
fine metrics: metric/psnr≈30.5115

laptop

trained intensively, the thin screen edge failed, far field not so great. more wobbly artifacts, I assume caused by either camera registration error or hypernerf's natural artifact.

interpolation:
Image 3
novelview:
Image 6

PSNR:
coarse metrics: metric/psnr≈23.8846
fine metrics: metric/psnr≈25.1817

dvd

the floating dvd logo: not so great, raw capture is not well set. too short, and "time" has been "associated" with viewing angle by the model.

novelview: Image 4

PSNR:
coarse metrics: metric/psnr≈27.1150
fine metrics: metric/psnr≈28.6814

tomato-mark

wobbly artifacts, I assume caused by either camera registration error or hypernerf's natural artifact. This is present in the hand scene and laptop scene as well

interpolation:
Image 5
PSNR:
coarse metrics: metric/psnr≈27.5819
fine metrics: metric/psnr≈27.9282

The Wobbly artifact mentioned earlier:
Image 9

reproduction steps

Due to deprecation, the hypernerf project doesn't work out of the box.
I had to modify dependencies, then minor changes at rendering part.
For this reproduction, I only used the notebooks.
The provided instructions below have been tested to work.
Click to reproduction steps

Dataset&checkpoint Download:

All in one:
https://huggingface.co/datasets/xieyizheng/hypernerf_custom_scenes/resolve/main/custom_scenes_all.zip

Separately:
https://huggingface.co/datasets/xieyizheng/hypernerf_custom_scenes/tree/main

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.