With virtual reality, digital painting on 2D canvases is now being extended to 3D spaces. Tilt Brush and Oculus Quill are widely accepted among artists as tools that pave the way to a new form of art - 3D emmersive painting. Current 3D painting systems are only a start, emitting textured triangular geometries. In this paper, we advance this new art of 3D painting to 3D volumetric painting that enables an artist to draw a huge scene with full control of spatial color fields. Inspired by the fact that 2D paintings often use vast space to paint background and small but detailed space for foreground, we claim that supporting a large canvas in varying detail is essential for 3D painting. In order to help artists focus and audiences to navigate the large canvas space, we provide small artist-defined areas, called rooms, that serve as beacons for artist-suggested scales, spaces, locations for intended appreciation view of the painting. Artists and audiences can easily transport themselves between different rooms. Technically, our canvas is represented as an array of deep octrees of depth 24 or higher, built on CPU for volume painting and on GPU for volume rendering using accurate ray casting. In CPU side, we design an efficient iterative algorithm to refine or coarsen octree, as a result of volumetric painting strokes, at highly interactive rates, and update the corresponding GPU textures. Then we use GPU-based ray casting algorithms to render the volumetric painting result. We explore precision issues stemming from ray-casting the octree of high depth, and provide a new analysis and verification. From our experimental results as well as the positive feedback from the participating artists, we strongly believe that our new 3D volume painting system can open up a new possibility for VR-driven digital art medium to professional artists as well as to novice users.
@cite_17: CavePainting is an artistic medium that uses a 3D analog of 2D brush strokes to create 3D works of art in a fully immersive Cave environment. Physical props and gestures are used to provide an intuitive interface for artists who may not be familiar with virtual reality. The system is designed to take advantage of the 8 ft. x 8 ft. x 8 ft. space in which the artist works. CavePainting enables the artist to create a new type of art and provides a novel approach to viewing this art after it has been created. In this paper, we describe CavePainting’s 3D brush strokes, color pickers, artwork viewing mode, and interface. We also present several works of art created using the system along with feedback from artists. Artists are excited about this form of art and the gestural, full-body experience of creating it. CR Categories and Subject Descriptors: I.3.6 [Computer Graphics]: Methodology and Techniques - Interaction Techniques; I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism Virtual Reality; J.5 [Arts and Humanities]: Fine Arts Additional Key Words: 3D painting, 3D modeling, gestures, tangible user interface, Cave
With the advent of modern VR systems, it become very natural to extend 2D painting to 3D space; beginning with @cite_17 's work, VR painting systems such as Tilt Brush http: www.tiltbrush.com and Quill http: storystudio.oculus.com lead a new trend for 3D painting and modeling. All these systems render quad strips as a result of painting strokes, thus have a difficulty in representing volumetric objects. Furthermore, voxel-based modeling or painting such as Oculus Medium http: www.oculus.com medium or High Fidelity http: highfidelity.io were introduced. However, due to the space and time complexity of uniform grid, they support only limited canvas spaces and also limited detail.