I'm a researcher working at the intersection of computer graphics, computer vision, and human-computer interaction. My main area of interest is developing technologies to simplify the manipulation of digital media, especially digital video. I draw on techniques from computer vision to improve interaction modalities for video.
I am presently employed as a research scientist in the Google Daydream team in Seattle. I am also an affiliate associate professor of Computer Science and Engineering at the University of Washington. I pursued my graduate studies in the UW CSE graphics group from 2002 to 2007, working with David Salesin, Brian Curless and Steve Seitz, then worked as a principal scientist in the Creative Technologies Lab at Adobe until 2015. My thesis, completed in June 2007, developed novel visualization and interaction techniques for digital video manipulation. Additional research interests include computational photography, methods for geometry capture and synthesis, and crowdsourcing. I am also a veteran of the visual effects industry: I spent 12 years (on and off) working for ILM, and I am a proud member of the Visual Effects Society. I've also worked as an intern at Digital Domain and as a consultant for Electronic Arts.
Thanks to my unique combination of careers, my Erdős-Bacon number is at most 6. If you are either a) a co-author of Paul Erdős looking for a research collaborator, or b) Kevin Bacon's agent looking for a co-star: please contact me immediately. (Proof: B = 2 via Rose Byrne appearing in both Star Wars Episode II: Attack of the Clones and X-Men: First Class; E = 4, various paths, but most reliably via David Salesin, Leo Guibas, and Richard Pollack.) My academic genealogy includes Donald Knuth, David Hilbert, and Sophus Lie.
This video explains my thesis research in layman's terms. It was featured in the popular tech blogs Engadget and Crunchgear, made it to the front page of Digg and Reddit, and has been viewed 200,000 times. I also contributed to this video, which demonstrates our implementation of PatchMatch for image inpainting in Photoshop, and has been viewed almost 5 million times!
Ricardo Martin-Brualla, Rohit Pandey, Shuoran Yang, Pevel Pidlypenskyi, Jonathan Taylor, Julien Valentin, Sameh Khamis, Philip Davidson, Anastasia Tkach, Peter Lincoln, Adarsh Kowdle, Christoph Rhemann, Dan B Goldman, Cem Keskin, Steve Seitz, Shahram Izadi, and Sean Fanello. LookinGood: Enhancing Performance Capture with Real-time Neural Re-Rendering. In ACM Transactions on Graphics (Proc. SIGGRAPH Asia), December 2018.
Harris Nover, Supreeth Achar, and Dan B Goldman. ESPReSSo: Efficient Slanted PatchMatch for Realtime Spacetime Stereo. In Proc. 3DV, Int'l. Conf. on 3D Vision, September 2018.
Rachel A. Albert, Dorian Yao Chan, Dan B Goldman, and James F. Obrien. Approximate svBRDF Estimation from Mobile Phone Video. In EGSR '18, Proc. Eurographics Symposium on Rendering, 37, p. 12, July 2018.
Amy Pavel, Dan B Goldman, Björn Hartmann, and Maneesh Agrawala. VidCrit: Video-Based Asynchronous Video Review. In UIST '16, Proc. ACM symposium on User Interface Software and Technology, October 2016.
Ohad Fried, Eli Shechtman, Dan B Goldman, and Adam Finkelstein. Perspective-aware Manipulation of Portrait Photos. In ACM Transactions on Graphics (Proc. SIGGRAPH), July 2016.
Amy Pavel, Dan B Goldman, Björn Hartmann, and Maneesh Agrawala. SceneSkim: Searching And Browsing Movies Using Synchronized Captions, Scripts, and Plot Summaries. In UIST '15, Proc. ACM symposium on User Interface Software and Technology, November 2015.
Daniyar Turmukhambetov, Neill D. F. Campbell, Dan B Goldman, and Jan Kautz. Interactive Sketch-Driven Image Synthesis. Computer Graphics Forum, August 2015.
Ohad Fried, Eli Shechtman, Dan B Goldman, and Adam Finkelstein. Finding Distractors in Images. In Proc. of Computer Vision and Pattern Recognition 2015, June 2015.
Valkyrie Savage, Andrew Head, Björn Hartmann, Dan B Goldman, Gautham Mysore and Wilmot Li. Lamello: Passive Acoustic Sensing for Tangible Input Components. In Proc. CHI 2015, April 2015.
Nima Khademi Kalantari, Eli Shechtman, Soheil Darabi, Dan B Goldman, and Pradeep Sen. Improving Patch-Based Synthesis by Learning Patch Masks. In Proc. of the International Conference on Computational Photography 2014, May 2014.
Nima Khademi Kalantari, Eli Shechtman, Connelly Barnes, Soheil Darabi, Dan B Goldman, and Pradeep Sen. Patch-Based High Dynamic Range Video. In ACM Transactions on Graphics (Proc. SIGGRAPH), 32(6), November 2013.
Yoav HaCohen, Eli Shechtman, Dan B Goldman, and Dani Lischinski. Optimizing Color Consistency in Photo Collections. In ACM Transactions on Graphics (Proc. SIGGRAPH), 32(4), August 2013.
Dmitry Rudoy, Dan B Goldman, Eli Shechtman, and Lihi Zelnik-Manor. Learning Video Saliency from Human Gaze Using Candidate Selection. In Proceedings of CVPR 2013, 1147-1154, June 2013.
Pradeep Sen, Nima Khademi Kalantari, Maziar Yaesoubi, Soheil Darabi, Dan B Goldman, and Eli Shechtman. Robust Patch-Based HDR Reconstruction of Dynamic Scenes. In ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 31(6), December 2012.
Soheil Darabi, Eli Shechtman, Connelly Barnes, Dan B Goldman, and Pradeep Sen. Image Melding: Combining Inconsistent Images using Patch-Based Synthesis. In ACM Transactions on Graphics (Proc. SIGGRAPH), 31(4), August 2012.
Dmitry Rudoy, Dan B Goldman, Eli Shechtman, and Lihi Zelnik-Manor. Crowdsourcing Gaze Data Collection. In Proc. Collective Intelligence, April 2012.
Connelly Barnes, Dan B Goldman, Eli Shechtman, and Adam Finkelstein. The PatchMatch Randomized Matching Algorithm for Image Manipulation. Communications of the ACM, 54(11), pp. 103–110, November 2011.
Hao Du, Peter Henry, Xiaofeng Ren, Marvin Cheng, Dan B Goldman, Steven M. Seitz, and Dieter Fox. Interactive 3D Modeling of Indoor Environments with a Consumer Depth Camera. In UBICOMP, Proc. International Conference on Ubiquitous Computing, September 2011.
Hao Du, Dan B Goldman, and Steven M. Seitz. Binocular Photometric Stereo using Filter Flow. In BMVC '11, Proc. British Machine Vision Conference, August 2011.
Yoav HaCohen, Eli Shechtman, Dan B Goldman, and Dani Lischinski. Non-Rigid Dense Correspondence with Applications for Image Enhancement. In ACM Transactions on Graphics (Proc. SIGGRAPH), 30(4), August 2011.
Dan B Goldman. Vignette and Exposure Calibration and Compensation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(12), pp. 2276–2288, December 2010.
David E. Jacobs, Dan B Goldman, Eli Shechtman. Cosaliency: Where People Look When Comparing Images. In UIST '10, Proc. ACM symposium on User Interface Software and Technology, October 2010.
Connelly Barnes, Eli Shechtman, Dan B Goldman, Adam Finkelstein. The Generalized PatchMatch Correspondence Algorithm. In Proc. European Conference on Computer Vision, LNCS 6313, pp. 29–43, September 2010.
Connelly Barnes, Dan B Goldman, Eli Shechtman, Adam Finkelstein. Video Tapestries with Continuous Temporal Zoom. In ACM Transactions on Graphics (Proc. SIGGRAPH), 29(3), July 2010.
Connelly Barnes, Eli Shechtman, Adam Finkelstein, Dan B Goldman. Patchmatch: A Randomized Correspondence Algorithm for Structural Image Editing. In ACM Transactions on Graphics (Proc. SIGGRAPH), 28(3), August 2009.
Connelly Barnes, David E. Jacobs, Jason Sanders, Dan B Goldman, Szymon Rusinkiewicz, Adam Finkelstein, Maneesh Agrawala. Video Puppetry: A Performative Interface for Cutout Animation. In ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 27(5), December 2008.
Dan B Goldman, Chris Gonterman, Brian Curless, David Salesin, Steven M. Seitz. Video Annotation, Navigation, and Composition. In UIST '08, Proc. ACM symposium on User Interface Software and Technology, pp. 3–12, October 2008.
Sujit Kuthirummal, Aseem Agarwala, Dan B Goldman and Shree Nayar. Priors for Large Photo Collections and What they Reveal about Cameras. In Proc. European Conference on Computer Vision, LNCS 5305, pp. 74–87, October 2008.
Dan B Goldman, Brian Curless, Steve Seitz, David Salesin. Schematic Storyboarding for Video Visualization and Editing. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH 2006), Vol. 25, No. 3, pp. 862–871, July 2006.
Dan B Goldman and Jiun-Hung Chen. Vignette and Exposure Calibration and Compensation. In Proceedings of ICCV 2005, Beijing, October 2005, pp. 899–906.
Yung-Yu Chuang, Dan B Goldman, Ke Colin Zheng, Brian Curless, David H. Salesin, and Richard Szeliski. Animating Pictures with Stochastic Motion Textures. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH 2005), Vol. 24, No. 3, pp. 853–860, July 2005.
Yung-Yu Chuang, Dan B Goldman, Brian Curless, David H. Salesin, and Richard Szeliski. Shadow Matting and Compositing. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH 2003), Vol. 22, No. 3, pp. 494–500, July 2003.
Dan B Goldman, Fake Fur Rendering, In SIGGRAPH 97 Conference Proceedings, pp. 127–134, Los Angeles, 1997.
Daniel R. Goldman, A Framework for Video Annotation, Visualization, and Interaction. PhD Thesis, University of Washington, 2007.
Raymond Yeh, Ziwei Liu, Dan B Goldman, Aseem Agarwala. Semantic Facial Expression Editing Using Autoencoded Flow ArXiv, 2016.
Niels Joubert, Jane L. E, Dan B Goldman, Floraine Berthouzoz, Mike Roberts, James A. Landay, Pat Hanrahan. Towards a Drone Cinematographer: Guiding Quadrotor Cameras using Visual Composition Principles. ArXiv, 2016.
Jan Jachnik, Dan B Goldman, Linjie Luo, Andrew J. Davison. Interactive 3D Face Stylization Using Sculptural Abstraction. ArXiv, 2015.
Hao Du, Peter Henry, Xiaofeng Ren, Dieter Fox, Dan B Goldman, and Steven M. Seitz. Interactive Dense 3D Modeling of Indoor Environments. UW-CSE-11-02-02.
Dan B Goldman, Brian Curless, David Salesin, and Steven M. Seitz. Interactive Video Object Annotation. UW-CSE-2007-04-01.
Dan B Goldman. Viewpoint: Blockbusters and Blackboards. Communications of the ACM, Vol. 49, No. 8, pp. 25–27, 2006.
Timothy P. Chartier and Dan B Goldman. "Mathematical Movie Magic." Math Horizons, April 2004.
Dan B Goldman, Brian Curless, Aaron Hertzmann, Steve Seitz. Shape and Spatially-Varying BRDFs From Photometric Stereo. UW-CSE-04-05-03.
Yung-Yu Chuang, Dan B Goldman, Brian Curless, David H. Salesin, Richard Szeliski. Animating Pictures with Stochastic Motion Textures. UW-CSE-04-04-02.
"Non-parametric image optimization," Mathematics, Computer Graphics, and Film Production, Joint Mathematics Meeting, January 13, 2013.
"Non-parametric image optimization & Crowdsourcing gaze data collection," Microsoft Research Cambridge, July 24, 2012.
"Non-parametric image optimization & Crowdsourcing gaze data collection," Imperial College London, July 12, 2012.
"Non-parametric image optimization," London Graphics Seminar, June 11, 2012.
"Interactive video visualization and navigation & Crowdsourcing gaze data collection," University of Washington computer vision seminar, April 11, 2012.
"Interactive video visualization and navigation & Crowdsourcing gaze data collection," University of Washington DUB seminar, February 15, 2012.
"Image and video manipulation," Keynote, SPIE Media Forensics, January 25, 2011.
"The PatchMatch image correspondence algorithm and applications," University of Colorado Applied Math seminar, May 2010.
"Creativity, inspirations, processes," Creativity seminar, University of Maine, December 2009.
"Real-time interaction for video manipulation," International workshop on vision, Barcelona, May 2009.
"Rethinking digital video," Laika animation, August 15, 2007.
I've also done uncredited production work on Strange Days (1995), software development for Jurassic Park (1993), Peter Pan (2003), and Star Wars Episode III (2005), and consulting for Van Helsing (2004).
Dan B or Daniel R.?
The truth is, my middle name is Robert. But, many years ago I had a nickname that starts with the initial B. I omit the name here, because it is a very "sticky" name that is hard to shake loose once you know it! Around that time I started using the middle initial as part of my "stage name" (with no period, just to confuse people a little bit). When I started publishing I continued using this as my "public facing" name on publications. Unfortunately, the University of Washington doesn't like nicknames or stage names in theses, and at the time I submitted the final draft I was several hundred miles away, and not keen on fighting the bureaucracy. So the thesis – and, for similar reasons, most of my screen credits – do not include the middle B.
Litt, J, and Goldman, D.B. "The RenderMan EasyBake Oven", Stupid RAT Tricks, Pixar Users Group Meeting, Siggraph 2001, Los Angeles, California, USA.
Bossworker - lightweight interface for distributed computation.