VR-Doh: Hands-on 3D Modeling in Virtual Reality

VR-Doh: Hands-on 3D Modeling in Virtual Reality

Project Website: https://simulation-intelligence.github.io/VR-Doh/

Publication: ACM Transactions on Graphics (SIGGRAPH 2025) Recognition: Top 10 Technical Papers Fast Forward

Authors

Zhaofeng Luo, Zhitong Cui, Shijian Luo, Mengyu Chu, Minchen Li

Overview

We present VR-Doh, an intuitive system for 3D object creation and manipulation in Virtual Reality. Using the Material Point Method (MPM) for real-time elastoplastic object simulation, our system enables sculpting, deforming, and editing objects through natural hand interactions.

Key Features

  • Real-time MPM Simulation: Accurate elastoplastic material behavior in VR
  • Natural Hand Interactions: Intuitive sculpting and deformation controls
  • Diverse Object Modeling: Support for food, characters, and structures
  • Localized Simulation: High performance through optimized computation
  • Seamless Rendering: Integration with 3D Gaussian Splatting

Impact

Our work bridges the gap between physical intuition and digital modeling, making 3D content creation more accessible and expressive in virtual reality environments.

Project Page

VR-Doh Teaser