Environment Capture for VR
This module is in development. Lessons will be added as they become available.
Status Update
Capture completed on Monday, January 27th with initial lesson delivery by Monday February 3rd with lessons being completed over the following week. I am recovering from elbow surgery so please pardon any delays.
Overview
This module will cover using the Xgrids Lixelkitty K1 lidar unit and Qoocam Ultra 3 to process a gaussian splat scene for viewing in the Meta Quest 2 headset via the Gracia app.
Current Limitations
Processing environments capture with only 360 videos for 3D gaussians while supported should be considered a work in progress and far from production ready. I will cover suggested best practice and workflows along with some experiments I had conducted. This is a topic of interest for me, and I see this research spreading out over a period of months as new techniques emerge with research papers such as zmliao/Fisheye-GS: 3D Gaussian Splatting (3DGS) on fisheye cameras and Implement Fisheye-GS. by jefequien · Pull Request #398 · nerfstudio-project/gsplat
Lesson Plan
This is a lesson plan currently in development and the lesson release dates.
- Introduction to Environment Capture for Virtual Reality (done)
- Introduction to the Xgrids K1 Lidar Scanner (done)
- Xgrids Data Processing (done)
- Xgrids Data Processing in Agisoft Metashape (done)
- Introduction to Qoocam Ultra 3 360 Camera (2/4/25)
- Processing Qoocam Ultra 3 Video and Imagery (2/4/25)
- Processing Qoocam Ultra 3 Data in Agisoft Metashape (2/4/25)
- Object Detection and Segmentation with Ultralytics Yolo (2/4/25)
- Processing Qoocam Ultra 3 3D Gaussians in Jawset Postshot (2/4/25)
- Optimizing & Exporting 3D Gaussians for Visualization (2/4/25)
- Introduction to Meta Quest Headset and Gracia App (2/5/25)
- Additional Reading and Research Papers (2/5/25)