Augmented Reality System for Overlaying Objects in Room

An Augmented Reality system for overlaying objects on a room floor (My room)

The “My Room” feature in Explorug, a product developed by Alternative Technology, offers a unique capability to overlay 3D objects onto a single RGB image. Leveraging machine learning algorithms and projective geometry, this feature achieves sophisticated augmentation. Initial steps involve image segmentation through deep learning algorithms, followed by line detection and vanishing point detection to identify the optimal plane for object overlay within the scene. Furthermore, the algorithm includes refinements in user experience, ensuring seamless object movement within the image.

Problem:

Traditional image augmentation techniques often lack the ability to overlay 3D objects onto 2D images seamlessly. Manual placement of objects can be time-consuming and imprecise, leading to a disjointed user experience. Additionally, achieving smooth object movement within the image presents further challenges in user interaction.

Research Aim:

The primary aim of this research is to develop and refine the “My Room” feature in Explorug, focusing on enhancing the seamless overlay of 3D objects onto single RGB images. By integrating machine learning algorithms and projective geometry, the study seeks to optimize image segmentation, line detection, and vanishing point detection processes to accurately position objects within the scene. Furthermore, the research aims to refine user experience aspects, ensuring smooth object movement and intuitive interaction within the augmented environment.

Outcome So Far:

Initial development efforts have successfully integrated machine learning algorithms and projective geometry techniques to achieve sophisticated image augmentation within the “My Room” feature. Progress has been made in optimizing image segmentation, line detection, and vanishing point detection processes for accurate object placement. Furthermore, refinements in user experience have been implemented to facilitate smooth object movement and intuitive interaction. Ongoing research focuses on further enhancing the feature’s capabilities and user experience, with the ultimate goal of delivering a seamless and immersive augmented reality experience within Explorug.

Figure I: Before Augmentation

Figure II: After Augmentation

Team: Shailesh Mishra, Ajad Chhatkuli

Shailesh Mishra: Explorug, NAAMII