Project BeachBot

Augmented Reality App

We developed a Virtual Reality (VR) interface for Project.BB’s BeachBot, enabling remote teleoperation of the robot on the beach. This VR application provided users with an immersive view of the robot’s surroundings, allowing them to virtually identify and mark litter for removal. By implementing hand tracking capabilities, I made it simple for users to mark points of intrest. I significantly reduced the learning curve for remote operation, from 15 minutes down to 5 minutes based on internal user testing, resulting in quicker adaption of the technology

Mobile App:

To facilitate a broader public participating, we developed a gamified mobile application that allowed users to remotely train the BeachBot’s litter detection algorithm. This involved designing engaging gameplay mechanics where users could “hunt” for virtual litter on a simulated beach. By labeling images of the virtual litter, users indirectly trained the robot’s AI, contributing to its real-world litter detection capabilities

AR Object Trainer

Using the NReal Augmented Reality glasses, we created an AI connected application to capture objects in and add custom labels to them in real-time.

The custom labels could then be used for updating and re-training the Image Recognition algorithm. Thus creating….