Inspiration

In modern-day gaming, haptic feedback is quite popular and is being immersed everywhere in VR on Oculus Quest. We thought it would be a good idea to have a game of Jenga while being able to feel haptic feedback while playing the game.

What it does

You will wear the modified gloves that we did and you will be playing in a VR environment playing Jenga. While playing Jenga, grabbing or pinching the Jenga Blocks will make haptic feedback on your gloves where your hand will be able to feel.

How we built it

We took some vibration motor and solder wires on it to extend the length of the vibration motor. We then connect it to esp32 where we wrote http which allows hotspots to be connected to our computer. This allows data to be transferred and received, so we know when to let the apply haptic feedback on the gloves. On the VR, we have created a unity game that contains hand tracking and interaction with 3D Objects. Whenever we pinch or palm grab in the VR game, it will make the esp32 know to apply a vibration motor which will give you haptic feedback from the game to your gloves.

Challenges we ran into

One challenge we faced was the soldering of the wires to the vibration motor because the wires connecting to the vibration motor were very thin and could easily break. Our ESP32 had some powering problems, we first used to put lithium batteries in series because a single lithium battery had too little voltage for our ESP32. We decided on bigger batteries which made the gloves heavier. One of our biggest challenges was making the Jenga game in unity with the Oculus Quest 2. The most challenging part of making the Jenga was the physics of it which was very painful to do and the Oculus Integration Package was very big which took running the game a long time.

Accomplishments that we're proud of

We were proud of getting the haptic feedback working correctly between the esp32 and Oculus Quest 2. We finished making the modified gloves which look very cool and work very well just with the esp32 working.

What we learned

We learned that making a Unity game with the Oculus Quest 2 was very hard, but I learned how to do physics on 3D Objects and code C# script in Unity. We also learn how to solder and learn how to connect to hotspots.

What's next for UltraHand

The next step for UltraHand is to make more features in the game and make the connection better. We also plan to modify the gloves more.

Built With

Share this project:

Updates