My Robot Coach
Group 5: Wentian Zhu, Ellie Huang, Jiamin Liu, Yifan Xu
Bounty Hunter on Cloud: https://www.youtube.com/watch?v=jXso3idTFWA
In this project, we investigated the potential of robot arms to enhance sports and gaming training in a simulated environment. In the physical world, expertise in sports and games usually entails repetitive exercise and access to appropriate equipment. Unfortunately, such resources may not be accessible to everyone, which is where robot arms come in as a valuable aid. By generating virtual scenes and offering support for sports or game-based training, robot arms can be of tremendous assistance to a wider population.
Through the use of technologies such as Arduino, WebSocket, and Unity, we were able to demonstrate how robot arms can be used to create an immersive and engaging training experience that promotes hand-eye coordination and quick thinking. However, challenges such as the optimal delay time in the communication between softwares need to be addressed to improve the overall gaming experience.
In addition, the feedback on the game’s representation of guns and shooting from a political perspective highlights the potential for exploring the concept further. By tying it into current societal, cultural, and political issues, we can create a thought-provoking experience that engages players in a dialogue about violence, human society, technology, and ethics.
The Arduino converts the data into JSON format and sends it to the WebSocket server, which in turn receives the data and sends it to Unity. Unity then converts the received data and convert it into C# format.
Arduino Diagram and Container Design
Step 1: Connect both Arduino and Unity to Websocket
In Step 1, we connected Arduino and Unity to the WebSocket for real-time data transfer, use a light sensor and laser pointer to trigger animations, add a score system, reset button, and LED light strip for feedback. This created an engaging game experience that responds promptly to user actions.
Step 2: Refinement
In Step 2, we refined the scene design and created storylines that will add depth to the game. We also started to consider the design of the Arduino container and cable organization to enhance user experience. Lastly, We changed the scoreboard to a reward system that will make the game more engaging and encourage players to continue playing.
Step 3: Final Adjustment
In Step 3, We laser cut the monster as the target and added ambient light to create a more immersive gaming experience, then we programmed the robot arm to respond to user’s movements, and enhancing the design of the Arduino container. These improvements allowed a more seamless and enjoyable game and helped us to reach a wider audience, including gamers and professional athletes looking to improve their reaction time and critical thinking skills.
Link to presentation slides: https://docs.google.com/presentation/d/1UARgt_aAtIAvsono_Bd3K7zpYPW3exxm33bZj-n9tMY/edit?usp=sharing
Github Link: https://github.com/NarrowSpace/ArduinoUnityWebsocket
Free Pixel Font – Thaleah: https://assetstore.unity.com/packages/2d/fonts/free-pixel-font-thaleah-140059
Pixel Art Icon Pack – RPG: https://assetstore.unity.com/packages/2d/gui/icons/pixel-art-icon-pack-rpg-158343
Simple Heart Health System: https://assetstore.unity.com/packages/tools/gui/simple-heart-health-system-120676
LowPoly Environment Pack: https://assetstore.unity.com/packages/3d/environments/landscapes/lowpoly-environment-pack-99479
Minecraft Villager Hurt Sound Effect: https://www.youtube.com/watch?v=1wJsOoUYKyY
“8 Bit World!” Fun Upbeat Chiptune Game Music by HeatleyBros: https://www.youtube.com/watch?v=VijZQa6hT9U&list=LL&index=6
3 2 1 0 Countdown With Sound Effect | No Copyright | Ready To Use: https://www.youtube.com/watch?v=DiUGv1vsuSU
WIN sound effect no copyright: https://www.youtube.com/watch?v=rr5CMS2GtCY
Comic speech bubble with vs text: https://www.freepik.com/free-vector/comic-speech-bubble-with-vs-text_14201655.htm#query=vs&position=21&from_view=search&track=sph
Big win surprise banner in comic style: