Project 2 – Group 5

My Robot Coach

Group 5: Wentian Zhu, Ellie Huang, Jiamin Liu, Yifan Xu

Sti

Group5

Bounty Hunter on Cloud: https://www.youtube.com/watch?v=jXso3idTFWA

In this project, we investigated the potential of robot arms to enhance sports and gaming training in a simulated environment. In the physical world, expertise in sports and games usually entails repetitive exercise and access to appropriate equipment. Unfortunately, such resources may not be accessible to everyone, which is where robot arms come in as a valuable aid. By generating virtual scenes and offering support for sports or game-based training, robot arms can be of tremendous assistance to a wider population.
Through the use of technologies such as Arduino, WebSocket, and Unity, we were able to demonstrate how robot arms can be used to create an immersive and engaging training experience that promotes hand-eye coordination and quick thinking. However, challenges such as the optimal delay time in the communication between softwares need to be addressed to improve the overall gaming experience.

In addition, the feedback on the game’s representation of guns and shooting from a political perspective highlights the potential for exploring the concept further. By tying it into current societal, cultural, and political issues, we can create a thought-provoking experience that engages players in a dialogue about violence, human society, technology, and ethics.

 

Workflow

wwwww

The Arduino converts the data into JSON format and sends it to the WebSocket server, which in turn receives the data and sends it to Unity. Unity then converts the received data and convert it into C# format.

 

Arduino Diagram and Container Design

w

Environment Setup

ezgif-com-video-to-gif

User Flow

wewew

 

Design Process

Step 1: Connect both Arduino and Unity to Websocket

In Step 1, we connected Arduino and Unity to the WebSocket for real-time data transfer, use a light sensor and laser pointer to trigger animations, add a score system, reset button, and LED light strip for feedback. This created an engaging game experience that responds promptly to user actions.

ezgif-com-video-to-gif-1

 

Step 2: Refinement

In Step 2, we refined the scene design and created storylines that will add depth to the game. We also started to consider the design of the Arduino container and cable organization to enhance user experience. Lastly, We changed the scoreboard to a reward system that will make the game more engaging and encourage players to continue playing.
ezgif-com-video-to-gif-23222

Step 3: Final Adjustment

In Step 3, We laser cut the monster as the target and added ambient light to create a more immersive gaming experience, then we programmed the robot arm to respond to user’s movements, and enhancing the design of the Arduino container. These improvements allowed a more seamless and enjoyable game and helped us to reach a wider audience, including gamers and professional athletes looking to improve their reaction time and critical thinking skills.

323232

 

Link to presentation slides: https://docs.google.com/presentation/d/1UARgt_aAtIAvsono_Bd3K7zpYPW3exxm33bZj-n9tMY/edit?usp=sharing

Github Link: https://github.com/NarrowSpace/ArduinoUnityWebsocket

 

Credits:

Unity Assets:

Magic Effects Free: https://assetstore.unity.com/packages/vfx/particles/spells/magic-effects-free-247933

Free Pixel Font – Thaleah: https://assetstore.unity.com/packages/2d/fonts/free-pixel-font-thaleah-140059

Pixel Art Icon Pack – RPG: https://assetstore.unity.com/packages/2d/gui/icons/pixel-art-icon-pack-rpg-158343

Simple Heart Health System: https://assetstore.unity.com/packages/tools/gui/simple-heart-health-system-120676

LowPoly Environment Pack: https://assetstore.unity.com/packages/3d/environments/landscapes/lowpoly-environment-pack-99479

Adventurer Blake: https://assetstore.unity.com/packages/3d/characters/humanoids/adventurer-blake-158728

Character Cactus: https://assetstore.unity.com/packages/3d/characters/creatures/character-cactus-32933

Sound Effects:

Minecraft Villager Hurt Sound Effect: https://www.youtube.com/watch?v=1wJsOoUYKyY

“8 Bit World!” Fun Upbeat Chiptune Game Music by HeatleyBros: https://www.youtube.com/watch?v=VijZQa6hT9U&list=LL&index=6

3 2 1 0 Countdown With Sound Effect | No Copyright | Ready To Use: https://www.youtube.com/watch?v=DiUGv1vsuSU

WIN sound effect no copyright: https://www.youtube.com/watch?v=rr5CMS2GtCY

Image:

Comic speech bubble with vs text: https://www.freepik.com/free-vector/comic-speech-bubble-with-vs-text_14201655.htm#query=vs&position=21&from_view=search&track=sph

Big win surprise banner in comic style:

https://www.freepik.com/free-vector/big-win-surprise-banner-comic-style_4192021.htm#page=3&query=win%20title&position=4&from_view=search&track=ais

Leave a Reply

Your email address will not be published. Required fields are marked *