I am a second year Digital Futures undergrad student at OCAD University based in Toronto. I enjoy exploring new software and building skills to create unique experimental projects. I try to push the boundaries of my ability and aim to expand my skill set through these projects.
CASTING THE MODELS
In order to begin the digital modification that I intended to do, I had to first cast the models of my body parts, my lips and hand as pictured above, and use photogrammetry to convert them into a digital form. For the model of the lips, I actually used a laser scanner, which made the model a lot more detailed. I ended up using the model of my mouth in my next two projects.
SOUNDING BODY PROJECT
My vision for this project was to have facial recognition move the model of the mouth so it appears as though it is speaking along with the viewer. My process was as followed:
I first separated the mouth into the top and bottom lip with zBrush. I then exported them as separate OBJs and imported them into touch designer.
Here I made the mouth move using faceOSC so it will move around with your mouth and play a sound when you open it.
I was struggling to get textures to work here
I added a pulsing effect to the mouth
After A LOT of trial and error, I realized I was missing the texture operator which was making adding a texture difficult.
Played around with PHONG operator, changed lighting and effects
(EX)CHANGING SOUNDING BODY PROJECT
Part two of this series was to make another interactive experience using body parts. This time, I worked with my friend Sulim Lee and we did the project together using models of my lips and her hand.
Since we had a model of Sulim’s hand doing a finger heart and a model of my mouth, we decided it could portray a theme of love. We had 3 hands rotating upon pressing a key on the keyboard, and when all three are pressed, a mouth will appear and say “I love you” in Korean (사랑해요), as the finger heart is a famous symbol of love in Korea.
Our use of a foreign language was intended to show that although we may have different words that express love, the expression of love itself is universally understandable. Although the viewer may not understand what the voice is saying, the imagery and symbols in the piece still relay to the user that this is about “love”.
We decided to do a 3D DIY hologram before we built a bigger version. We started by building a prototype for a smartphone, which was (1cmx5cmx8cm).
After we made the 3D DIY prototype successfully we decided to make a hologram pyramid for computer monitor size. So we bought Acrylic from the plastic shop and laser cut it as the dimension on .ai file.
This is what the monitor version looked like. It was not what we expected or hoped but it worked somewhat. We ended up liking the smaller mobile version more.
This is our touch design setup.
This is how it looked before we modified it to be a hologram.