Experiment 1 – Body as Controller

The Dawn (Click)

This was the first work that I did and I tried to keep it as simple as I could, while at the same time keeping an eye for the aesthetic aspects of my work. When I run the code, the sound of birds chirping will be played, similar to what we hear in the early morning. I personally hate the sound of all birds, but I think they could play a significant role in helping me expand the narrative and make it more real in terms of how powerful the ambiance would feel!

The way the interaction works in this piece is that by using Posenet, it detects the distance between my wrists, and whenever I clap my hands (basically whenever I put my wrists together) a star will pop up on a random spot in the sky.


  • Present link : https://preview.p5js.org/Parnian/present/AJzs2kDZS
  • Edit link : https://editor.p5js.org/Parnian/sketches/AJzs2kDZS
  • Video : https://vimeo.com/618232461


The Windmill (Swipe)

I have a personal interest in animated movies and cartoons and here it was no exception either. To me, the most attracting aspect of this work is the landscape, which is again very simply drawn, yet very satisfying in a nostalgic way.

By using Posenet, the movement of the nose along the x-axis will be detected. If I move to the left, the blades of the windmill will spin counterclockwise and if I move right, they will spin clockwise. The speed of the blades’ spin is also sensitive to the speed of my nose’s x-movement.


  • Present link : https://preview.p5js.org/Parnian/present/Zv48HHyb-
  • Edit link : https://editor.p5js.org/Parnian/sketches/Zv48HHyb-
  • Video : https://vimeo.com/618250438


Make-A-Wish… (Click)

The set of codes for this work is the only one in which I used clmtracker and I am happy to have done so! Because for some reasons I found that extremely challenging and confusing to work with clmtracker and given the amount of time I had to prepare these four works, I know I couldn’t have done better – even if I wanted to.

The way it works is that it calculates the distance between point 0 and point 14 in my face and when it is more than a certain amount, it means I am close enough to blow the candle and actually be able to turn it off (since we all know if you’re not close enough, no matter how hard you blow it won’t turn off). But if you wanted to play with it, please don’t cheat and make sure you do the actual blowing – it helps to communicate better with it! Also wait for the children to sing the “Happy Birthday” song to you. They will tell you when you can blow the candle…


  • Present link : https://preview.p5js.org/Parnian/present/p6gUktmSM
  • Edit link : https://editor.p5js.org/Parnian/sketches/p6gUktmSM
  • Video : https://vimeo.com/618253827


Help Isaac! (Swipe)

At first, writing codes for a game was very intimidating for me and I preferred to stay in the “playing around” phase of my learning. But finally for this last study, as I grew more skilled and more confident along the way, I decided to go for a game.

In this study, after being detected, the nose of the player is attached to the picture of Isaac Newton. If the player can manage to stay under the falling apple from the tree, a “Game Win” sound will be played and if not, a “Game Over” sound will play. This way they will know if they interacted with the work in the right or wrong way.


  • Present link : https://preview.p5js.org/Parnian/present/4q5S9aqDwf
  • Edit link : https://editor.p5js.org/Parnian/sketches/4q5S9aqDwf
  • Video : https://vimeo.com/618254266