This project is an installation piece, involving a display composed of LEDs and various materials (primarily laser-cut acrylic). We will be taking the interaction lightscape aspects of Experiment 1 (Sananda and Jevi), Experiment 2 (Jevi and Li), and Experiment 4 (Catherine, Li, Rittika, Jevi), and the work with LEDs and acrylic from Catherine and Sananda’s Experiment 2.
The theme of our installation is birds. Specifically, birds as they have been represented stylistically by the artists of our respective countries of origin. Aesthetically, the range of species, variation of visual patterns and textures works well with our optics. We will be working with distance sensors as a means of interaction with participants, limiting the activity to simple actions (activating and deactivating light based on proximity, and some light animation).
/materials/technology list: what you will use to build your project. Be specific.
The range of bird groupings and styles will span across four panels. If it’s possible to acquire them we are hoping to mount these panels to clothing racks on wheels so they are flexible in terms of portability. Behind the panels is where we will assemble our circuits and arduinos (hidden from view). The wiring will feed into the display via holes in the panels. The birds will be laser-cut from acrylic sheets (colour varying), though we may include other materials (paper, ink, and translucent fabrics) to emphasize the shift in artistic style.
Ambient/atmosphere: remote-lit bulbs
2 x RGB strips / 12” (50 RGBs per strip)
2 x RGB strips / 1 m (50 RGBs per strip)
5 x distance sensors (Ultrasonic Range Finder – LV – MaxSonar-EZ0)
5 x Arduino Nano 33 IoT
2 x Arduino Mega 2560
1 x Arduino Uno
Material : – Plastics (acrylic), laser-cut
Designed in Photoshop, Procreate and Illustrator
Work plan – include dates & milestones
Sunday November 23: Round 1 / bird designs created
Monday November 24: Round 1 / Bird designs laser-cut
Schematic / circuits
Tuesday November 25: Round 1 / Bird designs laser-cut
Wednesday November 26: Round 2 / Bird designs laser-cut
Initial tests/ RGBs and sensors
Panels designed for displays
Thursday November 27: Round 2 / Bird designs laser-cut
Friday November 28: Round 3 / Bird designs laser-cut
Panels drilled for circuits
Saturday November 29: Assembly / testing Sunday November 30: Assembly / testing
Monday December 1 : Assembly / testing
Tuesday December 2: Install in space
Wednesday December 3 : Install in space
Physical installation details: The displays will be mounted like paintings but as the artwork will be attached to the panels at varying distances, there will be a 3D aspect (depth). The LED circuits will be mounted on the backside of the panels, with the display components positioned in front, so that they’re ‘coloured’ by the LEDS while diffusing the light in the process.
The panels will in turn be supported by clothing racks on wheels for portability.
This project is going to display pattern and movement usually found in nature such as a bird flying or a flower blooming with kinetic sculptures. Changes in the pattern will be controlled based on visitors’ interactions with the sculptures. The project’s intention is to build a sense of connection between humans and nature and reflect on our relationship with it.
Parts / materials / technology list:
Arduino Nano/ Uno
Servos – the amount is to be decided
Digital fabrication including laser cut wood/plastic/acrylic
3 laser sensors
22 -26 November- Designing patterns and going through a few stages of prototyping
27-28 November- Coding and debugging
29 November- Test-assembling parts together to see if it works
30 November- Laser-cutting the final product and putting it altogether
This project will be an extension of what was presented in experiment three, an interface to interact with Persian calligraphy. After looking into different possibilities, I narrowed down the ideas into two different scenarios to extend the existing project. The main purpose of both scenarios is to improve the impression of the project for users.
Improving the interaction and visuals
One of the main things that I wanted to achieve in experiment 3 was to give users visual feedback on the specific point of interaction when touching the fabric. In the final result, I was only able to create one-dimensional horizontal feedback. Providing more accurate feedback is one of the ideas in this scenario. This scenario will most likely include:
Flat hanging fabric
Adding extra sensors or analyzing data differently
Modifying visuals respectively
Using multiple projectors (if applicable)
Creating a more immersive interface
I consider the use of a hanging piece of fabric a successful experiment as I had positive feedback from most of the participants. As a result, one of the possibilities to extend the project is to try different ways of hanging the fabric to surround the participants. This scenario will most likely include:
U-shaped hanging fabric
Analyzing new characteristics of the fabric and possible ways of interaction
Modifying the arrangement of sensors
Modifying visuals respectively
Using multiple projectors (if applicable)
Arduino (one or two)
VL53L0X laser distance sensors (two or more)
A large piece of white fabric
Wooden bar (straight or curved) for hanging the fabric
Tripods, stands or extending arms to install distance sensors
Other tools to create visuals (SVG animation tools, Adobe Illustrator, …)
Both scenarios require an initial setup so that data could be collected from sensors and the code creating the visuals could be tested and modified. Similarly, in both scenarios, new visuals should be designed, code should be modified, physical parts should be made and the final result should be calibrated for the presentation space.
In my experience with the previous experiment, the whole work can’t be divided into linear phases and is mostly done in an iterative way. However, some of the most important dates are:
NOV25: End of exploration/research/ideation
NOV25: Setting up the test setup (a prototype of the curved bar, if required)
DEC1 – DEC3: Making required parts for the final setup
DEC3 – Final tests and calibration (final calibration will be done on DEC4)
Physical installation details
In my previous experience, this project is best presented in a dark and empty space. Ideally, a narrow space would help to cover the space with the fabric and divide the space so that people won’t walk to the back of the fabric.
The physical installation is also highly dependant on the final space. I need to know the exact specifications of the space so that I can measure all the distances, model them and start creating everything accordingly. Ideally, I would like to install in room #118 to have full control over light and setup.
For Experiment 5, I’d like to expand on tangible interfaces and explore the use of Zero UI (invisible user interfaces) and having technology fully incorporated within a room (or household) with the use of pressure sensitive furniture and sensors with auditory feedback to elevate regular objects (a book) to create a more immersive experiences instead depending on screen based experiences. This experiment is an exploration in creating a multi-sensory reading experience with content catered towards the book’s contents.
The experiment would involve the use of a pressure sensor chair that lights up a nearby lamp when the participant sits down. The pressure sensor may be installed physically on the chair or hidden away with the design of a cushion or lining. The participant can pick up the book and read or flip through the book and hear the music referred in the book playing from a speaker hidden away (possible below or behind the chair). The audio would be mapped depending on what section of the book the participant is on.
The book I’d like to use is still undecided but one with many musical references such as Haruki Murakami’s book, The Wind Up Bird Chronicle, where as the book begins with the protagonist listening to Rossini’s the Thieving Magpie and refers to many other classical musicians. Another possible book could be J.R.R. Tolkien’s The Hobbit with the movie franchise’s music by Howard Shore playing instead.
Project Main Components and Parts
MP3 Shield (?)
Lightbulb and Wiring (Lamp)
Additional Components and Parts
Chair (Supporting Prop)
Fabric/Cushion (To Hide/Place Sensor)
Mat Rug (Prop To Hide Cables)
Fri, Nov 22 – Proposal Presentation Sat, Nov 23 – Coding + Gathering Digital Assets + Building Lo-Fi Breadboard Prototype Sun, Nov 24 – Coding + Gathering Digital Assets + Building Lo-Fi Breadboard Prototype Mon, Nov 25 – Coding + Creatron for Final Components Tues, Nov 26 – Presenting Progress of Lo-Fi Breadboard Prototype + Revisions Wed, Nov 27 – Prop Purchasing Thurs, Nov 28 – Laser Cutting Components and Coding Friday, Nov 29 – Troubleshooting / Bug Fixes Sat, Nov 30 – Troubleshooting / Bug Fixes Sun, Dec 1 – Troubleshooting / Bug Fixes Mon, Dec 2 – Troubleshooting / Bug Fixes Tues, Dec 3 – Final Critique Wed, Dec 4 – Open Show
I’d like to ideally place the set up in the corner of a room and with dimmer lighting so the lighting from the lamp is more visible when it turns on. Supporting objects within the set up would be the chair participants can sit on with the sensor attached.
Chair and Side table
Will need extension cords for power
Info for Open Show
Preferably displayed in the Grad Gallery room. I will just need an electrical outlet nearby or extension cord. We will need to book external speakers from AV.
The title is a play on Designing Calm Technology, Mark Weiser and John Seely Brown:
“Calm technology or Calm design is a type of information technology where the interaction between the technology and its user is designed to occur in the user’s periphery rather than constantly at the center of attention.”
The concept for this experiment was deliberately minimalistic. The intention from the outset: a display that people could approach with intuitive grasp of what to do and how to do it in a way that might seem while seemingly obvious may be credited to an attuned set of motor skills ingrained from experiential play in childhood. It needed to be welcoming, malleable and to an extent, user-defined. The set up needed to be durable, tough, possessing no fragility or risking of breaking; something that could endure the abuse and wear-and-tear of many hands (including those of small children) without compromising an acute level of sensitive response in movement and touch. Though the idea seems derived from Tom Gerhardt’s Mud Tub, and indeed I was inspired by from watching this video and reading about the intent behind the work, it was mostly the result of coincidence. Directly following the first class of our Experiment 3 lab, I gave a lecture to film students about drawing the human form. In an analogy about expressing the volume of a human figure, I alluded to the very tangible sensation of dividing up slabs of clay with a wire thread, and how satisfying it felt. As I said it, a student agreed enthusiastically. I took that as evidence enough that it was a sensation that was both familiar and relatable- especially to a group of Design students. But I was also interested in exploring why I had thought to use that particular analogy at all, clay having nothing to do with the class I was teaching. I had searched for a mental association that they could reference from deep memory, and lock a new idea to it, giving it ground. It was these same steps that I had interpreted in Ishii’s TUI mandates, as well as in Mark Weizer’s view: “The more you can do by intuition the smarter you are; the computer should extend your unconscious.”
From the top: Tom Gerhardt: Mud Tub, Tangible Interface 2009, and Cutting Clay with Wire, Delon Visual Arts
The display needed to be both self-explanatory and inviting; not by means of decor but with visuals and objects that elicit feelings of calm creativity: playing with clay in art class. The table surface was covered with that classic plastic, red-and-white checkered table-cloth so associated with craft tables. The only items upon it was a black rolling pin and next to it, a big ball of clay. I am quick to respond to any chance to play with art materials in any setting, and that especially goes for a public setting within an at least somewhat professional context, where the act of craft-making can quell the anxious feelings. I guessed that within this class of like-minded artists and designers, there was a likelihood that others might gravitate to the ‘crafts’ table, where they could zone out on the medium (clay) and with a tool they’re familiar with in an ingrained way since childhood (rolling pin).
Above the table, a large-screen display provided visual feedback as they kneaded the clay with the rolling pin. With the Arduino nestled like a level in the exact centre of the pin, the user’s hand movements were being recorded by the built-in gyroscope, and passed to the Processing code. The angle values over time were translated into shapes moving across the screen, with graphics (shape, frame location, size and colour) altering with the pace and pressure of the user’s hands over the clay.
The initial concept involved cutting wire through clay, and capturing the satisfying feeling with direct visual feedback on the screen (sliding the wire slowly through the clay would slow down the changing colours, for instance). I faced a few too many challenges with this idea, the main one being that even if I did purchase or acquire a sensor small enough to fit comfortably in the handle of the wire cutter, it seemed to throw off the balance if it was only in one handle. It also would have meant using high-quality clay to achieve the appropriate sliding effect, and that’s difficult to acquire unless purchased in a large quantity. The rolling pin proved to be not only more practical but in fact a lot more tangible, taking direct pressure from the hands on the pin, instead of the indirect pull from holding handles of a cutting wire.
PVC pipe (rolling pin)
floral dry-foam (structural support for the Arduino)
Lady’s razor container (holding the Arduino in place)
Electrical tape (to seal the Arduidno and USB casing)
I had been inspired by the ideas presented in Tangible Bits: Beyond Pixels (Hiroshi Ishii), and the principles of Ubiquitous Computing (Mark Weiser) of “weaving digital technology into the fabric of a physical environment and making it invisible”. It was Ishii’s emphasis on the ‘meaningful’ and ‘comprehensive’ that spoke directly to me. I often feel torn between the future of digital technology and the not-so-distant past, before it was drastically altered. It dawned on me while reading Ishii’s paper that the goal of the DF program was to find that link through art created by and made for people. It renewed my appreciation for what what we were learning, but it also made me feel the need to go back to basics.
TUI Mandate as described in Tangible Bits: Beyond Pixels (Ishii).
That’s where clay came in to the picture. I had another reason for keeping the material assembly of the concept as simple as possible : to maximize the amount of time I could devote to learning / working with the code. I envisioned dynamic, acutely responsive imagery on the screen, comprised of a myriad of images that would behave similarly to custom brushes in Photoshop where you can paint with photos of your cat or sample a nice arrangement of paw prints to use as an abstract texture. After some experimenting though, I found the use of images was a bit constrictive and disconnected. The most direct response came from the employ of very basic shapes, and it makes sense: in traditional animation, there is a rule of thumb that no more than one character should be moving at a time, in the same way that nothing should compete for attention with the main focal point in film. The simple familiarity of the basic shapes led to a more immediate response, with far less distraction.
I have since college, worked with a Wacom tablet and not long after, began a decade of working as a demo artist for the brand itself. During that time I created courses in how to make the best use of the pressure sensitivity in order to obtain design project goals. Something that has always fascinated me was the range of people that enrolled in the Digital Painting course (Continuing Education, George Brown College). The greatest challenge and most interesting aspect of this class was whom it attracted: professionals who thought it might benefit their respected profession in some way. That comprised of, to name a small few : a pool table designer, a costume designer, interior designer, architects, film-makers, photographers small-business owners, and of course, graphic designers of all kinds. Thanks to this work with digital pressure sensitivity, I feel like I have inadvertently been subscribing to the Ubiquitous Computing ideology and the mandates of Tangible User Interfaces (Ishii) long before I read about them two weeks ago.
I have a personal history to lend to the context of this project. The house I grew up in was a bit of a technology paradox. There was a computer (assembled DIY style by my programmer dad, comprised of used parts) in almost every room, each one surrounded and often semi-buried under stacks of paper, files and books (belonging to my editor-mom, who hated computers). I’ve always felt my mother sits at one end of the extreme of the boomer generation and my dad at the other: the luddite and the technologist. My mom is an educational-writer and potter and a believer in hard, physical work. In her retirement I have persuaded her to adapt to ‘smart’ technology tools as a means of making her life easier. She wound up distrusting the “Ok Google” voice-operated remote to the extent that she returned it for the in-the-box basic model. My dad meanwhile, taught himself how to write code in the 80s because it was fun, recorded all his favourite classical music to MIDI files in the 90s and still writes his own apps as a hobby. As an adult, my friendships have divided between two mindsets, both of which I identify with. On one end there are developers, sci-fi aficionados and comic geeks, on the other, carpenters, classic literature, folk and rock music and carpenters. Sometimes there is an overlap (and I identify with those people the most), but it’s been rare.
With the influence that all things digital has had in recent decades, that spectrum has become murkier with each generation since. Through the murkiness come big questions about where we are heading and where we are coming from. We wonder what we’ll be able to take with us and what we are leaving behind, to make way for the onset of ever-changing ideals pertaining to innovation.
Until college, my art practice was a physical, tangible process. Since then it has been mostly digital, with massive pros and cons. I had held out as long as I could; Majoring in Film Animation, I drew everything by hand and only used the ancient (obsolete) cameras and editors (Oxberry and Leika). When I later spent a year in the Computer Animation lab at Sheridan college, compared to the drawing studio Concordia, the difference in energy in both spaces was shocking. So much so that after walking in one day and taking in the sea of zoned-out, green-lit faces, I knew I would never work in that industry. There is something wrong with how we have been adapting to our digital environments, and it’s got nothing to do with the tools themselves. It’s how we believe we need to use them. It’s not just the difference between a Graphic User Interface and a tangible one. But the philosophical problem is most easily demonstrated in their comparison, making it the best place to start. My personal spin on it is a rule-of-thumb that has become a theme in my teaching, educational and art-making endeavours: my mom (representing the spectrum of Leonard Cohen luddites out there) needs her curiosity to be sparked enough to ask ‘why’, while my dad and everyone else who makes a habit of looking under the hood is challenged enough to ask ‘how’. Between those two questions lies my take on Ubiquitous Computing – it just needs a friendlier name.
After the first two group projects, I was looking forward to the opportunity to work alone so that I could prioritize my focus on learning about what was going on behind the scenes, in the gyroscope and accelerometer themselves, their inputs in Arduino, how the serial communication was being sent to Processing. I very much wanted to create some stunning animated visuals, but I allowed myself to go down the rabbit holes that group work had been preventing me from (and wisely, it turns out). I watched the class videos about the gyroscope and accelerometer several times, pausing and looking everything up that I didn’t immediately comprehend (including how G force works), I researched different types of sensors, I built my own class of objects after watching and reading Shiffman tutorials. The biggest rabbit hole was my determination to use inputs from both the accelerometer as well as the gyroscope. It seemed vital that the beauty of the rolling pin be in its level of sensitivity, and I had a hard time accepting that my lack of experience and knowledge pushed this goal out of scope. But it was a good lesson for the remaining experiments in this course, and could serve as an invaluable reminder in my thesis work. I did manage to acquire nicely organized reads from both, but everything seemed to fall apart with the map function. Even once I had resigned to just using the gyroscope inputs with the map function seemingly well-implemented, there was still more of a hike in the value incrementation than I could pass off as drift.
The result from all that determination, was that although I did probably learn a lot more than I realized, I became overwhelmed by the amount of new information coming in from so many areas and with the deadline quickly closing in, I was losing my sense of comprehension. This was nowhere more the case than in the Processing code, where I was continuously distracted by all the visual possibilities while not being able to write them cohesively. I had planned to write an elegant class of animation functions, but wound up with two rect shapes that took gyroscope X, Y, and Z angle values and a few basic animation functions. It was enough to demonstrate the concept in presentation, but I should have allotted more time to the visuals and perhaps requested help with the map function.
As a self-observation I found that I get easily fixated on one route to the goal. Discussions with Manisha helped me out of this mental quicksand more than once. It was talking with her that the idea evolved from a clay cutting wire to rolling pin. I am however, finding confidence in my resourcefulness in these projects: Engineering the problem-solving how to hang the mobile with limited resources and major restraints (experiment 2) and how to turn an Arduino into a level (razor container fits it perfectly!) in a fixed way (floral foam from Dollarama) within a DIY rolling pin (PVC pipe). I had fun exploring my home, scanning everything in sight in an abstract way, reinterpreting its potential use. Or just sitting back and exploring this process mentally, recalling in 5th-element style the encyclopedic reference of tools and objects from memory, until something stands out and is moved to the category of candidates for potential use, awaiting comparison against other objects with a similar potential purpose with a different set of offerings, to see how it holds up.