Handheld device interacts with camera in 3D software
When I was making my second animation “Bullet Trail”, my friend and I found that blocking the scene in 3D software is really painful since we could not operate the virtual camera by our hand. Instead, setting key frames by clicking the mouse not only takes longer time, but also results in stiff camera movement. The solution that has been using in industry is capturing the virtual camera movement by motion capture system, which is surprisingly pricey and inaccessible for independent 3D artist.
On the other hand, gyroscope and accelerometer, which can also record the movement of the device, have already became an essential part of our smart phones. Thus, is there any way that can create connection between the hand held device, by this term phones, and 3D software via Wi-Fi or Bluetooth? Answer is yes, with the rapid development of the App market, more and more app that designed for 3D artist using the build-in sensors have emerged. CameraMan, an app on iOS, by utilizing the data from build-in gyroscope and transfers them into the x, y and z axis position and rotation of a camera in Maya.
In recent years, as the development of technologies in the arena of digital media, the inseparable and complete integration of digital technologies into the film industry due to the new emerging technologies and science, the film creators and producers have gained much more freedom in the imagination and have multiple choices in diverse themes and topics than ever before. While at the same time, the professional equipments and softwares, like 3D Virtual Cameras, Fusion Cameras Systems and 3D softwares, have been developed to accommodate the rapid-changing scenes and requirements in the industry to produce complex and visual effect in scenes and footages.
The beauty of CGI technology is that it enables artist a way to bring the real world into computer and re-create the world in a different perspective. For example, the film director of “Avatar” James Cameron has developed some specific 3D Fusion Cameras and Virtual Camera to catch and shoot the actions performed by real characters and integrated into virtual footage simultaneously. We can simply regard this kind of technology as an excellent example of the integration between the “Augmented Reality(AR)” and “Virtual Reality(VR)” in the film industry. Director Steven Allan Spielberg has also deployed similar technologies in his just-yet-released film “The Adventures of Tintin”. The artists and directors now can utilize high-end digital technologies to bring the scenes from the imagination into the eyes of the audiences.
Check the Full Reports here: Handheld device interaction
- ScienceProg(January 3rd, 2010). “Technologies used in “Avatar” Movie.”. Retrieved from
- Wikipedia. “Virtual Camera”. Retrieved from
- Thomas C. Grane(2010). “Avatar: Creating the World of Pandora”. Retrieved from
- Jim Thacker(October 13th, 2011). “iDevCam: Control the 3dsMax camera with an iPhone”. Retrieved from
- http://www.cgchannel.com/2011/10/idevcam-control-the-3ds-max-camera-with-an-ip hone/
- Jim Thacker(March 31st, 2011). “New app records camera moves from your iPhone”. Retrieved from
- http://www.cgchannel.com/2011/03/new-app-records-camera-moves-from-your-ipho ne/
- Prosthetic Knowledge(October 3rd, 2013). “Computational Photography”. Retrieved from
- http://rhizome.org/editorial/2013/oct/3/prosthetic-knowledge-computational-photogra phy/
- IDNA(October 23rd, 2013). “360-Degree Spacial Story Telling iPad App”. Retrieved from