User:Sebastian Cimpean/gradproject/thesisfirstdraft

First Draft

what is the thesis
This thesis takes the form of a project report.

what are you going to talk about
Within this project report I would like to cover three main topics:

1. theoretical/conceptual and practical background to new-media art looking at both:
   • the history of immersive art (created with 360 degree environments)
   • technologically driven art (such as the E.A.T. collective)
   • history of projection
2. the conceptual background of my own project
   • flatland
   • journey through multiple dimensions
3. the technicality of my own project.
   • software
   • hardware
   • techniques
   • xbox kinect as a way of using a lens with a filter that makes it aesthetically continuous with the rest of the things.

what is your project
Concept: My project is an audio-visual immersive performance, where the audience is taken on a multi-dimensional journey. The main subject of play is perspective, and the goal is to affect the way the audience perceives the space surrounding them. If it is about a journey in multiple dimensions, I would first like them to perceive the space around them as a two-dimensional space, three-dimensional space, after which I would like to make them aware of the forth and possibly the fifth dimension. The most basic method in which I intend to do this is for each dimension, set up a set of rules, that become true/real to the audience, after I feel like they believe in them, my intention is to break the rules, in order to transcend to another dimension, where the process is repeated.

Practical: The project consists of a mapped 360 degree projected environment.

Previous practice / relation
This project is an extension of my previous work regarding mapping and perception of space. Previously I worked with augmented reality, focusing on the sense of perception related to one object. This time, rather than allowing the audience to view the object itself, my intention is to place the audience within the object, and therefore be completely immersed in the space that I create.

Additionally, as a result of a recent test where I hacked the Xbox Kinect in order to create abstract imagery through a lens, I continue working on my cinematographic skills, creating moving images. The abstractness and the hacking through coding of the image is also an extension of motion graphics - a field that I’ve been heavily involved in the last few years. All of this relates to the content than I’m generating, and if not created through this modified camera, it is motion graphics/animation.

Sections/Tags Perspective Multi-dimensionality Space Light + Shadow/Darkness Screen(s)

exp01

initial intention
The initial intention of this test was to observe the effects of a projected luminous object against a stroboscopic background (flickering between white and black). Secondarily, from visualization tests conducted in Cinema4D, I became interested in observing the effect the relationship between the shadow and object can create. From the visualization test, I noticed that the stroboscopic background can affect the way we perceive the shadow, more specifically, it appeared to move with a latency compared to the object creating it.

inputs [projected materials]
A series of videos of a pyramid and its shadow were created. In each video the relationship between the pyramid and its shadow is different, varying from a static shadow to a synchronized and desynchronized shadow. Additionally, different textures were used for the pyramid to test its “luminosity” when projected in contrast to the stroboscopic background, these textures included, highly luminous, matte and reflective.

modifiers
Modifiers for this test were not necessarily needed, as the goal was to see the relationship between the luminous object and stroboscopic background when projected. This being said, the speed of the videos was affected therefore changing the frame-rate of the video - especially when working with the feed of the stroboscopic source video.
Additionally, simple mapping techniques were used in order to display multiple videos on the same screen while placing them in specific parts of the screen. (scaling/position)
Potentially, the blur effect can have an use in this section.

output [screen(s)]
For this test, a flat, two dimensional surface was primarily used. Part of the test was conducted using an additional two-dimensional screen that was positioned in front of the original surface to add physical depth. This secondary screen was also tested as a moving screen.

back end
VDMX - a VJing software - was used to project, map and apply any changes other changes to the video.
The back of videos was generated using Cinema4D and AfterEffects.

conclusion
While the test proved the initial intuition not very effective, new things were discovered. The reason why the effect was not effective is because the relationship between the shadow and the object needs to be more drastically visualized (the shadow needs to go evidently out of sync). Furthermore, this effect does start to have an impact when the video is programmed to emphasize the change, ie: a movie with the shadow moving in sync, followed by a movie where the shadow stops, seamlessly joined. The transition has the most effect. This could also extend with the use of stroboscopic to flicker between different video files, in sync with the stroboscopic background, ie: the stroboscopic effect should be used as a transitional effect, as it overpowers the content, and it's hard to see the change. One of the new discoveries is related to perspective, and more precisely, forced perspective. When the pyramids were arranged in a forced perspective, walking around the screen created parallax, meaning that the brain creates the space that is actually absent. This technique will be investigated further. Going back to the forced depth, where an additional screen was placed in front of the original screen, what is interesting is that when you walk around the space, the forced perspective moves the object in the foreground screen either in front, or actually behind the foreground object in the original screen. Moving the screen emphasizes this effect further.

exp02

initial intention
The initial intention was to see the effects of projecting into a spherical mirror, focusing on how the image is spread to cover a large area (over 180 degrees of view).

inputs [projected materials]
Video file.

modifiers
None (other than the spherical mirror).

output
Large sized projection, the spherical mirror reflecting the image into a more than 180 degree projection.

back end
Spherical mirror / silver coated ball

conclusion
The problem with projecting using a spherical mirror is that the light is spread almost too much and therefore actually lights up a dark space. Secondly, the contrast, intensity and visibility of the image is lowered, and projecting graphical videos results in an image that is difficult to distinguish. This is also the reason why the projected image in the test is a photographic moving image. That being said, if the actual camera (in the source material) is moving a lot, the effect of the whole room moving is quite strong. I see this technique being used to create an ambiance in the space, and although seeing the whole room moving is strong, I think a 360 degree synced projection and out of multiple projectors could be stronger due to the higher quality of the image.