User:Sebastian Cimpean/gradproject/thesisfirstdraft

First Draft

what is the thesis
This thesis takes the form of a project report.

what are you going to talk about
Within this project report I would like to cover three main topics:

1. theoretical/conceptual and practical background to new-media art looking at both:
   • the history of immersive art (created with 360 degree environments)
   • technologically driven art (such as the E.A.T. collective)
   • history of projection
2. the conceptual background of my own project
   • flatland
   • journey through multiple dimensions
3. the technicality of my own project.
   • software
   • hardware
   • techniques
   • xbox kinect as a way of using a lens with a filter that makes it aesthetically continuous with the rest of the things.

what is your project
Concept: My project is an audio-visual immersive performance, where the audience is taken on a multi-dimensional journey. The main subject of play is perspective, and the goal is to affect the way the audience perceives the space surrounding them. If it is about a journey in multiple dimensions, I would first like them to perceive the space around them as a two-dimensional space, three-dimensional space, after which I would like to make them aware of the forth and possibly the fifth dimension. The most basic method in which I intend to do this is for each dimension, set up a set of rules, that become true/real to the audience, after I feel like they believe in them, my intention is to break the rules, in order to transcend to another dimension, where the process is repeated.

Practical: The project consists of a mapped 360 degree projected environment.

Previous practice / relation
This project is an extension of my previous work regarding mapping and perception of space. Previously I worked with augmented reality, focusing on the sense of perception related to one object. This time, rather than allowing the audience to view the object itself, my intention is to place the audience within the object, and therefore be completely immersed in the space that I create.

Additionally, as a result of a recent test where I hacked the Xbox Kinect in order to create abstract imagery through a lens, I continue working on my cinematographic skills, creating moving images. The abstractness and the hacking through coding of the image is also an extension of motion graphics - a field that I’ve been heavily involved in the last few years. All of this relates to the content than I’m generating, and if not created through this modified camera, it is motion graphics/animation.

Sections/Tags Perspective Multi-dimensionality Space Light + Shadow/Darkness Screen(s)

exp01

initial intention
The initial intention of this test was to observe the effects of a projected luminous object against a stroboscopic background (flickering between white and black). Secondarily, from visualization tests conducted in Cinema4D, I became interested in observing the effect the relationship between the shadow and object can create. From the visualization test, I noticed that the stroboscopic background can affect the way we perceive the shadow, more specifically, it appeared to move with a latency compared to the object creating it.

inputs [projected materials]
A series of videos of a pyramid and its shadow were created. In each video the relationship between the pyramid and its shadow is different, varying from a static shadow to a synchronized and desynchronized shadow. Additionally, different textures were used for the pyramid to test its “luminosity” when projected in contrast to the stroboscopic background, these textures included, highly luminous, matte and reflective.

modifiers
Modifiers for this test were not necessarily needed, as the goal was to see the relationship between the luminous object and stroboscopic background when projected. This being said, the speed of the videos was affected therefore changing the frame-rate of the video - especially when working with the feed of the stroboscopic source video.
Additionally, simple mapping techniques were used in order to display multiple videos on the same screen while placing them in specific parts of the screen. (scaling/position)
Potentially, the blur effect can have an use in this section.

output [screen(s)]
For this test, a flat, two dimensional surface was primarily used. Part of the test was conducted using an additional two-dimensional screen that was positioned in front of the original surface to add physical depth. This secondary screen was also tested as a moving screen.

back end
VDMX - a VJing software - was used to project, map and apply any changes other changes to the video.
The back of videos was generated using Cinema4D and AfterEffects.

conclusion
While the test proved the initial intuition not very effective, new things were discovered. The reason why the effect was not effective is because the relationship between the shadow and the object needs to be more drastically visualized (the shadow needs to go evidently out of sync). Furthermore, this effect does start to have an impact when the video is programmed to emphasize the change, ie: a movie with the shadow moving in sync, followed by a movie where the shadow stops, seamlessly joined. The transition has the most effect. This could also extend with the use of stroboscopic to flicker between different video files, in sync with the stroboscopic background, ie: the stroboscopic effect should be used as a transitional effect, as it overpowers the content, and it's hard to see the change. One of the new discoveries is related to perspective, and more precisely, forced perspective. When the pyramids were arranged in a forced perspective, walking around the screen created parallax, meaning that the brain creates the space that is actually absent. This technique will be investigated further. Going back to the forced depth, where an additional screen was placed in front of the original screen, what is interesting is that when you walk around the space, the forced perspective moves the object in the foreground screen either in front, or actually behind the foreground object in the original screen. Moving the screen emphasizes this effect further.