User:Francg/expub/specialissue2/dev: Difference between revisions

Latest revision as of 08:06, 7 March 2017

Motion Dialogues

Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.

- - -
* * Audio Feedback Loop * *

* The loop stops / starts again when new movement is detected inside the square’s area?

1- Webcam + Pd: Square Detects color change / motion

2- Pd: It activates oscilators and generates sound / or plays imported audio file

3- Pd: Sends signal to speakers

4- Speakers: They reproduce Pd audio

5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)

6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec

7- Pd: Plays automatically after a few seconds with [tabplay~] - - -

Feedback Loop = Score?

@@ Line 1: / Line 1: @@
-<div style="float: left; margin: 0 15px 0 0; width: 550px; ; font-size:90%; line-height: 1.3em; letter-spacing: 0.8px;">
+<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
-<br>
+<br>Motion Dialogues</div>
+<div style="float: left; color:black; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
+<br>Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.
-	* * Puredata * *
+https://pzwiki.wdka.nl/mw-mediadesign/images/a/a2/Opt-flow-py-3.png
-	Procedure report:
+<br>
+<br>
+<br>
+<br>
-- To use motion detection in Pd from our webcam, we need to use the "gem" library.
+- - -
+<br>* * Audio Feedback Loop * *
-- "Pd vainilla" doesn't install "Gem" by default. We need to download it and drag the folder in Users>Library>Pd (if there isn't, we create one)
-- Specify the "path" to this folder on Pd preferences.
+<br>* The loop stops / starts again when new movement is detected inside the square’s area?
-- Oops, the webcam is still not detected! :@
+<br>1- Webcam + Pd: Square Detects color change / motion
-- Apparently, Gem doesn't work with newer versions of Mac OS in "Pd Vainilla"
+<br>2- Pd: It activates oscilators and generates sound / or plays imported audio file
-- Let's try downloading "Pd - Extended", checking the path, etc.
+<br>3- Pd: Sends signal to speakers
-- Now it works! webcam is detected in Pd, success.
+<br>4- Speakers: They reproduce Pd audio
-- However, the log sends me errors of files that couldn't be loaded. Weird.
+<br>5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)
-- I keep on experimenting with the patch also using different tools from the gem library; pix_color/grey and other filters, rectangle shapes and positioning, pix_blob 4 using Osc to create sounds out of motion detection, etc.
+<br>6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec
-- I try to import audio to "Pd-extended" using different methods: "openpanel" by uploading everytime the audio file and "open" from path.
+<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
-	...but Pd cannot open the audio file! :@
+- - -
+</div>
+<br>
+<br>
-- I need to Download XQuarz so my system's library will be automatically updated.
-- Now we can import and listen to audio files! :)
-- Another Issue; the audio file plays far too fast
+<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
+<br>Feedback Loop = Score?</div>
+<br>
-- Check out audio file:
+https://pzwiki.wdka.nl/mw-mediadesign/images/d/df/22diagram2.png
-		- in preview: (16 bits per sample)
+<br>
-		- in Audacity: Sample Rate Format (32-bit float)
+<br>
-		- Default setting in Pd: Sample Rate: 41000
+https://pzwiki.wdka.nl/mw-mediadesign/images/3/36/Loop_diagram.png
+<br>
-		Which settings do work: 24000 Sample Rate
+<br>
+https://pzwiki.wdka.nl/mw-mediadesign/images/9/99/Motion-option2.png
-<br><br>
-	* * *					   * * *
-			Meeting notes / Feedback
-		* * *					   * * *
-	-	How can a body be represented into a score?
-	-	"Biovision Hierarchy" = file format - motion detection.
-	-     	[http://thursdaynight.hetnieuweinstituut.nl/en/activities/femke-snelting-reads-biovision-hierarchy-standard Femke Snelting reads the Biovision Hierarchy Standard]
-	- Systems of notations and coreography - Johanna's thesis in the wiki
-<br>- There are blocks of different technical properties that doesn't really connect to each other, which it seems arbitrary. In order to clarify and strengthen the concept, they need to run sepparately; <br><br>
-- on one side there is * motion capture * using different tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...
-			* This one could be more interestingly explored separately<br>
-- on the other hand, there is data / information reading
-		(e.g. countries, number of refugees arrived / dead / ... )
-			* This can be further developed and simplified.
-			* However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.
-	- - - - - -
-	Raspberry Pi *
-	- How to apply "Migration Flux" data
-	- Floppy disk: contains a patch from Pd.
-	- Box: Floppy Drive, camera, mic...
-	- Server: Documentation such as images, video, prototypes, resources...
-</div>