User:Francg/expub/specialissue2/dev: Difference between revisions

From XPUB & Lens-Based wiki
No edit summary
No edit summary
 
(16 intermediate revisions by the same user not shown)
Line 1: Line 1:
<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 550px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>'''Motion Dialogues'''
<br>Motion Dialogues</div>


<div style="float: left; color:black; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.
<br>Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.


https://pzwiki.wdka.nl/mw-mediadesign/images/a/a2/Opt-flow-py-3.png
<br>
<br>
<br>
<br>
<br>'''* * Audio Feedback Loop * *'''


<br>


<br>* The loop stops / starts again when new movement is detected inside the square’s area.
- - -
<br>* * Audio Feedback Loop * *
 
 
<br>* The loop stops / starts again when new movement is detected inside the square’s area?


<br>1- Webcam + Pd: Square Detects color change / motion
<br>1- Webcam + Pd: Square Detects color change / motion
Line 23: Line 33:


<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
<br>7- Pd: Plays automatically after a few seconds with [tabplay~]
- - -
</div>
<br>
<br>


<br><br>'''* * Pd procedure report * *'''
<br>1 - To use motion detection in Pd from our webcam, we need to use the "gem" library.
<br>2- "Pd vainilla" doesn't install "Gem" by default. We need to download it and drag the folder in Users>Library>Pd (if there isn't, we create one)
<br>3- Specify the "path" to this folder on Pd preferences.
<br>4- Oops, the webcam is still not detected! :@
<br>5- Apparently, Gem doesn't work with newer versions of Mac OS in "Pd Vainilla"
<br>6- Let's try downloading "Pd - Extended", checking the path, etc.
<br>7- Now it works! webcam is detected in Pd, success.
<br>8- However, the log sends me errors of files that couldn't be loaded. Weird.
<br>9- I keep on experimenting with the patch also using different tools from the gem library; pix_color/grey and other filters, rectangle shapes and positioning, pix_blob 4 using Osc to create sounds out of motion detection, etc.
<br>10- I try to import audio to "Pd-extended" using different methods: "openpanel" by uploading everytime the audio file and "open" from path.
...but Pd cannot open the audio file! :@
<br>11 - I need to Download XQuarz so my system's library will be automatically updated.
<br>12- Now we can import and listen to audio files! :)
<br>13- Another Issue; the audio file plays far too fast
<br>14- Check out audio settings:
<br>- in preview: (e.g. 16 bits per sample)
<br>- in Audacity: Sample Rate e.g. Format (32-bit float)
<br>- Default setting in Pd: e.g. Sample Rate: 41000




<div style="float: left; color:#00FF40; margin: 0 15px 0 0; width: 850px; font-size:120%; line-height: 1.3em; letter-spacing: 0.8px;">
<br>Feedback Loop = Score?</div>
<br>


https://pzwiki.wdka.nl/mw-mediadesign/images/d/df/22diagram2.png
<br>
<br>
https://pzwiki.wdka.nl/mw-mediadesign/images/3/36/Loop_diagram.png
<br>
<br>
<br>
<br>
'''* * Meeting notes / Feedback * *'''
https://pzwiki.wdka.nl/mw-mediadesign/images/9/99/Motion-option2.png
 
 
- How can a body be represented into a score?<br>
 
- "Biovision Hierarchy" = file format - motion detection.<br>
 
-    [http://thursdaynight.hetnieuweinstituut.nl/en/activities/femke-snelting-reads-biovision-hierarchy-standard Femke Snelting reads the Biovision Hierarchy Standard]<br>
 
- Systems of notations and choreography - Johanna's thesis in the wiki<br>
 
 
Raspberry Pi *
 
- Floppy disk: contains a patch from Pd.
 
- Box: Floppy Drive, camera, mic...
 
- Server: Documentation such as images, video, prototypes, resources... 
 
<br>- There are two different research paths that could be more interestingly further explored separately; <br><br>
1 - on one hand, * motion capture * by employing tools/software like "Kinect", "Synapse" app, "Max MSP", "Ableton", etc...
 
2 - on the other hand, there is data / information reading
* This can be further developed and simplified.
* However, motion capture using Pd and an ordinary webcam to make audio effects could be efficiently linked.
 
</div>

Latest revision as of 08:06, 7 March 2017


Motion Dialogues


Initially influenced by the interest on the current migration flux hitting occident, I will explore physical movement in specific delimited spaces and the reaction/consequences that this physical action will involve. It aims to generate audio feedback loops by using motion and color detection techniques in Pd.


Opt-flow-py-3.png





- - -
* * Audio Feedback Loop * *



* The loop stops / starts again when new movement is detected inside the square’s area?


1- Webcam + Pd: Square Detects color change / motion


2- Pd: It activates oscilators and generates sound / or plays imported audio file


3- Pd: Sends signal to speakers


4- Speakers: They reproduce Pd audio


5- Microphone: Mic connected to Raspberry Pi, placed near speakers detects the sound (+ surroundings making a mix?)


6- Pd: Live-recording on table (array) with [tabwrite~] just a few sec


7- Pd: Plays automatically after a few seconds with [tabplay~] - - -





Feedback Loop = Score?


22diagram2.png

Loop_diagram.png

Motion-option2.png

Retrieved from "https://pzwiki.wdka.nl/mw-mediadesign/index.php?title=User:Francg/expub/specialissue2/dev&oldid=104443"