User:)biyibiyibiyi(/grad project/repeater narration: Difference between revisions

From XPUB & Lens-Based wiki
(Created page with "==Narrative Video on Repeater== ===Props=== 500px|pointing stick")
 
 
(24 intermediate revisions by the same user not shown)
Line 1: Line 1:
==Narrative Video on Repeater==
==Narrative Video on Repeater==
===Props===
===Props===
[[File:IMG 3526.JPG|500px|pointing stick]]
[[File:IMG 3526.JPG|400px|caption]] pointing stick
[[File:IMG 3527.JPG|400px|caption]] oversized repeater made from cardboard
 
the repeater prop was inspired by how Haraway put masking tapes on the monitors...
 
===Affect===
[[File:Sign board.jpg|300px]]
[[File:Affective_gesture.jpg|300px]]
[[File:Farocki_affection.jpg|300px]]
 
===Narration===
 
===sketches in process===
* affective relationship between body and sound, materialized by the hand gestures for phonetic symbols.
 
[[File:Phonetic_gesture_1.png | 300px]]
[[File:Phonetic_gesture_2.png | 300px]]
 
watch link: uTube https://www.youtube.com/playlist?list=PLKb41PcUsXvJtpjqYTKVF0PhVFOj7LBGj
 
===make a "contact sheet format" collage with ffmpeg matrix method===
 
Started with this recipe:
<source lang="bash">
ffmpeg \
  -i videos/01.mkv \
  -i videos/02.mkv \
  -i videos/03.mkv \
  -i videos/04.mkv \
  -filter_complex " \
      [0:v] setpts=PTS-STARTPTS, scale=qvga [a0]; \
      [1:v] setpts=PTS-STARTPTS, scale=qvga [a1]; \
      [2:v] setpts=PTS-STARTPTS, scale=qvga [a2]; \
      [3:v] setpts=PTS-STARTPTS, scale=qvga [a3]; \
      [a0][a1][a2][a3]xstack=inputs=4:layout=0_0|0_h0|w0_0|w0_h0[out] \
      " \
    -map "[out]" \
    -c:v libx264 -t '30' -f matroska output_col_2x2.mkv
</source>
from ffmpeg wiki:https://trac.ffmpeg.org/wiki/Create%20a%20mosaic%20out%20of%20several%20input%20videos%20using%20xstack
 
log:
I adjusted the command and input two separate files. It either returned errors 'cannot find 01.mp4' or didn't run the commands. I don't know what the errors resulted from? the tutorial was quite self explanatory in terms of how the layout of mosaic is generated.
 
it could be these reasons I wasn't able to output a mosaic:
the clips are not entirely in sync. I watched another tutorial, before putting together the mosaic each video needs to be trimmed.
 
my videos are 1280x720px, try another tutorial? for now not use different videos but the same video. like this tutorial: https://www.youtube.com/watch?v=dYGs77q_dqA
 
log: I changed the parameters of this video's script, it didn't work. 
 
<source lang="bash">
ffmpeg -i 01.mp4 -i 02.mp4 -i 03.mp4 -i 04.mp4 -filter_complex "nullsrc=size=1280x720 [base]; [0:v] setpts=PTS-STARTPTS, scale=640x360 [upperleft]; [1:v] setpts=PTS-STARTPTS, scale=640x360 [upperright]; [2:v] setpts=PTS-STARTPTS, scale=640x360 [lowerleft]; [3:v] setpts=PTS-STARTPTS, scale=640x360 [lowerright]; [base][upperleft] overlay=shortest=1 [tmp1]; [tmp1][upperright] overlay=shortest=1:x=640 [tmp2]; [tmp2][lowerleft] overlay=shortest=1:y=360 [tmp3]; [tmp3][lowerright] overlay=shortest=1:x=640:y=360" -c:v libx264 output.mp4
</source>
 
from ffmepg wiki: https://trac.ffmpeg.org/wiki/Create%20a%20mosaic%20out%20of%20several%20input%20videos
 
log:I named one identical video to four files with different names to see if the command works, it worked and output something like this:
 
[[File:still_sync_a.png |300px]]
video link:https://www.youtube.com/watch?v=tBrw5eZc3mM&feature=youtu.be
 
at least the command works. try with not identical video clips:
 
log: worked so quite surprising. I thought the different video lengths is a problem. the audio retained the audio of the very first input.
 
[[File:sync_multi.png|300px]]
watch here:https://www.youtube.com/watch?v=FY9lO3-hAVM&feature=youtu.be
 
it will be more desirable if:
 
1.there can be gaps in between the video and i can set the gaps my self, without conflicting the parameters for setting width and height for each inputs.
 
2. the video can loop
 
3. try slow down the video and play with the slowed down effects
 
4. the collage's video length is not determined by the shorted length? in the four videos the longest one is 6 seconds but the collage is 4 seconds.
 
 
.....many more? ffmpeg offer quite a lot of mechanisms to play with video collage that can be exploited conceptually by video essays.
 
* repeater demo video with narration
watch link:
 
Tutorial notes: 13rd and 14th May:
 
 
 
====Essay on repeater and its media archaeological values====
https://pad.xpub.nl/p/repeater_archaeology_context
====Phrases I collected on Xianyu, the trading app====
An Archaeology of Repeaters: Stickers, User Narratives, Designs.
 
公务员标准英语300句两盒录音带,三字经录音带一盒.流行歌曲一盒。
Gift in package: 2 cassette tape recordings of 300 English Phrases for Civil Servants; 1 cassette tape The Three Character Canon; 1 cassette tape pop songs.
 
磁带(卡带)播放,复读,录音比对,功能完好,喜欢收藏的可考虑。自提,谢谢!Cassette tape playing, repeating, comparing audio clips. Great for collectors.
 
童年最奢侈的礼物——复读机,那会并没有用它学英语,可能都听了周杰棍的双截龙了,喜欢私信我。
The most luxurious gift in childhood - the repeater. Didn’t use it to learn English at the time, all spent to listen Jay Chou’s pop songs! Message me if you like.
 
童年记忆不包邮,售出后不退换。
Shipping not included for childhood memory, no return.
 
more here on pad: https://pad.xpub.nl/p/repeater_trading_phrases

Latest revision as of 11:25, 13 May 2020

Narrative Video on Repeater

Props

caption pointing stick caption oversized repeater made from cardboard

the repeater prop was inspired by how Haraway put masking tapes on the monitors...

Affect

Sign board.jpg Affective gesture.jpg Farocki affection.jpg

Narration

sketches in process

  • affective relationship between body and sound, materialized by the hand gestures for phonetic symbols.

Phonetic gesture 1.png Phonetic gesture 2.png

watch link: uTube https://www.youtube.com/playlist?list=PLKb41PcUsXvJtpjqYTKVF0PhVFOj7LBGj

make a "contact sheet format" collage with ffmpeg matrix method

Started with this recipe:

ffmpeg \
   -i videos/01.mkv \
   -i videos/02.mkv \
   -i videos/03.mkv \
   -i videos/04.mkv \
  -filter_complex " \
      [0:v] setpts=PTS-STARTPTS, scale=qvga [a0]; \
      [1:v] setpts=PTS-STARTPTS, scale=qvga [a1]; \
      [2:v] setpts=PTS-STARTPTS, scale=qvga [a2]; \
      [3:v] setpts=PTS-STARTPTS, scale=qvga [a3]; \
      [a0][a1][a2][a3]xstack=inputs=4:layout=0_0|0_h0|w0_0|w0_h0[out] \
      " \
    -map "[out]" \
    -c:v libx264 -t '30' -f matroska output_col_2x2.mkv

from ffmpeg wiki:https://trac.ffmpeg.org/wiki/Create%20a%20mosaic%20out%20of%20several%20input%20videos%20using%20xstack

log: I adjusted the command and input two separate files. It either returned errors 'cannot find 01.mp4' or didn't run the commands. I don't know what the errors resulted from? the tutorial was quite self explanatory in terms of how the layout of mosaic is generated.

it could be these reasons I wasn't able to output a mosaic: the clips are not entirely in sync. I watched another tutorial, before putting together the mosaic each video needs to be trimmed.

my videos are 1280x720px, try another tutorial? for now not use different videos but the same video. like this tutorial: https://www.youtube.com/watch?v=dYGs77q_dqA

log: I changed the parameters of this video's script, it didn't work.

ffmpeg -i 01.mp4 -i 02.mp4 -i 03.mp4 -i 04.mp4 -filter_complex "nullsrc=size=1280x720 [base]; [0:v] setpts=PTS-STARTPTS, scale=640x360 [upperleft]; [1:v] setpts=PTS-STARTPTS, scale=640x360 [upperright]; [2:v] setpts=PTS-STARTPTS, scale=640x360 [lowerleft]; [3:v] setpts=PTS-STARTPTS, scale=640x360 [lowerright]; [base][upperleft] overlay=shortest=1 [tmp1]; [tmp1][upperright] overlay=shortest=1:x=640 [tmp2]; [tmp2][lowerleft] overlay=shortest=1:y=360 [tmp3]; [tmp3][lowerright] overlay=shortest=1:x=640:y=360" -c:v libx264 output.mp4

from ffmepg wiki: https://trac.ffmpeg.org/wiki/Create%20a%20mosaic%20out%20of%20several%20input%20videos

log:I named one identical video to four files with different names to see if the command works, it worked and output something like this:

Still sync a.png video link:https://www.youtube.com/watch?v=tBrw5eZc3mM&feature=youtu.be

at least the command works. try with not identical video clips:

log: worked so quite surprising. I thought the different video lengths is a problem. the audio retained the audio of the very first input.

Sync multi.png watch here:https://www.youtube.com/watch?v=FY9lO3-hAVM&feature=youtu.be

it will be more desirable if:

1.there can be gaps in between the video and i can set the gaps my self, without conflicting the parameters for setting width and height for each inputs.

2. the video can loop

3. try slow down the video and play with the slowed down effects

4. the collage's video length is not determined by the shorted length? in the four videos the longest one is 6 seconds but the collage is 4 seconds.


.....many more? ffmpeg offer quite a lot of mechanisms to play with video collage that can be exploited conceptually by video essays.

  • repeater demo video with narration

watch link:

Tutorial notes: 13rd and 14th May:


Essay on repeater and its media archaeological values

https://pad.xpub.nl/p/repeater_archaeology_context

Phrases I collected on Xianyu, the trading app

An Archaeology of Repeaters: Stickers, User Narratives, Designs.

公务员标准英语300句两盒录音带,三字经录音带一盒.流行歌曲一盒。 Gift in package: 2 cassette tape recordings of 300 English Phrases for Civil Servants; 1 cassette tape The Three Character Canon; 1 cassette tape pop songs.

磁带(卡带)播放,复读,录音比对,功能完好,喜欢收藏的可考虑。自提,谢谢!Cassette tape playing, repeating, comparing audio clips. Great for collectors.

童年最奢侈的礼物——复读机,那会并没有用它学英语,可能都听了周杰棍的双截龙了,喜欢私信我。 The most luxurious gift in childhood - the repeater. Didn’t use it to learn English at the time, all spent to listen Jay Chou’s pop songs! Message me if you like.

童年记忆不包邮,售出后不退换。 Shipping not included for childhood memory, no return.

more here on pad: https://pad.xpub.nl/p/repeater_trading_phrases