Prototyping/2019-2020/T3: Difference between revisions

From XPUB & Lens-Based wiki
Line 14: Line 14:
* Why does a 8000Hz recording sound different than 44100Hz?
* Why does a 8000Hz recording sound different than 44100Hz?
* loops to test different sampling rates.... (data)compression loop ?
* loops to test different sampling rates.... (data)compression loop ?
RAW


* playing "[[Raw audio|raw]]" and non-sound data ... See [[Sonification]]
* playing "[[Raw audio|raw]]" and non-sound data ... See [[Sonification]]
* the example of the phonautograph
* the example of the phonautograph
EDITING
* commandline audio editing with [[ffmpeg]]...
* commandline audio editing with [[ffmpeg]]...
* cutting: extracting chunks with a start / duration
* cutting: extracting chunks with a start / duration
* assembling
* assembling
RIPPING
* youtube-dl
* youtube-dl
* ffmpeg to extract audio
* [[bash]] scripts with loops / variables for audio manipulation
* [[bash]] scripts with loops / variables for audio manipulation
* Example: [http://activearchives.org/wiki/Spectrum_sort spectrumsort]
* Example: [http://activearchives.org/wiki/Spectrum_sort spectrumsort]
RADIO
* Filtering for radio/streams:
* Filtering for radio/streams:
* compression (as in [https://en.wikipedia.org/wiki/Dynamic_range_compression Dynamic range compression] different from [https://en.wikipedia.org/wiki/Data_compression#Audio audio data compression]
* compression (as in [https://en.wikipedia.org/wiki/Dynamic_range_compression Dynamic range compression] different from [https://en.wikipedia.org/wiki/Data_compression#Audio audio data compression]
* "Loudness" and "Normalisation"... What is replaygain and why can it help?
* "Loudness" and "Normalisation"... What is replaygain and why can it help?
* [[liquidsoap]] for [[Liquidsoap#Sound_processing|sound processing]]  
* [[liquidsoap]] for [[Liquidsoap#Sound_processing|sound processing]]  
HRTF
* ASMR - HRTF ... https://www.youtube.com/watch?v=3VOLkehNz-8
* ASMR - HRTF ... https://www.youtube.com/watch?v=3VOLkehNz-8
* Spatilsation of Audio: https://www.york.ac.uk/sadie-project/database.html, head-related transfer functions (HRTFs)
* Spatilsation of Audio: https://www.york.ac.uk/sadie-project/database.html, head-related transfer functions (HRTFs)
* CLI spatialisation of audio: ffmpeg headphone, sofalizer
* CLI spatialisation of audio: ffmpeg headphone, sofalizer


Exercise: Create an "audio probes" a combination of particular content and a filter that (metaphorically, or literally) resonate
Exercise:
 
Create an "audio probes" a combination of particular content and a filter that (metaphorically, or literally) resonate


resources:
resources:

Revision as of 16:30, 10 May 2020

Prototyping session Spring 2020, in the context of Special Issue #12: Radio Implicancies

01

I AM SITTING IN A (CHAT) ROOM


COMMAND-LINE AUDIO WORKSTATION

  • the materiality of digital audio: samples, sampling rate, sample width, format, channels... See Sound and listening
  • Why does a 8000Hz recording sound different than 44100Hz?
  • loops to test different sampling rates.... (data)compression loop ?

RAW

  • playing "raw" and non-sound data ... See Sonification
  • the example of the phonautograph

EDITING

  • commandline audio editing with ffmpeg...
  • cutting: extracting chunks with a start / duration
  • assembling

RIPPING

  • youtube-dl
  • ffmpeg to extract audio
  • bash scripts with loops / variables for audio manipulation
  • Example: spectrumsort

RADIO

HRTF

Exercise:

Create an "audio probes" a combination of particular content and a filter that (metaphorically, or literally) resonate

resources:

Question relevant to the special issue: Are we streaming in stereo / mono? At what bitrate... Does it matter?

02

VOICE

  • text to speech / speech synthesis

Specifically the case of [MBROLA](https://github.com/numediart/MBROLA) and the "free" but not "libre" voices. https://github.com/numediart/MBROLA-voices

Espeak + MBrola https://github.com/espeak-ng/espeak-ng/blob/master/docs/mbrola.md

Projects spɛl ænd spik. hellocatfood (antonio roberts) https://www.hellocatfood.com/spell-and-speak/

"real" VOICES http://librivox.org

03

PLAYER

Radio webpage

(meta/way of working Publishing via git/githook TRY! )

  • random access media ?? (can an mp3 do a range request jump? or only ogg ??) depends on server, example of non-random access mp3
  • ubu audio player as anti-pattern ?!
  • html5 media fragments, and javascript

04

BOTS

Cross system / bots (2 parts?)

  • infobot
  • eliza
  • mud/moo
  • Bot / chatroom
  • Radio stream / schedule
  • mediawiki API (pull + push) .. example of epicpedia?
  • etherpad API (pull + push?) .. example of etherlamp (make js version?)

See: https://vnsmatrix.net/projects/corpusfantastica-moo-and-lambda-projects

05

PLEASE Leave a message

06