Prototyping/2019-2020/T3

Prototyping session Spring 2020, in the context of Special Issue #12: Radio Implicancies

01

I AM SITTING IN A (CHAT) ROOM

• Listen: Alvin Lucier's I am Sitting in a room

• Listen: Janet Cardiff A Large Slow River

• http://radio.aporee.org/

COMMAND-LINE AUDIO WORKSTATION

• the materiality of digital audio: samples, sampling rate, sample width, format, channels... See Sound and listening
• Why does a 8000Hz recording sound different than 44100Hz?
• loops to test different sampling rates.... (data)compression loop ?

RAW

• playing "raw" and non-sound data ... See Sonification
• the example of the phonautograph

EDITING

• commandline audio editing with ffmpeg...
• cutting: extracting chunks with a start / duration
• assembling

RIPPING

• youtube-dl
• ffmpeg to extract audio

• bash scripts with loops / variables for audio manipulation
• Example: spectrumsort

RADIO

• Filtering for radio/streams:
• compression (as in Dynamic range compression different from audio data compression
• "Loudness" and "Normalisation"... What is replaygain and why can it help?
• liquidsoap for sound processing

HRTF

• ASMR - HRTF ... https://www.youtube.com/watch?v=3VOLkehNz-8
• Spatilsation of Audio: https://www.york.ac.uk/sadie-project/database.html, head-related transfer functions (HRTFs)
• CLI spatialisation of audio: ffmpeg headphone, sofalizer

Exercise:

Create an "audio probes" a combination of particular content and a filter that (metaphorically, or literally) resonate

resources:

• field recordings @ freemusicarchive
• sound art on ubu
• William Burroughs: cut-ups + The Electronic Revolution

Question relevant to the special issue: Are we streaming in stereo / mono? At what bitrate... Does it matter?

02

VOICE

• text to speech / speech synthesis

Specifically the case of [MBROLA](https://github.com/numediart/MBROLA) and the "free" but not "libre" voices. https://github.com/numediart/MBROLA-voices

Espeak + MBrola https://github.com/espeak-ng/espeak-ng/blob/master/docs/mbrola.md

Projects spɛl ænd spik. hellocatfood (antonio roberts) https://www.hellocatfood.com/spell-and-speak/

"real" VOICES http://librivox.org

• speech to text
• We Hope This Email Finds You Well

03

PLAYER

Radio webpage

• Audio player (html/js)
• guest book cgi??!! (socially determined captcha !)
• Player: display metadata (Metadata from icecast? https://stackoverflow.com/questions/6115531/is-it-possible-to-get-icecast-metadata-from-html5-audio-element ) TRY!
• Generate podcast/RSS with json + Template (template.py(python+jinja)/makefile)
• Stream access (scheduling)

(meta/way of working Publishing via git/githook TRY! )

• random access media ?? (can an mp3 do a range request jump? or only ogg ??) depends on server, example of non-random access mp3
• ubu audio player as anti-pattern ?!
• html5 media fragments, and javascript

04

BOTS

Cross system / bots (2 parts?)

• infobot
• eliza
• mud/moo

• Bot / chatroom
• Radio stream / schedule
• mediawiki API (pull + push) .. example of epicpedia?
• etherpad API (pull + push?) .. example of etherlamp (make js version?)

See: https://vnsmatrix.net/projects/corpusfantastica-moo-and-lambda-projects

05

PLEASE Leave a message

• https://mdn.github.io/web-dictaphone/ https://github.com/mdn/web-dictaphone/ (+ javascript looping / instrument) ... now how to save / submit ... (
• online recording interface... interface with CGI to save/serve files ?
• https://developer.mozilla.org/en-US/docs/Web/API/MediaRecorder
• https://github.com/mattdiamond/Recorderjs
• Angeliki Diakrousis http://radioactive.w-i-t-m.net/

06

• gitea webhooks
• CGI to receive a JSON post
• php to receive JSON post (example on gitea webhooks page)
• CGI (making a "helloworld" / printenv with python) See CGI checklist