Prototyping/2019-2020/T3

Prototyping session Spring 2020, in the context of Special Issue #12: Radio Implicancies

This page is currently being worked on.

01

In the work for the Special Issue, we will employ a strategy of working between systems

Proposition is to publish prototyping work alongside other developments of the Special Issue in a rolling fashion, ie following an "early and often" approach to publishing.

Focus on using the wiki as a "cookbook" -- a place to record useful techniques for others.

• Review setup with liquidsoap and icecast from the sandbox to the lurk server.
• Review setup of webhook connecting git repo with webpage on sandbox
• Example of adding a makefile to the workflow. Idea of separating sources from outputs (targets in make speak).
• git and make not just for code presentation about using makefile and git in publishing workflows

practical to do's

• Update issue.xpub.nl to point http://issue.xpub.nl/12/ to (redirect to?) The working space of SI12.
• Understand and make use of the git & make based workflow.
• Familiarity using liquidsoap to create icecast streams.
• Use liquidsoap to create flexible streams that can be interrupted
• Use top to check the load on the sandbox
• Use liquidsoap as an editing tool to assemble, mix, and filter audio
• Explore some basic structural elements of liquidsoap (playlist, rotate, sequence).

Make Noise

• the colors of noise (using sox to generate white, brown, and pink noise)

Live or Fallback

• liquidsoap fallbacks
• mixing diverse sources of material...
• working with silence
• dynamics compression and loudness
• test streaming to an interruptable mount point...

• BASIC cutting / format manipulation with ffmpeg such as extracting chunks with a start / duration

Listening for next week

• Listen: Alvin Lucier's I am Sitting in a room
• Listen: Janet Cardiff A Large Slow River
• Radio Aporee

Mixing audio sources

• Filtering for radio/streams:
• compression (as in Dynamic range compression different from audio data compression
• "Loudness" and "Normalisation"... What is replaygain and why can it help?
• liquidsoap for sound processing

resources:

• The materiality of digital audio: samples, sampling rate, sample width, format, channels... See Sound and listening
• Playing "raw" and non-sound data ... See Sonification
• field recordings @ freemusicarchive
• sound art on ubu
• William Burroughs: cut-ups + The Electronic Revolution
• Example: spectrumsort

Question relevant to the special issue: Are we streaming in stereo / mono? At what bitrate... Does it matter?

Assignment(s) for next week

• Make a "self-referential" radio program with liquidsoap... that is one where the content and the material of its transmission and its tools of production are reflected.

• Document your use of liquidsoap, or other tool(s) in the xpub wiki in the style of a (code) "Cookbook" recipe.

02

VOICE

• text to speech / speech synthesis

Specifically the case of [MBROLA](https://github.com/numediart/MBROLA) and the "free" but not "libre" voices. https://github.com/numediart/MBROLA-voices

Espeak + MBrola https://github.com/espeak-ng/espeak-ng/blob/master/docs/mbrola.md

Projects spɛl ænd spik. hellocatfood (antonio roberts) https://www.hellocatfood.com/spell-and-speak/

"real" VOICES http://librivox.org

• speech to text
• We Hope This Email Finds You Well
• festival provides *text2wave* which liquidsoap uses

HRTF

• ASMR - HRTF ... https://www.youtube.com/watch?v=3VOLkehNz-8
• Spatilsation of Audio: https://www.york.ac.uk/sadie-project/database.html, head-related transfer functions (HRTFs)
• CLI spatialisation of audio: ffmpeg headphone, sofalizer
• https://trac.ffmpeg.org/wiki/AudioChannelManipulation#VirtualBinauralAcoustics

03

PLAYER

Radio webpage

• Audio player (html/js)
• guest book cgi??!! (socially determined captcha !)
• Player: display metadata (Metadata from icecast? https://stackoverflow.com/questions/6115531/is-it-possible-to-get-icecast-metadata-from-html5-audio-element ) TRY!
• Generate podcast/RSS with json + Template (template.py(python+jinja)/makefile)
• Stream access (scheduling)

(meta/way of working Publishing via git/githook TRY! )

• random access media ?? (can an mp3 do a range request jump? or only ogg ??) depends on server, example of non-random access mp3
• ubu audio player as anti-pattern ?!
• html5 media fragments, and javascript

04

BOTS

Cross system / bots (2 parts?)

• infobot
• eliza
• mud/moo

• Bot / chatroom
• Radio stream / schedule
• mediawiki API (pull + push) .. example of epicpedia?
• etherpad API (pull + push?) .. example of etherlamp (make js version?)

See: https://vnsmatrix.net/projects/corpusfantastica-moo-and-lambda-projects

05

PLEASE Leave a message

• https://mdn.github.io/web-dictaphone/ https://github.com/mdn/web-dictaphone/ (+ javascript looping / instrument) ... now how to save / submit ... (
• online recording interface... interface with CGI to save/serve files ?
• https://developer.mozilla.org/en-US/docs/Web/API/MediaRecorder
• https://github.com/mattdiamond/Recorderjs
• Angeliki Diakrousis http://radioactive.w-i-t-m.net/
• IDEA: Limit recordings to a fixed duration (data size)...

06

• gitea webhooks
• CGI to receive a JSON post
• php to receive JSON post (example on gitea webhooks page)
• CGI (making a "helloworld" / printenv with python) See CGI checklist
• Don't forget "sudo a2enmod cgi" and "sudo systemctl restart apache2" to enable the cgi module in Apache...

MIDI

• David Cope https://computerhistory.org/blog/algorithmic-music-david-cope-and-emi/ http://artsites.ucsc.edu/faculty/cope/5000.html
• Corneluis Cardew: Towards an Ethic of Improvisation The Great Learning