Prototyping/2019-2020/T3

From XPUB & Lens-Based wiki

Prototyping session Spring 2020, in the context of Special Issue #12: Radio Implicancies

01

COMMAND-LINE AUDIO WORKSTATION

  • the materiality of digital audio: samples, sampling rate, sample width, format, channels... See Sound and listening
  • Why does a 8000Hz recording sound different than 44100Hz?
  • playing "raw" and non-sound data ... See Sonification
  • the example of the phonautograph
  • commandline audio editing with ffmpeg...
  • cutting: extracting chunks with a start / duration
  • assembling
  • CLI spatialisation of audio ??
  • bash scripts with loops / variables for audio manipulation
  • Example: spectrumsort
  • Filtering for radio/streams:
  • compression (as in Dynamic range compression different from audio data compression
  • "Loudness" and "Normalisation"... What is replaygain and why can it help?
  • liquidsoap for sound processing

Exercise: Create an "audio probes" a combination of particular content and a filter that (metaphorically, or literally) resonate

resources:

Question relevant to the special issue: Are we streaming in stereo / mono? At what bitrate... Does it matter?

02

VOICE

  • text to speech / speech synthesis

Specifically the case of [MBROLA](https://github.com/numediart/MBROLA) and the "free" but not "libre" voices. https://github.com/numediart/MBROLA-voices

Espeak + MBrola https://github.com/espeak-ng/espeak-ng/blob/master/docs/mbrola.md

Projects spɛl ænd spik. hellocatfood (antonio roberts) https://www.hellocatfood.com/spell-and-speak/

"real" VOICES http://librivox.org

03

PLAYER

Radio webpage

(meta/way of working Publishing via git/githook TRY! )

  • random access media ?? (can an mp3 do a range request jump? or only ogg ??) depends on server, example of non-random access mp3
  • html5 media fragments, and javascript

04

BOTS

Cross system / bots (2 parts?)

  • infobot
  • eliza
  • mud/moo
  • Bot / chatroom
  • Radio stream / schedule
  • mediawiki API (pull + push) .. example of epicpedia?
  • etherpad API (pull + push?) .. example of etherlamp (make js version?)

See: https://vnsmatrix.net/projects/corpusfantastica-moo-and-lambda-projects

05

06