User:Max Lehmann/Special Issue X

From Media Design: Networked & Lens-Based wiki
Jump to navigation Jump to search

XPUB 1 «↔» SPECIAL ISSUE X «↔» LFP


compressor





1.Session with Dennis de Bel

Meergranen1
Meergranen module - all required parts
Meergranen2
Meergranen module - all parts
soldered together
Meergranen3
Meergranen module with custom
lasercut frontpanel



  • Intro into modular synthesis: (exists in both, analogue and digital form)
    Several modules, that are not hardwired totgether.
    Each module does (not allways) one task only - but does that very good.
    In-, outputs allow to interface several modules.
  • Soldering / testing of the "Meergranen" module
  • Flashing different presets with onto the Arduino
  • Designing and lasercutting the first custom frontpanel



Custom sample selection (to be continued):




2.Session with Olli Aarni at De Player

WorkshopOlli1
Dennis playing around with
a modular synthesizer setup
WorkshopOlli2
Modular synthesizer setup
Kantele
Begena



  • Listening sessions with the purpose of learning how to talk about sound
  • Hunting interesting sounds and writing a description of them
  • Inventing a new word to describe the sound: "knüsprichtlic" (engl.: "crunchdenseyficial")
  • learning musical vocabulary (pitch, frequency, timbre, overtone, metrics,...)
  • Exercise: sorting given abstract soundfiles into categories and naming them


WorkshopOlli4
Pile of objects that we brought
to the workshop to make music with
WorkshopOlli5
My improvised "instrument" and
notation for a performance
WorkshopOlli7
Recording of performances




  • Everybody brings in 3-4 random objects that one can make sound with
  • Choose objects and experiment with making:
    • ..the most quite sound possible
    • ..the longest sound possible
    • ..shortest sound possible
    • ..a sound that involves a change in pitch
    • ..a sound that involves a change in timbre
  • Choose objects and create sounds that match the categories created yesterday
  • Create a composition / performance and write down notation
  • Perform while being recorded
  • Jam in groups while being recorded
  • Talking about language (Phoneme, toneme, chroneme -> see interesting links)
  • Speech to song instrument: recording speech - looping a part of it and listening to the melody
  • Add recording from earlier and make a quick song
  • Course feedback



Field trip to Dutch Modular Fest


DMF1
DMF3
DMF2
DMF6
DMF5
DMF7
DMF4
DMF8



3.Session with Dennis de Bel


  • Talking about possibilities and limitations of Arduino
  • Introduction to Arduino coding
  • Playing around with the Meergranen
  • Connecting several Meergranen modules and modulating them with oneanother


Session3
Several Meergranen
modules connected
Session3
...




4.Session with Dennis de Bel


  • Recap on how to use the Git (with Aymeric)
  • Synthesis Basics (additive synth., substractive synth., FM synth., granular synth., wavetable synth., ...)
  • Making a simple Kick with Arduino
  • Going to meet again on Fr, 11.10 to deepen understanding of Arduino code and check the modules (see pad xpub1temp2)
OSC.gif
Kick on osciloscope



Independent Development 1


  • Developing and building a simple external trigger using a staple remover, 2 AA bateries, some cables, insulating tape, metal wire (paperclip) and a lightbulb to check battery level
  • Properly insulate one side of the staple remover and wrap the metal wire around it (must not touch the metal)
  • When closing the staple remover the wire must touch the other side of it (to closer the circuite and act as a switch)
  • Cut a patchcable in half and seperate the inner and outer cables from another
  • Connect wires to the batteries/patchcable/staple remover/(lightbulb is optional) as shown in the drawing
Stapletrigger4
Circuite diagram (unconventional)
Stapletrigger3
Final trigger(s)
Stapletrigger2
Final trigger(s)



5.Session with Olli Aarni at De Player


First Day

  • Feedback on the state of the process / work done so far
  • Collecting concept ideas (unstructured):
    • Need to let go, try out, find common ground
    • Transparency / de-blackboxing
    • Accessibility
    • Haptic gestural input
    • Deeper meaning: What do we want to say?
    • Visual output
    • Visualize sound
    • Analog / unconventional input triggers
    • Visualize the process / concept
    • Cultural signals / speech
    • Embrace frustration
    • Keep public in mind
    • A map as an interface
    • A map as a manual (as part of the publication)
    • Let the user choose the way to go (soundwise)
    • Sound maze
    • Navigating / journeying through the modules that create an overall soundscape together
    • What should the experience be?
    • Create sound with strangers
    • Deomcratize the process of the creation of audiovisual content
    • Open or close the "black box" (ramdomness / chaos // transparency)
    • Playing with expectations
    • Universal connection matrix
    • Live manual / adjusting to the actions of the user
    • Each module having both, one seen and one unseen function
    • Producing a series of modules, rather than just one single "percious" object
    • Educational / explainatory?
    • Accesibility or transparency?
    • Importance of code as the underlaying basis
    • Showing whats behind the surface
    • Several layers of depth
      • Playing aroung / interfacing / accessing
      • Understanding
      • Interpret
    • Unpredictability
    • Transpartent about our own project process


  • Two sides:
    • Accessible - Inaccessible
    • Mystifying - Demystifying
    • Tranparency - Black box


Second Day

  • Publication
    • Big map
    • Individual pockets to fill
    • Flowcharts / diagram
    • Statement on experience
    • Journey


  • Exhibition
    • Two sides:
      • Mystified - Demystified
    • Gradient / slider from mystified to demystified
    • Charish the ambivalent
    • Work closer together in model development for connectivity and good integration
    • Different combinations for different narratives


  • Technical potential
    • Usage of language
    • Visualize performance
    • Usage of speech to modify...
    • The modules as a representation of a deeper concept (?!)
    • Input sound - Output different sound
    • Input sound - Output visuals
    • Using components from old phone (text messaging / camera / antenna / screen / phone as module)
    • Input code (binary) - translation - output speech / strange sounds
    • Modules as vehicles for audio essays
    • Different types of listening (knobs to choose)
    • Output raw data
    • Video / image manipulation with narrative aspect
    • X-Y-manipulation
    • Asymetrical, confusing interface
Mystify&Understand
Felt relation of demystification
and understanding


Ollis conclusion

  • Endless amount of unstructured text / ideas
  • Conceptual starting point: mystify - demystify / transparent - black box
  • Common groung but enough freedom for individual idea development
  • Accessibility - inaccessibility = too broad
  • Find individual approaches
  • Map as a part of the publication
    • Map in a map / flowchart
    • Mapping somethting that is not physical
  • Design or art -> Democratic approach
  • Meet in study week to make ideas developed compatible




Independent Development 2 (Concept)


  • Name of module: Glutenfrei (Working title)
  • Audio/visual/other: Audio / Focus on interface
  • Input: I want to work with a variety of input sources that can be controlled with gestures, through shifting of bodyweight and maybe touch to cause dance-like movements by the user that result in sound output.
  • The input sources would (1.) trigger different sounds and (2.) modulate different parameters of these sounds. They would be installed in a three-dimensional - spaced out way within a room to encourage movement by one or multiple users. This technique might rely on more than one module. It could be connected to multiple other modules as in, or outputs to trigger more actions / different sounds and would work well with a visual component.
  • Output: The Output would be an auditive creation (soundscape) made by the user trough his/her interactions.
  • Description/Algorithm: The underlaying idea is to simplify / demystify the interface to empower a broad users community to participate intuitively in creating the soundscape. Also I would like to make the internal process transparent to render the way of operation of the device itself and the creation as understandable as possible.



Independent Development 3


  • Working with Light Dependent Resistors
  • Adding 1/2 LDRs to the trigger circuit and mesuring the input values
  • Using map and contrain function to translate the input
    values to the desired range
  • Writing a program to test the LDRs by generating a tone and manipulating the
    Hertz value with the mapped and constrained input values
LDR
LDR



Independent Development 4


  • Setting up an array of 4 LDRs and connecting them to the 4 available Inputs on the Meergranen
  • Writing a code: to trigger a different sound with each input; to change the pitch of arpeggiated tones; to change the frequency of a single tone;
  • Empirical value: Too little inputs are available, 8-18 would be nice; When using the Arduino tone function on a singular output only monophony is possible;
  • Possible solutions: Integrate a library that supports polyphony; Use individual outputs for each tone;
ldrarray1
LDR Array


ldrarray2
LDR Array




6.Session with Dennis de Bel


  • Introduction to the basics of electronics
  • Arduino and breadboard basics
maxbreadboard
Breadboard Setup



Independent Development 5


  • Concept sketches
maxconceptsketch1
ConceptSketch1
maxconceptsketch2
ConceptSketch2
maxconceptsketch3
ConceptSketch3



Fieldtrip to Impakt Festival on Thursday, 31st October


  • Panel Discussion: Messages from the Biological Self
  • Screening: Co-opting entities
  • Panel Discussion: Virtual Reality and Body Ownership
impaktthursday2
Impakt Festival
impaktthursday4
Mark Forid



7.Session with Dennis de Bel at Varia


  • Changing from Arduino Nano to the ESP8266 for greater processing power
  • Working with 4 x 16bit ADC multitplexers to generate 16 inputs out of two pins
  • Connecting a LDR to each Input
  • Further advantage: 16bit offers greater resolution
  • Writing code to measure these 16 input values (by using the Adafruit_ADS1X15 library) and trigger a different tone with each one
  • For now getting rid of the idea of bodyweight shift triggers -> focussing on polyphony
multiplexer1
Multiplexer/ADC
multiplexer2
Multiplexer/ADC




Independent Development 6


  • Research on audio libraries for Arduino
  • Working with the Mozzi audio synthesis library to gain greater control over the audio output and to create polyphony



8.Session with Michael


  • Setting up a simple touch keyboard to test the Mozzi audio synthesis library
  • Writing a simple code to trigger up to 3 tones at the same time
  • Output signal is very distorted (due to PWM) -> need to build a low pass filter
testkeyboard1
Test-touch-keyboard



Independent Development 7


  • Building a resistor capacitor low pass filter
  • Writing code to trigger different tones with the test-keyboard as well as adjusting their volume to prevent overload on the output
  • Combining the two codes
  • Empirical value: Mozzi and Adafruit_ADS1X15 seem to be using the same timer and thus won’t compile
  • In depth research about possibilities of changing these competing codes - without success
  • Switching to musicwithoutdelay library to resolve the problems
  • ESP8266 keeps crashing when running code -> switching back to Arduino Nano
  • 4 voiced polyphony running stable on Arduino Nano with Adafruit_ADS1X15
lowpassfilter
resistor capacitor lowpass filter circuit



9.Session with Andre


  • Writing code that triggers up to 16 voices
  • Arduino Nano keeps crashing when running code for more than 4 voiced polyphony -> too limited resources
  • Switching to Arduino Mega 2560
  • 10 voiced polyphony running stable on Arduino Mega 2560
  • 16+ voices are only possible on the Teensy LC & 3,0+ (incredible processing power! Would love to switch, should order one…)
  • Output value is distorted, keeps clipping and has high latency
gvrijonnano
on the Nano




10.Session with Dennis de Bel


  • Including a CV (control voltage) output option that can be switched on or off in the code to interface other modules
  • Getting rid of the multiplexers (as the Arduino Mega 2560 provides more then enough pins) to lower the latency and clean up code
  • Signal still distorted and delayed
gvrijonmega
on the mega



Independent Development 8


  • Working with the sensortobutton library to lower latency
  • Latency seems to be way better, but tones will never switch off properly - can’t fix that
  • Getting rid of sensortobutton library - restructuring and cleaning up previous code
  • Implementing a volume calculation, depending on number of instruments playing and
    distance of hand to LDR to prevent clipping and add controllability:
    
VOL0 = 50/count+constrain((analogRead(A0), TH0, TH0+450, 0, 50), 0, 50);
  • 10 voices polyphony now running super stable without clipping and with relatively low latency
  • Ordered a Teensy LC board. Lets see.
  • Recap of recent process see: [1]
LDRMega
10 LDRs on the Arduino Mega
without multiplexers




Independent Development 9


Teensy1
Teensy2
hardwaretimers





Independent Development 10


  • Soldering headers to the Teensy LC board.
  • Soldering LDRs to cables.
  • Setting up the Teensy LC board with the multiplexers on a breadboard.
  • 16 voice polyphony running stable on the Teensy LC.
  • Attaching LDRs with cable to a metal beam for expansive interaction.


LDRray6
LDR array
LDRray4
Bunch of LDRs with cables




Independent Development 11


  • Realization: Beam is very unwieldy and unpractical for transport setup and
    pretty much everything else.
  • Solution: Malleable sensors that can be aligned to personal preference -
    detachable for transport and exchangeability in case of malfunction.
  • Buying parts: metal wire, shrinking tube, insulating tape.
  • Construction of first sensor prototypes for testing of the concept.
  • Adding audio jacks to the breadboard.
  • Testing of the sensor prototype: works fine with following specs:
  • Audio plug 3,5mm as connection, max. 50cm hight, min 2,5 mm wire diameter.
Sensor
Flexible sensor sketch
Sensor_synth
Sensor plugged in
Sensor_plug
Sensor plug
SensorProto
Flexible sensor prototype




Independent Development 12


  • Testing GLARE (actual name of the device) module with a TV screen as a source of modulation by light (with manipulated code): works!
SensorTV
Sensors on TV screen



Making the PCB file


  • Constructing the circuit for the PCB production in Fritzing
  • Design an illustration to be screen printed onto the PCB
Glare_PCB
PCB file



Designing posters


  • Forming teams to work on different tasks (Poster design, Text, Web, Publication cover, ...)
  • Using an old industrial label printer as a design resource.
  • Limitations: On the Riso-printer max size is A3.
  • Concept: Making the poster modular. 1 poster consist of 4 out of 7 individual A3 posters, that hold different informations,
    like title, place, date and that can be combined in a few different ways.
  • Producing design elements by printing labels with the printer and then scanning them in different ways.
  • Using the design elements to establish a visual language.
  • Establishing a layout


LFPoster2
Lableprinter
LFPoster1
Lableprinter
LFPoster4
Design elements
LFPoster5
Poster drafts
LFPoster3
Poster drafts
LFPoster6
Prefinal posters




Generating content for and designing the publication


  • Format: 297 x 297mm, 1 sheet per person, front and back
  • Colors: choose 2 out of 3: black, pink, green
  • Writing conceptual / explanatory text.
  • Creating illustrations.
  • Layouting the page

Content page: Glare

GLARE_publication
Glare publication


GLARE_publication
Glare publication




Designing the cover


  • Creating a file to be laser cut from (transparent) perspex and then attached on top of the module including some labels
GLARE_Cover
GLARE Cover




Fieldtrip with De Player: Interfacing inaudible phenomena



InaudiblePhenomena4
Inaudible phenomena
InaudiblePhenomena1
Inaudible phenomena


InaudiblePhenomena2
Inaudible phenomena


InaudiblePhenomena3
Inaudible phenomena




Producing the posters


  • Making a A3 poster containing all information after learning about limitiations
    to hang posters bigger than that in public spaces
  • Printing all posters on the riso-printer
PosterSmallFinal
Final A3 poster




Producing the frontpanel/cover


  • Lasercutting the frontpanel for the GLARE module from 3mm transparent Perspex (Plexi)
  • 2 different versions: Engraving on the front / engraving on the backside mirrored
Frontpanel3
Rear
engraving
Frontpanel2
Front
engraving
Frontpanel1
Frontpanel





THE PCB


LFP_all_04
The PCB



Assembling the final GLARE modules (3pcs)


  • Soldering all required parts to the PCB
  • Producing 48 sensors from audio jacks, wires, shrinking tube and LDRs
LFP_11
GLARE module
GLARE_sensors01
GLARE sensors
LFP_detail_35
GLARE module
LFP_15
GLARE sensors



Printing the Publication


  • Printing all pages of the publication at a print run of 50 on a risograph printer at Varia with Dennis De Bel


publication
Printing the publication


LFP_deplayer_03
The publication



Finalizing the GLARE modules


  • Manufacturing wooden bases
  • Drilling bigger holes into the PCB and attaching it
    to a wooden base to prevent it from tipping over
  • Adding the front panel
  • Finalizing the Code
  • Taking photographs of all modules


LFP_detail_27
Finalized GLARE module
LFP_detail_28
Finalized GLARE module
LFP_detail_29
Finalized GLARE module
LFP_detail_34
Finalized GLARE module
Final_Glare
Finalized GLARE module




The event @ De Player


  • Setting up the exhibition at DE PLAYER
  • Connecting all 10 modules (using a GLARE module running a reversed code
    to read brightness information of the screens connected to other modules
    and then outputting control voltage to the same or to other modules)
LFP_deplayer_02
Impressions from the event
LFP_deplayer_06.jpg
Impressions from the event
LFP_deplayer_09.jpg
Impressions from the event
LFP_deplayer_11.jpg
Impressions from the event
LFP_deplayer_21.jpg
Impressions from the event
LFP_deplayer_29.jpg
Impressions from the event
LFP_deplayer_30.jpg
Impressions from the event
Publication01.jpg
Impressions from the event




Helpful/interesting links





Watchlist




Pads