User:Ohjian/Final presentation

From XPUB & Lens-Based wiki

MODULAR MATTER – REWIRE YOUR PRINTS!

[ Graduation project by ohjian - Jian Haake ]


previous practice, projects & prototypes


During my first year at XPUB I have been working on several projects and experiments that are linked or in some way related to my graduation project.



[ Workshop: The Screenless Office ]

In a workshop Brendan Howell introduced his project The Screenless Office. Collectively we developed a new function that was added to his Office: An operation that would use two texts as inputs, weave them together following a specific pattern and send it to the printer. Supi and I built a (screenless) physical interface with which the user could customize the pattern for the weaving function. We decided to use patchable cables as a physical representation of the weaving operation.

Weaving pattern sw 01.jpg



[ Analog Sound Synthesizers ]

A) Simple setup on a breadboard

This is the first analog synth I built. It consists of four variable oscillators that create different sounds and can be merged by two mixers. The setup also includes a DIY oscilloscope that uses an Arduino and an LCD display.


Modular patch synth sw 02.jpg Modular patch synth sw 01.jpg



B) Patchable / modular setup on a permanent breadboard

This is my first attempt of a patchable / modular synth. Two of the six oscillators can be connected to a mixer using patch cables.


Patchable synth sw 01.jpg

(Patchable synth)

[ Free Circuits ]

I experimented with some free circuit designs that would involve a simple interaction with the user to light an LED. My main interest was: How does the user experience change when you have to …

a) push a button
b) touch two points with your fingers and make your body part of the circuit

… to light the LED?


Free circuit sw 01.jpg Ghost circuit sw 01.jpg Ghost circuit sw 02.jpg Touch circuit sw 01.jpg Ghost circuit sw 03.jpg Ghost circuit sw 04.jpg




[ Book Generator ]

In the beginning of my XPUB studies I wrote a python function called Book Generator, which was based on the House of Dust by Alison Knowles. The function would run on a Raspberry Pi connected to a physical push button and a receipt printer. Every time the button was pushed, a new definition for the book would be printed. The Book Generator works as a research tool for anyone interested in reading, thinking and making (with) books.

Book-generator sw 01.jpg

[ more insights, XPUB1 ]

  1. Special Issue #16
  2. Special Issue #17
  3. Special Issue #17

Looking back, trying to connect the dots

Modular matter start1.jpg Modular matter start2.jpg


sketching first ideas

Modular matter getting started1.jpg Modular matter getting started2.jpg Modular matter getting started3.jpg Modular matter getting started4.jpg


project proposal

[ what? ]

For my graduation project I want to use the well-known concept of Modular Synthesis. Instead of working with sound, I want to translate the idea to the realm of print publishing. More precisely, I want to create physical modules that perform operations on text and images to create printed outcome.



Modular Synthesis
A modular synthesizer is an electronic instrument that generates electronic sounds. It consists of many different and independent modules that can be combined in any numbers of ways to create and manipulate the output. Each module performs a certain operation which can be controlled by adjustable components like switches, sliders and patch cables. The output of one module can be used as the input for another module. This allows for creative combinations, loops and unexpected outcome.


Suzanne Channi

(Suzanne Channi and the Serge Modular Synthesizer)



Make Noise Erbe Verb Illustrated Manual

(Erbe-Verb module by Make Noise, Illustrated Manual)


Desktop Publishing (DTP)
Desktop Publishing is commonly used to create printed matter and combines several hardware and software components such as input devices (keyboard, camera), control devices (mouse, keyboard) and output devices such as a printer. The operation relies on a Graphical User Interface (GUI) and WYSIWYG software.



Re-thinking Desktop Publishing with the concept of Modular Synthesis
The process of Desktop Publishing could be transformed into a number of independent and combinable modules, each of them performing a specific operation with an operation-specific physical interface. Input modules that generate text or images and a preview module for accurate representation of the process could be accompanied by several transform modules to process and manipulate the input. The output module shall be a printer for typographical and pictorial outcome.





Audience
The project addresses graphic designers and other creatives who are used to work with traditional Desktop Publishing software and tools. By introducing my physical modules as an alternative approach I am hoping to break open those habits and make them reflect on the tools they are familiar with. Since the modules produce printed outcome on A4 paper they can be used to create small posters, flyers and even simple publications.
For the graduation show I envision an interactive installation where the modules can be used and tested and where conversations about tools could arise. In the future I am hoping to integrate the modules in the workshops that I regularly facilitate for graphic designers.




[ why? ]

As a trained graphic designer, mainly concerned with printed matter and book making, I have been familiar with Desktop Publishing for more than ten years. The big player Adobe has been very present in all my making, designing and publishing processes and I never really reflected on the influence it might have on my practice. XPUB introduced me to the idea and benefits of alternative tools and software and I started to look at Desktop Publishing software from a more critical angle.

Parallel to that I was introduced to physical computing and started to experiment with microcontrollers and analog electronic circuits. I became interested in modular synthesizers and started to build a few small prototypes. Even though sound has never been part of my creative making practice, I was clearly fascinated by the concept behind it.

In my graduation project I want to bring together these two interests by using the concept of Modular Synthesis and translating it to the context of print publishing. By creating my own modules I want to suggest alternative physical interfaces and create a different experience of human-machine-interaction.
In “Software Takes Command” Lev Manovich reflects on the impact that interfaces and tools have on contemporary aesthetics, visual languages and graphic design. As creatives we are so used to seemingly flawless devices that experimental or clunky modules may help to slow down the process and produce unexpected outcome. This new perspective could help to reveal, reflect and evaluate what is normally concealed:

  • How (and to what extent) tools shape our practice.
  • What impact tools have on our imagination and independence as creatives.
  • How our practice changes when we create our own tools.



technical infrastructure

In the beginning stages of the project, the biggest challenge is to come up with a technical infrastructure. I want to make sure to create a system that works for both text and images. To enable the modular approach I have to research and test different languages, formats and hardware components that allow connection and communication between the modules.

[ first sketches ]

Modular matter infrastructure1.jpg Modular matter infrastructure2.jpg Modular matter infrastructure3.jpg Modular matter infrastructure4.jpg

[ flowcharts ]

How to create a modular system for both hardware and software?

  • independent modules that read values from a physical interface -> microcontrollers?
  • output module(s) that generate a printable file and connect to a printer and preview screen -> Raspberry Pi?

Modular matter infrastructure flowcharts1.jpg Modular matter infrastructure flowcharts2.jpg Modular matter infrastructure flowcharts3.jpg Modular matter infrastructure flowcharts4.jpg Modular matter infrastructure flowcharts5.jpg Modular matter infrastructure flowcharts6.jpg

breadboard prototypes

First simple prototypes, experiments and test runs to establish a modular system.

IMG 6438.jpg IMG 7735.jpg IMG 7770.jpg IMG 7772.jpg IMG 7775.jpg

reading & writing

format

contents

tryouts PCB (printed circuit boards)

How to get away from the breadboard? Building my first printed circuit boards (PCB) to understand how they work / how to build them.

  1. A simple 1-layer touch circuit built with Fritzing and CNC mill
  2. A simple module built with KiCad and produced by a manufacturer

Modular matter PCB tryouts1.jpg Modular matter PCB tryouts2.jpg Modular matter PCB tryouts3.jpg Modular matter PCB tryouts4.jpg Modular matter PCB tryouts5.jpg Modular matter PCB tryouts6.jpg

test prints & previews

First experiments with postscript syntax to generate / write printable files

Modular matter test outcome1.jpg Modular matter test outcome2.jpg Modular matter test outcome3.jpg Modular matter test outcome4.jpg Modular matter test outcome5.jpg Modular matter test outcome6.jpg Modular matter test outcome7.jpg Modular matter test outcome8.jpg Modular matter test outcome9.jpg

midwives gift kit

Selected items for my midwives support group to give insight into the project and process. The letter reads:

Dear fellows,
I hope this small kit finds you well, despite the piling workload and lack of leisure time.
In this kit you will find some technical schematics, which try to document and visualize the tool I am working on. The material stems from a chapter in my thesis that functions as a technical manual for my tool. To help you imagine the hardware modules, you will find a few physical components that I am using a lot. The small prints in the kit are first test layouts, made with my modules.
When we meet, I would like to walk you through the material and invite you to annotate the schematics. In my thesis, I am implementing an annotation and it would be nice to find some inspiration for that.
Yours,
Jian


(+ notes I received from Kamo as contribution to my process)

Gift kit midwives1.jpg Gift kit midwives2.jpg Gift kit midwives3.jpg


related side project: drawing robots

In a workshop with Holunder Heiß and Joseph Knierzinger I created a drawing machine by hacking a robotic vacuum cleaner. A marker is attached to the robot and the movement can be control via a remote control. I was invited to present the project in an interactive session at Extrapool, Nijmegen. The audience, amongst them many visual artists, illustrators and graphic designers, was using two drawing machines to draw onto riso printed posters on the floor. By being confronted with this clumsy and unfamiliar tool (as opposed to holding a marker in their own hands) they experienced unexpected moments, happy accidents and little failures, wondering how those have the potential to stimulate and inspire creative processes and outcome.

Drawing robot 01.jpg Drawing robot 02.jpg Drawing robot 03.jpg Drawing robot 04.jpg Drawing robot 05.jpg Drawing robot 06.jpg Drawing robot 07.jpg

modules: printed circuit boards

[ electronic components ]

Test, understand and select electronic components for my physical interface

Modular matter electronic components1.jpg Modular matter electronic components2.jpg Modular matter electronic components3.jpg Modular matter electronic components4.jpg Modular matter electronic components5.jpg

[ first sketches ]

Sketching different transform module, trying to come up with physical interfaces that to some degree resemble the (computational) operation that is running in the software

Modular matter pcb drafts1.jpg Modular matter pcb drafts2.jpg Modular matter pcb drafts3.jpg Modular matter pcb drafts4.jpg Modular matter pcb drafts5.jpg Modular matter pcb drafts6.jpg Modular matter pcb drafts7.jpg Modular matter pcb drafts8.jpg Modular matter pcb drafts9.jpg Modular matter pcb drafts10.jpg Modular matter pcb drafts11.jpg

[ drafts for final modules ]

  1. DYNAMIC GLYPH (text input module as an alternative to a standard keyboard)
  2. FRICTION LABEL (uses text input to generate a label or sticker, distorted by glitch effects)
  3. WEAVER (uses a large number of rotating knobs and patch cables to create a pattern / patchwork)
  4. FUTURE RELICS (generates a graphical shapes)
  5. WHOOSH (uses text input and creates a poetic layout using white spaces and repetition)
  6. EMERGENT MATTER (output module that generates a postscript file that is sent to the printer or preview screen)

Modular matter pcb drafts12.jpg Modular matter pcb drafts13.jpg Modular matter pcb drafts14.jpg Modular matter pcb drafts15.jpg Modular matter pcb drafts17.jpg Modular matter pcb drafts16.jpg

[ electronic circuits ]

Drawing the electronic circuits for all 6 modules that are necessary to create the printed circuit boards

Modular matter electronic circuits1.jpg Modular matter electronic circuits2.jpg Modular matter electronic circuits3.jpg Modular matter electronic circuits4.jpg Modular matter electronic circuits5.jpg Modular matter electronic circuits6.jpg

[ PCB layouts ]

Creating the layouts for 2-layered PCBs for all modules (front and back)

Dynamic glyph front sw.pdf Dynamic glyph back sw.pdf Emergent matter front sw.pdf Emergent matter back sw.pdf Friction label front sw.pdf Friction label back sw.pdf Future relics front sw.pdf Future relics back sw.pdf Weaver front sw.pdf Weaver back sw.pdf Whoosh front sw.pdf Whoosh back sw.pdf

[ paper mockups ]

Test printing the PCB layout and placing the electronic components to review the physical interfaces before production

Modular matter pcb paper mockups1.jpg Modular matter pcb paper mockups2.jpg Modular matter pcb paper mockups3.jpg Modular matter pcb paper mockups4.jpg

[ PCB unboxing ]

Modular matter pcb unboxing2.jpg Modular matter pcb unboxing3.jpg Modular matter pcb unboxing4.jpg Modular matter pcb unboxing5.jpg Modular matter pcb unboxing1.jpg

[ PCB assembly & setup ]

Modular matter pcb assembly1.jpg Modular matter pcb assembly2.jpg Modular matter pcb assembly3.jpg Modular matter pcb assembly4.jpg

[ final modules ]

Modular matter final modules16.jpg Modular matter final modules1.jpg Modular matter final modules2.jpg Modular matter final modules3.jpg Modular matter final modules4.jpg Modular matter final modules5.jpg Modular matter final modules6.jpg Modular matter final modules7.jpg Modular matter final modules8.jpg Modular matter final modules9.jpg Modular matter final modules10.jpg Modular matter final modules11.jpg Modular matter final modules12.jpg Modular matter final modules13.jpg Modular matter final modules14.jpg Modular matter final modules15.jpg


grad show

[ setup ]

interactive wall installation with all 6 modules, printer and preview screen

Modular matter grad show.jpg

[ radio show ]

  1. conversation about our projects and practices with Supi
  2. informercial to tease my project


script for informercial:

MODULAR MATTER – REWIRE YOUR PRINTS!

Are you tired of your usual Desktop Publishing setup and need to switch things up?
Then this modular tool is for you!
Combine the new hardware modules DYNAMIC GLYPH, FRICTION LABEL, WHOOSH, FUTURE RELICS, WEAVER and EMERGENT MATTER to create unexpected and exciting print results!

MODULAR MATTER – REWIRE YOUR PRINTS!


[ blob shop ]

goods I want to sell at the shop:

  • MODULAR MATTER toolkit (PCBs + electronic components + Situated and Annotated Manual)
  • DRAWING ROBOT POSTERS
  • GHOST CIRCUITS

tools & components in use

(honest) list of (almost) all things that were used (or not) in the process of developing, planning, building, assembling, documenting and presenting the project

[ digital tools ]

  • Raspberry Pi Zero
  • python 3
  • ESP32
  • C++
  • terminal
  • bash
  • postscript
  • ghostscript viewer
  • KiCad
  • Atom
  • InDesign
  • Photoshop
  • Acrobat Pro
  • Safari
  • Preview
  • Notes
  • MacBook Pro
  • iPhone


[ physical tools & materials ]

  • soldering iron
  • solder
  • sponge
  • breadboards
  • jumper wires
  • wire cutter
  • awl
  • scredriver


[ electronic components for the tool itself ]

  • 1 Raspberry Pi Zero
  • 6 ESP32 (LilyGO TTGO T8 ESP32-S2 - with SD Card Slot)
  • 1 DFRobot I2C 16x2 Arduino LCD
  • 30 10k rotary potentiometers
  • 25 knobs small
  • 4 knobs medium
  • 1 knob large
  • 8 10k slide potentiometers
  • 5 push buttons
  • 1 slide switches
  • 1 rotary encoder
  • 5 3mm LEDs
  • 5 1k resistors
  • 16 audio jacks
  • 10 x 20 pinheaders
  • 1 x 4 pinheader 90 degree
  • 24 M3 bolts and nuts 30mm
  • 4 M3 bolts and nuts 10mm
  • 10 audio patch cables
  • 6 power supplies
  • 1 screen + HDMI cable + power supply
  • 1 printer + USB cable + power supply


[ services & shops ]

  • Tinytronics
  • Musicstore
  • Wetronic
  • Seeed Studio PCB manufacturer
  • DHL