Projects SI 28: Difference between revisions

From XPUB & Lens-Based wiki
(Move main content of “Love Machine” to a dedicated page.)
 
(33 intermediate revisions by 9 users not shown)
Line 1: Line 1:
== Writing Machine Ensemble ==
<noinclude>
''Participants'': [[User:SHRED|Ema]], [[User:Daanprincen|Daan]], [[User:Robin|Robin]], [[User:Thijshijsijsjss|Thijs]]
[[Category: SI28]]
</noinclude>


==== Currently working on: ====
The following is a collection of the projects conceived for the main event of [[SI28|Special Issue 28]], that took place at Ubik, Rotterdam on 19<sup>th</sup> November 2025.


==== Description ====
== [[Projects SI 28/Writing Machine Ensemble|Writing Machine Ensemble]] ==
'''<big>Writing Machine Ensemble</big>'''
''Participants: [[User:Robin|Robin]], [[User:SHRED|Ema]], [[User:Daanprincen|Daan]]''


'''Explorations in Potential Musicality'''
=== Description ===
With the Writing Machine Ensemble, rhythm and repetition will be experienced in a radically new form. Explorations in Potential Musicality is a musical journey through the sonic qualities of printers—with a strong emphasis on improvisation, yet promising dramatic intensity.


With the Writing Machine Ensemble, rythm and repetition will be experienced in a radically new form. ''Explorations in Potential Musicality'' is a musical journey through the sonic qualities of printers—with a strong emphasis on improvisation, yet promising dramatic intensity.
Co-founded by its current members, is an international group of experimental musicians from around the XPUB Studio. Independent and idealistic, they focus on blending the role of 'instrument' and 'musician' in an assemblage of artistic creation, striving to find the essential musical quality in tools of writing.


'''Writing Machine Ensemble'''
=== Media ===
 
Performance with dot matrix printer, pen plotter, typewriters.
The Writing Machine Ensemble, co-founded by it's current members, is an international group of experimental musicians from around the XPUB Studio. Independent and idealistic, they focus on blending the role of 'instrument' and 'musician' in an assemblage of artistic creation, striving to find the essential musical quality in tools of writing. Since its debut in September 2025, the ensemble has performed once on WORM Radio, for the 5th edition of XPUB's Special Issue Radio show, where the group's unique live scoring method was born.
 
'''Members'''
 
Emanuele Arrigoni, Daan Princen, Robin de Haan,Thijs van Loenhout, Monica Olympia, Erika Model, N.E.C. (Dottie) Parson, Taxan X.Y. Plotter
 
==== Medium/Media ====
Performance (not naming the printers as medium is part of the concept)
 
(or, if possible, change formatting to that of a concert announcement, so no mention of medium)
 
[https://pzwiki.wdka.nl/mediadesign/Curator_Conversations#Typewriter_Orchestra_(Robin,_Daan,_Ema)| Conversations with the curators]
 
''Keywords: Technical Assemblage, Live Scoring, Scores, Notation, Sound, Performance, Writing Machines, tools shape practice practice shape tool''
 
=== -> Input -> Output -> ===
INPUT: Finger movements that originate symbols and letters onto electronic devices.
 
OUTPUT[S]: the same input text BUT on long continuous sheets of paper, thanks to the use of ink that is both being sprayed onto the paper thanks to the marvellous technical engineering of a head that moves horizontally, and imprinted, thanks to the mechanical movements of engraved metal rods hitting the paper. --> This sums up into Printing, and those types of printing techniques produces noises. --> Together, noises and symbols on paper, leads people to wander into stuff called semiotics, thoughts and imagination through the use of interpretation.


== Gesture Machine ==
== Gesture Machine ==
Line 37: Line 20:
''Participants:'' [https://pzwiki.wdka.nl/mediadesign/User:Valentin97| Valentin]
''Participants:'' [https://pzwiki.wdka.nl/mediadesign/User:Valentin97| Valentin]


==== Currently working on: ====
=== Currently working on: ===
Experimentin with opensource motion capture datasets in touchdesigner.
Experimenting with open source motion capture datasets in touchdesigner.


==== Description ====
=== Description ===
N. Katherine Hayles' Cognitive Assemblages: People and technology made by people performing cognitive functions together. Only certain technologies considered as cognitive machines: The ones are capable of interpreting information of its' own environment and act on the changes of the environment therefore changing its own context which creates meaning.
N. Katherine Hayles’ Cognitive Assemblages: People and technology made by people performing cognitive functions together. Only certain technologies considered as cognitive machines: The ones are capable of interpreting information of its own environment and act on the changes of the environment therefore changing its own context which creates meaning.


Volumetric Regimes are the industries that keep the technology 3D representation in a close circulation, iterating the same technology over and over again.
Volumetric Regimes are the industries that keep the technology 3D representation in a close circulation, iterating the same technology over and over again.


As a designer and amateur animator I take the position to make a cognitive animation table and attempting to explore free softwares provided by the above mentioned industry through the lenses of Hayles' Cognitive Assemblages.
As a designer and amateur animator I take the position to make a cognitive animation table and attempting to explore free software provided by the above-mentioned industry through the lenses of Hayles’ Cognitive Assemblages.


[https://pzwiki.wdka.nl/mediadesign/GestureMachineProject_ARA| more info]
[https://pzwiki.wdka.nl/mediadesign/GestureMachineProject_ARA more info]


==== Medium/Media ====
=== Media ===
hologram, stop-motion armature, human body
Hologram, stop-motion armature, human body


''Keywords:''
''Keywords:''
Line 60: Line 43:
Output: stop-motion animation
Output: stop-motion animation


=== Experiments ===
== [[Projects SI 28/A story in a story in a story|A story in a story in a story]] ==


==== 00 AMASS/MANO modell ====
''Participants: [[User:Youjung|Youjung]] [[User:Barbs|Barbs]] [[User:Kiki|Kiki]]''
Failed to align python dependencies on mac. A windows trial could be beneficial.


==== 01 Mediapipe - One Hand ====
=== Description ===
"A story in a story in a story" invites you into an interactive narrative that lets you explore, gather and plot. Wander around in the virtual environment, pick up what you resonate with and that is what you take with you at the end of the day and becomes a tiny part of you.


[[File:Screenshot 2025-11-08 at 14.09.23.png|Alt text|300px]]
=== Medium/Media ===
[[File:Screenshot 2025-11-08 at 14.10.13.png|Alt text|300px]]
terminal, python, pen plotter, text adventure, fiction, paper & ink
[[File:Screenshot 2025-11-08 at 14.11.17.png|Alt text|300px]]
 
'''Libraries used:'''
 
'''[https://pypi.org/project/opencv-python/ | OpnecCV]:'''
 
"OpenCV is the largest Computer Vision library in the world. It's used worldwide: in the world's biggest companies, underwater, and in space.
 
OpenCV was started in 1998 and played the key role in the development of Computer Vision and Artificial Intelligence. It is released under Apache 2.0 license and is open-source and free for everyone."
 
'''[https://matplotlib.org/ | Matplotlib]:'''
I used Matplotlib to plot the mediapipe data on a '3d visualiser'.
 
'''[https://ai.google.dev/edge/mediapipe/solutions/guide | Mediapipe]:'''
 
I used media pipe to detect handshape and get 3D data of the skeleton.
 
'''[https://numpy.org/ | NumPy]:'''
 
I used numpy to store 3d data in an array which is then used by open3D.


"NumPy is an open source project that enables numerical computing with Python. It was created in 2005 building on the early work of the Numeric and Numarray libraries. NumPy will always be 100% open source software and free for all to use. It is released under the liberal terms of the modified BSD license.
== [[Projects_SI_28/The-Calm-Machine|The Calm Machine]] ==


NumPy is developed in the open on GitHub, through the consensus of the NumPy and wider scientific Python community. For more information on our governance approach, please see our Governance Document."
''Participants: Lea & Sibyl''


'''[https://pandas.pydata.org/about/ | Pandas]:'''
=== Description ===
The Calm Machine is a quiet and cozy island in the buzzing and bustling of this event. Hidden away from the other stations, it provides privacy and a moment of peace. Come in, sit down, touch, listen and observe. We then invite you to go for a psychogeographic walk. Walking is a form of reading. Through the act of walking, you interpret and rewrite the city. You are a gear in the mechanics of the Calm Machine—by interacting, you make it come to life! Connect with your senses and surroundings, and perhaps generate a new sensation.


I used Pandas to export the recorded motion data into a timpestamped CSV.
=== Medium/Media ===
touchdesigner, touchboard, sound, desk lamp


""
== [[User:Lucatorsera/Marginalia|Marginalia]] ==
 
==== 02 Mediapipe - Two Handed - No 3D plot ====
 
[[File:Screenshot 2025-11-08 at 14.12.23.png|Alt text|300px]]
[[File:Screenshot 2025-11-08 at 14.13.12.png|Alt text|300px]]
 
 
After 3 days of trying to set up a project for hand tracking using MANO and AMASS but it failed in aliging dependecies.
SO i decided to use mediapipe and my webcam for handtracking and exporting it into a timestamped .csv so later i can convert the data into C3D or BVH.
 
Also tried to convert the CSV into BVH but it failed many times.
[[File:Screenshot 2025-11-08 at 14.18.30.png|Alt text|600px]]
 
Steve:
* look how people react on seeing themselves represented as 3D point cloud
* feedback is essential for a self-sustaining system
 
 
==== 03 Blender - Audio Reacting Hand Armature ====
 
[[File:Screenshot 2025-11-08 at 22.16.41.png|Alt text|600px]]
 
Thinking about the event in UBIK, started experimenting with animating [https://blendswap.com/blend/26804 | a free rigged hand armature] with audio input.
 
Each finger is reacting on different frequecies.
 
==== 04 Blender - Webcam Reacting Hand Armature ====
 
[[File:Screenshot 2025-11-08 at 22.17.25.png|Alt text|600px]]
 
Then i wanted to try to use my webcam and the medipipe hand-tracking to animate the armature but it was very hard to figure out the alignement.
 
==== 05 Mediapipe - Open3D - Thinking on the event ====
 
[[File:Screenshot 2025-11-08 at 14.32.41.png|Alt text|600px]]
[[File:Screenshot 2025-11-08 at 14.32.52.png|Alt text|600px]]
 
Anyway, using Blender opened up a ton of new possibilites and i felt that i am drifiting far from my original goal which is building a armature, and i reminded myself that this is only the hand gesture mocap phase so  i decided to use the event to collect hand gestures from the performances and the audience and i started thinking on how to make it fun.
 
So i went back to the first trials but i used open3D to visualize the 3D hand data.
 
On the event i would like to use wireless webcams attached to caps so people can try them on and the hands will be seen from the view of the person who is wearing it. This could be developed further and aso used in many life situations which is kind of a big thing in the world of mocap.
 
On the event i would like to still visualise the data in a hologram format but also show the traces of the movement.
 
And ofcourse have conversations about that i found something beautiful experimenting on the edge of biology and technology. Need a good title....
 
  '''Feedback:'''<br>
  Alexia:
  * First person view for mocap handgestures. In gaming first person view has a particular function beside beign the easiest depiciton of the human body. This particularfunction is to interact with other characters and often aiming weapon. The esaiest because only the hands need to be animated instead of a whole body.
  * It is the performance of the hand that is important rather then what gesture it is altough some instructions could help to narrow down possibilites
  * Mirroring effect, how is it different to look in the mirror and see my hands reflected and represented as a skeleton on a digital devices's screen? <br>
  Lea:
  *Some instructions would be nice, and the delocalised idea of capturing is definetly something to explore.
  * Suggests to bring in an pre recorded audio where a voice is talking about cognitve assemblages and performative maachines to bring in context.
  * We are usually not aware of our hands moving and perfoming gestures and this particular demo does makes her more aware and thinks of situations where this could be an important instrument of learning (eg. learning to draw, surgery )
  * If i think of the project as a cognitive machine it helps me to think about what cognitive functions could be performed in animation when my hand movement is captured and projected on an armature hand. :) I can imagine that it is like a surgery ... tbc.
  * She suggests to capture snapshots so it can be documented and shared later. GOOOD ONE!!! <br>
  Manetta:
  * What is the original contexts of the model and the dependencies im using in my project, is important to see a bit of the history of these models in terms of research!! CHECK Mediapipe and open3D
  * A manual or steps to show the data collected can be used in animation processes
  * Be clear about personal fascination in stop-motion -> personal contex VERY IMPORTANT to clear intentions and to communicate the idea of the project
  * Motion Capture > Steps > Stop-motion Animation
  * For now it is only a demo of mediapipe's model of handtracking visualized in open3D, so communicating the fascination in making animation + adding context to it (cognitive assemblages) will make it a layaered project.
 
== A story in a story in a story ==
 
''Participants: [[User:Youjung|Youjung]] [[User:Barbs|Barbs]] [[User:Kiki|Kiki]]''
 
==== Description ====
"A story in a story in a story" invites you into an interactive narrative that lets you explore, gather and plot. Wander around in the virtual environment, pick up what you resonate with and that is what you take with you at the end of the day and becomes a tiny part of you.
 
==== Medium/Media ====
terminal, python, pen plotter, text adventure, fiction, paper & ink
 
==[[Projects_SI_28/The-Calm-Machine|The Calm Machine]]==
 
== Marginalia ==


''Participants: [[User:Lucatorsera|Luca]]''
''Participants: [[User:Lucatorsera|Luca]]''


==== Currently working on: ====
=== Currently working on: ===
Scripting pipeline to convert texts to graphs; Editorial research on specific textual archives
Scripting pipeline to convert texts to graphs; Editorial research on specific textual archives


==== Description ====
=== Description ===
Writing does something when published. Since the invention of text, it has functioned to flatten out a plurality of worlds from history, performing domination, differentiation and justifying violence. Marginalia takes selected texts in different historical contexts, and transforms them in experimental annotations engraved in canonical books. The resulting visual language communicates semiotics of displacement and a cartography manufactured by hegemonic world views. As a performance, layers of text, speech and distortion presents a writing machine as sonic warfare.
Writing does something when published. Since the invention of text, it has functioned to flatten out a plurality of worlds from history, performing domination, differentiation and justifying violence. Marginalia takes selected texts in different historical contexts, and transforms them in experimental annotations engraved in canonical books. The resulting visual language communicates semiotics of displacement and a cartography manufactured by hegemonic world views. As a performance, layers of text, speech, and distortion present a writing machine as sonic warfare.


==== Medium/Media: ====
=== Media ===
Laser engraving on books, laser projection, live sound
Laser engraving on books, laser projection, live sound


''Keywords: Territory, Cartography, Text, Colonialism''
== [[Projects SI 28/Water Vessel Dwelling in Temporality|Water Vessel: Dwelling in Temporality]] ==
 
[[File:DSC02976.jpg|thumb|312x312px]]
=== -> Input -> Output -> ===
text->cartography
 
== Water Vessel: Dwelling in Temporality ==
''Participants: Soda''
''Participants: Soda''


==== Currently working on: ====
=== Currently working on: ===
Exploring about this city and all the Europe


==== Description ====
=== Description ===
This work begins with my personal experience of living in Rotterdam — a city that is structured and rhythmically defined by water. Surrounded by ponds, canals, and rainwater systems, I constantly sense a condition of ''floating dwelling'': a way of living that feels both anchored and adrift, stable yet impermanent.
<big>''Rotterdam feels to me like a vast writing machine''</big>


In response to this environment, I started collecting abandoned wooden materials around the city. These wooden materials came from the furniture and wooden waste thrown out by the people living here, construction sites, and branches sawn off by gardeners. This act of gathering is not only a process of reclaiming the city’s discarded fragments, but also a gesture of ''re-dwelling'' — an attempt to reconnect with the material traces of the place. Each piece of wood, marked by time, humidity, and human touch, carries the city’s sedimented memory. Its textures and scars speak of erosion, adaptation, and survival — revealing what I call the ''temporality of dwelling'': the sense of being-in-time within unstable conditions.
-its stories continuously inscribed by the people who live here.


Through joining, sanding, and bending these fragments, I assembled them into the form of a '''water vessel''' — a wooden pool suspended in mid-air. The vessel, as an object, embodies both containment and permeability. Water gives the vessel its meaning, yet constantly transforms its surface and temperature. Their coexistence suggests a reciprocal relationship between ''dwelling and being dwelled'': to inhabit and to be shaped by what we inhabit.
I collected discarded wood from streets and construction sites and reassembled it into a suspended wooden form. The varied origins and textures of these materials echo people from different backgrounds coming together to form a temporary place of dwelling.


For me, this vessel reflects the experience of living as an immigrant — of existing between lands, languages, and temporalities. In Rotterdam, a city of water and migration, this wooden container becomes a metaphor for ''temporary belonging'', for the fragile balance between stability and drift. It is a space where time gathers, where the act of dwelling is never complete but always in the process of becoming.
Water gives the form shape while constantly altering it, just as residents and the city mutually reshape one another.
 
==== Medium/Media ====
Sculpture / Installation


This wooden structure becomes a metaphor for provisional belonging, capturing the fragile balance between drift and stability.


=== Medium/Media ===
Wood Sculpture / Installation
''Keywords:'' Fluidity, Temporality of Dwelling, Nonlinear Memory, Liminality, Fragmentation
''Keywords:'' Fluidity, Temporality of Dwelling, Nonlinear Memory, Liminality, Fragmentation


== Love Machine ==
== [[Projects SI 28/Love Machine|Love Machine]] ==


''Participants: Phillip''
''Participants: [[User:Phillip_Kesumo|Phillip]]''


==== Currently working on: ====
=== Currently working on: ===
Picture storybook , comes with slides different images using AI and using my own word to tell the story of  my characters such as Clara.  
Picture storybook, comes with slides different images using AI and using my own word to tell the story of  my characters such as Clara.  


==== Description ====
=== Description ===
I use AI to write my novel, and then I use AI again to create images for a picture storybook. The prompts are heavily supervised by me, so it is based on my own plot, story, and characters. It includes original storyline as well, and some scenes in the picture storybook are not in my original novel.
I use AI to write my novel, and then I use AI again to create images for a picture storybook. The prompts are heavily supervised by me, so it is based on my own plot, story, and characters. It includes original storyline as well, and some scenes in the picture storybook are not in my original novel.


== The Metathinking Metamachine ==
== [[Projects SI 28/The Metathinking Metamachine|The Metathinking Metamachine]] ==
 
''Participants:'' [[User:Tommi|Tommi]]
 
==== Currently working on: ====


* From [https://en.wikipedia.org/wiki/Zettelkasten Zettelkasten] to obsessing over personal knowledge management
[[File:Tommi’s Metathinking Metamachine.jpg|thumb|right|alt=Photo of Tommi next to the pen plotter, performing The Metathinking Metamachine]]
* Software escatology


==== Description ====
''Participants: [[User:Tommi|Tommi]]''


{{:Projects SI 28/The Metathinking Metamachine}}
=== Description ===


==== Medium/Media ====
A fictional seance with the <q>Gods of Tools</q>, using <q>The Ultimate Tool</q> to finally solve all Tommi’s software quests, utopian dreams, and issues.


''Installation'' made by a series of drawers for archives + ''monologue'' on tools hyperfocus.
=== Media ===


''Keywords:'' [[Metathinking]], Knowledge management, tools shape practices shape tools…
Performance with pen plotter.

Latest revision as of 00:45, 5 December 2025


The following is a collection of the projects conceived for the main event of Special Issue 28, that took place at Ubik, Rotterdam on 19th November 2025.

Writing Machine Ensemble

Participants: Robin, Ema, Daan

Description

With the Writing Machine Ensemble, rhythm and repetition will be experienced in a radically new form. Explorations in Potential Musicality is a musical journey through the sonic qualities of printers—with a strong emphasis on improvisation, yet promising dramatic intensity.

Co-founded by its current members, is an international group of experimental musicians from around the XPUB Studio. Independent and idealistic, they focus on blending the role of 'instrument' and 'musician' in an assemblage of artistic creation, striving to find the essential musical quality in tools of writing.

Media

Performance with dot matrix printer, pen plotter, typewriters.

Gesture Machine

Participants: Valentin

Currently working on:

Experimenting with open source motion capture datasets in touchdesigner.

Description

N. Katherine Hayles’ Cognitive Assemblages: People and technology made by people performing cognitive functions together. Only certain technologies considered as cognitive machines: The ones are capable of interpreting information of its own environment and act on the changes of the environment therefore changing its own context which creates meaning.

Volumetric Regimes are the industries that keep the technology 3D representation in a close circulation, iterating the same technology over and over again.

As a designer and amateur animator I take the position to make a cognitive animation table and attempting to explore free software provided by the above-mentioned industry through the lenses of Hayles’ Cognitive Assemblages.

more info

Media

Hologram, stop-motion armature, human body

Keywords: gesture, non-verbal communication, body language, animation, stop-motion

-> Input -> Output ->

Input: hand gestures
Output: stop-motion animation

A story in a story in a story

Participants: Youjung Barbs Kiki

Description

"A story in a story in a story" invites you into an interactive narrative that lets you explore, gather and plot. Wander around in the virtual environment, pick up what you resonate with and that is what you take with you at the end of the day and becomes a tiny part of you.

Medium/Media

terminal, python, pen plotter, text adventure, fiction, paper & ink

The Calm Machine

Participants: Lea & Sibyl

Description

The Calm Machine is a quiet and cozy island in the buzzing and bustling of this event. Hidden away from the other stations, it provides privacy and a moment of peace. Come in, sit down, touch, listen and observe. We then invite you to go for a psychogeographic walk. Walking is a form of reading. Through the act of walking, you interpret and rewrite the city. You are a gear in the mechanics of the Calm Machine—by interacting, you make it come to life! Connect with your senses and surroundings, and perhaps generate a new sensation.

Medium/Media

touchdesigner, touchboard, sound, desk lamp

Marginalia

Participants: Luca

Currently working on:

Scripting pipeline to convert texts to graphs; Editorial research on specific textual archives

Description

Writing does something when published. Since the invention of text, it has functioned to flatten out a plurality of worlds from history, performing domination, differentiation and justifying violence. Marginalia takes selected texts in different historical contexts, and transforms them in experimental annotations engraved in canonical books. The resulting visual language communicates semiotics of displacement and a cartography manufactured by hegemonic world views. As a performance, layers of text, speech, and distortion present a writing machine as sonic warfare.

Media

Laser engraving on books, laser projection, live sound

Water Vessel: Dwelling in Temporality

DSC02976.jpg

Participants: Soda

Currently working on:

Exploring about this city and all the Europe

Description

Rotterdam feels to me like a vast writing machine

-its stories continuously inscribed by the people who live here.

I collected discarded wood from streets and construction sites and reassembled it into a suspended wooden form. The varied origins and textures of these materials echo people from different backgrounds coming together to form a temporary place of dwelling.

Water gives the form shape while constantly altering it, just as residents and the city mutually reshape one another.

This wooden structure becomes a metaphor for provisional belonging, capturing the fragile balance between drift and stability.

Medium/Media

Wood Sculpture / Installation Keywords: Fluidity, Temporality of Dwelling, Nonlinear Memory, Liminality, Fragmentation

Love Machine

Participants: Phillip

Currently working on:

Picture storybook, comes with slides different images using AI and using my own word to tell the story of my characters such as Clara.

Description

I use AI to write my novel, and then I use AI again to create images for a picture storybook. The prompts are heavily supervised by me, so it is based on my own plot, story, and characters. It includes original storyline as well, and some scenes in the picture storybook are not in my original novel.

The Metathinking Metamachine

Photo of Tommi next to the pen plotter, performing The Metathinking Metamachine

Participants: Tommi

Description

A fictional seance with the Gods of Tools, using The Ultimate Tool to finally solve all Tommi’s software quests, utopian dreams, and issues.

Media

Performance with pen plotter.

Retrieved from "https://pzwiki.wdka.nl/mw-mediadesign/index.php?title=Projects_SI_28&oldid=319220"