OuNuPo: Difference between revisions
(→links) |
(→links) |
||
Line 140: | Line 140: | ||
=links= | =links= | ||
[https://annuel.framapad.org/p/ergbookscan Pad from ERG Bookscan session: details on updating CHDK firmware]<br> | [https://annuel.framapad.org/p/ergbookscan Pad from ERG Bookscan session: details on updating CHDK firmware]<br> | ||
[https://pzwiki.wdka.nl/mediadesign/CHDK | [https://pzwiki.wdka.nl/mediadesign/CHDK Notes on CHDK]<br> | ||
[http://mighty-hoernsche.de/ CDHK firmware] | [http://mighty-hoernsche.de/ CDHK firmware] | ||
Revision as of 19:24, 29 October 2019
Special Issue 5: OuNuPo, Ouvroir de Numérisation Potentielle
Project Description
Main partner: WORM (WORM's Pirate Bay to be precise)
Special guests: Manetta Berends and Cristina Cochior (Algolit group)
Launch date: 28 March (wed)
Assessment date: 29 March (thu)
The outcome of the special issue will be the following things:
- 2 book scanners (one to stay at XPUB, one to stay at WORM)
- one unique (as in unique copy) reader in the form of an artist's book.
The reader will be a collection of texts curated by students and staff on the topic of book scanner, text mobility, constraint writing, algorithmic literature, and I also hope the culture and politics of OCR, text analysis, AI in the context of text processing and generation.
- a collection of different software back-ends for the book scanner, so
as to reconfigure its functionality, ie you might scan a book, and get a pdf, the content of which has been manipulated in poetical or critical way, or you could also get something else entirely, a sound file, an collection of images, etc.
- a gigantic collection of files produced by combining the reader as
input source into the scanner making use of the plethora of different back-ends. IMPORTANT: the reader will never exist as a typical digital alter-ego of the analog original but only through a multitude of different digital interpretations.
- an evening launch at WORM with presentation of the reader, back-ends,
results, etc.
Sessions
- 09.01.2018 Intro to the 'Feminist Reader' pad
- 10.01.2018 The Alphabet as Software - R&W
- 15.01.2018 Optical character recognition - pad
- 17.01.2018 Python and N+7 - pad
- 18.01.2018 Publishing Pipelines - OuLi/NuPo, natural language processing, materiality (pad)
- 30.01.2018 Publishing Pipelines - methodologies, considerations & examples + a short pdf field study @ pirate libraries (pad)
- 29.01.2018 Sonification - pad
- 30.01.2018 Publishing Pipelines - inter-annotator (dis)agreements, counting techniques & training a binary classifier (pad)
- 05.03.2018 OuNuPo Publishing Experiments
- 15.03.2018 - VARIA - Presentation OuNuPo beta at Varia's Algolit
- 23.03.2018 - Presentation Pad / Makefile
- 28.03.2018 - WORM - final presentation
- 29.03.2018 - assessments
Independent Research
week 2
Look into your assigned topic, try, test, and on a wiki page write a recipe/report/tutorial based on your experiments and research. Andre Castro (talk) 20:01, 15 January 2018 (CET)
- Zalan: page segmentation; image detection
- Alex: Web ocr implementation: WebOCR
- Angeliki + Alice: training Tesseract to detect new font
- Tash: retraining Tesseract to misinterpret text (hidding messages in plain-sight - Steganography ) here
- Joca: image manipulation to optimize OCR
week 5
Raw data sonification/visualization research: a recipe, a work (with documentation on how you got to the result), a survey of tools, a workflow, or whatever you feel curious about, concerning that topic.
week 8 (feb 20 2018)
Natasha
First scan, OCR results and take the 50 most common words, and this should then somehow affects what happens in next scan.
- Where do you store things like a text file,
- How does it get exported / postprocessed
- When does OCR occur?
- What hooks can we use?
Alice
Desire to go back to print, maybe a poster. Select words based on their length (example of OuLiPo, Carl Andre)
- How to extract patterns from words
- How to produce new outputs (build a poster)
- What "leftovers" exist in the processing of the images?
- Word searches
Zalan
Needs to find a rule to constraining. Reading in a non-linear way
> Borges ... L
OCR Materializing text in 3D ... blender. 360 projection ... spatialize?
Alex
- Scanned data as chatbot?
- Database back to narrative ...
- Integrating with ReportLab/Platypus generated layouts
- Including code in results
The Feminist Reader
The Feminist Reader is a compilation of 6 books on scanning cultures, edited, designed and produced by the XPUB students. Starting from a set of questions and using critical and feminist research methodologies, each publication constitutes a chapter of the Reader; What culture do we reproduce when we scan books? How do we share and reproduce knowledge online? Who has access and who is excluded in the narrative and the Canon? Who is the librarian? Are data sets biased? Does software have a gender? does it have a voice? How do weaving and programming connect historically? Building from a collective knowledge database online, each Reader is a compilation of 5 to 10 annotated texts addressing a specific question. The 6 books are wrapped in an Ouvroir, scarf embroidered automatically, and folded according to the Japanese art of Furoshiki. The Feminist Reader project was initiated by Delphine Bedel for the XPUB Special Issue 5. For the second par tof the project, after building two DIY book scanners with Worm in Rotterdam, the students and tutors further expanded the Feminist Reader and their research is a series of Python scripts and algorithms to scan books. The Reader will never exist as a typical digital alter-ego of the analog original but only through a multitude of different digital interpretations.
Scanner Building notes
- Software: pad
- Uploaded the preinstalled .img to the pzi-server (temporarily): scannerpi.img.xz (decompress with xz, and partition maybe needs to be resized)
- Installed new image on PI: https://github.com/Tenrec-Builders/pi-scan
- Bookscanner makefile
- Hardware:
Software
- Camera firmware:
- Image acquisition:
- Pi Scan -RaspberryPi read-only image. It tries to take the best
possible shots and save them to an external SD Card, restart the camera if crashed, and resuming work if done in several sessions.
- Post-processing:
- scan-tailor: interactive post-processing (GUI) tool for scanned pages:page splitting, deskewing, adding/removing borders, selecting content.
- Unpaper Unpaper is able to deskew scanned pages and optionally combine single pages onto spreads. It uses .ppm .pbm and .pnm files as input and will output the same formats.
- Textcleaner script is an imagemagick script for cropping, grayscaling and de-noising of images. I don't need the full script, but maybe I can reconstruct it and make a script that just does the grayscaling and denoising.
- All-in-one
Spreads: Spreads is a scanner workflow tool for book scanning. It's written in python and has a command-line and web-based interface.
links
Pad from ERG Bookscan session: details on updating CHDK firmware
Notes on CHDK
CDHK firmware
Links/References/Reading List
The Archivist — DIY Book Scanner http://diybookscanner.org/archivist/indexee7f.html
DIY Book Scanner forum: Hardware & building
Archivist Book Scanner (looks more like our parts)
Klijn, Edwin. 2008. ‘The Current State-of-Art in Newspaper Digitization: A Market Perspective’. D-Lib Magazine 14
(1/2). https://doi.org/10.1045/january2008-klijn.
pi scan installation
Media
- Varia presentation photos: https://vvvvvvaria.org/archive/2018-03-16.17-Algologs/
- Varia presentation audio: http://pzwart1.wdka.hro.nl/~amansoux/SP5%20Beta%20Launch%2048.ogg
- WORM presentation audio: http://pzwart1.wdka.hro.nl/~acastro/SI5-recording-worm.mp3