User:Supisara/Special Issue 16: Difference between revisions
m (→Next steps) |
m (→Next steps) |
||
(31 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
==Special Issue #16: Vernacular Language Processing== | ==Special Issue #16: Vernacular Language Processing== | ||
=== Prototyping === | |||
Jupyter notebooks for carrier-bag-of-notebooks (to be linked)<br> | |||
{| class="wikitable" | |||
|- | |||
! Date !! Link | |||
|- | |||
| 21/09/21 || XP4, 5, 6 + A House of Dust | |||
|- | |||
| 27/09/21 || XP7 + NLTK1 | |||
|- | |||
| 04/10/21 || XP8 + NLTK2 | |||
|- | |||
| 08/11/21 || XP15 | |||
|} | |||
Jupyter notebooks from the subgroup coding tryout of the Annotation Compass led by Kamo: [https://hub.xpub.nl/soupboat/~supi/__lab__/lab/workspaces/auto-H/tree/SI16/labels/labels-Copy1.ipynb 01] [https://hub.xpub.nl/soupboat/~supi/__lab__/lab/workspaces/auto-H/tree/SI16/labels/test.ipynb 02] <br> | |||
Sample snippets: <br> | |||
01 for keywords <br> | |||
<syntaxhighlight lang="python"> | |||
filtered_labels = [] | |||
for label in data_json['labels']: | |||
if 'table' in label['text']: | |||
# print(label['text']) | |||
filtered_labels.append(label) | |||
print(filtered_labels) | |||
</syntaxhighlight> | |||
02 for user IDs | |||
<syntaxhighlight lang="python"> | |||
all_userIDs = [] | |||
for label in data_json['labels']: | |||
all_userIDs.append(label['userID']) | |||
print(all_userIDs) | |||
</syntaxhighlight> | |||
=== Group exercises === | === Group exercises === | ||
Line 12: | Line 53: | ||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
| 05/10/21 || [https://pad.xpub.nl/p/SP16_0510 SI16] || Text processing || 1.) Soliloquy slow processing with Chae, Miriam, Carmen (lines 111-156): selecting a linguistic pattern to apply to a literary device. Contribution: invisible spellcheck annotation<br> | | 05/10/21 || [https://pad.xpub.nl/p/SP16_0510 SI16] || Text processing || 1.) Soliloquy slow processing with Chae, Miriam, Carmen (lines 111-156): selecting a linguistic pattern to apply to a literary device. Contribution: invisible spellcheck annotation<br> | ||
[[File:Supi soliloquy slow processing.png|thumb| | [[File:Supi soliloquy slow processing.png|thumb|none|Letter ghosting / sticky spellcheck and punctuation]] | ||
2.) [https://pad.xpub.nl/p/SP16_0510_texts Magic words glossary] with everyone: text processing with special customized commands/incantations for a collaborative spell book | 2.) [https://pad.xpub.nl/p/SP16_0510_texts Magic words glossary] with everyone: text processing with special customized commands/incantations for a collaborative spell book | ||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
Line 19: | Line 60: | ||
| 12/10/21 || [https://pad.xpub.nl/p/SP16_1210 SI16] || Transcription processes || [https://pad.xpub.nl/p/supi_mitsa%2012/10/21 Multilingual multitasking] with Mitsa: transcribing while recording, listening, thinking, editing, then generating translations in two more languages | | 12/10/21 || [https://pad.xpub.nl/p/SP16_1210 SI16] || Transcription processes || [https://pad.xpub.nl/p/supi_mitsa%2012/10/21 Multilingual multitasking] with Mitsa: transcribing while recording, listening, thinking, editing, then generating translations in two more languages | ||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
| 01/11/21 || [https://pad.xpub.nl/p/si16-protoyping-week-7 Prototyping] || Custom corpora || Concrete Label ([https://pad.xpub.nl/p/AGAINST_FILTERING pad], [https://hub.xpub.nl/soupboat/concrete-label/ tool] (WIP)) with Kamo: manually filtering/annotating concrete poetry | | 01/11/21 || [https://pad.xpub.nl/p/si16-protoyping-week-7 Prototyping] || Custom corpora || Concrete Label ([https://pad.xpub.nl/p/AGAINST_FILTERING pad], [https://hub.xpub.nl/soupboat/concrete-label/ tool] (WIP)) with Kamo: manually filtering/annotating concrete poetry. Contribution: sample concrete poetry reading [[File:Concrete labeling tryout.gif|thumb|none|Initial mockups]] | ||
|} | |} | ||
=== Research === | === Research === | ||
Related resources from workshops, station skills, discussions: | |||
{| class="wikitable" | |||
|- style="text-align:left; vertical-align: top;" | |||
! Date !! Topic !! Description || Source | |||
|- style="text-align:left; vertical-align: top;" | |||
| 06/10/21 || ''Cybernetic Dreams: Arduino + sensors: an artificial nervous system'' with Dennis de Bel || Workshop || | |||
|- style="text-align:left; vertical-align: top;" | |||
| 07/10/21 || ''Cybernetic Dreams: Speech-to-derive: the myth of natural language'' with Federico Poni and Francesco Luzzana || Workshop || | |||
|- style="text-align:left; vertical-align: top;" | |||
| 09/10/21 || ''Cybernetic Dreams: Soul of the Beast: The Magic of Chance/Chaos'' with Telemagic || Workshop || | |||
|- style="text-align:left; vertical-align: top;" | |||
| 17/10/21 || ''Machine Listening: Unnatural Language Processing'' by Liquid Architecture x Unsound || Workshop || | |||
|- style="text-align:left; vertical-align: top;" | |||
| 23/10/21 || ''Cassette Hacking'' with Dogbotic Labs || Workshop || | |||
|- style="text-align:left; vertical-align: top;" | |||
| 04/11/21-02/12/11 || Smart Textiles with Bram van Waardenberg || Station Skill || | |||
|- style="text-align:left; vertical-align: top;" | |||
| 06/11/21 || ''Zine Camp: Glyph Assembling Workshop'' by Júlia C Aguair || Workshop || | |||
|- style="text-align:left; vertical-align: top;" | |||
| 06/11/21 || ''Zine Camp: E-Zines off the Grid'' by Florian Cramer || Workshop || | |||
|} | |||
=== Observations === | === Observations === | ||
Line 31: | Line 95: | ||
=== Experiments === | === Experiments === | ||
''' | Individual experiments on vernacular processing methods through different tools and interactions''':<br> | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- style="text-align:left; vertical-align: top;" | ||
! Date !! | ! Date !! No. !! Description !! Output | ||
|- | |- style="text-align:left; vertical-align: top;" | ||
| 21/ | | 04/10/21 || 01 || TextEdit + Spoken Content #1: processing text from “I Am Sitting in a Room” || [https://vimeo.com/637738403 Video] | ||
|- | |- style="text-align:left; vertical-align: top;" | ||
| | | 04/10/21 || 02 || TextEdit + Spoken Content #2, processing text from “I Am Sitting in a Room” || [https://vimeo.com/637738768 Video] | ||
|- | |- style="text-align:left; vertical-align: top;" | ||
| | | 04/10/21 || 03 || TextEdit + Spoken Content #3, processing text from “I Am Sitting in a Room” || [https://vimeo.com/637740824 Video] | ||
|- | |- style="text-align:left; vertical-align: top;" | ||
| | | 05/10/21 || 04 || Google Translate scan + a doodle: processing text from multiple readers || [https://vimeo.com/637710381 Video] | ||
|- style="text-align:left; vertical-align: top;" | |||
| 05/10/21 || 05 || Google Translate scan + a gesture || [https://vimeo.com/637710946 Video] | |||
|- style="text-align:left; vertical-align: top;" | |||
| 05/10/21 || 06 || Wiki → pad hyperlink weave || [https://vimeo.com/637707108 Video] | |||
|} | |} | ||
=== Deliverables === | === Deliverables === | ||
Collective and individual contributions for Special Issue 16: Learning How To Walk While Catwalking | |||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
! Phase !! Output | ! Phase !! Description !! Output (Collective) !! Output (Individual) | ||
|- style="text-align:left; vertical-align: top;" | |||
| '''1.) Processing''' || '''1.) The vernacular, rejections, the API, SI16 subgroup work distribution''' || '''1.) Rejection as form of VLP''': [https://pad.xpub.nl/p/Rejection_Glossary pad], [https://pzwiki.wdka.nl/mediadesign/Rejection wiki] <br> '''2.) SI16 Group meetings''' [https://pad.xpub.nl/p/Meeting_SP16_Nov_04%20pad pad] || '''1.) Visualizing rejection as''' [https://hub.xpub.nl/soupboat/~supi/special_issue_16/rejection_1.jpg a compressed decision-making process], [https://hub.xpub.nl/soupboat/~supi/special_issue_16/rejection_2.jpg a selection ↔︎ omission process via interaction with space], [https://hub.xpub.nl/soupboat/~supi/special_issue_16/rejection_3.jpg a force] <br> '''2.) Understanding the API as''' ''"a personifcation of something that's intended to be functional, in that we assign the API a particular behavior so that it does the unexpected. For instance [re: "Learning How To Walk While Catwalking"], a cat-like API––unpredictable, playful, does the opposite of what you ask. The vernacular makes the intimidating a commonplace and [more] approachable."''<br>'''3.) Understanding SI16 as''' | |||
[[File:Si16 processing 1.jpg|thumb|none]] [[File:Si16 processing 2.jpg|thumb|none]] | |||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
| '''1.) | | '''2.) Production''' || '''1.) "Annotation Compass"''' with Alex, Emma, Jian, Kamo, Kimberley<br> '''2.) "Inverse Annotations"''' project showcase || '''1.1.) "Selection Process"''' with Kamo, Jian, Kimberley: [https://pad.xpub.nl/p/sunday pad], [https://pzwiki.wdka.nl/mediadesign/Selection_Process_/_Filter_/_Interface wiki], [https://hub.xpub.nl/soupboat/selection-process/ page], [https://hub.xpub.nl/soupboat/generic-labels/ tool]<br>'''1.2.) "Annotation Compass"''' [https://hub.xpub.nl/soupboat/si16/projects/annotation-compass/ project] <br> '''2.1.) "Inverse Annotations"''' pre-launch tryout at Varia––submitted results: <br> 2.1.1.) Combined (click on "load"): [https://hub.xpub.nl/soupboat/si16/annotation-compass/annotate/img.png/ 01] <br> 2.2.2.) Individual: [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/alex.png 01] [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/blank-space-mitsa.jpg 02] [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/miri.png 03] [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/Screenshot%202021-12-15%20at%2013.19.26.png 04] [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/supi-load.png 05], [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/supi.jpg 06] [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/SUPI.jpg 07] [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/what%20is%20the%20size%20of%20a%20city.png 08] [https://hub.xpub.nl/soupboat/~supi/__lab__/files/shared/html/OLD_si16/documentation/Supi/%E1%84%89%E1%85%B3%E1%84%8F%E1%85%B3%E1%84%85%E1%85%B5%E1%86%AB%E1%84%89%E1%85%A3%E1%86%BA%202021-12-15%20%E1%84%8B%E1%85%A9%E1%84%92%E1%85%AE%201.19.34.png 09] || '''1.) "Selection Process" experiments:'''<br> 1.1.) Subjective map [[File:Selection_process_09.jpg|thumb|none]] <br> 1.2.) Subjective map with filters (mockups): [https://hub.xpub.nl/soupboat/~supi/filter_elevation_1.jpg 01] [https://hub.xpub.nl/soupboat/~supi/filter_elevation_2.png 02] [https://hub.xpub.nl/soupboat/~supi/filter_slit.png 03] <br> 1.3.) Non-map [[File:Inverse annotations 1.png|thumb|none|Sample 1]] <br> 2.) '''"Inverse Annotations"'''<br> 2.1.) [https://hub.xpub.nl/soupboat/si16/projects/annotation-compass/inverse_annotations/ Project showcase] <br> 2.2.) [https://hub.xpub.nl/soupboat/si16/annotation-compass/annotate/space.png/ Image for launch at Varia] | ||
1.) | |||
1.1. | |||
2.) | |||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
| '''2.) | | || '''2.) SI16 Visual Identity''' with Kimberley, Alex, Kamo, Gersande || '''1.) Tryouts:''' [https://www.are.na/si16-visual-identity are.na] <br> '''2.) Package:''' [https://www.are.na/block/14321505 guidelines], [https://hub.xpub.nl/soupboat/~supi/__lab__/lab/workspaces/auto-U/tree/shared/html/si16_visual-identity icons, pictograms, stickers] || '''1.) Initial mockups:''' <br> 1.1.) R1 [https://www.are.na/block/14272020 01] [https://www.are.na/block/14240436 02] [https://www.are.na/block/14240437 03] [https://www.are.na/block/14240441 04] <br> 1.2.) R2 [https://www.are.na/block/14242588 01] [https://www.are.na/block/14242590 02] [https://www.are.na/block/14242592 03] [https://www.are.na/block/14242594 04] [https://www.are.na/block/14242843 05] <br> 1.3.) R3 [https://www.are.na/block/14248339 01] [https://www.are.na/block/14248344 02] [https://www.are.na/block/14248341 03] [https://www.are.na/block/14248342 04] [https://www.are.na/block/14248340 05] [https://www.are.na/block/14248343 06] <br> 1.4.) R4 [https://www.are.na/block/14250161 01] [https://www.are.na/block/14250162 02] [https://www.are.na/block/14250430 03] <br> 1.5.) R5 (animation test) [https://arena-attachments.s3.amazonaws.com/14286534/7bacdd470da5dee0aeb1866a8b9e34b4.mp4?1638961444 01] <br> | ||
'''1.) | '''2.) Communication materials for event launch:'''<br> | ||
1.1.) [https:// | 2.1.) Instagram [https://www.instagram.com/p/CXOvDlHAsR8/ announcement], [https://www.instagram.com/p/CXlWf-tg87I/ launch] <br> 2.2.) [https://www.are.na/block/14289707 Facebook] | ||
1.2.) [https:// | |||
1. | |||
< | |||
< | |||
1 | |||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
| || | ||| '''3.) SI16 Front End''' with Kamo, Emma, Chae || '''1.) Mockups:''' [https://www.figma.com/file/JU1RQpwzzXvCjw9ChX9Ojc/si16-test Figma]<br> '''2.) Website:''' [https://hub.xpub.nl/soupboat/si16/ SI16] || '''1.) Initial mockups:''' <br> 1.1.) Homepage: [https://www.are.na/block/14272022 01], [https://www.are.na/block/14272020 02], 03 <br> 1.2.) "Annotation Compass" page: tool, upload page, icons <br> 1.3.) Projects page <br> 1.4.) Header variations <br> 1.5.) Favicon | ||
''' | |} | ||
'''2 | |||
=== Next steps === | |||
Developed interests/for further research: | |||
{| class="wikitable" | |||
|- style="text-align:left; vertical-align: top;" | |||
! No !! Topic !! Description !! Reference | |||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
||| | | 1 || INDD processing time || "Selection Process" animation, navigation || | ||
[[File:Selection process animation.gif|thumb|none|INDD 1-1]] | |||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
| | | 2 || HTML markup || Variations of "Inverse Annotations" || | ||
[[File:Inverse annotations further research 1-1.png|thumb|none|HTML 1-1]] | |||
1 | [[File:Inverse annotations further research 1-2.png|thumb|none|HTML 1-2]] | ||
2.2 | |||
|- style="text-align:left; vertical-align: top;" | |- style="text-align:left; vertical-align: top;" | ||
| 3 || Sticker script || Leftover stickers from cursor hover from SI16 website || | |||
[[File:Si16 hover.png|thumb|none|Hover 1-1]] | |||
|} | |} | ||
Latest revision as of 04:09, 19 April 2022
Special Issue #16: Vernacular Language Processing
Prototyping
Jupyter notebooks for carrier-bag-of-notebooks (to be linked)
Date | Link |
---|---|
21/09/21 | XP4, 5, 6 + A House of Dust |
27/09/21 | XP7 + NLTK1 |
04/10/21 | XP8 + NLTK2 |
08/11/21 | XP15 |
Jupyter notebooks from the subgroup coding tryout of the Annotation Compass led by Kamo: 01 02
Sample snippets:
01 for keywords
filtered_labels = []
for label in data_json['labels']:
if 'table' in label['text']:
# print(label['text'])
filtered_labels.append(label)
print(filtered_labels)
02 for user IDs
all_userIDs = []
for label in data_json['labels']:
all_userIDs.append(label['userID'])
print(all_userIDs)
Group exercises
Date | Pad | Description | Output |
---|---|---|---|
22/09/21 | RW&RM | Intro, first reading and writing workshop | Emoji markup with Jian, Kamo, Erica. Annotating a reader with emojis to indicate the beginning and endings of each person's side notes, questions, distractions, references, etc. Annotations became interruptions that were woven into the original reader and transformed it into reader 2.0. |
28/09/21 | SI16 | On orientation & navigation | Text traverse + keyword geotag with Alex, Jian: selecting, combining, and rearranging texts from multiple readers to create a new one to perform with. Keyword repetition is used as a text navigation tool/method, so performance can vary (for example, start/stop reading at specific word). |
05/10/21 | SI16 | Text processing | 1.) Soliloquy slow processing with Chae, Miriam, Carmen (lines 111-156): selecting a linguistic pattern to apply to a literary device. Contribution: invisible spellcheck annotation 2.) Magic words glossary with everyone: text processing with special customized commands/incantations for a collaborative spell book |
06/10/21 | RW&RM | Reader prototypes | From pad to bubbles with Kamo, Alex: converting chaos to calm in the form and flow of chat bubbles |
12/10/21 | SI16 | Transcription processes | Multilingual multitasking with Mitsa: transcribing while recording, listening, thinking, editing, then generating translations in two more languages |
01/11/21 | Prototyping | Custom corpora | Concrete Label (pad, tool (WIP)) with Kamo: manually filtering/annotating concrete poetry. Contribution: sample concrete poetry reading |
Research
Related resources from workshops, station skills, discussions:
Date | Topic | Description | Source |
---|---|---|---|
06/10/21 | Cybernetic Dreams: Arduino + sensors: an artificial nervous system with Dennis de Bel | Workshop | |
07/10/21 | Cybernetic Dreams: Speech-to-derive: the myth of natural language with Federico Poni and Francesco Luzzana | Workshop | |
09/10/21 | Cybernetic Dreams: Soul of the Beast: The Magic of Chance/Chaos with Telemagic | Workshop | |
17/10/21 | Machine Listening: Unnatural Language Processing by Liquid Architecture x Unsound | Workshop | |
23/10/21 | Cassette Hacking with Dogbotic Labs | Workshop | |
04/11/21-02/12/11 | Smart Textiles with Bram van Waardenberg | Station Skill | |
06/11/21 | Zine Camp: Glyph Assembling Workshop by Júlia C Aguair | Workshop | |
06/11/21 | Zine Camp: E-Zines off the Grid by Florian Cramer | Workshop |
Observations
and/or reflections, side thoughts, curiosities, rabbit holes
- processing is time and environment-based
- rejection as a vernacular processing method: masks, magnetic field, compressed directions/decisions, simultaneous selection + omission, frame rates of events/active-inactive states, physics (collision/energy)
Experiments
Individual experiments on vernacular processing methods through different tools and interactions:
Date | No. | Description | Output |
---|---|---|---|
04/10/21 | 01 | TextEdit + Spoken Content #1: processing text from “I Am Sitting in a Room” | Video |
04/10/21 | 02 | TextEdit + Spoken Content #2, processing text from “I Am Sitting in a Room” | Video |
04/10/21 | 03 | TextEdit + Spoken Content #3, processing text from “I Am Sitting in a Room” | Video |
05/10/21 | 04 | Google Translate scan + a doodle: processing text from multiple readers | Video |
05/10/21 | 05 | Google Translate scan + a gesture | Video |
05/10/21 | 06 | Wiki → pad hyperlink weave | Video |
Deliverables
Collective and individual contributions for Special Issue 16: Learning How To Walk While Catwalking
Phase | Description | Output (Collective) | Output (Individual) |
---|---|---|---|
1.) Processing | 1.) The vernacular, rejections, the API, SI16 subgroup work distribution | 1.) Rejection as form of VLP: pad, wiki 2.) SI16 Group meetings pad |
1.) Visualizing rejection as a compressed decision-making process, a selection ↔︎ omission process via interaction with space, a force 2.) Understanding the API as "a personifcation of something that's intended to be functional, in that we assign the API a particular behavior so that it does the unexpected. For instance [re: "Learning How To Walk While Catwalking"], a cat-like API––unpredictable, playful, does the opposite of what you ask. The vernacular makes the intimidating a commonplace and [more] approachable." 3.) Understanding SI16 as |
2.) Production | 1.) "Annotation Compass" with Alex, Emma, Jian, Kamo, Kimberley 2.) "Inverse Annotations" project showcase |
1.1.) "Selection Process" with Kamo, Jian, Kimberley: pad, wiki, page, tool 1.2.) "Annotation Compass" project 2.1.) "Inverse Annotations" pre-launch tryout at Varia––submitted results: 2.1.1.) Combined (click on "load"): 01 2.2.2.) Individual: 01 02 03 04 05, 06 07 08 09 |
1.) "Selection Process" experiments: 1.1.) Subjective map 1.2.) Subjective map with filters (mockups): 01 02 03 1.3.) Non-map 2.) "Inverse Annotations" 2.1.) Project showcase 2.2.) Image for launch at Varia |
2.) SI16 Visual Identity with Kimberley, Alex, Kamo, Gersande | 1.) Tryouts: are.na 2.) Package: guidelines, icons, pictograms, stickers |
1.) Initial mockups: 1.1.) R1 01 02 03 04 1.2.) R2 01 02 03 04 05 1.3.) R3 01 02 03 04 05 06 1.4.) R4 01 02 03 1.5.) R5 (animation test) 01 2.) Communication materials for event launch: | |
3.) SI16 Front End with Kamo, Emma, Chae | 1.) Mockups: Figma 2.) Website: SI16 |
1.) Initial mockups: 1.1.) Homepage: 01, 02, 03 1.2.) "Annotation Compass" page: tool, upload page, icons 1.3.) Projects page 1.4.) Header variations 1.5.) Favicon |
Next steps
Developed interests/for further research:
No | Topic | Description | Reference |
---|---|---|---|
1 | INDD processing time | "Selection Process" animation, navigation | |
2 | HTML markup | Variations of "Inverse Annotations" | |
3 | Sticker script | Leftover stickers from cursor hover from SI16 website |