User:Angeliki/Grad project speech analysis

From XPUB & Lens-Based wiki

Re- humanizing voice samples

I want to highlight/be aware of the politics/situation regarding the speech recognition and analysis tools that are changing our perspective on our embodied voices. Beyond their experimental or commercial uses they are also used to control our access in a country or institutions and affect our behaviour with our bodies and technology. In extend the way they are used affects our relations with the others/estrange us from our relations with the others and our surroundings/ dehumanize our lives. Those tools that are recently very broadly used are trained by a database of 'real' voice samples. These samples come from different sources around the world [research projects, frequencies, radio] sometimes with the permission of the people donating their voice. The more the accents are and the bigger the dataset becomes the better the tool can be trained. At the same time these tools (like automatic dialect analysis) are used from states [Germany] to verify the claims of origin of refugees. It is very often that this process can get wrong because "Identifying the region of origin for anyone based on their speech is an extremely complex task" and depends on "a wide range of factors".[1]


I will do it by relating the two sides of the tool and rethink/hack this tool in a way that open a conversation around this issue/ radicalise this tool.

Our voice is personal

Voice samples for training speech analysis software (LDC). Tracing the samples Using speech analysis software to verify voice samples


what data: ordered samples or real samples (broadcast conversations, broadcast news, field recordings[air traffic, walking/noise background, ], meeting speech, microphone conversation, microphone speech, telephone conversations, telephone speech, transcribed speech, video) examples of verification: diagnostic tool(for disease, depression), personal assistants (humanize the software voice), refugees seeking asylum/verification of claims of origin/Germany, banks


from where: universities (of linguistics) around the world, research projects or satellites, radio Example


extracts of descriptions of the samples: "Transcripts have been made of all recordings in this publication, manually time aligned to the phrasal level, annotated to identify boundaries between news stories, speaker turn boundaries and gender information about the speakers.", "The audio files are 8 KHz, 16-bit linear sampled data, representing continuous monitoring, without squelch or silence elimination, of a single FAA frequency for one to two hours.", "The Air Traffic Control Corpus (ATC0) is comprised of recorded speech for use in supporting research and development activities in the area of robust speech recognition in domains similar to air traffic control (several speakers, noisy channels, relatively small vocabulary, constrained languaged, etc.) The audio data is composed of voice communication traffic between various controllers and pilots." Example

with permission from the users or not in the case of real samples matter of privacy, de-humanizing automated processes regarding control of the body

Some audio samples with their transcriptions:


LDC93S1 0 46797 She had your dark suit in greasy wash water all year. (microphone)


por que al fin y al cabo el miedo de la mujer a la violencia del hombre es el espejo del miedo del hombre a la mujer sin miedo CMPB_M_32_01IVN_00004 (broadcast conversation)


Interview 15
(A=Interviewer; B=Interviewee)
A: So we are recording.  Awesome.  So how long have you lived in Flint? (unclear)
B: 38 years.
A: Is that your whole life?  Wow you look really young.
B: Thank you!(...)(microphone conversation)