User:Zuhui/๐Ÿ‘€/Experimental Translation

From XPUB & Lens-Based wiki

"The sign is dead"

  • If language is reduced to just data, where does meaning actually come from?
  • Is the difference between human translation and machine translation purely technical, or is there a deeper, more โ€˜philosophicalโ€™ aspect to it?

MT - SMT - NMT

In early stage of machine translation, rule-based MT did not work
Languages are too complex and diverse to be reduced to fixed rules.
โ†“
Algorithms based on habit: SMT
SMT analyzes large-scale human translation data to learn patterns and calculates the likelihood of certain phrases or words being translated a specific way. so more flexible and capable of reflecting linguistic complexities compared to rule-based systems.
โ†“
NMT and word vectors
NMT is a significant advancement over SMT. it uses these vectors to perform translations by aligning and transforming relationships across languages.

  • NMT๋Š” ๋‹จ์ˆœํžˆ ์™ธ๊ตญ์–ด๋ฅผ "์ด์ƒํ•œ ๊ธฐํ˜ธ"๋กœ ๋ณด๊ณ  ์ด๋ฅผ ํ•ด๋…ํ•˜๋Š” ๋ฐฉ์‹์ด ์•„๋‹ˆ๋‹ค: SMT๋Š” ๊ณผ๊ฑฐ ๋ฐ์ดํ„ฐ์— ๊ธฐ๋ฐ˜ํ•œ ๋‹จ์ˆœ ํ™•๋ฅ  ๊ณ„์‚ฐ์„ ์‚ฌ์šฉํ–ˆ์ง€๋งŒ, NMT๋Š” ์–ธ์–ด ๋‚ด๋ถ€์˜ ๋ณต์žกํ•œ ์—ฐ์‚ฐ์„ ํ†ตํ•ด ๋‘ ์–ธ์–ด ๊ฐ„์˜ ๊ด€๊ณ„๋ฅผ ์„ค์ •ํ•˜๊ณ  ์ด๋ฅผ ์ƒํ˜ธ์ž‘์šฉ์œผ๋กœ ๋ฐœ์ „์‹œํ‚ค๊ธฐ ๋•Œ๋ฌธ.
Tokens and Vector Embeddings
A token is the smallest unit into which text is broken down for processing in tasks like machine translation.

โ€ข Tokens can be words, prefixes/suffixes, or even specific characters.
โ€ข These tokens are then converted into numerical data that machines can process.
โ€ข Tokenization


Vector embedding is a technique that represents each token as coordinates in a multidimensional space.

โ€ข The machine learns the relationships between words using these coordinates.
โ€ข Each word is represented as a vector, which captures how it relates to other words.


Word Window
analyzes how often a specific token appears near other tokens in a given range of text.
โ€ข Usually, a word window spans 3โ€“15 words.


Multidimensional Vector
Vectors represent the relationships between words mathematically.โ€จEach token is expressed as a vector in a multidimensional space. These vectors represent:

โ€ข The likelihood of a specific word appearing alongside others.
โ€ข The similarities and differences between words.

Vectors arenโ€™t just limited to two or three-dimensional representations. In tasks like machine translation, vectors typically span hundreds of dimensions.
  • ์ด๋Ÿฐ ๋ฐฉ์‹์œผ๋กœ ๋ฒกํ„ฐ๋Š” ์–ธ์–ด์  ๋„คํŠธ์›Œํฌ๋ฅผ ํ˜•์„ฑํ•˜๋ฉฐ, ์ด๋ฅผ ํ†ตํ•ด ๋ณต์žกํ•œ ์˜๋ฏธ์™€ ๋งฅ๋ฝ์„ ํŒŒ์•…ํ•  ์ˆ˜ ์žˆ๊ฒŒ ๋œ๋‹ค: ๋ฒกํ„ฐ ๊ณต๊ฐ„์€ ๊ฐ ๋‹จ์–ด๊ฐ€ ๋‹จ์ˆœํžˆ ํŠน์ • ๋‹จ์–ด์™€์˜ ๊ด€๊ณ„๋ฟ ์•„๋‹ˆ๋ผ, ๋‹ค๋ฅธ ๋‹จ์–ด๋“ค๊ณผ ๋งบ๋Š” ๋ชจ๋“  ๊ด€๊ณ„๋ฅผ ํ•จ๊ป˜ ๊ณ ๋ คํ•˜๊ธฐ ๋•Œ๋ฌธ.
  • ๋ฒกํ„ฐ ์ž„๋ฒ ๋”ฉ์€ ๊ธฐ๊ณ„ ๋ฒˆ์—ญ์ด ๋‹จ์–ด์˜ ๋‹จ์ˆœํ•œ ์น˜ํ™˜์„ ๋„˜์–ด, ๋‹จ์–ด์˜ ๋งฅ๋ฝ๊ณผ ์˜๋ฏธ์  ๊ด€๊ณ„๋ฅผ ์ดํ•ดํ•˜๊ฒŒ ๋งŒ๋“œ๋Š” ํ•ต์‹ฌ ๊ธฐ์ˆ ์ด ๋จ.
  • NMT๋Š” ๋‹จ์ˆœํ•œ ๋ฒˆ์—ญ ์ด์ƒ์˜ ์ž‘์—…: ์–ธ์–ด ๊ฐ„์˜ ๋Œ€ํ™”์™€ ์ƒํ˜ธ์ž‘์šฉ์„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•˜๋Š” ์ƒˆ๋กœ์šด ๋ฒˆ์—ญ ๋ฐฉ์‹์„ ์—ด์–ด์ค€๋‹ค.

Spacey emptiness, Gayatri Spivak

"spacey emptiness" as introduced by Gayatri Spivak refers to the gaps, voids, or untranslatable spaces between languages that cannot be bridged by simple word-for-word translations.

why does this gap exists?
languages are products of unique cultural, historical, and social contexts. These contexts shape how meaning is expressed, and they often don't have exact parallels in other languages.

why does this gap HAS to exist?
Spivak says that trying to completely eliminate the gap between languages risks suppressing diversity. Instead, the "spacey emptiness" should be seen as an opportunity for richer, more creative interactions.
์Šคํ”ผ๋ฐ•์€ ๋ฒˆ์—ญ์„ ๋‹จ์ˆœํ•œ ๋ณ€ํ™˜์ด ์•„๋‹ˆ๋ผ ์–ธ์–ด์™€ ์–ธ์–ด ๊ฐ„์˜ ๋Œ€ํ™”๋กœ ๊ฐ„์ฃผํ•œ๋‹ค. ์ด๋Š” NMT๊ฐ€ ์ด๋Š” ๊ณตํ—ˆํ•œ ๊ณต๊ฐ„์„ ์–ต์ง€๋กœ ์ง€์šฐ๋Š” ๋Œ€์‹ , ๊ฐ ์–ธ์–ด์˜ ๋…ํŠนํ•œ ์˜๋ฏธ ์ฒด๊ณ„์™€ ๊ตฌ์กฐ๋ฅผ ์กด์ค‘ํ•˜๋Š” ๋ฐฉ์‹๊ณผ ๋งž๋‹ฟ์•„ ์žˆ๋‹ค. NMT๋˜ํ•œ ๊ณต๋ฐฑ์†์—์„œ ์ƒํ˜ธ์ž‘์šฉํ•œ๋‹ค๋Š” ์ ์—์„œ, ๊ทธ๋ฆฌ๊ณ  ํ•œ ์–ธ์–ด์˜ ์˜๋ฏธ ์ฒด๊ณ„๋ฅผ ๋‹ค๋ฅธ ์–ธ์–ด๋กœ ๋‹จ์ˆœํžˆ ๋ณต์‚ฌํ•˜์ง€ ์•Š๊ณ , ์˜๋ฏธ์  ์œ ์‚ฌ์„ฑ์„ ์ƒˆ๋กญ๊ฒŒ ํ˜•์„ฑํ•œ๋‹ค๋Š” ์ ์—์„œ ์Šคํ”ผ๋ฐ•์˜ ๊ณตํ—ˆํ•œ ๊ณต๊ฐ„๊ณผ ์˜๋ฏธ๊ฐ€ ๋น„์Šทํ•˜๋‹ค๊ณ  ๋ณผ ์ˆ˜ ์žˆ์Œใ….

Allison Parrish

Allison Parrish uses colors to show the same principle, adding vectors for red and blue together to get purple.

This blows up any model for language that is thinking of the meaning of language as a relationship of referents to an external (or internal) reality, since meaning is produced by vector space: the plotting of tokens on a matrix according to where they fall in language useโ€”and not in relation to what they represent.

But language still represents, and organic bodies are still feeling it in space-times other than vector space, and what do you do with that?

Critique of translational norms

Translational norms traditionally include the following principles

โ€ข Fidelity: ๋ฒˆ์—ญ์€ ์›๋ฌธ์— ์ถฉ์‹คํ•ด์•ผ ํ•˜๋ฉฐ, ์˜๋ฏธ์™€ ๊ตฌ์กฐ๋ฅผ ๊ฐ€๋Šฅํ•œ ํ•œ ๊ทธ๋Œ€๋กœ ์ „๋‹ฌํ•ด์•ผ ํ•œ๋‹ค.
โ€ข Transparency: ๋ฒˆ์—ญ์ด ์ž์—ฐ์Šค๋Ÿฝ๊ณ  ๋งค๋„๋Ÿฌ์›Œ์•ผ ํ•˜๋ฉฐ, ๋ฒˆ์—ญ๋œ ํ…์ŠคํŠธ๋Š” ๋ฒˆ์—ญ๋˜์—ˆ์Œ์„ ๋“œ๋Ÿฌ๋‚ด์ง€ ์•Š์•„์•ผ ํ•œ๋‹ค.
โ€ข Equivalence: ๋ฒˆ์—ญ๋ฌธ์€ ์›๋ฌธ๊ณผ ๋™๋“ฑํ•œ ๊ฐ€์น˜๋ฅผ ๊ฐ€์ ธ์•ผ ํ•œ๋‹ค๋Š” ๊ฐ€์ •. ์ด ๊ทœ๋ฒ”๋“ค์€ ๋ฒˆ์—ญ์ด "์›๋ฌธ์— ์ตœ๋Œ€ํ•œ ๊ฐ€๊น๊ฒŒ" ์ด๋ฃจ์–ด์ ธ์•ผ ํ•œ๋‹ค๋Š” ์ „ํ†ต์  ๊ด€์ ์„ ๋ฐ˜์˜ํ•จ.

Cult of transparency

Free-flowing data = Free-flowing capital

Global English and machine translation

โ€ข Global English and machine translation abide by the principle of instrumental rationality and technocracy
โ€ข Critique of the translational norms defined by Slater as the โ€˜productive, predictive and the navigableโ€™

English-language privilege, like other forms of privilege, allows its speakers a certain blindness to its positionality.
It is in this way that English travels as not a language, the way that masculinity has traveled as not a gender, or whiteness as not a race (although of course I do not wish to conflate the structures or injustices of these prejudices).
As Sara Ahmed writes: โ€œWhat makes a privilege a privilege: the experiences you are protected from having; the thoughts you do not have to thinkโ€

Likewise, the English language, like all hegemonic structures, also has a way of undoing itself from within. This happens primarily through the fact that English has become so big, so multinational, that the majority of its speakers are no longer native speakers, which makes English the least monolingual language in the world, at the same time as its monolingual ideologies are producing and reproducing events of linguistic oppression all over the globe.

  • The author mentions English as a language with a colonial past, present, and future.
    โ†˜๏ธŽ while English is used globally, its historical context is complex and closely tied to colonialism, therefor the norms of English translation reflect its colonial heritage, and these norms exert a powerful influence today.

Hinge Language

โ€ฆthe invisible language of the machine is English, as Slater and Raley have pointed out. It is the language of computer code and programming languages.
It is also often used as a hinge language in machine translation, meaning that two languages that do not have enough respective data between them to create neural nets and train a machine translation model will pass first through a translation into English and then out again (Poibeau 140). In this way, the structures of English contaminate many other languagesโ€”and the smaller the language, the more vulnerable it is.

"Experimental" as in fallible force