Louisa-thesis outline

From XPUB & Lens-Based wiki

Draft, 10th January 2021.

Research Question

How can I suggest alternate ways of urban behaviour in an industrial playground like Rotterdam, moving people to play instead of be played? Can location-based games be used to cause critical reflection on location-based targeted advertisement, making the matter more tangible?

Abstract

[150-200 words]

In this thesis I will document the process of building a location-based, pervasive game. The topic revolves around personalised, location-based targeted content under the veil of ludification. By analysing novelty game formats like alternate reality- and escape games, and connecting them to methods of targeted advertisement, I am starting a networked narrative through augmentation and modification of physical spaces.

Introduction

[500 words]

I wake up from a loud bang. I am standing in the middle of my room. To my feet, a bottle is spilling water all over the blanket I am wrapped in. I grab the bottle, take it to the sink where I put it down and look at my face in the mirror. It takes me a moment to realise I have been sleep walking again.- October, 2021.

For the first time I am able to remember the dream I had, while moving through my room in parallel. There were blankets in my dream too, and the proportions of the floor plan roughly matched. Everything further away than my hands was rather dark and blurry. I am in the same space in a new timeline. Thanks to the maps roughly matching up, I was able to move around without walking against walls bumping my head, considering that making the bottle fall was an accident. Something clicks and I realise why, in my creative practice, I am obsessed with giving objects, places and people in real spaces a new meaning within another narrative. Subconsciously I felt these sensations for many nights as a child, and now as a strange recurrence as an adult. Do I want to go back? Or do I want to recreate this sensation in others?

I was challenged to think of games/events/activities which can exist during times of a rather strict lockdown and closed cultural venues. This led me to work on location-based games, to unlock audio-pieces and later on even a secret concert venue. Thinking of puzzles and progressive narratives and then seeing people interact with them is incredibly rewarding and feels like a powerful tool of capturing peoples attention, even if for just a little while. My aim is to activate people and change their state of mind and experience of their environment. Making use of the group present and the things everyone could contribute to the experience, instead of making them passive spectators of a work, is very valuable to me. During this research I have tried geocaching, an internation treasure-hunt of hidden name logs in public spaces. Looking closely, everything could be a potential hint. In parallel, I am building on my research on interactive fiction and targeted advertisement.

Chapter 1: Navigating Invisible Borders

[1200 words]

In this chapter I am researching methods video game makers as well as advertisers are commonly using to herd user movement to desired areas. How are spaces being used to manipulate user's movement and actions?

Living in Rotterdam for a few years, I noticed that I started moving in very strict patterns through the urban landscape. It was as if I was inhabiting a tiny village, spread around different districts. It felt almost impossible to change the paths that I travelled through. As if there was an invisible force holding me back from peeking into a side street I have never been to, or to stop and look closely at the buildings I passed by. But there wasn't, was there? I remember telling a friend that I feel as if I cannot see the corners of the rooms I am in any more. I can only see what I need to see in order to move around and do what's needed. "This is what growing up is like." They said. "I feel like I'm in a video game." I said. In video games, you seem to instinctively know where to go, what object to click on or pick up, who to fight and who to befriend. It seems as is there was an infinite amount of things to explore, places to visit and people to have meaningful dialogue with. At least in well developed video games that is. If the game makers have done their job, you won't notice that every other room in that building was empty, that only in that main hall you stumbled into, their was an overflow of storyline presented to you. This made me think back about the small village I have lined out for myself within the city of Rotterdam. I have the constant feeling that I could go anywhere, at any time, if only I chose to.


Invisible Borders in Video Games

Focussing on video game techniques to hide the map borders, integrating limits of map and unreachable areas as part of storyline.

Have you ever walked into one direction for a long time in a game, just to see if you can reach its borders? You wouldn't be the only one. There are gamers who record themselves for hours and hours on end just to capture the moment they finally cannot go any further, revealing the boundaries of the map. Video game maps are often surrounded by sea, a reason for players not to consider it as part of the playable area. But what happens when a player does decide, against all odds, to go for an extended swim? Well, in some games they might drown, in some a shark might attack, and in some a massive electric eel might penetrate their submarine. Understandably, since the depths of the ocean are not a safe place for a humans to explore, many dangers are waiting under its reflective cover. In some war games, players might get warnings about landmines, when trying to reach a part of the map that's not intended for game play, not adding to the progression of the narrative. Also understandably, apparently this is war and this can mean that there are areas that are unsafe to walk over.

Mad Max, 2005, Video Game Still


Invisible Borders in Virtual Reality

In XR, geographical markers are translated into fictional environment to make sure players are not walking against walls or outside of playing field, like a wall appearing as a scary abyss.

Last September, during the media art festival RGB XYZ in Amsterdam, my sister put on VR glasses for the first time. There was an immediate cut from her and her previous environment, a rather blank room. She started moving around in excitement, calling out the things she was seeing. All of the sudden I saw her walking closely to the wall. She stopped right in front of it, looking down and saying: Woah!! It goes down so far. What she was seeing instead of the wall was an abyss. Instinctual fear kept her from daring to take any step further.


Ubiquitous Games

"a game only exists when its being played" - Alternate Reality Games and the Cusp of Digital Gameplay

A project I find particularly interesting is the location-based, hybrid catch game "Can You See Me Now?" by Blast Theory. Using GPS sensors in order to map the physical live location and movement of players to a simulation of the same space in a video game, a strange disconnect between on and offline players is being highlighted.


Can You See Me Now? - Blast Theory, 2001


   “A crucial feature of Blast Theory projects is the ability to extend user and audience affect outside the game - rather than delimiting our consciousness to the stereotypical and virtual, the gameplay pushes us to understand aspects of ourselves, our communities and social responsibility. This is partially achieved by the very visceral gameplay - in CYSMN? the players and gameplay self-generate affects of pursuers and pursued. ... It was encouraging to see Blast Theory awarded the Prix Ars Electronica Golden Nica, which has in the past lauded some commercial, apolitical projects.[1]”


I would like to sum Chapter 1 up by proposing how the various methods of moving users across spaces is going to feed into the project development.

Chapter 2: Take a Leap in the Dark

Interactive Fiction meets Surveillance Capitalism

ubiquitous games/ubiquitous extraction-everything is a potential part of the game [2000 words] keywords: playbour, smart city, instrumentarian power

Blueprints of Control

Subtle methods of herding user's movement is of course not a digital-born phenomenon. Making sure that people stay on designated areas and behave in pre-scripted ways is applied to the very blueprints of the city that its buildings and social encounters emerge from and has so for centuries. In the early past, surveillance and tracking has been able to spill into every corner of the urban landscapes, from parking lots to lamp posts, justified in the name of safety, tolerated only in light of escalation. Video surveillance has first been implemented in Manchester during football games in the 80s, since the hooligans were hard to control. Police was trained to read behaviour always expecting escalation, making it impossible for people to act different than the before mentioned location-based (and time based) scripts.

In this chapter I want to make a connection between ubiquitous games and the surveillance capitalism applied in smart city technology, both creating a sensation of unknowing where the boundaries of interaction with the systems in place start and stop. As Prof. Soshana Zuboff lays out in "The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power", surveillance capitalism is a new phenomenon bred on the fertile grounds of individualization, emerging in a second wave of modernity. The needs and desires which come along with self-determination of digital content streams result in an unprecedented, unhinged wave of a new mutation of capitalism. Surveillance capitalism is supported by widespread digital infrastructures, connected in a web of personal computers, phones but in also increasing network of an internet of things governing and mediating virtually any human interaction. The new stage for this is the city itself, no longer confining the manipulation of user movement and behaviour to online platforms, but the infrastructures of the cities around the screens.

Surveillance Capitalism spilling into the city streets, leading you to where the algorithm thinks you should be going. How do companies make use of playbour, keeping them and the players happy? How can we appropriate these methods for play without labour and make them our own?



"Imagine these supply chains growing and becoming more elaborate as interfaces are invented for nearly every aspect of human experience. This began in the online world, with our searching, our browsing, our social interactions and so forth, but these interfaces now extend to every aspect of human activity. Now we carry a little computer in our pocket. We’re out in the world, subjected to many more devices, sensors and cameras. Every “smart” product and “personalized” service is a supply chain interface extracting everything from our location and movements to our voices, conversations, gaze, gait, posture, faces, who we are with, what we’re buying, what we’re eating, where we’re going, what we’re doing in our homes, what we’re doing in our automobiles — all of these dimensions of human experience are now exposed to these interfaces that claim and data-fy our lives." - https://www.cigionline.org/articles/shoshana-zuboff-undetectable-indecipherable-world-surveillance-capitalism/

"Eventually surveillance capitalists discovered that the best source of predictive data is to actually intervene in people’s behaviour and shape it. This is what I call “economies of action.” It means that surveillance capital must commandeer the increasingly ubiquitous digital infrastructure that saturates our lives, in order to remotely influence, manipulate and modify our behaviour in the direction of its preferred commercial outcomes.[...] Now the same digital architecture used for monitoring becomes the means of behaviour modification with programmed triggers, subliminal cues, rewards, punishments, social comparison dynamics – all of it aimed at tuning and herding human behaviour in the direction that aligns with the commercial goals of business customers."

Players Locked in The Game

"economies of action" "Pokémon Go was spun off from Google as Niantic Labs with Hanke (google mapping expert) as its head. It presented itself to the world as if it was some clever start-up, though Google remained its primary investor. The game brought Google’s experimentation on tuning and herding populations to the real world, to real streets, real towns, real cities, engaging families and friends in a search game without revealing that it was really the participants who were being searched. Game players were actually pawns in a larger, higher-order game aimed at providing “footfall” to establishments that paid Niantic Labs a fee for consumer traffic in exactly the same way that online advertisers pay for click-through behaviour. Niantic used gamification, with its rewards and punishments, to herd people to its real-world business customers, from McDonald’s and Starbucks to Joe’s Pizza." - Soshana Zuboff for https://www.cigionline.org Shoshana Zuboff on the Undetectable, Indecipherable World of Surveillance Capitalism

Smart House Smart City Smart World

Let's have a look at the technology in place. What structures are covering the city streets, how do they sense changes in the environment, where does the information go and how is it fed back to the reality of the city?

"Rotterdam Maasvlakte

SkyLab has expanded the public Internet of Things network in the Port of Rotterdam with a loRaWAN® Gateway on the Uniper Benelux, Rotterdam. The gateway is a Dutch record, with a height of 130 meters from ground level. The gateway is connected to the largest and fastest growing IoT community network in the world, The Things Network & The Things Industries. This gateway can receive sensor information in a radius of 15 km and covers a large area of about 700 km2 or more for outdoor sensors. It provides a large part of the Rotterdam Maasvlakte, North Sea, Hoek van Holland, Zeeland and the “Havenspoorlijn”."

https://www.skylab.nl/gateways/

“The Internet of Things use-cases for this CENT-R network are myriad, ranging from city-light management to asset tracking to measuring climate data,” said Remy de Jong Sr., CEO of SkyLab. “With the right sensors connected to this LoRaWAN network through Kerlink gateways, virtually every IoT use case is possible.”

https://www.thethingsnetwork.org/ LoRaWAN

SEMTECH https://www.semtech.com/ "Semtech is a leading global supplier of high performance analog and mixed-signal semiconductors and advanced algorithms for infrastructure, high-end consumer and industrial equipment.

Through our advanced technology platforms, Semtech is enabling mission critical applications for three of the industry's fastest growing markets: Internet of Things, Data Centers and Mobility."

https://wyldnetworks.com/what-is-a-lorawan-gateway/ https://www.kerlink.com/product/wanesy-wave/

It seems like the next step in the development of smart city devices is connecting them all in one big network, like the things network, where all incoming data can be processed and monitored. I do not mean to paint these developments as a purely negative process, as there are many positive outcomes of this self regulating smart devices, adjusting immediately and efficiently to changes in their environment. Smart light poles can adjust the brightness according to the environment, saving energy. A lot of these tools are intended to foster energy saving and circular solutions. But the privacy concerns of such a vast amount of easily updateable computers, determining the movement flow and civil behaviour are to be taken seriously. Let's take Sidewalk labs proposal for Toronto as an example. The google funded company produces devices which can be attached and integrated into public space.

GPS tracking

Movement Sensors

https://www.youtube.com/watch?v=1t12UqYl5SA

Pebble - Sidewalk Labs
Pebble - Sidewalk Labs

locking/unlocking

Geofencing

Researching this method and political motivation behind its application.

Geofencing is a software feature used to draw geographic boundaries based on GPS or RFID information. Based on whether you are in or outside of these boundaries is decisive for what functions are available and which content is visible within an application or other service. This virtual space is mapped onto the physical landscape. The main motivation for geofencing seems to be security, as its being used in security tags in clothes in shops and for car sharing services. But geofencing is not only used to prevent theft, it is also used in order to target voters in political campaigns. Geofences can be drawn around a single building, a neighbourhood or an entire state in order to target people with relevant content in order to stir them to vote for one party instead of another.

We can no longer trace back if we want something because of smart marketing or because of our own free choice.

Chapter 3: The Game

[2600 words]

Which elements can i use, what platforms and engines would make sense? In this chapter I will document the process of building a location-based game, reviewing tests and adapting design choices. Am I choosing the right locations and methods in order to support the narrative?


game mechanics:

   1 way mirror
   hiding means losing
   predicting players movement
   using smart objects to trace progress
   coordinates
   game is using secret code to hide in plain sight
   

Forming a progressive storyline

How could geographical markers like coordinates connect alternate, fictive spaces. Playing the game should result in subtle changes in public spaces of city and the game should adapt to the way its being played.

Creating a visual language and communication methods

Play Tests

Documentation and analysis.

EtherAxis

28th November & 5th December

The Overkill Festival

EtherAxis Game board, photographed by Emilia Tapprest

https://pad.xpub.nl/p/EtherAxis_Analysis

Development Week TETEM

March

TETEM

in-game

Documentation of actual Gameplay.

post-game

Analysis. I am planning to review the different game methods I have tested and applied and in what ways they have supported the progression of the narrative through lived experience. Based on the results of this analysis I will suggest areas of improvement and propose a future set-up of the game.

Conclusion

[500 words]

Based on my research on methods of location-based advertisement, I will formulate my vision of its potential and dangers, picturing a ludified smart city and celebrating ways of dancing on the structures of its system.

Bibliography

Books & Articles

Huizinga, Johan (1955). Homo Ludens: a Study of the Play-Element in Culture. Boston, MA: The Beacon Press.

Turkle, S. (1996). Life on the Screen: Identity in the Age of the Internet. London: Weidenfeld & Nicholson.

Aarseth, E.J. (1997). Cybertext: Perspectives on Ergodic Literature. Baltimore, Md.: Johns Hopkins University Press.

Towell, J. & Towell, E. (1997). Presence in Text-Based Networked Virtual Environments or “MUDS”. Massachusetts: Massachusetts Institute of Technology.

Szulborski, D. (2005). This is Not a Game: A Guide to Alternate Reality Gaming. Pennsylvania: New-Fiction Pub.

von Borries, F. & Walz, S.P & Boettger, M. (2007). Space Time Play: Computer Games, Architecture and Urbanism: The Next Level. Switzerland, Basel: Birkhaeuser Verlag AG.

Eyal, N & Hoover, R. (2014). Hooked: How to Build Habit-Forming Products. Penguin Books Ltd.

Zuboff, S. (2019). The Age of Surveillance Capitalism: The Fight for the Future at the New Frontier of Power. London: Profile Books.

Hoffman, D.D. (2019). The Case Against Reality: How Evolution Hid the Truth From Our Eyes. United States of America: W.W. Norton & Company.

Web Articles

[1] Blast Theory. (n.d.). Can You See Me Now? [online] Available at: https://www.blasttheory.co.uk/projects/can-you-see-me-now/.

[2] Arushi Jaiswal (2018). Dark patterns in UX: how designers should be responsible for their actions. [online] Medium. Available at: https://uxdesign.cc/dark-patterns-in-ux-design-7009a83b233c.

Play to Earn. (n.d.). Blockchain Gaming Archives. [online] Available at: https://www.playtoearn.online/category/blockchain-gaming/ [Accessed 21 Nov. 2021].

from, D. (2019). What is geo-fencing (geofencing)? - Definition from WhatIs.com. [online] WhatIs.com. Available at: https://whatis.techtarget.com/definition/geofencing.

Games

Blast Theory. (2003). Can you see me now?. Rotterdam, The Netherlands.

Kihara, T. (2018). Escape the Smart City. Amsterdam, The Netherlands.

Groothuizen, R. (2021). I want to delete it all, but not now. Enschede, The Netherlands.

Appendix

Game Narrative

I would like to attach the written narrative of the game I built here for further reading.