User:Francg/expub/thesis/project-draft-09.11.17: Difference between revisions

From XPUB & Lens-Based wiki
Line 32: Line 32:
==How do you plan to make it?==
==How do you plan to make it?==


To realize this idea, I will create a news station using programming tools to track and scrape data from news sites. Concretely, diffengine will allow me to extract the primary content of news media using RSS technology, outputting html files to my device. This extraction will run at timed intervals through 'cron', a time-based job scheduler. This will allow me to document more material, for instance with quickly changing articles. Using algorithmic processes, only articles concerning the mentioned topic will be filtered and collected. The system will be set up on Linux OS free software and possibly on a Raspberry Pi. Additional hardware will be integrated into this news station.[[File:oustedpuig.png|right|thumbnail|200px|[http://www.aljazeera.com/news/2017/10/deposed-catalonia-leader-puigdemont-stand-poll-171031113726828.html] ''Ousted Catalonia leader Puigdemont 'not seeking asylum''' <ref>[http://www.aljazeera.com/news/2017/10/deposed-catalonia-leader-puigdemont-stand-poll-171031113726828.html]Ousted Catalonia leader Puigdemont 'not seeking asylum'.</ref>]]  
To realize this idea, I will create a news station using programming tools to track and scrape data from news sites. Concretely, diffengine will allow me to extract the primary content of news media using RSS technology, outputting html files to my device. This extraction will run at timed intervals through 'cron', a time-based job scheduler. This will allow me to document more material, for instance with quickly changing articles. Using algorithmic processes, only articles concerning the mentioned topic will be filtered and collected. The system will be set up on Linux OS free software and possibly on a Raspberry Pi. Additional hardware will be integrated into this news station.[[File:Rsshuff.png|right|thumbnail|200px|[https://www.huffingtonpost.com/section/world-news/feed] RSS feed Huffingtonpost <ref>[https://www.huffingtonpost.com/section/world-news/feed]RSS feed Huffingtonpost'.</ref>]] [[File:Processdiffs.png|right|thumbnail|200px|Development: config.yaml > rundiff.sh > cron log <ref>config.yaml > rundiff.sh > cron log.</ref>]] [[File:oustedpuig.png|right|thumbnail|200px|[http://www.aljazeera.com/news/2017/10/deposed-catalonia-leader-puigdemont-stand-poll-171031113726828.html] ''Ousted Catalonia leader Puigdemont 'not seeking asylum''' <ref>[http://www.aljazeera.com/news/2017/10/deposed-catalonia-leader-puigdemont-stand-poll-171031113726828.html]Ousted Catalonia leader Puigdemont 'not seeking asylum'.</ref>]]  





Revision as of 20:19, 24 November 2017

Graduation Proposal


Title: uWWWn

(user wwwatch news)

Introduction

We live in an era where news media generates, changes and updates information almost instantaneously. Information is quickly expanded and facts spread worldwide across networks. These facts are shared and communicated through individuals interaction, creating huge quantities of data spinning around, which are also increasingly replicated and transformed. In this sense, news data is constantly rewritten and revised. However data is also vulnerable to state authorities, centralized platforms and institutionalized environments. That is to say, information is not free and open, most importantly, it is censored, manipulated and revised, yet this is invisible often.

[1] This domain name has been sized pursuant to a seizure warrant under the Judicial Authority and is under its administration [1]
[2] The world's first internet war has begun, in Catalonia, as the people and government use it to organize an independence referendum on Sunday and Spanish intelligence attacks, freezing telecommunications links, occupying telecoms buildings, censors 100s of sites, protocols etc. [2]


Context

This project will be contextualized surrounding the events of the current sociopolitical conflict between Catalonia and Spain. It will focus specially on the behavior and consequences of the news media, tracking, collecting and analyzing data. At the same time, it will reflect critically on network surveillance and media censorship issues, experimenting with algorithmic tools, in order to process quickly-changing information, diving into restricted zones where data becomes exclusive. This will allow observing any possible version of generated data, making information more visible, while empowering the user to become aware of its nature.

The mass media gave very diverse views and attention to the institutionalized punishment happening before, during and after the 1st of October. State authorities censored hundreds of websites, occupied telecommunication buildings, raided newsprint and used body armour.The topic quickly expanded and took enough room in social networks to be daily commented in waves of extreme diverse manifestation, creating a massive flood of information, a lot of it manipulated. In the end, the mass media could no longer ignore this topic and it also spread internationally. Meanwhile, a vast quantity of news is constantly updated.

[3] "Steps to Apply Article 155 of the Spanish Constitution in Catalonia" [3]

What is it?

The project will experiment with a series of tools, that will actively track and stream news media. This generated data-set will function as an open platform or archive for data collection, attempting to make information visible and accessible without restrictions. It aims to empower the user, allowing to query individual needs in a functional way, encouraging to participate in providing documentation; written essays, abstracts, thoughts, sources, or any other useful material. At the same time, it will also seek to maintain an ethical environment, meaning careful criteria concerning accessibility will need to be applied. In this way, access keys or invitation systems will be considered.

This platform will serve the necessary infrastructure, providing opportunities for decentralized forms of organization. Using RSS readers as main engines for content compilation, without appropriating it. Data will therefore be open and treated equally, attempting to provide a non-discriminatory access to the use of it, giving participants equal chances to provide material or participate in dialogue.

In this way, this social algorithmic experiment will continuously be spitting out data collected from a wide variety of news sources, embracing more democratic results. Data observation will be useful to strengthen research, analyze demographic groups, compare sources, inform, denounce, or combat misinformation. Emphasizing a continuous monitored observation of news media, will possibly draw some attention to both the audience watching news media, and news media changing information on the fly.


How do you plan to make it?

To realize this idea, I will create a news station using programming tools to track and scrape data from news sites. Concretely, diffengine will allow me to extract the primary content of news media using RSS technology, outputting html files to my device. This extraction will run at timed intervals through 'cron', a time-based job scheduler. This will allow me to document more material, for instance with quickly changing articles. Using algorithmic processes, only articles concerning the mentioned topic will be filtered and collected. The system will be set up on Linux OS free software and possibly on a Raspberry Pi. Additional hardware will be integrated into this news station.
[4] RSS feed Huffingtonpost [4]
Development: config.yaml > rundiff.sh > cron log [5]
[5] Ousted Catalonia leader Puigdemont 'not seeking asylum' [6]


NewsDiffs Tracking Online News Over Time / NewsDiffs archives changes in articles after publication. Currently, we track nytimes.com, cnn.com, politico.com, washingtonpost.com, and bbc.co.uk. [7]

Although there is no legitimate authority that can decide how relevant a piece of information is, the design setup and maintenance of new-coming data will however be the most important part of this platform to decide. The interface will enable a functional experience both using and visualizing data, which could for instance allow the user to query something and find it, or navigate through a timeline where data flows are recorded and organized, a visualization that illustrates the data stream from new generated article drafts that can be used to compare data production between sites. This idea is approached similarly by NewsDiff, archiving news while bringing to discussion the difficulties of revisions in the digital age.

Each individually could be linked to comments, essays, or any other sort of intervention. Written communication can also play an important role; analyzing whether or not changes have any significance, or the total number of edited characters (deleted and added), the amount of times specific words are displayed, etc. In any case, I will be testing the platform with users, and adopt it to people’s necessities while using it.

Additionally, tracking large amounts of public and also restricted information locked behind paywalls, can also bring discussion on the topic of data appropriation. This would explain why some news media tend to inform quicker rather than accurately, aiming to reach a wider audience.


Timetable

September – November: this is the first stage of development when I acquire methods and experiment with tools in order to learn and get substantial results. This means, improving on bash/shell scripting, learning web scrapping tools, python libraries and other command line tools for streaming and archiving data.

December – March: the second stage will consist on putting all this generated material aside, and start designing a functional interface. This process has already began. Alongside this process, it will be necessary to go back and forth in order to apply criteria that design might demand for an efficient use of this data.

April – June: the third and last stage will be to implement design, tools and targets, creating the project’s main body.


Why do you want to make it?

[6]If you're running a Catalan site being shut down by Spanish authorities, contact me for anonymous hosting and domains. We've got you covered, Peter Stunde [8]

I want to support an ethical collection of media content during the ongoing conflict between Catalonia and Spain. I want to offer more transparency to the happening facts, preserving all reviewed published material, and reinforce the importance of accurate information. At the same time, I want to share my insights regarding this political and social matter through pragmatic results, and reach an audience that can actively engage with the platform.


Who can help and how

Former students who are actively engaged politically could contribute providing resources. Henry Warwick: considering an offline space that could be accessed by anyone without online dependency. Transforming an active stream data-set into a static but regularly maintained offline archive. Ducan Barok (linking externally to Monoscope sources), Marcel Mars (perhaps a peace of code), Femke Snelting (essay, comments). Docnow (community developed around supporting the ethical collection, use, and preservation of social media content), NewsDiff, Archivers of Catalonia Associació d'Arxivers-Gestors documentals de Catalunya also creators of the phenomena #ArxivemelMoment (Archiving the now), Witness. Contact Ricardo Gutierrez, director of the European Federation of Journalists, or with the Catalan Agency of News (ACN), they could provide some interesting insight as they were banned by the state. Human Rights Watch denounced forcefully the extreme violence of police authorities during the 1st of October, also the group of journalists specialized in tracking fake news Maldito Bulo, and international newspapers such as The Independent (they said there was a military coup), between others. Independent journalist Arkaitz Zubiaga, specialized in the study of social media data in the context of journalism.


Relation to previous practice

I've been recently more actively engaged into shell scripting and coding languages since the past two years, learning the fundamentals of new languages and building front-end prototypes that have allowed me to increasingly get more substantial results with these digital environments. Very concretely, my previous practice working on the “Autonomous Archive” gave me some insights into the problematic of online information, bringing to question; Who has access to this data? What is the political position of the project/platform? What information is included, collected and stored? Who hosts and under what conditions? etc.


Relation to a larger context

The world of news media is increasingly being datafied. Information is constantly morphing and a control over its archive is necessary in order to extract knowledge. In this sense, we have the responsibility to bring to discussion the ethics of online information. French philosopher Emmanuel Levinas says:

“You are the source, the hub, the database, and the interface of the Other. Your existence, your data, and your offers of communication, co-determine the Other’s freedom. Declining to join a certain platform limits the Other’s freedom of using it. Not providing an encrypted channel prevents the Other from communicating with you securely. Deleting online content restricts the Other’s querying privileges. Finally, suppressing certain kinds of information may constrain the Other in as-yet unknown ways.”

[10].


Relation with the thesis

 * The thesis will work hand-in-hand with the project. 
 * It will position the audience into the project's sociopolitical context. 
 * The thesis will provide documentation on the project's experimentation
 * Presenting them together will reinforce and conclude their core arguments.


References

Books

Assange, J (2012) Cypherpunks: Freedom and the Future of the Internet, OR Books
Beaude, B (2016) The Ends of the Internet, Inst of Network Cultures
Eagle, N and Greene, K (2014) Reality Mining: Using Big Data to Engineer a Better World, MIT Press,
Heller, C (2011) Post Privacy, Beck C.H.
Hyde, A (2013) The Cryptoparty Handbook, Unglue.it
Levinas, E (1998) Entre Nous: On Thinking-of-theOther, Columbia University Press
Matthew, A (2013) Mining the Social Web: Data Mining Facebook, Twitter, LinkedIn, Google+, GitHub, O'Reilly Media
Moon, D Ruffini, P and Segal, D (2012) Hacking Politics, OR Books
Padilla, M (2013) El Kit de la Lucha en Internet, Traficantes de Sueños
Schneier, B (2015) Data and Goliath, The Hidden Battles to Collect Your Data and Control Your World, W. W. Norton & Company
Seemann, M (2015) Digital Tailspin. Ten Rules of the Internet after Snowden., Network Notebook
Stewart, K (2015) The Tao of Open Source Cyber Intelligence, It Governance Publishing
Tech Tools for Activism (2012)
Toeffler, A, (1971) Future Shock, Random House

Current (or former) related projects

NewsDiffs, (2015) [onlne] Available at: http://newsdiffs.org/ [Accessed 23 Nov. 2017]
guardian_diff [onlne] Available at: https://twitter.com/guardian_diff [Accessed 23 Nov. 2017]
Github, diffengine examples [onlne] Available at: https://github.com/docnow/diffengine#examples [Accessed 23 Nov. 2017]

Tools

Diffengine [online] Available at: https://github.com/docnow/diffengine [Accessed 24 Nov. 2017]
Python-readability [online] Available at: https://github.com/buriy/python-readability [Accessed 24 Nov. 2017]
Beautiful Soup 4 [online] Available at: https://pypi.python.org/pypi/beautifulsoup4/ [Accessed 24 Nov. 2017]
Scrapy [online] Available at: https://scrapy.org/ [Accessed 24 Nov. 2017]
Twarc [online] Available at: https://github.com/DocNow/twarc [Accessed 24 Nov. 2017]
Feeds [online] Available at: https://github.com/nblock/feeds [Accessed 24 Nov. 2017]
MongoDB [online] Available at: https://www.mongodb.com/ [Accessed 24 Nov. 2017]

  1. [7] "This domain name has been sized pursuant to a seizure warrant under the Judicial Authority and is under its administration"
  2. [8] "The world's first internet war has begun, in Catalonia, as the people and government use it to organize an independence referendum on Sunday and Spanish intelligence attacks, freezing telecommunications links, occupying telecoms buildings, censors 100s of sites, protocols etc.", Julian Assange
  3. [9] "Steps to Apply Article 155 of the Spanish Constitution in Catalonia"
  4. [10]RSS feed Huffingtonpost'.
  5. config.yaml > rundiff.sh > cron log.
  6. [11]Ousted Catalonia leader Puigdemont 'not seeking asylum'.
  7. [12]Tracking Online News Over Time / NewsDiffs archives changes in articles after publication.
  8. [13] "If you're running a Catalan site being shut down by Spanish authorities, contact me for anonymous hosting and domains. We've got you covered", Peter Stunde
  9. [14] The Autonomous Archive
  10. [15] "You are the source, the hub, the database, and the interface of the Other. Your existence, your data, and your offers of communication, co-determine the Other’s freedom. Declining to join a certain platform limits the Other’s freedom of using it. Not providing an encrypted channel prevents the Other from communicating with you securely. Deleting online content restricts the Other’s querying privileges. Finally, suppressing certain kinds of information may constrain the Other in as-yet unknown ways.”, Michael Seeman