Readings

Books

Text books:

• Rob Kitchin. The Data Revolution - A Critical Analysis of Big Data, Open Data and Data Infrastructures, 2nd Edition. Sage, 2021.
  • chapters 1, 3-5, 12-19 are mandatory (I will make some of the latest chapters supplementary, perhaps 14, 18, and 19 - TBA)

• Bill Chambers and Matei Zaharia: Spark: The Definitive Guide - Big Data Processing Made Simple. O'Riley, 2018. File:Spark-TheDefinitiveGuide.pdf
  • chapters 1-9, 12, 15, 20-21 are mandatory (chapter 10 on SQL is also highly relevant)
  • GitHub repository with code and data examples

Papers

Selected papers will become available here, including:

• Section 1 in Opdahl, A. L., & Nunavath, V. (2020). Big Data. Big Data in Emergency Management: Exploitation Techniques for Social and Mobile Data, 15-29. Book chapter
• Gallofré, M., Opdahl, A. L., Stoppel, S., Tessem, B., & Veres, C. (2021). The News Angler Project: Exploring the Next Generation of Journalistic Knowledge Platforms. In Proceedings of Norsk IKT-konferanse for forskning og utdanning. Short Paper and poster: File:A1-Poster-NIKT2021.pdf

Supplementary:

• Opdahl, A. L., & Tessem, B. (2021). Ontologies for finding journalistic angles. Software and Systems Modeling, 20(1), 71-87. Paper
• Berven, A., Christensen, O. A., Moldeklev, S., Opdahl, A. L., & Villanger, K. J. (2020). A knowledge-graph platform for newsrooms. Computers in Industry, 123, 103321. Paper

Technical introductions

Selected web pages will become available here, including:

• Kafka Introduction
• NREC and OpenStack, the following sections/pages: Introduction, Project application, Logging in, The dashboard, Create a Linux virtual machine (skip: Windows), Using SSH, Working with Security Groups, Create and manage volumes, Create and manage snapshots (skip: images), Instance console
• TerraForm and NREC part I, part II, and part III
• How Ansible Works and the Ansible Community portal
• Docker Docs: Docker overview and Get started
• Learn Kubernetes basics, modules 1-6
• What is GDPR, the EU’s new data protection law?

Supplementary:

• Spark 3.3.0 Overview and Quick Start (with Python examples)
• Twitter API v2
• Tweepy: Twitter for Python
• Tweepy Documentation
• Structured Streaming Spark Programming Guide
• Apache Spark Structured Streaming
• kafka-python API
• EU's General Data Protection Regulation (GDPR) - the official legal text

Lecture slides

See the Session page for lecture slides after each session.

Readings for each session

The Sessions page will suggest specific readings for each session and its associated exercise.