Readings

Books

We will use two text books:

• Rob Kitchin. The Data Revolution - Big Data, Open Data, Data Infrastructures & Their Consequences. Sage, 2014.
  • At least chapters 1, 3-5 and some later chapters are mandatory.
• Bill Chambers and Matei Zaharia: Spark: The Definitive Guide - Big Data Processing Made Simple. O'Riley, 2018. File:Spark-TheDefinitiveGuide.pdf
  • At least chapters 1-9 and some later chapters are mandatory.

Papers

Selected papers will become available here, including:

• Gallofré, M., Opdahl, A. L., Stoppel, S., Tessem, B., & Veres, C. (2021). The News Angler Project: Exploring the Next Generation of Journalistic Knowledge Platforms. In Proceedings of Norsk IKT-konferanse for forskning og utdanning. Short Paper File:A1-Poster-NIKT2021.pdf

Technical introductions

Selected web pages will become available here, including:

• Spark 3.3.0 Overview and Quick Start (with Python examples)
• NREC and OpenStack, the following sections/pages: Introduction, Project application, Logging in, The dashboard, Create a Linux virtual machine (skip: Windows), Using SSH, Working with Security Groups, Create and manage volumes, Create and manage snapshots (skip: images), Instance console
• TerraForm and NREC part I, part II, and part III
• How Ansible Works and the Ansible Community portal
• Kafka Introduction

Additional non-mandatory materials will be made available to support the exercises further.

Lecture slides

See the Session page for lecture slides after each session.

Readings for each session and exercise

The Sessions and Exercises pages will suggest specific readings for each session and exercise.