Exercises

Outline of the exercises. Because the exercises are new this year, it is hard to plan exactly, so this is likely to change a bit!

• Exercise 1: Getting started with Apache Spark and Processing tweets with Spark.
• Exercise 2: Streaming tweets with Twitter API
• Exercise 3: Streaming tweets with Kafka and Spark
• Exercise 4 - not completely finished: Create Spark cluster Install HDFS and YARN on the cluster Install Spark on the cluster Install Kafka on the cluster
• Exercise 5: Cloud management. We will automate upgrading and scaling of clusters using Terraform and Ansible.

I also hope to be able to do something with Docker, Docker Swarm and/or Kubernetes.