Exercises

Outline of the exercises. Because the exercises are new this year, it is hard to plan exactly, so this is likely to change a bit!

• Exercise 1: Getting started with Apache Spark and Processing tweets with Spark.
• Exercise 2: Streaming tweets with Twitter API
• Exercise 3: Streaming tweets with Kafka and Spark
• Exercise 4:
  • Create Spark cluster
  • Install HDFS and YARN on the cluster
  • Install Spark on the cluster
  • Install Kafka on the cluster
• Exercise 5 (preliminary):
  • Create Spark cluster using Terraform
  • Configure Spark cluster using Ansible