Exercises: Difference between revisions

Latest revision as of 13:56, 31 October 2022

Outline of the exercises. Because the exercises are new this year, it is hard to plan exactly, so this is likely to change a bit!

@@ Line 1: / Line 1: @@
 Outline of the exercises. Because the exercises are new this year, it is hard to plan exactly, so this is likely to change a bit!
 * Exercise 1: [[Getting started with Apache Spark]] and [[Processing tweets with Spark]].
-* Exercise 2: '''Programming Spark.''' Basic Spark programming. Simple streaming. <!-- [[Spark Streaming Twitter]] [[Sentiment analysis using Spark Streaming]] -->
+* Exercise 2: [[Streaming tweets with Twitter API]]
-* Exercise 3: '''Streaming Spark.''' We will continue analysing tweets or other streaming types of information. <!-- Kafka -->
+* Exercise 3: [[Streaming tweets with Kafka and Spark]]
-* Exercise 4: '''Spark in the cloud.''' We will run Apache Spark on a cluster of virtual machines in the OpenStack cloud. <!-- Docker -->
+* Exercise 4:
-* Exercise 5: '''Cloud management.''' We will automate upgrading and scaling of clusters using Terraform and Ansible.
+** [[Create Spark cluster]]
+** [[Install HDFS and YARN on the cluster]]
-I also hope to be able to do something with Docker, Docker Swarm and/or Kubernetes.
+** [[Install Spark on the cluster]]
+** [[Install Kafka on the cluster]]
+* Exercise 5:
+** [[Create Spark cluster using Terraform]]
+** [[Configure Spark cluster using Ansible]]