Practical session, using Spark for emergency datasources: Difference between revisions

Latest revision as of 09:22, 18 August 2020

Practical session: In every practical session, I expect you to install all needed software beforehand to focus on the tasks.

2) Apache Spark cluster setup in Azure HDInsight and data processing.
- Apache Spark cluster setup [1]
- Load data and run queries on sensor data [2]

Solve Variables error: File:Variables.pdf

@@ Line 1: / Line 1: @@
-Practical session:
+'''Practical session:'''
+In every practical session, I expect you to install all needed software beforehand to focus on the tasks.
+===Tasks:===
-Querying analyzing open data source with Apache park.
+*'''1) Running Apache Hadoop and MapReduce:'''
+**[[Running Hadoop | Getting started with Hadoop]]
-The used data source: https://data.sfgov.org/Public-Safety/Fire-Department-Calls-for-Service/nuek-vuh3.
+* '''2) Apache Spark cluster setup in Azure HDInsight and data processing.'''
+** Apache Spark cluster setup [https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters]
+** Load data and run queries on sensor data [https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-load-data-run-query]
-Data bricks: https://databricks.com/try-databricks
-Session file: [[:File:data.zip]]
+'''Solve Variables error:''' [[:File:Variables.pdf]]