Practical session, using Spark for emergency datasources: Difference between revisions
No edit summary |
No edit summary |
||
| (One intermediate revision by the same user not shown) | |||
| Line 1: | Line 1: | ||
'''Practical session:''' | '''Practical session:''' | ||
In every practical session, I expect you to install all needed software beforehand to focus on the tasks. | |||
===Tasks:=== | |||
*'''1) Running Apache Hadoop and MapReduce:''' | |||
**[[Running Hadoop | Getting started with Hadoop]] | |||
* ''' | * '''2) Apache Spark cluster setup in Azure HDInsight and data processing.''' | ||
** Apache Spark cluster setup [https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters] | ** Apache Spark cluster setup [https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters] | ||
** Load data and run queries on sensor data [https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-load-data-run-query] | ** Load data and run queries on sensor data [https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-load-data-run-query] | ||
'''Solve Variables error:''' [[:File:Variables.pdf]] | '''Solve Variables error:''' [[:File:Variables.pdf]] | ||
Latest revision as of 09:22, 18 August 2020
Practical session: In every practical session, I expect you to install all needed software beforehand to focus on the tasks.
Tasks:
- 1) Running Apache Hadoop and MapReduce:
- 2) Apache Spark cluster setup in Azure HDInsight and data processing.
Solve Variables error: File:Variables.pdf