Practical session, using Spark for emergency datasources: Difference between revisions

From info319
No edit summary
No edit summary
Line 3: Line 3:
===Tasks:===
===Tasks:===


* '''1) Apache Spark cluster setup in Azure HDInsight and data processing.'''
*'''1) Running Apache Hadoop and MapReduce:'''
**[[Running Hadoop | Getting started with Hadoop]]
 
* '''2) Apache Spark cluster setup in Azure HDInsight and data processing.'''
** Apache Spark cluster setup [https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters]
** Apache Spark cluster setup [https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters]
** Load data and run queries on sensor data [https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-load-data-run-query]
** Load data and run queries on sensor data [https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-load-data-run-query]


*'''2) Running Apache Hadoop and MapReduce:'''
 
**[[Running Hadoop | Getting started with Hadoop]]




'''Solve Variables error:''' [[:File:Variables.pdf]]
'''Solve Variables error:''' [[:File:Variables.pdf]]

Revision as of 12:29, 19 September 2019

Practical session:

Tasks:

  • 2) Apache Spark cluster setup in Azure HDInsight and data processing.
    • Apache Spark cluster setup [1]
    • Load data and run queries on sensor data [2]



Solve Variables error: File:Variables.pdf