Practical session, using Spark for emergency datasources: Difference between revisions

From info319
No edit summary
No edit summary
Line 3: Line 3:
===Tasks:===
===Tasks:===


* '''1) Running Apache Hadoop and MapReduce:'''
* '''1) Apache Spark cluster setup in Azure HDInsight and data processing.'''
** Apache Spark cluster setup [https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters]
** Load data and run queries on sensor data [https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-load-data-run-query]
 
*'''1) Running Apache Hadoop and MapReduce:'''
**[[Running Hadoop | Getting started with Hadoop]]
**[[Running Hadoop | Getting started with Hadoop]]


* '''2) Apache Spark cluster setup in Azure HDInsight and data processing.'''
*** Apache Spark cluster setup [https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-provision-linux-clusters]
*** Load data and run queries on sensor data [https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-load-data-run-query]


'''Solve Variables error:''' [[:File:Variables.pdf]]
'''Solve Variables error:''' [[:File:Variables.pdf]]

Revision as of 12:29, 19 September 2019

Practical session:

Tasks:

  • 1) Apache Spark cluster setup in Azure HDInsight and data processing.
    • Apache Spark cluster setup [1]
    • Load data and run queries on sensor data [2]


Solve Variables error: File:Variables.pdf

Retrieved from "http://info319.wiki.uib.no/index.php?title=Practical_session,_using_Spark_for_emergency_datasources&oldid=635"