Spark Scala coding framework, testing, Structured streaming




Spark Scala coding framework, testing, Structured streaming

This course will bridge the gap between your academic and real world knowledge and prepare you for an entry level Big Data Spark Scala developer role. You will learn the following

  • Spark Scala coding best practices

  • Logging - log4j, slf4

  • Exception Handling

  • Configuration using Typesafe config

  • Doing development work using IntelliJ, Maven

  • Using your local environment as a Hadoop Hive environment

  • Reading and writing to a Postgres database using Spark

  • Unit Testing Spark Scala using JUnit , ScalaTest, FlatSpec & Assertion

  • Building a data pipeline using Hadoop , Spark and Postgres

  • Bonus - Setting up Cloudera QuickStart VM on Google Cloud Platform (GCP)

  • Structured Streaming


Prerequisites :

  • Basic programming skills

  • Basic database knowledge

  • Big Data and Spark entry level knowledge



Spark Scala Framework, Hive, IntelliJ, Maven, Logging, Exception Handling, log4j, ScalaTest, JUnit, Structured Streaming

Url: View Details

What you will learn
  • Spark Scala industry standard coding practices - Logging, Exception Handling, Reading from Configuration File
  • Unit Testing Spark Scala using JUnit , ScalaTest, FlatSpec & Assertion
  • Building a data pipeline using Hive, Spark and PostgreSQL

Rating: 4.53846

Level: All Levels

Duration: 4.5 hours

Instructor: FutureX Skills


Courses By:   0-9  A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z 

About US

The display of third-party trademarks and trade names on this site does not necessarily indicate any affiliation or endorsement of course-link.com.


© 2021 course-link.com. All rights reserved.
View Sitemap