Skip to content

Latest commit

 

History

History
18 lines (15 loc) · 770 Bytes

README.md

File metadata and controls

18 lines (15 loc) · 770 Bytes
Raw

Spark Test

This project collect multiple unit tests for different spark components and within different testing libraries.

Project Source

  • WordCounter.scala: Spark job
  • CoreUnitTest.scala: unit test for Spark core statements using scalatest library.
  • SqlUnitTest.scala: unit test for Spark SQL using scalatest library.
  • StreamingUnitTest.scala: unit test for Spark Streaming using scalatest library.
  • WordCounterTest.scala: unit test for Spark job using spark-testing-base library.

Dependencies