Caused by: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession

 problem: 

Caused by: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass

Solution:

change the scope of all the spark dependencies from provided to compile