not really -- yarn is just a resource negotiator to which multiple versions of spark can connect.

If running on Kubernetes: you’re free to choose your Spark version for each separate Docker image! This is in contrast to YARN, where you must use the same global Spark version for the entire cluster.
Spark and Docker: Your Spark development cycle just got 10x faster!
221
2
Jean Yves
Vojtech Tuma
·Follow
Nov 6, 2020
--
not really -- yarn is just a resource negotiator to which multiple versions of spark can connect. Our cluster has four concurrently deployed versions of spark, with a common wrapper with --sparkVersion switch. Not saying that Docker is more convenient, tho
--
--
Written by Vojtech Tuma59 Followers
·114 Following
#books - #running - #pullups - #boardGames - #dataScience - #programming - #trolling - #etc
No responses yet
Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams