BigData / Apache Spark
Types of shared variables in Spark.
Spark supports 2 types of shared variables: broadcast variables and accumulators.
Broadcast variables allow the programmer to keep a read-only variable cached on each machine to give every node a copy of a large input dataset in an efficient manner.
Accumulators are variables that are only "added" to through an associative and commutative operation and can, therefore, be efficiently supported in parallel. They can be used to implement counters or sums.
More Related questions...
