Prev Next

BigData / Apache Spark

What is Dataset in Apache spark?

After Spark 2.0, RDDs are replaced by Dataset, which is strongly-typed like an RDD, but with richer optimizations.

Dataset is the Spark’s primary abstraction of distributed collection of items. Datasets can be created from Hadoop InputFormats (such as HDFS files) or by transforming other Datasets.

More Related questions...

Show more question and Answers...


Comments & Discussions