19 - Apache Spark First Java Program - Spark RDD Reduce Method смотреть онлайн

@backstreetbrogrammer

--------------------------------------------------------------------------------
Chapter 03 - Apache Spark First Java Program - Spark RDD Reduce Method
--------------------------------------------------------------------------------
Create RDD from Spark Context object which is a fault-tolerant collection of elements that can be operated on in parallel.

There are two ways to create RDDs:
1) parallelizing an existing collection in the driver program (only used for POC or prototyping)
2) referencing a dataset in an external storage system, such as a shared filesystem, HDFS, HBase, or any data source offering a Hadoop InputFormat

Various Transformations (map, filter, etc.) and Actions (count, collect, etc.) can be called on RDD

final var myRdd = sc.parallelize(data);

final var max = myRdd.reduce(Integer::max);
final var min = myRdd.reduce(Integer::min);
final var sum = myRdd.reduce(Integer::sum);

Github: https://github.com/backstreetbrogrammer/11_JavaSpark

- Apache Spark for Java Developers Playlist: https://youtube.com/playlist?list=PLQDzPczdXrTgqEc0uomGYDS0SFu7qY3g3
- Java Serialization Playlist: https://youtube.com/playlist?list=PLQDzPczdXrTjGLkI8kd2d0bfNHx0v7dTy
- Dynamic Programming Playlist: https://youtube.com/playlist?list=PLQDzPczdXrTilRgmNUQ632OrD-wfRLUR_

#java #javadevelopers #javaprogramming #apachespark #spark