Combine by key to find max
Use combine by key and use map transformation to find Max value for all the keys in Spark
group by key
Group by key and in the Map Partition apply some custom logic on the aggregated values of the key in Spark
accumulate all values for a given key in spark
For a given key collect all the values, which can be later use for applying some custom logic like ( average , max , min, top n, expression evaluation) in Spark
Read from Aerospike from Spark via MapPartitions
Read from Aerospike with a spark application via mapPartitions in Spark
Read from Aerospike
Read From Aerospike Using Spark via Map Transformation in Spark
Write To Aerospike via mapPartitions
Write to Aerospike from spark via MapPartitions
Write To Aerospike From Spark
Read from Hdfs and write to Aerospike from Spark via Map Transformation
Understanding Spark Serialization
Understanding Spark Serialization , and in the process try to understand when to use lambada function , static,anonymous class and transient references
Spark mapPartitions
Understanding Map Partition in Spark
Spark Map
Spark Map Example , which throws light at Object Reuse , CombineByKey , Transient variables usage in Spark
- 1
- 2