Spark RDD to Task mapping
Understanding how RDD are converted to Task
Avro Schema Compatibility Test
How to make schema compatibility check part of your build time.
Progamatically inter-convert Avro Schema to Class
How to inter-convert avro schema to class programatically.
Define Avro Schema with default values
How to define Avro Schema with Default values
Avro serialization de-serialization using Confluent Schema registry
Avro serialization de-serialization using Confluent Schema registry
How is BigData Used
Where is Big Data used and how has the architecture of systems evolved in the light of Big Data
ReduceByKey vs CombineByKey
Whats the difference between reduceByKey and CombineByKey in Spark
GroupBy vs ReduceByKey
Whats the difference between groupByKey vs ReduceByKey in Spark
Combine by key to find max
Use combine by key and use map transformation to find Max value for all the keys in Spark
group by key
Group by key and in the Map Partition apply some custom logic on the aggregated values of the key in Spark