Byte Padding

Eyegasm for geeks

  • Home
  • Java
    • Java Core
    • Java Date
    • Java JSON
    • JDBC
  • Spring
  • Big Data
    • Apache Kafka
    • Spark
    • Hbase
    • Map Reduce
    • Aerospike
    • Apache Flink
    • Security
  • Linux
  • About
  • Contacts

Spark

Understanding Spark

  • Understanding Spark through Map Reduce
  • Spark Input Formats And Parallel factor
  • Spark Code Analysis
  • Understanding Spark Serialization

 

Spark with Examples

  • Word Count in Spark
  • Read Write Parquet Files using Spark
  • Word Count using CombineByKey in Spark
  • Write a CSV text file from Spark

 

InputFormats

  • CombineParquetFileInputFormat

 

Oozie schedular

  • How to submit spark job through oozie

 

Spark Transformations

  • Spark Map
  • Spark mapPartitions
  • Spark Map Vs mapPartitions

 

Joins

  • DataFrame  Join in Spark
  • Map Side Joins in Spark
  • DataFrame Broadcast Join

 

ReduceByKey And CombineByKey

  • Word Count in Spark reduceByKey
  • Word Count using CombineByKey in Spark
  • reduceByKey vs CombineByKey

 

GroupByKey And CombineByKey

 

  • GroupByKey
  • Collect all value for a given key using CombineByKey
  • CombineByKey to find Max
  • GroupByKey Vs ReduceBykey/CombineByKey

 

Aerospike I/O

  • Write to Aerospike via Map
  • Write to Aerospike via MapPartition
  • Read from Aerospike via Map
  • Read From Aerospike via MapPartition

 

Utils(Avro)

  • Spark Avro Util
  • Convert Avro Object To Row
  • Define Avro Schema and create Avro Class
  • Avro SerDe with Confluent
  • Avro schema to class interconversion
  • Avro schema evolution compatibility check




Views

  • Avro serialization de-serialization using Confluent Schema registry - 231,002 views
  • Read Write Parquet Files using Spark - 37,505 views
  • Understanding Spark Serialization - 30,190 views
  • Define Avro Schema with default values - 23,868 views
  • Spark mapPartitions - 20,936 views
  • Java generate random number in a range - 20,165 views
  • Spring Data MongoDB Validation - 17,235 views
  • Contacts - 15,679 views
  • Spark Map Vs mapPartitions - 14,496 views
  • Avro Schema Compatibility Test - 14,123 views

Copyright © 2016 bytepadding.com, all rights reserved. Privacy Policy