Byte Padding

Eyegasm for geeks

  • Home
  • Java
    • Java Core
    • Java Date
    • Java JSON
    • JDBC
  • Spring
  • Big Data
    • Apache Kafka
    • Spark
    • Hbase
    • Map Reduce
    • Aerospike
    • Apache Flink
    • Security
  • Linux
  • About
  • Contacts

Spark

Understanding Spark

  • Understanding Spark through Map Reduce
  • Spark Input Formats And Parallel factor
  • Spark Code Analysis
  • Understanding Spark Serialization

 

Spark with Examples

  • Word Count in Spark
  • Read Write Parquet Files using Spark
  • Word Count using CombineByKey in Spark
  • Write a CSV text file from Spark

 

InputFormats

  • CombineParquetFileInputFormat

 

Oozie schedular

  • How to submit spark job through oozie

 

Spark Transformations

  • Spark Map
  • Spark mapPartitions
  • Spark Map Vs mapPartitions

 

Joins

  • DataFrame  Join in Spark
  • Map Side Joins in Spark
  • DataFrame Broadcast Join

 

ReduceByKey And CombineByKey

  • Word Count in Spark reduceByKey
  • Word Count using CombineByKey in Spark
  • reduceByKey vs CombineByKey

 

GroupByKey And CombineByKey

 

  • GroupByKey
  • Collect all value for a given key using CombineByKey
  • CombineByKey to find Max
  • GroupByKey Vs ReduceBykey/CombineByKey

 

Aerospike I/O

  • Write to Aerospike via Map
  • Write to Aerospike via MapPartition
  • Read from Aerospike via Map
  • Read From Aerospike via MapPartition

 

Utils(Avro)

  • Spark Avro Util
  • Convert Avro Object To Row
  • Define Avro Schema and create Avro Class
  • Avro SerDe with Confluent
  • Avro schema to class interconversion
  • Avro schema evolution compatibility check




Views

  • Avro serialization de-serialization using Confluent Schema registry - 229,472 views
  • Read Write Parquet Files using Spark - 35,097 views
  • Understanding Spark Serialization - 28,903 views
  • Define Avro Schema with default values - 21,643 views
  • Spark mapPartitions - 19,953 views
  • Java generate random number in a range - 19,042 views
  • Spring Data MongoDB Validation - 16,128 views
  • Spark Map Vs mapPartitions - 13,834 views
  • Apache Kafka Internals - 13,457 views
  • Avro Schema Compatibility Test - 13,044 views

Copyright © 2016 bytepadding.com, all rights reserved. Privacy Policy