How is BigData Used
Where is Big Data used and how has the architecture of systems evolved in the light of Big Data
[addToAppearHere]
| Traditional Systems | BigData Systems |
| Application Web servers | Thrift Servers |
| Java Message Queues/ Rabbit MQ | Kafka |
| FileSystem like ext , NTFS | HDFS |
| Single Node | Cluster (Group Of machine) : YARN , MESOS |
| SQL DataBase Oracle , MongoDB | NoSql Database like Aerospike , Hbase, Cassandra |
| Reporting : SQL over Data Base and presenting in a UI | DRUID, HIVE for doing analytics over the data |
| Cron , Quartz scheduler for schedulling jobs | Oozie , Airflow |
| MultiHreaded Process running on a single of Couple of Nodes | Distributed process (Hadoop, Spark, Flink) |