Big Data

Storage & formates of data

File Storage:

  • HDFS (Hadoop distributed file system)
  • ZFS

No SQL:

  • Key Value Store: Redis, Aerospike
  • In Memory: Ignite
  • Distributed DB: Cassandra, Hbase

Traditional DB:

  • MySQL
  • Postgres

Raw file Formats:

Formates-

  • Plain text (unstructured)
  • Structured Text Data (Rows, CSV, TSV, JASON)
  • Binarys files (Images, Videos)
  • Avro (Row oriented)
Author: shixuan liu
Link: http://tedlsx.github.io/2020/03/27/bigdata/
Copyright Notice: All articles in this blog are licensed under CC BY-NC-SA 4.0 unless stating additionally.
Donate
  • Wechat
  • Alipay

Comment