ngods (new generation open-source data stack)

Last updated Feb 9, 2024

As Modern Data Stack is an overused term, people searching for another one. One would be Open-Source Data Stack or this one is “New Generation open-source Data Stack”.

I found that the data stack nicely scales from small data (a few GBs) to mid-size data (a few hundred GBs). It is also much cheaper than cloud data stacks that utilize usage-based pricing (e.g., Snowflake, Redshift, or BigQuery).

See also Open-Source Data Engineering Projects.

Origin: Iceberg + Spark + Trino + Dagster: modern, open-source data stack demo | by ZD | Jul, 2022 | Dev Genius
References:
Created 2022-08-16