SQL Query Engine

Products:

• Presto
• Trino
• Spark SQL
• Dremio
• Photon Engine
• Apache Hive (why?)
• DuckDB
• Cloud Data Warehouses like snoflake, biquery etc.
• dbt Fusion (acquired SDF)
• Husky by DataDog

See more on Emerging Architectures for Modern Data Infrastructure (a16z), SQL Reference - FoundationDB Record Layer documentation.

Focus on Python dataframes:

Image by Mimoune Djouallah on @mimdj.bsky.social on Bluesky ^749aea

See also

More engines on Apache Spark Alternatives.

Origin: Data Lake and Lakehouse Guide- Powered by Data Lake Table Formats (Delta Lake, Iceberg, Hudi)
References: RW Compute Engine Strengths