Contents
πŸ” PREVIEW ONLY: This article is not yet published and is only visible at this URL

Internal vs. External Storage? What's the Limit of External Tables

This article was written as part of my services

The History of External Tables β€” Interactive Timeline

Explore 33 years of external table evolution across databases, from Microsoft Access linked tables in 1992 to DuckLake in 2025. Filter by era, category, or click around to explore how external data access evolved from simple file readers to governed open table formats.

History of External Tables β€” Interactive Dive

Loading interactive visualization...

Data: 33 tools across 6 eras β€” from Oracle’s flat-file abstraction to Iceberg’s governed lakehouse. Powered by MotherDuck Dives.

Dives:

  1. Log into MotherDuck: https://app.motherduck.com/ (simu@sspaeti.com)
  2. Open your Dive: ID 297a9e47-c926-41fc-a9cb-3f40437fc73c
  3. Connect to data: external_data.main.external_tables_history
  4. Build visualizations using queries from dive-queries.sql
  5. Test embed in your Hugo blog with hugo server -D

Key Story to Tell

Your Dive should visually demonstrate the Lindy Effect:

  • 33 years of continuous innovation (1992-2025)
  • Every major vendor adopted external tables (Oracle, AWS, Google, Snowflake, Databricks)
  • Evolution from simple CSV readers β†’ governed ACID-compliant data lakehouses
  • Open standards matter: SQL/MED β†’ Hive Metastore β†’ Iceberg/Delta

All files are ready in /home/sspaeti/git/ssp-data/writing-motherduck/ πŸŽ‰

πŸ” PREVIEW ONLY: This article is not yet published and is only visible at this URL
Discuss on Bluesky   |