What language does an Orchestrator speak?

Also, what language is best suited for Data Orchestrators? As all of the above data orchestrators speak Python, SQL is rising again. The post about SQL vs. Python for Data Analysis shows that both should be used in conjunction and whatever fits better. For example, using dbt for SQL transformation and a schedule and orchestrator to integrate them with Prefect or Dagster gives you the best of both worlds. I want to say believe that there is almost no data engineering project that does not use Python at some point. 

Programming Languages Trend 2022 StackOverflow

Another interesting one is Functional Programming languages which are on the rise. Scala, Rust, Julia, Elixir, and many others are relatively new. Compared to Python, these are more niche languages. 

Good Read about the Battle of Language

The Battle for Data Engineer’s Favorite Programming Language Is Not Over Yet is an excellent comparison with SQL, Python, and Rust with interesting data projects implemented with Rust. DataFusion integration to Delta Lake with delta-rs, and a Rust library for Apache Kafka.

Read also more on my article about Rust for Data Engineering.

Origin: Data Orchestrators
References:
Created 2022-06-07