š§ Second Brain
Search
Python
Python is a high-level, general-purpose programming language. Its design philosophy emphasizes code readability with the use of significant indentation. Python is dynamically-typed and garbage-collected. It supports multiple programming paradigms, including structured, object-oriented, and Functional Programming.
Python is the de facto standard for Data Engineering next to SQL.
# What aspects of Python should I learn that are most important for Data Engineering?
I’d learn how to writeĀ Functional Data EngineeringĀ code within python. My favorite is dagster, which forces you to write functional blocks of code with superior features. Python and Functional ProgrammingĀ is also an excellent read in that direction.
Python is one of the most accessible programming l code within Python. My favorite isĀ Dagster, which forces you to write functional blocks of code with superior featuresācoming from a more SQL, T-SQL, and PL-SQL background. As a data engineer, I’d say you’d not expect to write perfect code; it’s better to know theĀ Big-O annotationĀ to avoid long-running data pipelines, even if your code doesn’t look the prettiest. Static types such asĀ mypy might be another good one to know, as it will detect errors pre-runtime, which is the biggest problem of Python.
# Working with Packages in Python
Breaking Packages in Python | Dagster Blog
# Other Resources
- Awesome-python on GitHub: An opinionated list of awesome Python frameworks, libraries, software and resources.
References: The growth of major programming languages