About Me | My Expertise
I am Esdras Rocha, a Data Engineer with over 10 years of experience in modern data architecture and cloud platforms. My journey in data engineering began with a strong foundation in SQL and Python, evolving into extensive work with complex ETL/ELT processes and scalable solutions across AWS and Azure.
I specialize in the full data lifecycle, thriving on turning complex data challenges into elegant, scalable solutions that empower business teams.
My key areas of expertise include Lakehouse architecture, legacy system modernization, API integration, and end-to-end KPI automation.
I have a proven track record of delivering significant results for top-tier companies across Latin America and Europe, including Volvo, C&A, Meta, Carrefour, and HSBC.
I’m currently expanding my knowledge in Artificial Intelligence and Machine Learning, aiming to bring innovative approaches to data-driven solutions.
My Tech Stack | Core Competencies
Cloud Platforms: AWS (EMR, Glue, Lambda, Athena, S3), Azure (Data Factory, Databricks, Data Lake, Synapse)
Big Data & Processing: Apache Spark, PySpark, Databricks, Delta Lake, Delta Live Tables (DLT)
Databases & Warehousing: SQL, SQL Server, Oracle, Teradata, PostgreSQL, MySQL, Data Warehousing, Dimensional Modeling
ETL/Orchestration: ETL/ELT, Azure Data Factory, AWS Glue, Apache Airflow, Oracle Data Integrator (ODI), Control-M
Programming & Scripting: Python, PySpark, SQL
Data Governance & Practices: Lakehouse Architecture, CI/CD, Git, Azure DevOps, Data Governance, Scrum
My Projects | GitHub Portfolio
As a hands-on Data Engineer, I actively contribute to and showcase my work on GitHub. You'll find practical examples of my expertise in building scalable data pipelines, optimizing performance, and developing solutions for fraud detection, risk assessment, and API integration.
From PySpark scripts on Databricks to cloud-native ETL/ELT implementations on AWS and Azure, my repositories demonstrate my commitment to clean code, robust architectures, and delivering tangible results.