Lead Data Engineer

COCUS Prosource is all about People! We are proud to deliver skilled services and products developed by great talent, with attitude and ambition to work in innovative IT solutions.

Emotions are part of us, we encourage everyone to be what they truly are in a collaborative, informal, transparent, and open environment, that is why we take our partnerships seriously - supporting as a Talent Acquisition specialized partner on the recruitment for companies with the same People first mindset as we have!

As a Lead Data Engineer, you will provide technical leadership across the data engineering domain, driving the design, development, and optimization of scalable data platforms and data products on Azure Databricks. 

• You will play a key role in establishing engineering standards, mentoring Data Engineers, and ensuring the delivery of reliable, high-quality, and business-critical data solutions. Working closely with Data Architects, DevOps, Analytics teams, and business stakeholders, you will help shape the future of the organization's data ecosystem. 
• Lead the design and implementation of scalable data pipelines and data products using Azure Databricks, Python, and SQL 
• Design and maintain robust batch and streaming data processing solutions 
• Drive the adoption of modern data architecture principles, including Medallion Architecture and curated data layers 
• Define and enforce engineering best practices across coding standards, testing, CI/CD, documentation, monitoring, and observability 
• Perform code reviews and provide technical guidance to Data Engineers across multiple initiatives 
• Collaborate with Data Architects, Platform Engineering, DevOps, and Analytics teams to deliver high-quality data solutions 
• Implement and oversee data quality frameworks, data contracts, reconciliation processes, and automated validation mechanisms 
• Optimize data pipelines, Spark workloads, cluster configurations, and storage consumption to improve performance and cost efficiency 
• Support production operations through incident investigation, root cause analysis, and continuous improvement initiatives 
• Evaluate and adopt new Azure and Databricks capabilities that improve scalability, reliability, and engineering productivity 
• Contribute to the development of a strong engineering culture through mentoring, knowledge sharing, and technical leadership. 

• Several years of experience in Data Engineering roles 
• Strong hands-on experience with Azure Data Platform technologies and Databricks 
• Proven experience designing and implementing large-scale data pipelines and data products 
• Strong expertise in Python, SQL, and Apache Spark 
• Experience building batch and streaming data processing solutions 
• Strong understanding of modern data architecture concepts, including Medallion Architecture and data lakehouse principles 
• Experience optimizing Spark workloads, including partitioning strategies, caching techniques, and cluster performance tuning 
• Experience with modern DataOps and DevOps practices, including CI/CD pipelines, automated testing, monitoring, and observability 
• Experience with Azure DevOps, GitHub, and version control best practices 
• Experience working with dbt and data transformation frameworks 
• Strong understanding of data quality, data governance, and data validation practices 
• Experience mentoring engineers and leading technical delivery across multiple concurrent initiatives 
• Excellent problem-solving, analytical, and communication skills 
• Fluent in written and spoken English 
• Degree in Computer Science, Engineering, Information Technology, or a related field. 

• Azure Data Engineer Associate (DP-203) certification 
• Databricks certifications 
• Experience working with large-scale enterprise data platforms 
• Exposure to Machine Learning platforms and MLOps practices 
• Experience working with distributed international teams 
• Experience with Infrastructure as Code and cloud automation practices 
• Previous experience leading engineering communities, mentoring programs, or technical excellence initiatives 
• Knowledge of advanced monitoring and observability solutions for data platforms. 

• Permanent contract with long-term career prospects 
• Competitive salary aligned with your experience and expertise 
• Annual target bonus based on performance 
• Daily meal allowance 
• Health insurance and Life insurance 
• Access to Employee Assistance Program for well-being and support 
• A flexible hybrid work model