Python Data Engineer

Let's take your Data Engineering career to the next level!

We are looking for a skilled Python Data Engineer to join our client's dynamic team. If you are passionate about building scalable data solutions and optimizing performance in a cloud-based environment, this role is for you! You will play a crucial role in designing and implementing data processing workflows, integrating APIs, and working with cutting-edge technologies like Azure Databricks and Apache Spark.

Key Responsibilities

* Develop, optimize, and maintain data pipelines using Python and Apache Spark.
* Work with Azure Databricks to manage clusters, workflows, and asset bundles.
* Implement and manage CI/CD pipelines in Azure DevOps, including YAML pipelines and release management.
* Build and expose REST APIs for seamless data integration with other applications.
* Optimize Spark jobs for performance and scalability.
* Collaborate with cross-functional teams to translate business requirements into technical solutions.
* Ensure data quality, security, and governance best practices are followed.

Required Experience & Skills

* Proven experience as a Data Engineer.
* Strong programming skills in Python, including experience with REST APIs and data processing libraries (PySpark, Requests, Pandas).
* Hands-on experience with Azure Databricks (clusters, workflows, Databricks asset bundles, and frameworks).
* Experience implementing CI/CD pipelines using Azure DevOps.
* Strong knowledge of Apache Spark and the ability to optimize Spark jobs.
* Ability to design and expose APIs for application integration.
* Experience in an industrial B2B market is a plus.
* Strong problem-solving skills and attention to detail.
* Effective communication skills and the ability to work collaboratively in cross-functional teams.

Nice to Have

* Knowledge of Azure MLflows.
* Experience with Scala (ability to read and understand existing code).
* Familiarity with Agile methodologies, including implementing design and testing strategies.



Our client offers a stimulating work environment where innovation and collaboration are key. They foster an open and diverse company culture and prioritize flexibility to ensure a healthy work-life balance. This is an exciting opportunity to work with cutting-edge technologies while continuously developing your skills in a supportive environment.

About the Client

Our client offers a stimulating work environment where you can continuously develop your skills. They foster an open and diverse company culture that prioritizes innovation and collaboration. Additionally, they offer flexibility to help maintain a healthy work-life balance.

If this sounds like the perfect next step for you, let's connect!

Send me a message or apply now.
0471 38 86 98

Our account managers and recruiters each focus on one Business Inteligence, Data or Analytics expertise, one specific type of contract and one particular region. Thanks to this triple focus, they know all relevant organisations within their focus area. As a result, they quickly find your best match.