Senior Data Engineer & Team Lead

The client is a private equity firm

Basic information

Location: mostly remote (once a month from Warsaw) Rate: 180-240PLN/h net + VAT Employment type: B2B contract Duration: 12 months + extensions Recruitment process: 2 stages English: B2+/C1 Luxmed, MultiSport, equipment provided by the client

Project description Client is transforming cloud-first, data-driven technology environment and data platform. The role sits in the Core Development team and focuses on owning end-to-end data engineering solutions on Azure Databricks, acting as the Databricks subject matter expert and hands-on technical lead. Responsibilities

• Own end-to-end delivery from scoping, design, build and testing through deployment, support and production ownership.
• Architect and build scalable Databricks pipelines and workflows, including Jobs, Notebooks, SDP and Workflows.
• Implement CDF/CDC patterns and develop Delta Lake / Lakehouse solutions aligned with Bronze, Silver and Gold architecture.
• Design and manage Unity Catalog resources, access controls, permissions and governance policies.
• Promote solutions through CI/CD pipelines using Declarative Automation Bundles and GitHub Actions or Azure DevOps.
• Collaborate with BAs, business stakeholders, QA and Scrum Master to translate requirements, define acceptance criteria and deliver stories within sprints.
• Define and enforce engineering standards, code quality, testing, documentation and reusable component libraries.
• Mentor and upskill team members, facilitate communication, run check-ins and support team coherence
• 2+ years of leadership experience is required

Key technologies

• Databricks: Jobs, Workflows, Notebooks, Spark Declarative Pipelines, Unity Catalog, CDF/CDC, Declarative Automation Bundles
• Azure: ADLS Gen2, Azure SQL, Azure Key Vault, Entra ID
• PySpark / Python, Delta Lake, Lakehouse and Medallion architecture
• CI/CD: GitHub Actions or Azure DevOps, GitHub / Azure Repos
• Infrastructure as Code: Pulumi or Terraform
• AI/LLM APIs, MCP servers, agentic AI workflows
• Nice to have: Kafka / Event Hub, Power BI, MongoDB, Logic Apps / Power Automate

Team

Core Development team. Agile/Scrum delivery is referenced, including sprint planning, backlog grooming, estimation and retrospectives. The role includes shared responsibility with the Scrum Master and close cooperation with BAs, business stakeholders and QA

Hays Poland sp. z o.o. is an employment agency registered in a registry kept by Marshal of the Mazowieckie Voivodeship under the number 361.

#li-dni

#1201188 - Mateusz Malachowski