Databricks Data Developer (B2B)

Responsibilities

We are looking for a Databricks Data Developer who wants to build and optimize scalable data pipelines and data architectures within an international digital commerce ecosystem. You will work on a central Databricks platform supporting both marketplace operations and OBI's own retail business, ensuring seamless data integration across both areas.

You will contribute to the data engineering foundation of an international e-commerce platform operating across 8 countries, collaborating with Digital Business, Analytics, Product Management, and IT teams.

Your key responsibilities will include

• Design, develop, and maintain scalable, production-grade ETL/ELT pipelines and data models processing high-volume e-commerce, marketplace, retail, and tracking data.
• Build and optimize data engineering solutions on Databricks and Apache Spark, using Python, PySpark, Scala, and SQL as appropriate.
• Implement and maintain Delta Lake pipelines and modern Databricks capabilities, including Unity Catalog, Databricks Workflows, and Structured Streaming.
• Develop robust data models that integrate marketplace and retail data, ensuring data consistency, quality, and availability across business domains.
• Automate complex data preparation and transformation processes to enable reliable data delivery and self-service analytics.
• Optimize, monitor, and troubleshoot distributed data jobs, ensuring pipeline performance, reliability, and scalability.
• Integrate data pipelines with downstream analytics and BI solutions, including Looker, while collaborating with business and technical stakeholders to translate requirements into effective data solutions.

Qualifications

• Completed university degree in Computer Science, Software Engineering, Business Informatics, Data Engineering, or a comparable quantitative field.
• Several years of professional experience in Data Engineering or Data Platform Development, ideally within e-commerce or digital commerce environments.
• Strong hands-on expertise in Databricks, Apache Spark and Delta Lake, including building and maintaining scalable batch and streaming data pipelines.
• Excellent knowledge of Python and SQL, with experience in data transformation, data modeling, and processing large datasets.
• Practical experience with workflow orchestration tools such as Databricks Workflows or Apache Airflow, as well as CI/CD practices for data engineering.
• Understanding of data quality, governance, monitoring, and performance optimization in distributed data platforms.
• Strong communication skills in English and Polish, with readiness to work in a hybrid model in Katowice

Nice to Have

• Experience with Unity Catalog and Structured Streaming in Databricks.
• Familiarity with integrating data pipelines into BI and analytics ecosystems, particularly Looker.
• Experience with AI/ML integrations within Databricks.
• Knowledge of data engineering challenges in international marketplace and retail environments.

About OBI Smart Technologies

Who are we

We are a joint venture between OBI and Reply Group, responsible for co-designing, building and operating mission-critical digital platforms for commerce, customer service, and omnichannel retail.

Our mission

"We unite technology leadership with deep retail vision to implement standardized processes and scalable digital products that drive efficient support for one of Europe’s largest DIY retailers. Leveraging proven best practices, we advance the internationalization of products and the digital mindset of our partners, delivering consistent and business-critical solutions to support the targets of our customer."