Databricks Data Developer

Responsibilities

We are looking for a Databricks Data Developer who wants to build and optimize scalable data pipelines and data architectures within an international digital commerce ecosystem. You will work on a central Databricks platform supporting both marketplace operations and OBI's own retail business, ensuring seamless data integration across both areas.

You will contribute to the data engineering foundation of an international e-commerce platform operating across 8 countries, collaborating with Digital Business, Analytics, Product Management, and IT teams.

Your key responsibilities will include

• Design, develop, and maintain scalable, production-grade ETL/ELT pipelines and data models processing high-volume e-commerce, marketplace, retail, and tracking data.
• Build and optimize data engineering solutions on Databricks and Apache Spark, using Python, PySpark, Scala, and SQL as appropriate.
• Implement and maintain Delta Lake pipelines and modern Databricks capabilities, including Unity Catalog, Databricks Workflows, and Structured Streaming.
• Develop robust data models that integrate marketplace and retail data, ensuring data consistency, quality, and availability across business domains.
• Automate complex data preparation and transformation processes to enable reliable data delivery and self-service analytics.
• Optimize, monitor, and troubleshoot distributed data jobs, ensuring pipeline performance, reliability, and scalability.
• Integrate data pipelines with downstream analytics and BI solutions, including Looker, while collaborating with business and technical stakeholders to translate requirements into effective data solutions.

Benefits

• Salary range for Employment Contract: 13 000 - 22 000 PLN gross/month.
• Motivizer Benefits Platform to choose and manage all your benefits in one place. You receive a budget (550 PLN monthly). You can choose medical care package, meal tickets, sports cards (we have Multisport and on preferential terms, we have membership cards to one of the most popular Gyms), cinema tickets, shop vouchers, discounts and many more.
• Language Courses - you'll have access to a multi-language learning platform enabling you to practice your language skills and learn new ones!
• Regular and systematic further training opportunities - both internally and from external providers. We support your ongoing learning and development.
• Cooperation within an internal community is our everyday reality. We have networking events, coding challenges, and company parties for different occasions.

Qualifications

• Completed university degree in Computer Science, Software Engineering, Business Informatics, Data Engineering, or a comparable quantitative field.
• Several years of professional experience in Data Engineering or Data Platform Development, ideally within e-commerce or digital commerce environments.
• Strong hands-on expertise in Databricks, Apache Spark and Delta Lake, including building and maintaining scalable batch and streaming data pipelines.
• Excellent knowledge of Python and SQL, with experience in data transformation, data modeling, and processing large datasets.
• Practical experience with workflow orchestration tools such as Databricks Workflows or Apache Airflow, as well as CI/CD practices for data engineering.
• Understanding of data quality, governance, monitoring, and performance optimization in distributed data platforms.
• Strong communication skills in English and Polish, with readiness to work in a hybrid model in Katowice

Nice to Have

• Experience with Unity Catalog and Structured Streaming in Databricks.
• Familiarity with integrating data pipelines into BI and analytics ecosystems, particularly Looker.
• Experience with AI/ML integrations within Databricks.
• Knowledge of data engineering challenges in international marketplace and retail environments.

About OBI Smart Technologies

Who are we

We are a joint venture between OBI and Reply Group, responsible for co-designing, building and operating mission-critical digital platforms for commerce, customer service, and omnichannel retail.

Our mission

"We unite technology leadership with deep retail vision to implement standardized processes and scalable digital products that drive efficient support for one of Europe’s largest DIY retailers. Leveraging proven best practices, we advance the internationalization of products and the digital mindset of our partners, delivering consistent and business-critical solutions to support the targets of our customer."