Home › Jobs › Data Engineer (Databricks)

Data Engineer (Databricks)

Omnes Group

Full time Belgrade / Hybrid
Apply Now

Job description

We are seeking a Data Engineer to join a long-term renewable energy data platform project focused on building and scaling modern data products for operational and sensor data from global wind turbine fleets. The role is based in Belgrade (hybrid) and involves working with Databricks on Azure, designing and maintaining batch and streaming pipelines, and implementing data governance using Unity Catalog within a lakehouse architecture.

The ideal candidate has strong hands-on experience with Databricks, Spark (PySpark), SQL, and Python, along with solid knowledge of data modeling, ETL/ELT processes, and cloud platforms. Experience with data governance, data product or data mesh concepts, and integrating data via REST APIs is essential, along with a strong ownership mindset and the ability to work independently in an international environment.

Responsibilities

  • Design, build, and maintain batch and streaming data pipelines using Databricks
  • Develop and optimize data products within a modern lakehouse architecture
  • Model and transform data using medallion architecture principles (bronze/silver/gold)
  • Implement and maintain data governance, lineage, access control, cataloging, and data sharing capabilities through Unity Catalog
  • Integrate data from multiple sources, including REST APIs and serverless/event-driven services
  • Ensure data quality, reliability, performance, monitoring, and CI/CD practices
  • Collaborate with business stakeholders, analysts, and domain experts to deliver trusted datasets and data products
  • Contribute to platform evolution, architecture discussions, and engineering best practices

Requirements

  • 3+ years of hands-on Data Engineering experience
  • Strong practical Databricks experience in production environments
  • Hands-on experience with Apache Spark, PySpark, Delta Lake, Databricks notebooks, jobs, and workflows
  • Strong experience with Unity Catalog, including governance, lineage, access management, and data sharing concepts
  • Experience working with Data Product-oriented or Data Mesh architectures
  • Strong SQL and Python skills
  • Experience with data modeling and ETL/ELT design (lakehouse / medallion architecture)
  • Experience with Azure or AWS cloud platforms
  • Experience integrating data through REST APIs
  • Familiarity with Git and CI/CD practices
  • Strong communication skills and professional English
  • Ability to work independently and take ownership of technical solution

Nice to have Qualifications (not Required):

  • Azure Functions or other serverless technologies
  • Databricks Workflows
  • Delta Sharing
  • Infrastructure-as-Code or DevOps exposure
  • Experience with telemetry, SCADA, IoT, or industrial data
  • Familiarity with EU Data Act, GDPR, NIS2, ISO 27001, or IEC 62443
  • Experience building customer-facing Data Products
Apply Now