Senior Data & Backend Engineer (Python)

Quantum One is an Abu Dhabi-based AI consulting and solutions company. We deliver AI/ML systems to industrial clients across energy, logistics, manufacturing and infrastructure in the UAE.

The role

A deliberately hybrid position: roughly half data engineering, half Python backend development. You own the pipelines that bring industrial data to a production-ready state on Databricks, and the services through which model outputs reach client systems. This is a senior individual contributor role with direct client exposure. Candidates who prefer to specialise exclusively in data or backend are not to be a fit.

Responsibilities

• Design and operate Databricks pipelines ingesting industrial data from historians, SCADA/IoT telemetry, ERP/MES systems and third-party APIs

• Model and maintain data structures for ML workloads, including time-series

• Build production Python services for model inference, orchestration and client integration, and design the APIs client teams consume

• Own operational readiness: containerisation, CI/CD, monitoring and performance

• Define architecture and defend it in technical reviews with clients

Requirements

• Hands-on production experience with Databricks: Spark, Delta Lake and Workflows

• 5+ years of professional Python, with production experience in both backend services (FastAPI or equivalent) and data pipelines

• Strong SQL and sound data-modelling judgement; PostgreSQL plus an analytical or time-series store

• Batch and streaming processing (Spark, Polars, Kafka or equivalent)

• End-to-end service ownership: Docker, Kubernetes, CI/CD, Azure

• Client delivery or consulting experience, with the ability to engage credibly with a client's engineering lead

• Professional fluency in English

Preferred

• Industrial protocols and historians: OPC UA, MQTT, OSIsoft PI

• ML models in production: MLflow, feature stores, inference services

• Domain exposure to energy, logistics, manufacturing or infrastructure

Terms

• Fully remote, UAE time zone

• Contractor engagement; competitive compensation

Referrals are welcome.