JOB DETAILS
Senior Databricks Consultant / Architect
CompanyUnison Group
LocationSingapore
Work ModeOn Site
PostedNovember 13, 2026
About The Company
We are a team of highly experienced sustainability experts, bringing over 20 years of wide-ranging technical, sectoral, and cultural expertise to your projects in Central Asia.
This includes providing services around renewable energy supply, energy efficiency, ‘green’ technology and finance, climate change mitigation, water sustainability, green tourism, nature-based solutions, and sustainable consumption and production (SCP). This makes Unison one of the leading organisations contributing to the circular economy in the Central Asia region. We collaborate with clients to sustainably support their efforts in innovating and achieving long-term performance improvements.
We advise governments, financial institutions, donors and civil society organizations on the most critical issues and provide sustainable solutions for Central Asia.
Our partners include renowned international donor organisations and finance institutions, nonprofit organisations, and state authorities at the national, regional and local levels.
We aim for large-scale, long-term positive changes in the energy, climate, government and environmental sectors.
About the Role
Role Overview
We are looking for an experienced Senior Databricks Consultant / Architect to lead the design, architecture, development, and implementation of enterprise-scale data engineering and analytics solutions using Azure Databricks. The ideal candidate should have strong expertise in Lakehouse architecture, PySpark, Delta Lake, cloud data platforms, and data governance.
Key Responsibilities- Design and architect scalable, secure, and high-performance Lakehouse solutions using Databricks.
- Lead end-to-end data engineering and data platform implementation.
- Define enterprise data architecture, standards, best practices, and technical roadmaps.
- Design and implement data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
- Develop and optimize ETL/ELT pipelines for batch and streaming data processing.
- Implement Medallion Architecture (Bronze, Silver, Gold) and Delta Live Tables (DLT).
- Work extensively with Unity Catalog for data governance, security, access control, and lineage.
- Integrate Databricks with Azure services such as ADLS Gen2, Azure Data Factory, Event Hubs, and Azure Key Vault.
- Optimize Spark workloads, cluster configurations, SQL queries, and overall platform performance.
- Implement CI/CD pipelines, automated deployments, and DevOps practices.
- Provide technical leadership, conduct design reviews, and mentor data engineering teams.
- Collaborate with business stakeholders, architects, and engineering teams to translate business requirements into technical solutions.
- Strong hands-on experience with Azure Databricks and Apache Spark.
- Expertise in PySpark, Spark SQL, Python, and SQL.
- Strong knowledge of Delta Lake and Lakehouse architecture.
- Experience implementing Medallion Architecture.
- Expertise in Unity Catalog, Delta Live Tables (DLT), and Auto Loader.
- Strong understanding of ETL/ELT design and data pipeline development.
- Experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory.
- Knowledge of Databricks Workflows, cluster management, and performance tuning.
- Experience with data security, governance, and access management.
- Hands-on experience with Git, Azure DevOps, and CI/CD.
- Experience with AWS Databricks or GCP Databricks.
- Knowledge of Kafka, Event Hubs, and real-time data streaming.
- Experience with Databricks SQL and Lakehouse Monitoring.
- Knowledge of Terraform and Infrastructure as Code.
- Experience with MLflow and the Databricks Machine Learning ecosystem.
- Databricks Professional-level certifications.
- Strong experience in enterprise data architecture and large-scale data engineering implementations.
- Ability to independently drive architecture decisions and technical delivery.
- Excellent communication, stakeholder management, and problem-solving skills.
- Ability to work with cross-functional teams and provide technical direction.
Key Skills
Azure DatabricksApache SparkPySparkSpark SQLPythonSQLDelta LakeLakehouse ArchitectureMedallion ArchitectureUnity CatalogDelta Live TablesAzure Data FactoryADLS Gen2CI/CDAzure DevOpsData Engineering
Categories
Data & AnalyticsTechnologySoftwareConsultingEngineering
Job Information
📋Core Responsibilities
Lead the design, architecture, and implementation of enterprise-scale data engineering and analytics solutions using Azure Databricks. Define technical roadmaps, mentor engineering teams, and collaborate with stakeholders to translate business requirements into high-performance data pipelines.
📋Job Type
full time
📊Experience Level
10+
💼Company Size
33
📊Visa Sponsorship
No
💼Language
English
🏢Working Hours
40 hours
Apply Now →
You'll be redirected to
the company's application page