About the Role
We are seeking an experienced Solution Architect and Senior Azure DevOps Lead to design, build, and operate a secure, highly available cloud data platform that supports business-critical applications and AI/ML models. In this role, you will take ownership of the architecture and automation of our Azure infrastructure, drive DevOps best practices within a cross-functional engineering team, and ensure that the platform adheres to the security and compliance standards required in a tightly regulated environment.
What You'll Do
- Architect and lead the delivery of an enterprise cloud data platform that hosts critical applications and AI models.
- Design and maintain Azure DevOps CI/CD pipelines to automate the provisioning of cloud infrastructure.
- Implement and administer Databricks Unity Catalog.
- Oversee Databricks workspace administration, including cluster policies, instance pools, and autoscaling, balancing performance with cloud cost governance.
- Deploy and operate Apache Airflow on Kubernetes (AKS).
- Manage the security and compliance posture of the cloud infrastructure, focusing on network security groups, firewalls, and identity and access management.
- Architect a secure, scalable, and highly available infrastructure for hosting AI models in production.
- Lead, mentor, and develop a cross-functional engineering team to ensure smooth operations and delivery.
- Collaborate with compliance, risk, and business stakeholders to onboard new applications and use cases onto the platform.
What You'll Bring
- Over 10 years of experience in cloud engineering, DevOps, or solution architecture, with extensive hands-on experience in Azure, including roles in senior or lead capacities.
- A proven track record in designing and managing Azure DevOps CI/CD pipelines for infrastructure automation.
- Strong hands-on experience with Kubernetes (AKS), Databricks, and Apache Airflow in production environments.
- Experience implementing data governance and access-control frameworks (e.g., Unity Catalog or equivalent).
- Proficient in secrets management (Azure Key Vault, HashiCorp Vault) and core infrastructure security controls (NSGs, firewalls, IAM).
- Experience architecting or hosting AI/ML models on cloud infrastructure.
- Demonstrated experience leading or mentoring engineers and collaborating with enterprise stakeholders.
- Excellent written and verbal communication skills.
Nice to Have
- Experience in a highly regulated industry (e.g., financial services, insurance, healthcare).
- Experience delivering AI/ML use cases for compliance or risk functions (e.g., KYC reviews, risk scoring).
- Expertise in data platform architecture and cloud cost optimization.
Apply online using the form below. Only applications matching the job profile will be considered.