Infrastructure Data Engineer at Cushman & Wakefield

India

<p style="text-align:left"><span style="font-size:18px"><b>Job Title</b></span></p>Infrastructure Data Engineer<p style="text-align:left"><b><span style="font-size:18px">Job Description Summary</span></b></p><p style="text-align:left"><span style="font-size:18px"><b>Job Description</b></span></p><p></p><p>We are seeking a highly skilled Azure Cloud Engineer with deep expertise in designing, implementing, and optimizing Azure Databricks environments. This role will also support a broad range of Azure services—including Web Applications, Azure Data Factory, Application Gateway, Storage Accounts, Lakebase, Azure SQL/Databases, and Azure Monitor—to ensure our cloud ecosystem is secure, scalable, cost-efficient, and aligned with the Five Pillars of the Azure Well-Architected Framework: Operational Excellence, Security, Reliability, Performance Efficiency, and Cost Optimization.</p><p>The ideal candidate combines strong hands-on engineering skills with a strategic mindset for cloud governance, automation, and continuous improvement.</p><p></p><p><b>Key Responsibilities</b></p><p><b>Primary Focus: Azure Databricks Engineering</b></p><ul><li>·Design, deploy, and optimize Azure Databricks workspaces, clusters, jobs, and pipelines.</li><li>Implement best practices for cluster sizing, autoscaling, job orchestration, and cost governance.</li><li>Collaborate with data engineering teams to build scalable ETL/ELT pipelines using Databricks notebooks, Delta Lake, and Spark.</li><li>Integrate Databricks with Azure Data Lake, Azure SQL, Azure Data Factory, and other platform services.</li><li>Implement security controls including Unity Catalog, RBAC, service principals, secret scopes, and network isolation.</li><li>Monitor Databricks performance and reliability using Azure Monitor, Log Analytics, and Databricks native tools.</li></ul><p><b>Azure Platform Engineering Responsibilities</b></p><p><b>Azure Application &amp; Integration Services</b></p><ul><li>Deploy, configure, and maintain Azure Web Apps, Function Apps, and API Management.</li><li>Build and maintain Azure Data Factory pipelines for data ingestion, transformation, and orchestration.</li><li>Configure and optimize Azure Application Gateway, WAF policies, routing rules, and SSL/TLS certificates.</li></ul><p><b>Azure Storage &amp; Database Services</b></p><ul><li>Manage Azure Storage Accounts, lifecycle policies, replication, encryption, and access controls.</li><li>Support Azure SQL, Cosmos DB, and other database services including performance tuning and security hardening.</li></ul><p><b>Monitoring, Governance &amp; Optimization</b></p><ul><li>Use Azure Monitor, Log Analytics, Application Insights, and Azure Advisor to proactively identify and resolve issues.</li><li>Implement alerting, dashboards, and automated remediation workflows.</li><li>Continuously optimize cloud resources for cost, performance, and reliability.</li><li>Contribute to cloud governance standards including tagging, resource organization, RBAC, and policy enforcement.</li></ul><p><b>Automation &amp; Infrastructure as Code</b></p><ul><li>Build and maintain IaC templates using Terraform, Bicep, or ARM.</li><li>Automate deployments, configuration, and operational tasks using Azure DevOps, GitHub Actions, or PowerShell.</li><li>Support CI/CD pipelines for application and data workloads.</li></ul><p><b>Responsibilities Aligned to the 5 Pillars of the Cloud Operating Model</b></p><p><b>Operational Excellence</b></p><ul><li>Develop repeatable deployment patterns and IaC modules.</li><li>Implement monitoring, logging, and alerting standards across all Azure services.</li><li>Document architectures, runbooks, and operational procedures.</li></ul><p><b>Security</b></p><ul><li>Enforce Zero Trust principles across identity, network, and data layers.</li><li>Implement RBAC, managed identities, Key Vault, private endpoints, and network security groups.</li><li>Support compliance initiatives and security assessments.</li></ul><p><b>Reliability</b></p><ul><li>Design resilient architectures using availability zones, redundancy, and failover strategies.</li><li>Implement backup, disaster recovery, and business continuity plans.</li><li>Monitor system health and proactively address reliability risks.</li></ul><p><b>Performance Efficiency</b></p><ul><li>Optimize Databricks clusters, SQL databases, and application services for throughput and latency.</li><li>Conduct performance testing and capacity planning.</li><li>Use Azure Monitor and Advisor insights to drive continuous improvement.</li></ul><p><b>Cost Optimization</b></p><ul><li>Implement cost-efficient Databricks cluster policies and autoscaling.</li><li>Monitor and optimize Azure consumption across compute, storage, and networking.</li><li>Provide recommendations for reserved instances, rightsizing, and lifecycle management.<br>&nbsp;</li></ul><p><b>Required Qualifications</b></p><ul><li>3–7+ years of hands-on experience with Microsoft Azure.</li><li>Strong expertise in Azure Databricks, Spark, Delta Lake, and data engineering concepts.</li><li>Experience with Azure services such as Web Apps, Data Factory, Application Gateway, Storage Accounts, and Azure SQL.</li><li>Proficiency with Terraform, Bicep, ARM, or similar IaC tools.</li><li>Strong scripting skills (PowerShell, Python, Bash).</li><li>Experience with Azure Monitor, Log Analytics, and Azure Advisor.</li><li>Solid understanding of cloud networking (VNETs, private endpoints, firewalls, routing).</li><li>Familiarity with the Azure Well-Architected Framework.</li></ul><p></p><p><b>Preferred Qualifications</b></p><ul><li>Azure certifications (AZ-104, AZ-204, DP-203, AZ-305, or Databricks certifications).</li><li>Experience with CI/CD pipelines in Azure DevOps or GitHub Actions.</li><li>Experience with Unity Catalog, Databricks SQL, or MLflow.</li><li>Background in data engineering, DevOps, or cloud architecture.</li></ul><p><b>Soft Skills</b></p><ul><li>Strong communication and documentation abilities.</li><li>Ability to collaborate across data, application, and infrastructure teams.</li><li>Problem-solving mindset with a focus on automation and continuous improvement.</li><li>Comfortable working in fast-paced, cloud-first environments</li></ul><p style="text-align:inherit"></p><br><p style="text-align:inherit"></p><br><p style="text-align:inherit"></p><br><p style="text-align:inherit"></p><p>&nbsp;</p><p>&nbsp;</p><p>&nbsp;</p><p style="text-align:inherit"></p><br><p style="text-align:inherit"></p><p style="text-align:inherit"></p><br><p style="text-align:inherit"></p><p style="text-align:inherit"></p><br><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p style="text-align:inherit"></p><p></p><p></p>INCO: “Cushman &amp; Wakefield”