Azure Databricks Architect

Company: Cognizant
Location: Plano
Posted on: May 3, 2025

Job Description:

We are Cognizant Artificial IntelligenceDigital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. But clients need new business models built from analyzing customers and business operations at every angle to really understand them.With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate, and scale the most desirable products and delivery models to enterprise scale within weeks.This is a hybrid position open to any qualified applicant in the United StatesJob Title: Azure Databricks ArchitectJob Summary:We are seeking a highly experienced Principal Architect with 20 to 24 years of experience to join our team. The ideal candidate will have expertise in Databricks Unity Catalog, Delta Live Pipelines, Kafka, Azure Data Lake Store, Azure DevOps, Python, Databricks SQL, Databricks Workflows, and PySpark. This is a hybrid work model with day shifts and no travel required.Key Responsibilities:

• Lead the design and implementation of scalable data architectures using Databricks Unity Catalog and Delta Live Pipelines.
• Oversee the integration of Kafka for real-time data processing and streaming.
• Provide expertise in Azure Data Lake Store to ensure efficient data storage and retrieval.
• Contribute to the company's mission by enhancing supply chain visibility and optimizing distributed order management.
• Experience with Delta Lake, Delta Sharing, Delta Live Tables (DLT), AI/BI Workflows for the end-to-end orchestration, Marketplace, Lakehouse, Federation.
• Strong experience in design and building ingestion patterns for various data loads such as batch, real-time, near real-time, and micro-batches.
• Knowledge in building, deploying, evaluating, and governing AI and ML solutions using Mosaic AI.
• Utilize Azure DevOps for continuous integration and continuous deployment (CI/CD) processes.
• Develop and maintain Python scripts for data manipulation and analysis.
• Implement Databricks SQL for querying and analyzing large datasets.
• Manage Databricks Workflows to automate data pipelines and workflows.
• Apply PySpark for distributed data processing and big data analytics.
• Ensure data governance and security compliance within the data architecture.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Drive innovation and best practices in data engineering and architecture.
• Mentor and guide junior team members in technical and domain-specific areas.
• Overall knowledge of data engineering principles including data pipelines, data warehousing, and data lakes.Qualifications:
• Must have extensive experience with Databricks Unity Catalog, Delta Live Pipelines, Kafka, Azure Data Lake Store, Azure DevOps, Python, Databricks SQL, Databricks Workflows, and PySpark.
• Should possess strong knowledge in Distributed Order Management and Supply Chain Visibility.
• Must have excellent communication skills in English (Read/Write/Speak).
• Should have a proven track record of leading complex data architecture projects.
• Nice to have experience with other cloud platforms and big data technologies.
• Should be able to work effectively in a hybrid work model.Certifications Required:
• Databricks Certified Data Engineer Professional
• Microsoft Certified: Azure Solutions Architect ExpertSalary and Other Compensation:The annual salary for this position is between $112,000 - $200,000 depending on experience and other qualifications of the successful candidate. This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans.Benefits:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase PlanDisclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.#LI-EV1 #CB #Ind123
  #J-18808-Ljbffr

Keywords: Cognizant, Cedar Hill , Azure Databricks Architect, Professions , Plano, Texas