IN.JobDiagnosis logo

Job Title:

Associate Architect - Data Engineering

Company: Response Informatics

Location: Eluru, Andhra Pradesh

Created: 2025-09-04

Job Type: Full Time

Job Description:

About the Role: We are seeking an experienced Data Architect to lead the transformation of enterprise data solutions, with a strong focus on migrating Alteryx workflows into Azure Databricks. The ideal candidate will have deep expertise in the Microsoft Azure ecosystem, including Azure Data Factory, Databricks, Synapse Analytics, Microsoft Fabric, and a strong background in data architecture, governance, and distributed computing. This role requires both strategic thinking and hands-on architectural leadership to ensure scalable, secure, and high-performance data solutions.Key Responsibilities: Define the overall migration strategy for transforming Alteryx workflows into scalable, cloud-native data solutions on Azure Databricks. Architect end-to-end data frameworks leveraging Databricks, Delta Lake, Azure Data Lake, and Synapse. Establish best practices, standards, and governance frameworks for pipeline design, orchestration, and data lifecycle management. Guide engineering teams in re-engineering Alteryx workflows into distributed Spark- based architectures. Collaborate with business stakeholders to ensure solutions align with analytics, reporting, and advanced AI/ML initiatives. Oversee data quality, lineage, and security compliance across the data ecosystem. Drive CI/CD adoption, automation, and DevOps practices for Azure Databricks and related services. Provide architectural leadership, design reviews, and mentorship to engineering and analytics teams. Optimize solutions for performance, scalability, and cost-efficiency within Azure. Participate in enterprise architecture forums and influence data strategy across the organization.Required Skills and Qualifications: 10+ years of experience in data architecture, engineering, or solution design. Proven expertise in Alteryx workflows and their modernization into Azure Databricks (Spark, PySpark, SQL, Delta Lake). Deep knowledge of the Microsoft Azure data ecosystem: o Azure Data Factory (ADF) o Azure Synapse Analyticso Microsoft Fabric o Azure Databricks Strong background in data governance, lineage, security, and compliance frameworks. Demonstrated experience in architecting data lakes, data warehouses, and analytics platforms. Proficiency in Python, SQL, and Apache Spark for prototyping and design validation. Excellent leadership, communication, and stakeholder management skills.Preferred Qualifications: Microsoft Azure certifications (e.g., Azure Solutions Architect Expert, Azure Data Engineer Associate). Experience leading large-scale migration programs or modernization initiatives. Familiarity with enterprise architecture frameworks (TOGAF, Zachman). Exposure to machine learning enablement on Azure Databricks. Strong understanding of Agile delivery and working in multi-disciplinary teams.

Apply Now

➤
Home | Contact Us | Privacy Policy | Terms & Conditions | Unsubscribe | Popular Job Searches
Use of our Website constitutes acceptance of our Terms & Conditions and Privacy Policies.
Copyright © 2005 to 2025 [VHMnetwork LLC] All rights reserved. Design, Develop and Maintained by NextGen TechEdge Solutions Pvt. Ltd.