Databricks Architect -ATGTJP00101580

JobTitle: Databricks Experience Level: 8 to 12 years JobLocation: Chennai Detailed Job Description: Architect and implement enterprise-grade Lakehouse solutions using Databricks. Design and deliver end-to-end data engineering pipelines, including batch and real-time streaming solutions. Lead implementation of: Cloud-based data lakehouse platforms integrating diverse data sources. Real-time data processing pipelines for operational and analytical use cases. Develop scalable ETL/ELT pipelines using PySpark, Scala, and SQL. Implement advanced data modeling solutions including 3NF, dimensional modeling, and enterprise data warehousing strategies. Must Required Skills in KEYWORDS: Data lake , Data Bricks, Apache Spark, Delta Lake Client Interview (Yes/No) Yes **Billing Start date: May 2nd Shift Timings: General **Must have Skills Matrix (Keywords) 1 Databricks and cloud-native storage/compute platforms 2 Apache Spark (batch & streaming) 3 Delta Lake & Lakehouse architecture 4 Distributed data processing systems We are seeking a highly skilled Databricks Architect to lead the design, implementation, and optimization of scalable cloud-based data platforms. This role requires deep expertise in Lakehouse architecture, Databricks, Apache Spark, and Delta Lake, along with proven experience delivering end-to-end enterprise data engineering solutions. Key Responsibilities Architect and implement enterprise-grade Lakehouse solutions using Databricks. Design and deliver end-to-end data engineering pipelines, including batch and real-time streaming solutions. Lead implementation of: Cloud-based data lakehouse platforms integrating diverse data sources. Real-time data processing pipelines for operational and analytical use cases. Develop scalable ETL/ELT pipelines using PySpark, Scala, and SQL. Implement advanced data modeling solutions including 3NF, dimensional modeling, and enterprise data warehousing strategies. Design and build incremental data loading frameworks and metadata-driven ingestion pipelines. Establish data quality frameworks and governance standards. Implement and manage Unity Catalog, including fine-grained security and access controls. Leverage Databricks components such as: Delta Live Tables Autoloader Structured Streaming Databricks Workflows

Apply Now