Sr Data Engineer

Job Title: Data EngineerExperience: 5-7 yearsRelevant Experience – 5 yearsWork location: Bangalore/ Pune/Hyderabad/Chennai/NoidaJob DescriptionData engineers design, build, and maintain the infrastructure for an organization's data,ensuring it is reliable, accessible, and optimized for use by data scientists and analysts. Keyresponsibilities include creating and managing data pipelines (ETL processes), optimizing datastorage and processing, ensuring data quality and security, and collaborating with other teamsto meet data needs. Responsibilities Design and build data infrastructure: Create and maintain scalable data pipelines, databases, and data warehouses to handle largevolumes of data from various sources. Ensure data quality and reliability: Implement data cleansing, validation, and quality checks to ensure the data is accurate andtrustworthy. Optimize data systems: Monitor and tune performance of databases and data processing tasks to ensure efficiency andspeed. Collaborate with stakeholders: Work with data scientists, analysts, and other teams to understand their data requirements andmake data accessible for their use. Key skillsData Platform Project Autonomous level people Skillsets needed (Mandatory) Pyspark, Spark SQL - Databricks Data Governance – Unity Catalog Python – Pandera Framework REST API FrameworksNice to have Cloud platforms: Experience with cloud services (e.g. GCP Services - Cloud build, BigQuery,Firestore etc… Airbyte/Fivetran Nutter Framework – Experience in writing unit test in Nutter Framework Terraform Mandatory. CI/CD Concepts OAuth 2 Protocol Analytical and problem-solving skills: Strong analytical abilities are needed to troubleshootissues and find solutions.

Apply Now