Data Platform Engineer_6+years_Mumbai

Role: Data Platform Engineer Location: Mumbai (Hybrid) Contract Duration:12+months, extendable Notice period: Immediate Joiners only Strong Experience in PySpark Hands-on expertise in building scalable data pipelines using PySpark. Proficiency in using Spark SQL, DataFrame, and RDD APIs to implement complex business logic. Proficient Programming Skills Solid coding skills in Python (preferred), with strong fundamentals in data structures, algorithms, and software engineering principles. Data Pipeline Development Proven experience designing, developing, and maintaining batch and streaming data pipelines. Understanding of ETL/ELT processes and best practices for data transformation, data quality, and performance optimization. Knowledge of Modern Data Engineering Ecosystem Familiarity with the current data engineering landscape including distributed data processing, storage systems, and workflow orchestration tools. Tools/technologies could include Apache Airflow, dbt, Delta Lake, etc. Cloud Data Platform Experience (Preferably AWS) Experience working with cloud services such as: AWS S3 (data lake) AWS Glue / EMR (for Spark workloads) AWS Lambda , Step Functions , or similar for orchestration/integration Redshift or other cloud data warehouses Spark API Expertise for Business Logic Implementation Ability to choose and apply the right Spark APIs (DataFrame, Dataset, RDD) for performance-efficient implementation of business logic at scale.

Apply Now