High-Performance Data Solutions Engineer

Job Overview We are seeking a highly skilled Data Platform Engineer to join our team. The ideal candidate will have extensive experience in data platform engineering, ETL development, and expertise in PySpark and Python. They must possess excellent communication skills and be able to collaborate with stakeholders to ensure alignment with business objectives. Key Responsibilities: Design and implement technical solutions, including ETL pipelines, leveraging PySpark. Build solutions to integrate two main data platforms (Palantir Foundry & Databricks). Integrate data platforms with other tools, such as incident management, identity management, and data observability. Optimize existing ETL processes for improved performance, scalability, and reliability. Develop and maintain unit and integration tests. Resolve production incidents as a third-line engineer. Required Skills & Qualifications Education: Bachelor's degree in IT or a related field. Experience: Minimum 8 years in IT/Data-related roles. Technical Expertise: Proficient in PySpark and Python. Advanced SQL skills. Familiarity with ETL tools and data warehousing platforms. Solid understanding of data modeling. Experienced with version control tools and monitoring tools. Knowledge of scheduling tools and data freshness frameworks. About the Role This is an exciting opportunity to work with cutting-edge technologies and contribute to the success of our organization. If you are a motivated and passionate individual with a passion for data platform engineering, we encourage you to apply.

Apply Now