Data Engineer

About Cybage Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the worlds largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are enabled by a scientific, data-driven system called Decision Mines for Digital Excellence Key Aspects of the Role: Design and implement the Audience Database architecture , integrating multiple data sources including CRMs, APIs, and web tracking. Build and manage ETL/ELT pipelines using Airbyte to ingest and normalize data into storage layers such as PostgreSQL, S3 , and ClickHouse . Develop backend components and RESTful APIs using FastAPI to serve audience data for dashboards and campaign systems. Integrate and optimize Elasticsearch for indexing, search, and personalized audience filtering. Apply data transformations, deduplication, and schema management using Python and SQL. Ensure high availability, performance, and reliability of the data infrastructure. Work closely with product and analytics teams to define data requirements and delivery mechanisms. Lead and mentor a team of data engineers and ensure project milestones are met. Required skillset: Experience in Data Engineering , with strong Python programming skills. Proven experience with Airbyte (Cloud or OSS) for connector-based data ingestion. Hands-on experience building APIs using FastAPI or similar Python frameworks (Flask, Django REST). Strong experience with Elasticsearch , including index design, query optimization, and integration. Solid command of SQL and data modeling in PostgreSQL or other relational databases. Familiarity with cloud storage and processing (e.g., AWS S3) . Experience with OAuth2, webhooks , and API-based integrations. Ability to lead small technical teams and coordinate with stakeholders across functions.

Apply Now