Data Consultant

Desired Competencies (Technical/Behavioral Competency) Must-Have Develop and deploy Databricks in a cloud environment, including workspace configuration, cluster management, and storage. Experience with orchestration tools like Airflow, Prefect, Dagster, or Azure Data Factory pipelines. Knowledge of distributed systems and big data frameworks (e.g Spark, Kafka, Hadoop). Familiarity with containerization and CI/CD (Docker, GitHub Actions, Cloud Build, etc.). Databricks and Snowflake proficiency is must ,Proficiency in at least one major platform: AWS: Glue, S3, Lambda, Redshift, Athena, EMR Azure: Data Factory, Synapse, ADLS Gen2, Databricks GCP: Dataflow, BigQuery, Pub/Sub, Dataproc, Cloud Composer Strong skills in SQL, Python, and data transformation logic. Understanding of data governance, cataloging, and metadata management. Good-to-Have Cloud certifications. Experience with modern data stacks (Snowflake, Delta Lake, Databricks). Exposure to real-time processing frameworks (Kafka, Spark Streaming, Flink). Knowledge of DevOps/MLOps principles or experience supporting ML workflows.

Apply Now