shell scripting

Experience: 5+ Years Location: Pune Employment Type: Full-Time Job Summary: We are looking for a highly skilled and detail-oriented Data Engineer / Data Operations Specialist with 5+ years of experience in shell scripting, data pipeline orchestration, and database scripting. The ideal candidate will have strong hands-on expertise in Linux environments, Teradata tools, and a good understanding of DAG-based workflows. Key Responsibilities: Develop and maintain shell/Korn shell (KSH) scripts to automate data processing and system tasks. Write and optimize SQL queries (preferably BigQuery, but other DBs acceptable). Design, monitor, and troubleshoot data pipelines using Airflow or equivalent scheduling/orchestration tools. Handle large data loads using Teradata tools such as BTEQ, MLOAD, FLOAD, and FastExport. Ensure smooth data flow across different layers by writing robust ETL/ELT processes. Collaborate with data analysts, engineers, and DevOps teams to resolve pipeline issues. Continuously improve system performance and data accuracy. Required Skills: Linux Shell Scripting / KSH – Advanced SQL Expertise – Preferably BigQuery (but strong SQL logic is mandatory) Data Pipeline Knowledge – Understanding of DAGs; hands-on with Apache Airflow or similar tools Teradata Scripting – BTEQ, MLOAD, FLOAD, FastExport experience is essential Logical & Analytical Skills – Strong problem-solving and debugging capability Command Line Proficiency – Comfortable working in CLI-based environments Good to Have: Exposure to cloud platforms like GCP or AWS Familiarity with Git and CI/CD practices Basic knowledge of Python or any scripting language Education: Bachelor's degree in Computer Science, Information Systems, or related field

Created: 2025-07-26