Data Engineer with Airflow

Location: Chennai / Hyderabad / Bangalore

Years of Experience: 5-7 Years

Job Summary: We are seeking a skilled Software Development Engineer with strong experience in Apache Airflow and proficiency in Python. The ideal candidate will have a solid understanding of ETL/ELT concepts and data pipeline architecture, along with experience in SQL and relational databases. Familiarity with cloud platforms, particularly Amazon Web Services, is essential. This role requires a detail-oriented individual who can design and implement robust data solutions.

Responsibilities:

• Design, develop, and maintain data pipelines using Apache Airflow.
• Implement ETL/ELT processes to ensure efficient data flow and transformation.
• Collaborate with data engineers and analysts to optimize data architecture.
• Write and optimize SQL queries for data retrieval and manipulation.
• Deploy and manage data solutions on cloud platforms, primarily AWS.
• Ensure data quality and integrity throughout the data lifecycle.
• Document processes and maintain technical specifications.
• Strong experience with Apache Airflow.
• Proficiency in Python programming.
• Solid understanding of ETL/ELT concepts and data pipeline architecture.
• Experience with SQL and relational databases.
• Familiarity with Amazon Web Services (AWS).
• Experience with Snowflake is a deal breaker.

Preferred Skills:

• Knowledge of data warehousing concepts.
• Experience with data visualization tools.
• Familiarity with containerization technologies (e.g., Docker).

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5-7 years of relevant experience in software development and data engineering.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.