Data engineering

About The Job:

• As a Backend Developer, you will play a crucial role in designing, developing, and optimizing robust backend solutions. You will leverage your expertise in AWS and Snowflake to build scalable data pipelines, streamline data management processes, and ensure high performance, reliability, and security.
• The ideal candidate will have strong expertise in AWS data services, Snowflake, ETL processes, Python development, SQL optimization, and enterprise application development in Agile environments.

Essential Job Functions:

• Design, develop, and optimize scalable backend solutions using AWS and Snowflake technologies.
• Build and maintain scalable data pipelines and streamline data integration processes.
• Work extensively with AWS services including:
  • CloudWatch
  • AWS Lambda
  • AWS Glue
  • EMR Clusters
• Analyze daily batch loads, production issues, and escalations, taking necessary actions to ensure service continuity.
• Develop a deep understanding of complex job workflows and data flows within the project.
• Document, analyze, and simulate complex technical issues for troubleshooting and resolution.
• Work within Agile development methodologies and participate in sprint planning, reviews, and retrospectives.
• Support AEDL Dashboard setup and monitoring activities.
• Design, develop, and maintain scalable enterprise applications using Python and the Django framework.
• Build reusable frameworks, APIs, and components to accelerate application development.
• Develop and implement automation solutions to improve operational efficiency and reduce manual effort.
• Write, optimize, and troubleshoot complex SQL queries, stored procedures, and database solutions.
• Perform data analysis, statistical modeling, and reporting using R programming language.
• Collaborate with business users, QA teams, and cross-functional stakeholders to gather requirements and deliver solutions.
• Ensure application performance, security, scalability, and adherence to coding standards and best practices.
• Lead code reviews and provide technical mentorship to junior developers.
• Implement CI/CD pipelines, version control practices, and deployment processes.
• Contribute to architecture discussions, technology improvements, and innovation initiatives.

Qualifications:
Required Technical Skills

• Strong experience with AWS services including CloudWatch, Lambda, Glue, and EMR Clusters.
• Expertise in Snowflake administration and performance tuning concepts.
• End-to-end knowledge of ETL processes and data pipeline development.
• Strong experience in Python development.
• Hands-on experience with Django framework.
• Experience building RESTful APIs and backend services.
• Strong expertise in SQL query development, optimization, and database programming.
• Experience in data analysis and reporting using R programming.
• Knowledge of CI/CD pipelines and deployment automation.
• Experience with version control systems such as Git.
• Understanding of Agile development methodologies.
• Experience with application performance tuning and troubleshooting.
• Knowledge of data warehousing, data integration, and cloud-based analytics solutions.
• Experience monitoring production systems and handling incident management activities.
• Experience with AEDL Dashboard setup is preferred.

Key Competencies

• Backend Development.
• AWS Cloud Engineering.
• Snowflake Data Engineering.
• ETL and Data Integration.
• Problem Solving and Root Cause Analysis.
• Technical Leadership and Mentoring.
• Performance Optimization.
• Agile Delivery.
• Cross-Functional Collaboration.

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards: Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions.

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA.

Equal Opportunity Employer:

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.