Senior Data Engineer
About The Client:
Client is a pioneering Software Engineering and IT consultancy company, transforming and executing at the intersection of Domain and Technology to create digital leaders for our people, clients, partners, and communities.
About The Job:
- Experience: 8 – 10 years
- We are looking for a Senior Data Engineer to design, build, and maintain scalable data pipelines that power analytics and downstream customer systems.
- You will work closely with product, analytics, and platform teams to ingest, process, and transform large volumes of customer, booking, and operational data using modern cloudnative data engineering practices.
- This role requires strong hands-on expertise in Python, workflow orchestration, and cloud data platforms, along with the ability to shape robust canonical data models and high-quality metrics.
Essential Job Functions:
Data Pipeline Design & Development
- Design, build, and optimize scalable ETL/ELT pipelines using Python.
- Ingest data from multiple sources including customer, booking, and operational systems.
- Implement robust data validation, cleansing, and transformation logic.
- Use Apache Airflow to schedule, orchestrate, monitor, and manage data workflows.
- Ensure reliability, fault tolerance, and observability of pipelines.
- Use Google Cloud Storage (GCS) to manage and store customer data files securely.
- Build and maintain analytics-ready datasets in BigQuery.
- Optimize queries, partitions, and cost-performance trade-offs in BigQuery.
- Develop and maintain modular, version-controlled SQL transformations using dbt.
- Create and manage Canonical Data Models (CDM) to ensure consistency across datasets.
- Define, calculate, and publish standardized business metrics.
- Prepare and upload curated datasets and metrics to downstream customer systems.
- Ensure data quality, timeliness, and contractual SLAs are consistently met.
- Implement data quality checks, monitoring, and alerting.
- Follow best practices for version control, testing, documentation, and CI/CD for data pipelines.
- Collaborate with stakeholders to define data contracts and schemas.
- Mentor junior data engineers and review code for quality and performance.
- Partner with analytics, product, and platform teams to translate business needs into data solutions.
Qualifications:
Technical Skills
- Strong proficiency in Python for data processing and pipeline development.
- Hands-on experience with Apache Airflow for workflow orchestration.
- Advanced SQL skills; hands-on experience with dbt for data transformations.
- Strong experience with BigQuery or similar cloud data warehouses.
- Experience working with GCS or equivalent cloud object storage.
- Solid understanding of ETL/ELT patterns, data modeling, and analytics engineering.
- Data Engineering Concepts
- Experience designing canonical data models and metric layers.
- Strong understanding of data quality, validation, and observability.
- Familiarity with CI/CD practices for data pipelines.
- Strong problem-solving and analytical skills.
- Ability to work independently in ambiguous environments.
- Excellent communication skills for working with technical and non-technical stakeholders.
- Experience with customer-facing data integrations.
- Exposure to SRE or reliability practices for data platforms.
- Familiarity with cloud security and data governance standards.
- Experience working in high-scale or regulated data environments
How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
