Lead II - Data Engineering - Kafka
About The Client:
Client is a leading digital transformation solutions provider and IT services company with over 30,000 employees across 30+ countries. Headquartered in Aliso Viejo, California, it helps Fortune 500 and Global 1000 clients with digital, cloud, AI, cybersecurity, and engineering services.
body { font-family: Calibri, sans-serif; font-size: 12pt; }
Essential Job Functions:
- Develop, and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services.
- Configure and manage Kafka connectors, ensuring seamless data flow and integration across systems.
- Demonstrate a strong understanding of the Kafka ecosystem, including producers, consumers, brokers, topics, and schema registry.
- Design and implement scalable ETL/ELT workflows to process large volumes of data efficiently.
- Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue.
- Implement robust monitoring, testing, and observability practices to ensure data platform reliability and performance.
- Uphold data security, governance, and compliance standards across all data operations.
Qualifications:
Requirements
- Minimum of 5 years of experience in data engineering or related roles.
- Proven expertise with Apache Kafka and the AWS data stack (MSK, Glue, Lambda, S3, etc.).
- Proficient in coding with Python, SQL, and Java (Java strongly preferred).
- Person needs to flexible to write code in Python/Java
- Experience with infrastructure-as-code tools (e.g. CloudFormation) and CI/CD pipelines.
- Excellent problem-solving skills and strong communication and collaboration abilities.
Skills
- kafka
- aws lambda
- java
- apache kafka
- aws
- python
- sql
How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
0-2 years INR 5,000
2-6 years INR 7,500
6+ years INR 10,000
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
