Posted 08 July, 2026
AWS Devops-Nvidia
Diverse Lynx
Karnataka
Full Time
Reference: 365_569689_26-00996
- Design, deploy, and maintain scalable DevOps infrastructure on AWS, supporting data engineering and analytics workloads across production environments.
- Manage and optimize Apache Airflow workflows for orchestration, scheduling, monitoring, and failure recovery of batch data pipelines.
- Support Amazon EMR clusters for large-scale distributed data processing, including cluster provisioning, configuration, job monitoring, and cost optimization.
- Deploy and operatecontainerized applications on Kubernetes, managing workloads, services, configurations, secrets, and autoscaling.
- Build and maintain CI/CD pipelines to automate application deployment, infrastructure changes, and data platform releases.
- Implemented infrastructure automation using tools such as Terraform, CloudFormation, or AWS CLI to improve consistency and reduce manual operations
- Monitor system health, pipeline performance, cluster utilization, and application logs using AWS-native and third-party observability tools.
- Troubleshoot production issues across Airflow DAGs, EMR jobs, Kubernetes pods, and AWS services to ensure platform reliability.
- Improved reliability and uptime by implementing alerting, retry strategies, failure notifications, and operational runbooks.
- Collaborate with data engineers, application teams, and cloud infrastructure teams to support secure and scalable data platform operations.
- Manage AWS resources including EC2, S3, IAM, CloudWatch, VPC, EMR, EKS, and related networking/security components.
- Implement access controls, IAM roles, secrets management, and security best practices across cloud and Kubernetes environments.
- Optimize cloud costs by tuning EMR cluster sizing, Kubernetes resource requests/limits, autoscaling policies, and AWS resource usage.
- Support environment deployments across development, staging, and production with standardized release and rollback procedures.
- Maintain documentation for deployment processes, incident response, infrastructure architecture, and operational procedures.
