Senior/Lead Software Engineer - Java/Scala, Spark, SQL, AWS, Python

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. As a Senior/Lead Software Engineer, you will be working as part of a DevOps team focusing on analyzing, developing, testing, and supporting Big Data applications.Your primary objective is to ensure project goals are achieved and are aligned with business objectives. You will also work closely with your Scrum team and program team to test, develop, refine, and implement quality software in production via standard Agile methodologies.

Responsibilities

• Hands-on developer to design, code, and test iteratively to support complex big data applications deployed on Cloud Infrastructure (AWS).
• Plan, develop, execute, and maintain the automated unit, and functional test cases; develop modular, robust, and maintainable automation scripts to integrate with the CICD process.
• Must have strong analytical and technical skills with a passion for deep dive on data in troubleshooting, devising techniques for problem resolution.
• Support product owner in defining future stories and tech lead in defining technical requirements for new initiatives
• Build platform reusable code and components that could be used by multiple project teams.
• Promote a culture of best practices with peer code reviews and extreme ownership for continuous incremental delivery.
• Collaborate with cross-functional teams and stakeholders to align development objectives with broader business goals

Key Skills: Domain Expertise

• 6+ years of hands-on software development with a bachelor’s degree in computer science, engineering
• Must have strong cloud Implementation expertise in cloud architecture.
• Must have very good knowledge of storage, network, and AWS. Have sound
• knowledge in multi-zone, region-based designs.
• Must have the ability to provide solutions utilizing best practices for resilience,
• Scalability, cloud optimization and security.

Technical Skills

• Extensive programming experience and desire to write and review code 70% of time.
• 6+ years of experience working with Java and Scala with appreciation for Object Oriented and functional programming paradigms. Familiarity with Python is a plus.
• Hands-on experience with Spark, Spark SQL, Spark on K8s, M/R Framework and Big Data Technology Stack.
• Experience developing cloud-hosted (AWS), containerized applications and services.
• AWS Components: EKS, EMR, EC2, S3 storage, Lambda, Relational Database Service, Simple Notification Service (SNS), Elasticache, etc.
• Familiarity with Relational and Big data storage technologies: RDS, Postgres and columnar Storage.
• Demonstrates knowledge of CI/CD processes, testing frameworks, practices and tools (Jenkins, jUnit, Terraform, JFrog, Jacoco, SonarQube, of Linux platforms with knowledge of shell scripting.
• Knowledge of networking and protocols: HTTP/HTTPS, TLS/SSL/certificates, TCP/IP
• Experience with source code control tools. Gitlab experience is a plus.