Sr. Spark Lead Engineer

Candidate should be able to:
Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.
open to receiving feedback and constructive criticism.
Proficiency working with large data stores
understanding of Test Driven Development (TDD) or Pair Programming
Candidate should have:
Deep understanding of all aspects of database technologies - schema design, optimization, scalability, etc.
Excellent communication skills
passion for resolving user pain points through great design.
Track record of contributions to open-source software projects.
Experience in SDLC, especially testing and deployment.
Professional ETL experience using Spark (Python or Scala)
Experience in Software version control (e.g. git working knowledge or greater)
Experience in Unix-like operating system environment (proficient)
3+ years of CI/CD experience (Jenkins, Terraform, Cloud Formation, etc.)
4+ years of experience designing technical solutions using object-oriented design concepts.
3+ years of AWS solution engineering and architecture experience