Senior QA Engineer (Gen AI Platform)
Check out this video and find out why our team loves to work here!
Join Us! CDM Smith – where amazing career journeys unfold.
Imagine a place committed to offering an unmatched employee experience. Where you work on projects that are meaningful to you. Where you play an active part in shaping your career journey. Where your co-workers are invested in you and your success. Where you are encouraged and supported to do your very best and given the tools and resources to do so. Where it’s a priority that the company takes good care of you and your family.
Our employees are the heart of our company. As an employer of choice, our goal is to provide a challenging, progressive and inclusive work environment which fosters personal leadership, career growth and development for every employee. We value passionate individuals who challenge the norm, deliver world-class solutions and bring diverse perspectives. Join our team, and together we will make a difference and change the world.
Job Description
CDM Smith is seeking a Senior Quality Engineer to join our Digital Capital team. At CDM Smith, we see the value of what AI can bring to our company, and we are actively adopting and implementing co-pilots and Generative AI technologies to boost productivity across our business. As a Senior Quality Engineer you will be responsible for designing and implementing quality assurance processes to test AI models, applications, and infrastructure. You will collaborate with cross-functional teams to identify potential issues, optimize platform performance, and deliver high-quality AI-powered products that meet our use expectations.The ideal candidate for the Senior Quality Engineer role is a detail-oriented professional with a strong background in software testing and automation, coupled with a solid understanding of machine learning concepts. They have a proven track record of developing and executing comprehensive test plans, creating test automation frameworks, and ensuring the accuracy and performance of AI models. They are proactive and possess excellent communication skills that enable them to collaborate seamlessly with cross-functional teams and key stakeholders. Key responsibilities include: Develop, implement, and maintain test strategies for AI models, APIs, and user-facing applications. Create detailed test plans, test cases, and scripts to ensure comprehensive test coverage across the code base. Test the accuracy, robustness, and model drift of various large language models. Build and maintain automated testing frameworks for backend systems, APIs, and user interfaces. Implement automated pipelines for model validation and regression testing during deployments. Conduct load, stress, and performance testing to ensure application and AI models handle scaling efficiently. Identify, log, and track bugs using tools like Azure DevOps. Work closely with developers to troubleshoot and resolve issues. Ensure compliance with data privacy regulations and ethical AI guidelines. Maintain detailed documentation of testing processes, tools, and results.Skills and Abilities: Strong experience in software testing methodologies, tools, and processes. Hands on experience with test automation frameworks such as Deep Eval or Playwright. Knowledge of Python or JavaScript for test scripting. Familiarity with API testing tools like Postman or REST Assured. Knowledge of Azure and Azure Kubernetes. Familiar with CI/CD pipelines and integrating automated tests into deployment workflows. Proficient in performance testing tools such as JMeter. Experience working with agile delivery methodologies and working in an agile delivery team. Excellent communication skills to articulate test results and collaborate across teams. Proactive and self-motivated with a passion for maintaining high-quality standards. Curious. Stays abreast of current and upcoming technologies and tools.
Skills & Abilities
Advanced understanding and experience with all functions of the data management lifecycle including data governance, data architecture, data integration, metadata management, data development, data quality management, data administration, security & operations, data stewardship and master data management. Advanced knowledge of various data architecture modeling and implementation techniques to support transactional, relational, dimensional, and unstructured data requirements. Advanced with cloud platform tools and modern data architecture solution techniques such as cloud data warehousing, data lakes, and advanced query platforms is required. Excellent communication, project management and analytical skills. Expert knowledge of database design and implementation of databases. Proven technical skills and the ability to support a changing environment. Must be a team player. Experience with modern tools used for working with structured and unstructured data. Ability to visualize and communicate results clearly. Expert in manipulating SQL queries. Expert in the features, benefits and application of analytics and business intelligence products and comparable technology solutions. Proven experience with Agile Scrum methodologies.
Qualifications
Minimum 5 years of experience in related domain and bachelor's degree in computer science /information technology or any related specialization.
Amount of Travel Required
No Travel is required
Additional Compensation
All bonuses at CDM Smith are discretionary and may or may not apply to this position.Qualifications:Minimum 5 years of experience in related domain and bachelor's degree in computer science /information technology or any related specialization.Education:UNAVAILABLEEmployment Type: UNAVAILABLE