Consultant Software Engineer - AI Application Development

Role: Consultant Software Engineer/AI Application Developer
Type: Full-Time
Level: Mid to Senior (7-10 Years of Experience)

About the Role
We are looking for an experienced AI Application Developer to join our brand new "Data Lab" team within ISR (Information Security and Risk). You will design, build, and deploy intelligent systems leveraging modern AI architectures - from retrieval-augmented pipelines to fully autonomous agentic workflows. This is a unique opportunity to be a founding member of a team at the intersection of AI innovation and information security.

Key Responsibilities
- Design and develop AI-powered applications using LLMs (OpenAI, Anthropic, Azure OpenAI, etc.)
- Build and maintain RAG (Retrieval-Augmented Generation) pipelines including vector stores, chunking strategies, and embedding models
- Develop agentic solutions using frameworks such as LangChain, LangGraph, AutoGen, CrewAI, or Semantic Kernel
- Implement and integrate MCP (Model Context Protocol) servers and clients for tool-enabled LLM workflows
- Build and expose tools, APIs, and data connectors for use within agent runtimes
- Work with orchestration patterns: multi-agent systems, planning loops, memory management, and tool-use
- Evaluate LLM output quality, implement guardrails, and optimize prompt engineering
- Design and develop full stack applications spanning backend (Python / .NET) and frontend (React) layers
- Architect and deploy solutions on cloud platforms (AWS and/or Azure)
- Collaborate with data engineers and backend teams to integrate AI capabilities into production systems

What We're Looking For
Someone who stays current with fast-moving AI tooling, can prototype quickly, and translate AI capabilities into reliable production features. You are comfortable working at both the infrastructure and application layer of AI systems, and bring a full stack mindset to building secure, scalable, production-grade AI solutions.

Required Skills
- 7-10 years of overall software development experience
- 1-3 years of hands-on experience working in the AI/ML domain
- Strong full stack development experience: Python and/or .NET on the backend, React on the frontend
- Cloud platform experience: AWS (Bedrock, Lambda, S3, etc.) and/or Azure (Azure OpenAI, Azure ML, AKS, etc.)
- Hands-on experience building RAG pipelines (LlamaIndex, LangChain, or custom)
- Experience with vector databases (Chroma, Qdrant, Weaviate, pgvector, etc.)
- Familiarity with MCP and tool/function calling patterns in LLM applications
- Experience designing agentic workflows (ReAct, plan-and-execute, multi-agent)
- REST API development (FastAPI / Flask / ASP.NET)
- Understanding of prompt engineering, context window management, and LLM evaluation

Nice to Have
- Familiarity with observability tools for LLM apps (LangSmith, Arize, Helicone)
- Knowledge of fine-tuning or RLHF workflows
- Exposure to MCP server development (SSE / stdio transport)
- Containerization with Docker / Kubernetes
- Experience working in the cyber domain or having cyber knowledge will be an added advantage