Senior Software Engineer II(Go,AI)
We are looking for a Senior Software Engineer II (IC4) who is passionate about distributed systems orchestration, high-throughput API design, and building the multi-tenant control plane that powers AI Agents.
As a Senior Software Engineer II (IC4) at DigitalOcean, you will join a dynamic engineering team dedicated to revolutionizing cloud computing and AI. In this role, you will report directly to the Senior Engineering Manager of the Agents team. You will act as the technical anchor for the team responsible for the Agents platform that allows our customers to build/migrate, deploy and use their agents efficiently on our cloud, while we take over management of these agents. You will design and develop the "brain" of the product, interfacing directly with customer facing SDK's/CLI's/UI/UX and coordinating with underlying internal virtualization services to deliver a seamless, secure, and scalable developer experience. This is a hands-on role, requiring you to be able to develop/mentor high quality software while availing of all the productivity boosts granted by the latest AI coding agents.
What You'll Do
- Technical Leadership: Act as a technical leader on the team, driving the end-to-end design, development, and delivery of critical control plane and data plane components of a multi-tenant platform that hosts a large number of AI agents.
- Design and scale the core platform using Go, managing the global state, session lifecycles, agent memory, complex state synchronization, human in the loop workflows, history management, tight integrations with popular agents (e.g. Claude code, open code, codex etc.) and agentic frameworks like Langchain, Langraph, crew.ai etc. for millions of user requests.
- Implement and optimize robust multi-tenant services, API gateways and authentication layers to securely isolate customer workloads, rate-limit abuse, and track usage for billing, while maintaining sub-20ms overhead.
- Own the developer interface, optimizing how the control plane surfaces real-time execution telemetry, structured logging pipelines, and token streaming back to the user's application.
- Collaboration: Work cross-functionally with Product Managers, customer-facing teams, and other engineering teams to align technical roadmaps with customer needs.
- Mentorship: Coach and mentor junior engineers, fostering a culture of technical excellence and continuous improvement.
- Operational Excellence: Maintain and operate critical, high-scale services, utilizing observability tools and defining SLOs to ensure superior platform health and a 99.99% uptime.
What You'll Add to DigitalOcean
- Distributed Systems Mastery: 8+ years of professional software engineering experience working on microservices, messaging systems, databases, and infrastructure as code, with a heavy emphasis on building large-scale SaaS or PaaS products using Go or similar backend languages.
- AI/ML Domain Knowledge: Hands-on experience integrating with LLMs or multimodal models, creating, managing & operating Agentic workloads for high scale customers - managing complex multi-day agent session lifecycles, pause/resume transitions, fan-out live agent token streams from agents directly to developer CLI and Web UI clients using Kafka, SSE, sub-second responsiveness for inline Human-in-the-Loop (HITL) approvals and state transitions are constructs you have already built or have a working knowledge of.
- API & Proxy Expertise: Proven experience building high-throughput REST/gRPC APIs, custom reverse proxies, or network routers handling concurrent connection scaling.
- Orchestration & State Management: Practical experience with cluster schedulers (Kubernetes, Nomad), service meshes, or distributed key-value stores (Redis, Consul, Etcd) for real-time state tracking.
- Data Layer Architecture: Strong experience modeling application state in relational dbs like PostgreSQL or MySQL and designing high-volume telemetry ingestion pipelines using data stores like Snowflake, ClickHouse etc.
- Product-First Mindset: Experience building products designed for other developers (APIs, SDKs, Cloud Consoles) with a deep empathy for developer workflows and latency constraints.
- Cloud Operations: Proven experience shipping customer-facing software products and running critical services in a high-scale environment similar to DigitalOcean.
- Preferred Attributes: Familiarity with the unique orchestration challenges of Agentic AI, LLM frameworks (LangGraph, OpenAI Agents SDK, CrewAI), Model Context Protocol (MCP), or Human-in-the-Loop (HITL) primitives.
*This job is located in Hyderabad, India
#LI-Hybrid