Software Engineer, Infrastructure

The role

You will design, build, and maintain core systems for an AI platform. The role focuses on making infrastructure secure, reliable, and scalable.

What you will do

• Ensure reliability, scalability, and performance of platform and LLM inference serving
• Build and maintain cloud infrastructure using Terraform
• Create and maintain a self-serve infrastructure platform
• Own and evolve CI/CD pipelines and release management
• Architect and operate distributed systems using distributed databases, retrieval systems, and ML models
• Develop and maintain core data serving abstractions with authentication and security features
• Integrate stack with enterprise customer environments
• Enhance observability tooling
• Lead and participate in incident management

Required qualifications

• 5–7+ years of hands-on development experience in highly technical products
• Inclination towards building automation, tooling, and platform
• Experience with cloud platforms (AWS, GCP, or Azure)
• Experience with infrastructure as code
• Hands-on expertise in CI/CD systems, release management, and container orchestration (e.g., Docker, Kubernetes)
• Experience with observability tools (Prometheus, Grafana, Datadog, OpenTelemetry, etc.)
• Experience in incident response and operating distributed systems in production
• Degree in Computer Science or related field, or equivalent professional experience

Nice to have

• Production experience working with LLMs and machine learning models
• Background in distributed systems, running SaaS services at scale, and agentic architecture
• Familiarity with security and authentication protocols (OAuth, SSO, mTLS)
• Previous experience in a fast-paced startup environment or platform/infra-focused team
• Terraform

Benefits

• Flexible (unlimited) paid time off
• Medical, dental, and vision benefits for you and your family
• Life insurance and disability benefits
• Retirement plan dependent on country of employment
• Parental leave
• Fertility and family building benefits
• Lunch, snacks, and coffee when working onsite
• Discretionary benefit stipend
• Free alphorn lessons
• Equity plans for eligible full-time employees

About the company

Sierra is a platform for customer-facing AI agents working with brands like The GAP, Rocket Mortgage, SoFi, Sutter Health, and SoftBank. It is an in-person company based in San Francisco.