Job Description
Note: The job is a remote job and is open to candidates in USA. Cresta is on a mission to turn every customer conversation into a competitive advantage by unlocking the true potential of the contact center. The Senior Software Engineer will build real-time AI agent infrastructure, solve distributed systems problems, and enhance developer experience while ensuring high production quality.
- Responsibilities
- Build real-time AI agent infrastructure: Design and operate the stateful, low-latency runtime that powers voice and chat AI agents — from LLM streaming and conversation state management to graceful recovery and multi-channel support
- Solve distributed systems problems: Own session management across scaled-out workers — including affinity, checkpointing, crash recovery, and consistency under concurrent access
- Build a function execution platform: Own a serverless-style runtime where customers deploy custom logic — build orchestration, container lifecycle, autoscaling, and versioned rollouts
- Own developer experience and test infrastructure: Build CLI tools, local development environments, and test execution frameworks that let engineers iterate quickly and ship with confidence
- Raise the bar on production quality: Drive observability, incident response, and engineering best practices across the team
- Skills
- 5+ years of software engineering experience, with meaningful time spent on infrastructure, platform, or systems work
- Strong Python and Go — both are core to this role, not one primary and one secondary
- Deep understanding of distributed systems: consistency, fault tolerance, state management, concurrency
- Experience with Kubernetes and cloud-native infrastructure
- Experience building developer-facing tooling — CLIs, SDKs, local dev environments, or internal platforms
- Strong communicator who can drive technical decisions, write clear design docs, and mentor others
- High bar for code quality — thorough testing, thoughtful code review, and sustainable engineering practices
- Comfort operating what you build — on-call, incident response, and production ownership
- AI-native workflow — you actively use LLMs and AI-assisted tools in your daily development, and can leverage them to move faster and tackle problems that would otherwise be impractical
- Experience with real-time voice or streaming media systems
- Hands-on with LLM integration — streaming inference, prompt orchestration, retrieval-augmented generation
- Experience building serverless or function-as-a-service platforms
- Workflow engines (Temporal, Argo, Airflow) for durable, long-running processes
- Experience in conversational AI or speech domains
- Infrastructure-as-code and GitOps workflows
- Benefits
- We offer Cresta employees a variety of medical, dental, and vision plans, designed to fit you and your family’s needs
- Paid parental leave to support you and your family
- Monthly Health & Wellness allowance
- Work from home office stipend to help you succeed in a remote environment
- Lunch reimbursement for in-office employees
- PTO: 3 weeks in Canada
- Company Overview
- Cresta uses artificial intelligence to assist sales and service agents in the quality of customer service. It was founded in 2017, and is headquartered in Palo Alto, California, USA, with a workforce of 201-500 employees. Its website is https://www.cresta.com.
- Company H1B Sponsorship
- Cresta has a track record of offering H1B sponsorships, with 9 in 2025, 6 in 2024, 2 in 2023, 10 in 2022, 4 in 2021, 3 in 2020. Please note that this does not guarantee sponsorship for this specific role.
Apply tot his job
Apply To this Job