Senior Software Engineer, Go - LLM Team
United States / Remote (US)
Full Time
48 minutes ago
Senior LevelEngineeringWorldwide
Over $120K

USD per year

Job Description

Senior Software Engineer, Go - LLM Team

$180K - $240K3 United States / Remote (US) Job type Full-time Role Engineering, Full stack Experience 6+ years Visa US citizen/visa only Skills Go, Python

About the role

About AssemblyAI

AssemblyAI builds the best-in-class Speech AI models powering the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2 billion+ end-user experiencesfrom voice agents and meeting assistants to contact centers and medical scribes. Companies like Zoom, Granola, Fireflies, Cluely, and Calabrio rely on AssemblyAI to ship production-ready voice AI. We're at an inflection point in Speech AI. We released Universal-Streaming in mid-2025, and it has quickly earned its place as the model offering the best accuracy-latency-cost tradeoff on the market. Our research team drives these advances and ships with relentless velocity. Since releasing Universal-Streaming, we've already launched keyterms prompting feature and multilingual supportwith more significant improvements on the roadmap. We've raised $115M+ from Accel, Insight Partners, Y Combinator's AI Fund, Patrick and John Collison, Nat Friedman, and Daniel Gross. We're a remote team building one of the next great AI companiesand we're looking for people who will shape its future. About the Role We're seeking an exceptional Senior Software Engineer to join our LLM team. This role is focused on building and maintaining our LLM gateway servicea unified API platform that connects customers to multiple LLM providers. You'll work on high-impact projects that directly solve customer problems, improve their AI and agentic workflows, and ensure reliable access to the best models for their use cases. This is a deeply customer-focused role. You'll work closely with our customer success team to understand customer challenges, help optimize their prompt strategies, build features that address their pain points, and ensure our service reliably delivers value. We're looking for someone who combines software engineering excellence with genuine curiosity about how customers use AI and a drive to make their lives better. As a Senior Engineer, you'll drive technical execution within the team, taking ownership of significant features and integrations while mentoring more junior engineers. You should be passionate about writing clean, maintainable code, implementing comprehensive testing strategies, and building highly reliable systems in service of solving real customer problems. This role requires close collaboration with customer success, product managers, external API providers, and other engineering stakeholders. You'll need to balance technical excellence with pragmatic delivery in a fast-paced startup environment where uptime, reliability, and customer success are critical. What You'll Do Solve Customer Problems

  • Partner closely with the customer success team to understand customer use cases, challenges, and integration needs
  • Translate customer pain points surfaced by the CS team into technical solutions and product improvements
  • Build features and tooling that directly address customer needs and improve their workflows
  • Provide technical guidance and expertise to the customer success team to help them support customers effectively

Drive Technical Execution

  • Own and deliver complete features and integrations within our LLM gateway service
  • Build and maintain integrations with multiple LLM providers and AI services (OpenAI, Anthropic,...
How to Apply
About AssemblyAI

AssemblyAI builds the most accurate, fully featured speech-to-text and speech understanding models on the market, enabling developers to ship groundbreaking Voice AI products quickly and scale with ease. Their products include Speech-to-Text, Streaming Speech-to-Text, Speech Understanding, LLM Gateway, Guardrails, and Speech-to-Speech. AssemblyAI's models lead the industry in accuracy and reliability with the industry's lowest Word Error Rate (WER), up to 30% fewer hallucinations than other providers, and are preferred by 73% of end users in unbiased evaluations. They provide a full suite of speech understanding capabilities such as advanced speaker diarization, automatic text and alphanumeric formatting, and multilingual speech detection. AssemblyAI serves over 600 million inference calls and 840 million API calls per month, processing over 40 terabytes of audio daily. The platform is designed to be easy for developers to start with and scale on, offering pay-as-you-go pricing without contracts or throttles. Their technology is used by top Voice AI companies including startups and Fortune 500 organizations to unlock the power of voice data and launch best-in-class products.

View Company Profile