Software Engineer, Enterprise

Location: London, UK

Role Overview:

• Backend Engineer to build core infrastructure powering AI products for large enterprises.
• Design scalable APIs, distributed data systems, and deployment pipelines for production-grade reliability and performance.
• Focus on backend and infrastructure challenges in GenAI systems at enterprise scale.

Responsibilities:

• Design, build, and scale backend systems for enterprise GenAI products focusing on reliability, performance, and deployment.
• Develop core services and APIs integrating AI models and enterprise data securely and efficiently.
• Architect scalable distributed systems for data processing, inference, and orchestration of large-scale GenAI workloads.
• Optimize backend performance for latency, throughput, and cost across hybrid and multi-cloud environments.
• Manage and evolve cloud infrastructure (AWS, Azure, or GCP) with automation, observability, and security.
• Collaborate with ML and product teams to bring GenAI models into production via APIs, model serving systems,

and evaluation frameworks.

• Continuously improve reliability and scalability applying strong engineering practices.

Qualifications:

• 4+ years experience in large-scale backend or infrastructure systems emphasizing distributed services,

reliability, and scalability.

• Proficiency in Python or TypeScript; experience with FastAPI,

Flask, Express, or NestJS frameworks.

• Deep familiarity with cloud infrastructure (AWS preferred), container orchestration (Kubernetes,

Docker), Infrastructure-as-Code tools like Terraform.

• Experience managing relational and NoSQL databases (PostgreSQL,

DynamoDB) and building data pipelines.

• Hands-on experience with GenAI applications including deployment,

evaluation, scaling AI workloads in production.

• Strong understanding of observability,

CI/CD, security best practices for enterprise/multi-tenant environments.

• Ability to balance rapid iteration with production-grade quality in fast-paced environments.
• Collaborative mindset working closely with ML,

infra, product teams.

Additional Notes:

• 90-day waiting period policy before reconsidering candidates for the same role.

About Scale AI:

• Mission: Develop reliable AI systems for critical decisions worldwide.
• Products power leading models; work with enterprises/governments like Meta,

Cisco, Mayo Clinic, US Army/Air Force.

• Inclusive equal opportunity workplace committed to accommodations for disabilities.