Software Engineer - Infrastructure (Mid - Senior)
San Francisco, CA
Full Time
56 minutes ago
Mid LevelEngineeringWorldwide
Over $120K

USD per year

Job Description
  • Julius is an applied AI lab building coding agents.
  • Executes approximately 1 million lines of code every 36 hours for over 1 million users.
  • Has generated over 3 million visualizations.
  • All code runs in isolated remote containers (code sandboxes) managed by Julius.
  • Revenue-generating and backed by AI Grant, YCombinator, Bessemer Venture Partners, and founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

Role Summary:

  • Build and scale code-execution sandboxes across cloud environments (AWS and GCP).
  • Orchestrate over 500k containers per month with growing demand.
  • Own reliability, performance, and security for multi-tenant compute infrastructure.

Compensation & Benefits:

  • Competitive base salary range: $150K – $200K plus meaningful equity.
  • Benefits include health & dental insurance, gym reimbursement, daily team meals, commuter benefits.

Team & Impact:

  • Small senior team working on challenging infrastructure problems at meaningful scale.

What You’ll Do:

  • Design and operate secure multi-tenant container infrastructure with fast startup and smart autoscaling.
  • Ship cloud deployments (Helm/Terraform) with SSO network controls and audit logging.
  • Drive observability (metrics traces logs) with clear SLOs; lead incident response.
  • Optimize images scheduling networking cost; build fair-use and rate-limiting controls.

What You Bring:

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.
  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).
  • Monitoring/Logging (Prometheus Grafana OpenTelemetry ELK/Vector).
  • Security best practices for containerized multi-tenant systems.

Nice to Have:

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).
  • You’ve built an AI side project and enjoy tinkering with LLMs.
How to Apply
About Julius

Early stage AI lab based in San Francisco with a mission to build the most powerful AI tools for knowledge workers.

View Company Profile