Palo Alto, United States
Software Engineer - Cloud
Ollama · Palo Alto · United States
- Contract
- Full time
- Occupation
- Software Engineer
Posted: 7/9/2026 · Last checked: 11/17/2026
Job description
Quoted in full from Ollama's job posting. Gavroche does not edit it.
Ollama is the most popular way for developers to access open models. What started as an open-source, local-first runtime is now the largest developer network in the open-model ecosystem: 8.9 million monthly active developers and over 67,000+ community-built integrations. We're backed by Y Combinator, Benchmark, 8VC, and Theory Ventures.
Our team is small and talent dense. We're flat, low-ego, and fast-moving. We like people who are truth-seeking, passionate, design-driven, and who enjoy shipping code.
About the role
You'll build Ollama’s cloud, a scalable inference platform that lets developers run large, capable open models in their workflow. You'll work on high-throughput, low-latency distributed systems — inference serving, GPU fleet management, routing, metering, and the platform that Pro, Max, Team, and Enterprise customers rely on to process trillions of tokens.
What you'll do
Build and scale the inference platform that serves every request from ollama.com.
Design the routing and capacity layer that places workloads across GPUs and regions for cost, latency, and availability.
Own multi-tenant infrastructure: isolation, quotas, usage metering, billing, and Pro/Max/team/enterprise tiering.
Build the reliability, observability, and cost controls for our team and customers
You may be a fit if
You have deep experience with high-throughput, low-latency distributed systems — inference serving, traffic routing, real-time data pipelines, or large-scale APIs.
You're comfortable with cost/performance tradeoffs at scale and have owned a production service end-to-end.
You've worked with Kubernetes, GPU scheduling, or inference infrastructure.
You think in terms of reliability, SLOs, and honest capacity planning.
Bonus: experience building an inference platform, GPU fleet management, or billing/metering for an AI service.
From Gavroche data
Figures computed from live adverts on Gavroche; the job text above is the employer's.
Similar roles in Palo Alto
- Software Engineer - Super Intelligence · SpaceXAI, Palo Alto
- Software Engineer - Consumer Subscriptions · SpaceXAI, Palo Alto
- Software Engineer - Backend · Nace AI, Palo Alto
- Software Engineer - Virtual Platform · Rubrik Job Board, Palo Alto
- Software Engineer - Apps & Agents · Ollama, Palo Alto
- Developer Relations · Ollama, Palo Alto
200 open roles like this one; at most three per employer shown.
What software engineer adverts in the United States state
Middle half: 155,000 – 222,325 USD a year; median 193,000 USD.
From 2254 adverts by 392 employers that state a salary, annualised.
How software engineer roles in the United States are worked
1% fully remote · 1% hybrid · 98% do not say
Of 1033 adverts. An advert that does not state a work mode is counted as not saying, not as on-site.
New openings in Palo Alto, by week
- 8/24/2026 36
- 8/31/2026 31
- 9/7/2026 28
- 9/14/2026 33
- 9/21/2026 41
- 9/28/2026 49
- 10/5/2026 51
- 10/12/2026 62
- 10/19/2026 71
- 10/26/2026 45
- 11/2/2026 71
- 11/9/2026 48
- 11/16/2026 3
569 openings over 12 weeks, by the week they were published.
Other roles at Ollama
- Software Engineer - Customer Experience · Palo Alto
- Developer Relations · Palo Alto
- Software Engineer - Apps & Agents · Palo Alto
- Software Engineer - Runtime · Palo Alto
- Account Executive · Palo Alto
- GTM Engineer · Palo Alto
6 open.