Palo Alto, United States
Software Engineer - Core Platform
Elorian · Palo Alto · United States
- Salary
- $300,000–$450,000 per year
- Contract
- Full time
- Occupation
- Software Engineer
Posted: 10/17/2026 · Last checked: 11/17/2026
Job description
Quoted in full from Elorian's job posting. Gavroche does not edit it.
About Us
We are a well-funded, early-stage AI lab focused on building the next generation of frontier multimodal AI models. Founded by former DeepMind researchers, including Andrew Dai, who was previously a leader on Gemini. Our team currently consists of 20 world-class scientists and engineers. We recently raised $55M in seed funding from Striker Ventures, Menlo Ventures, Altimeter Capital, and NVIDIA. We are tackling some of the hardest problems in artificial intelligence, and we are growing fast.
About the role
We’re looking for a Software Engineer to design, scale, and harden the core distributed systems behind Elorian’s frontier multimodal models. Our models can only advance as fast as the systems underneath them.
You’ll build the backbone that connects research to production: distributed training and evaluation, and low-latency inference for visual reasoning. You’ll work directly with researchers, who then spend their time on model capabilities rather than infrastructure.
What you will do
Distributed core systems: Build and own high-throughput, low-latency services, async job execution engines, and streaming pipelines for training, evaluation, and inference on large-scale image and video data.
Fleet performance: Improve utilization, concurrency, and inter-service communication across large GPU clusters.
Reliability and scaling: Design for fault tolerance, automated node recovery, capacity planning, and auto-scaling across multi-cloud and bare-metal environments.
Safe delivery and observability: Own the operational lifecycle: CI/CD with canary releases, SLOs/SLIs, runbooks, and blameless on-call.
Load and capacity testing: Build benchmarking harnesses that simulate 10-100x load spikes, and fix the concurrency, network, and memory bottlenecks they expose.
Research-to-production interface: Work with research scientists to turn new visual reasoning capabilities into stable, ergonomic APIs and internal research platforms.
What we are looking for
3+ years designing, shipping, and operating distributed backend systems in production at high data volume and traffic
Strong systems fundamentals: concurrency, networking, memory management, event-driven architecture, and fault-tolerant design
Strong proficiency in C++ and Python
Experience running production services: on-call, incident response, runbooks, and good telemetry and alerting
Hands-on experience with infrastructure as code (e.g. Terraform), containers, and orchestrators (Kubernetes, Slurm, or Ray)
High agency: comfortable with ambiguity, and able to balance speed against long-term stability.
Nice to have
Experience at a frontier AI lab, research institute, or platform team supporting foundation models
Experience building data pipelines or serving systems for multimodal models
Familiarity with PyTorch and Rust, and with serving or training runtimes such as vLLM
Exposure to accelerator networking (InfiniBand, RoCE), distributed file systems, multi-tenant isolation, or usage metering
Logistics
Location: Palo Alto, CA (on-site)
Type: Full-time
Compensation: $300k – $450k + meaningful equity stake + full health/wellness benefits
From Gavroche data
Figures computed from live adverts on Gavroche; the job text above is the employer's.
Similar roles in Palo Alto
- Software Engineer - Super Intelligence · SpaceXAI, Palo Alto
- Software Engineer - Consumer Subscriptions · SpaceXAI, Palo Alto
- Software Engineer - Backend · Nace AI, Palo Alto
- Software Engineer - Virtual Platform · Rubrik Job Board, Palo Alto
- Software Engineer - Customer Experience · Ollama, Palo Alto
- Software Engineer - Runtime · Ollama, Palo Alto
200 open roles like this one; at most three per employer shown.
What software engineer adverts in the United States state
Middle half: 155,000 – 222,325 USD a year; median 193,000 USD.
From 2254 adverts by 392 employers that state a salary, annualised.
How software engineer roles in the United States are worked
1% fully remote · 1% hybrid · 98% do not say
Of 1032 adverts. An advert that does not state a work mode is counted as not saying, not as on-site.
New openings in Palo Alto, by week
- 8/24/2026 36
- 8/31/2026 31
- 9/7/2026 28
- 9/14/2026 33
- 9/21/2026 41
- 9/28/2026 49
- 10/5/2026 51
- 10/12/2026 62
- 10/19/2026 71
- 10/26/2026 45
- 11/2/2026 71
- 11/9/2026 48
- 11/16/2026 3
569 openings over 12 weeks, by the week they were published.
Other roles at Elorian
- Research Scientist - Multimodal Foundation Models & Visual Reasoning · Palo Alto
- Executive Assistant to the CEO · Palo Alto
2 open.