--- title: Head Engineering at LlamaIndex in San Francisco, CA description: LlamaIndex is hiring for the Head Engineering role in San Francisco, CA. Pays $200K–$300K per year. See the full description and apply. type: job url: https://www.foundrole.com/jobs/head-engineering-at-llamaindex-01a11e01-f9f1-7fd2-b94d-c8a5c3a2f6a9 date: 2026-10-09T00:15:33Z og_description: Join LlamaIndex as Head Engineering in San Francisco, CA. Pays $200K–$300K per year. Full-time, hybrid role. og_image: https://www.foundrole.com/og/9lrtx4.png breadcrumbs: - label: Home url: https://www.foundrole.com/ - label: Search url: https://www.foundrole.com/jobs --- | | | |---|---| | **Company** | LlamaIndex | | **Location** | San Francisco, CA (Hybrid) | | **Salary** | $200K/yr - $300K/yr | | **Type** | Full Time | | **Posted** | Oct 08, 2026 | ## Description **Join us and help shape the future of AI by defining the narrative around document understanding.** ### About the Role LlamaIndex is hiring a Head of Engineering to lead and develop our engineering team as we build software that makes enterprise data useful for AI applications. You will own engineering execution, technical direction, hiring, and team development. You will work closely with company leadership and product teams to decide what we build, how we build it, and how we deliver it reliably to customers. This is a hands-on role. You should be comfortable reviewing code and architecture, debugging production issues, and writing code for critical systems. We are looking for someone who has shipped and operated B2B API products and understands both model serving and model training—from experimentation and evaluation to deployment and production operations. ### Responsibilities - Lead and develop our engineering team, setting clear priorities, ownership, and accountability. - Partner with company leadership to translate customer needs into a focused roadmap and deliver software predictably. - Stay directly involved in architecture, code reviews, production debugging, and implementation of critical changes. - Set technical direction across application services, APIs, data pipelines, and ML infrastructure, balancing immediate customer needs with long-term maintainability. - Work with ML engineers and researchers on model training, fine-tuning, evaluation, and deployment, ensuring model improvements translate into better production outcomes. - Guide model serving decisions across latency, throughput, GPU utilization, capacity, reliability, and inference cost. - Improve engineering practices for testing, observability, security, incident response, and releases. - Hire strong engineers, coach technical leaders and managers, and build a culture of direct communication, customer focus, and responsibility for results. ### Required Qualifications - Experience leading engineering teams in B2B SaaS, with responsibility for delivering and operating customer-facing products. - Experience leading multiple engineering teams or technical domains with complexity comparable to a 20–30-person organization. - Strong, current hands-on engineering skills: you can read and write production code, review architecture, and diagnose complex technical problems. - Practical familiarity with model serving and model training, including training or fine-tuning workflows, evaluation, deployment, and production operations. - Understanding of the tradeoffs between model quality, latency, throughput, GPU resources, reliability, and cost. - Strong background in backend systems, APIs, distributed systems, and cloud infrastructure. - A track record of hiring and developing engineers, setting clear expectations, and giving constructive feedback. - Good product judgment, including knowing when to move quickly and when to invest in correctness, reliability, and security. - Clear written and verbal communication with technical teams, customers, and company leadership. ### Preferred Qualifications - Experience scaling engineering at a Series A–C startup. - Experience with document processing, OCR, extraction, retrieval, indexing, or other systems that work with enterprise data. - Experience with LLMs or multimodal models, evaluation datasets, and model quality monitoring. - Experience with GPU infrastructure, distributed training, inference optimization, or model serving frameworks. - Experience building developer tools or API-first products. - Experience with enterprise requirements such as multi-tenancy, access controls, audibility, and security reviews. - Experience developing engineering managers while staying closely involved in technical execution. ***Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.*** ***LlamaIndex does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, employees, or any other organization location. LlamaIndex is not responsible for any fees related to unsolicited resumes.*** ## Skills - Debugging - Machine Learning Model Training - Access Controls - Document Processing - Customer Focus - Software Deployment - Code Review - Technical Direction - Machine Learning Model Fine-Tuning - Business-to-Business (B2b) Sales - Observability - Quality Monitoring - Inference Optimization - Distributed Training (Machine Learning) - Optical Character Recognition (Ocr) - Incident Response - Software Maintainability - GPU (Graphics Processing Unit) - Large Language Models (Llm) - Cloud Infrastructure - Leadership - API Design - Multi-Tenant Architecture - Software as a Service (SaaS) - Product Roadmaps - Security Review - Communication - Model Serving - GPU Infrastructure - Constructive Feedback - Multimodal AI - Data Pipeline - Distributed Systems ## Related - [Engineering jobs](https://www.foundrole.com/careers/engineering?utm_source=ai_markdown)- [Engineering Manager jobs](https://www.foundrole.com/careers/engineering/engineering-managers?utm_source=ai_markdown)- [Engineering Manager jobs](https://www.foundrole.com/careers/engineering/engineering-managers/engineering-manager?utm_source=ai_markdown)- [Browse all companies](https://www.foundrole.com/companies?utm_source=ai_markdown) ## Explore this job market - [California](https://www.foundrole.com/locations/us/california?utm_source=ai_markdown) — 273697 jobs - [Software Products](https://www.foundrole.com/sectors/technology/software-products?utm_source=ai_markdown) — 117900 jobs - [San Francisco, CA](https://www.foundrole.com/locations/us/california/san-francisco?utm_source=ai_markdown) — 27058 jobs ## Related pages - [California](https://www.foundrole.com/locations/us/california?utm_source=ai_markdown) — 273697 jobs - [Software Products](https://www.foundrole.com/sectors/technology/software-products?utm_source=ai_markdown) — 117900 jobs - [San Francisco, CA](https://www.foundrole.com/locations/us/california/san-francisco?utm_source=ai_markdown) — 27058 jobs ## Browse - [Companies](https://www.foundrole.com/companies?utm_source=ai_markdown) - [Jobs by country](https://www.foundrole.com/locations?utm_source=ai_markdown) - [Jobs in the United States by state and city](https://www.foundrole.com/locations/us?utm_source=ai_markdown) - [H1B sponsors by location](https://www.foundrole.com/h1b-sponsors?utm_source=ai_markdown) - [H1B salaries](https://www.foundrole.com/h1b-salaries?utm_source=ai_markdown) - [Sectors and industries](https://www.foundrole.com/sectors?utm_source=ai_markdown) - [Jobs by career field](https://www.foundrole.com/careers?utm_source=ai_markdown) - [Latest jobs](https://www.foundrole.com/jobs/latest?utm_source=ai_markdown)