--- title: Technical Program Manager, AI2, TPU Software at Google description: Google is hiring for the Technical Program Manager, AI2, TPU Software role in Sunnyvale, CA. See the full description and apply. type: job url: https://www.foundrole.com/jobs/technical-program-manager-ai2-tpu-software-at-google-01a15370-8064-782e-8a3f-d75a8624777d date: 2026-11-15T01:26:44Z og_description: Join Google as Technical Program Manager, AI2, TPU Software in Sunnyvale, CA. Pays $192K–$278K per year. og_image: https://www.foundrole.com/og/cqm6vr.png breadcrumbs: - label: Home url: https://www.foundrole.com/ - label: Search url: https://www.foundrole.com/jobs --- | | | |---|---| | **Company** | [Google](https://www.foundrole.com/companies/google?utm_source=ai_markdown) | | **Location** | Sunnyvale, CA | | **Salary** | $192K/yr - $278K/yr | | **Posted** | Oct 19, 2026 | ## Is this job real? **Ghost job check:** A- · Low risk. Probably a real opening. ## Visa sponsorship - **H-1B:** Google sponsors H-1B visas. It filed 9,179 H-1B petitions (FY2026 Q1 – FY2026 Q4). - **E-Verify:** No E-Verify enrollment on record for Google. ## Pay for similar jobs Most similar jobs pay $200,000 – $235,000 a year (median $204,000). ## Description A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Technical Program Manager at Google, you’ll use your technical expertise to lead complex, multi-disciplinary projects from start to finish. You’ll work with stakeholders to plan requirements, identify risks, manage project schedules, and communicate clearly with cross-functional partners across the company. You're equally comfortable explaining your team's analyses and recommendations to executives as you are discussing the technical tradeoffs in product development with engineers. The Core ML Program Management Office (PMO) is looking for a strong Technical Program Manager (TPM) to drive the strategy and execution for the TPU ecosystem, scaling production-grade inference and training infrastructure across Jax and PyTorch frameworks. You will lead efforts to establish price-performance and total cost of ownership leadership for frontier AI models. Your work will focus on qualifying next-generation TPU hardware, advancing distributed orchestration for agentic workloads and tiered KV-cache management, and expanding support into multimodal, diffusion, physical AI, and world models. Additionally, you will foster developer velocity by automating model onboarding pipelines and optimizing specialized kernel libraries. The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide. We're the driving force behind Google's groundbreaking innovations, empowering the development of our cutting-edge AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more. Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $192000 - $278000 (USD) + 20% bonus target + equity + benefits Learn more about [benefits at Google](https://www.google.com/about/careers/applications/benefits/). - Develop and execute end-to-end program strategies for complex ML infrastructure, covering scope, resource planning, risk management, and roadmap delivery. - Partner with cross-functional engineering, product, and research teams to define technical milestones and prioritize key platform capabilities. - Drive execution across workstreams, proactively identifying dependencies, mitigating risks, and maintaining alignment on schedules and critical path items. - Provide clear, concise updates and strategic recommendations to leadership and executive stakeholders to align on technical priorities and decisions. - Ensure production readiness and quality standards for hardware/software deployments, supporting large-scale developer adoption and workload efficiency. ### Minimum qualifications: - Bachelor's degree in a technical field, or equivalent practical experience. - 8 years of experience in program management. - Experience with artificial intelligence/machine learning projects, tools, or infrastructure. ### Preferred qualifications: - 8 years of experience managing cross-functional or cross-team projects. - Experience with Jax and PyTorch frameworks, OSS models like Qwen and GLM, and inference stacks like vLLM and SGLang. - Experience running production facing large scale software programs. - Bachelor's degree in a technical field, or equivalent practical experience. - 8 years of experience in program management. - Experience with artificial intelligence/machine learning projects, tools, or infrastructure. ## Skills - Program Management - Quality Standards - Critical Path Method (Cpm) Scheduling - Risk Management - Artificial Intelligence - SGLang - New Product Development - JAX - Product Roadmaps - Machine Learning - Generalized Linear Models (Glm) - vLLM ## Related - [More jobs at Google](https://www.foundrole.com/companies/google?utm_source=ai_markdown) - [Technology & Software jobs](https://www.foundrole.com/careers/technology-and-software?utm_source=ai_markdown)- [IT Manager jobs](https://www.foundrole.com/careers/technology-and-software/it-managers?utm_source=ai_markdown)- [Technical Program Manager jobs](https://www.foundrole.com/careers/technology-and-software/it-managers/technical-program-manager?utm_source=ai_markdown)- [Browse all companies](https://www.foundrole.com/companies?utm_source=ai_markdown) ## Explore this job market - [California](https://www.foundrole.com/locations/us/california?utm_source=ai_markdown) — 260759 jobs - [Technology, Information and Internet](https://www.foundrole.com/sectors/technology/technology-information-and-internet?utm_source=ai_markdown) — 11788 jobs - [Sunnyvale, CA](https://www.foundrole.com/locations/us/california/sunnyvale?utm_source=ai_markdown) — 5882 jobs - [Google](https://www.foundrole.com/companies/google?utm_source=ai_markdown) — 3839 jobs ## Related pages - [California](https://www.foundrole.com/locations/us/california?utm_source=ai_markdown) — 260759 jobs - [Technology, Information and Internet](https://www.foundrole.com/sectors/technology/technology-information-and-internet?utm_source=ai_markdown) — 11788 jobs - [Sunnyvale, CA](https://www.foundrole.com/locations/us/california/sunnyvale?utm_source=ai_markdown) — 5882 jobs - [Google](https://www.foundrole.com/companies/google?utm_source=ai_markdown) — 3839 jobs ## Browse - [Companies](https://www.foundrole.com/companies?utm_source=ai_markdown) - [Jobs by country](https://www.foundrole.com/locations?utm_source=ai_markdown) - [Jobs in the United States by state and city](https://www.foundrole.com/locations/us?utm_source=ai_markdown) - [H1B sponsors by location](https://www.foundrole.com/h1b-sponsors?utm_source=ai_markdown) - [H1B salaries](https://www.foundrole.com/h1b-salaries?utm_source=ai_markdown) - [Sectors and industries](https://www.foundrole.com/sectors?utm_source=ai_markdown) - [Jobs by career field](https://www.foundrole.com/careers?utm_source=ai_markdown) - [Latest jobs](https://www.foundrole.com/jobs/latest?utm_source=ai_markdown)