Software Engineering Manager, Cloud AI/ML Infrastructure

About the role

Google is looking for a Software Engineering Manager to lead the Cloud AI/ML Infrastructure team. You will guide technical strategy, oversee large‑scale AI projects, and mentor engineers across multiple locations.

Key responsibilities

• Define and communicate team priorities that align with broader organizational goals.
• Set clear expectations, conduct regular performance and development discussions, and provide coaching.
• Develop and evolve a mid‑term technical roadmap for AI/ML infrastructure.
• Design, review, and validate system architectures in partnership with cross‑functional and cross‑regional teams.
• Manage a sizable product budget and oversee deployment of large‑scale projects internationally.

Required profile

• Bachelor’s degree or equivalent practical experience.
• 8+ years of software development experience.
• 5+ years designing and optimizing ML infrastructure (model deployment, evaluation, data processing, debugging, fine‑tuning).
• 3+ years in a technical leadership role.
• 2+ years of people‑management or team‑leadership experience.
• Preferred: Master’s or PhD in a technical field, experience in matrixed organizations, and expertise with Generative AI, LLMs, GPUs, or TPUs.

Required skills

• Machine Learning infrastructure
• Model deployment and evaluation
• Data processing and debugging
• Fine‑tuning of ML models
• Generative AI and Large Language Models
• Distributed computing with GPUs and TPUs
• Large‑scale system design and cloud AI/ML platforms