Senior Software Engineer, AI/ML Infrastructure

Google's software engineers develop next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Their products handle information at massive scale and extend beyond web search. Engineers work on projects critical to Google’s needs with opportunities to switch teams and projects as the business evolves. The Cloud ML Compute Services team focuses on advancing AI infrastructure by optimizing ML workload performance across the technical stack from networking and data storage to ML models, providing AI developers with high-performance experience on Google's AI infrastructure. Google Cloud delivers enterprise-grade solutions leveraging cutting-edge technology to customers in more than 200 countries and territories, enabling growth and solving critical business problems.

• Bachelor's degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages.
• 3 years of experience testing, maintaining, or launching software products.
• 1 year of experience with software design and architecture.
• 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).

Nice to have:

• Master's degree or PhD in Computer Science or related technical fields.
• 5 years of experience with data structures and algorithms.
• Experience with distributed computing leveraging GPUs or TPUs.
• Ability to scope and solve ambiguous problems and grow in a fluid environment where AI technologies are continuously advancing.

• Design and implement solutions in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise in a chosen field.
• Optimize performance on Google's AI infrastructure across the technical stack.
• Conduct performance profiling, debugging, and troubleshooting of AI/ML training and inference workloads.
• Develop tools and software for AI/ML Infrastructure to deliver excellent developer experience.
• Partner closely with cross-functional, cross-regional teams to ensure AI/ML infrastructure delivers exceptional value and drives success for customers.