Product Manager - Machine Learning Compiler

Seattle or Remote | Full-time | Fully remote



OctoML is an energetic new company changing how developers optimize and deploy machine learning models for their AI needs. We’re a team of machine learning systems leaders focused on making machine learning (ML) more efficient and easier to deploy by… applying machine learning to it!

OctoML was founded by the creators of Apache TVM, a popular open-source compiler that transforms ML models into highly-efficient binary code optimized for the specific hardware and model architecture. We are building the Octomizer, a cloud-based "TVM as a Service" product that enables developers to optimize and package their ML models through a modern web app as well as a rich API surface.

We dream big but execute with focus and believe in creativity, productivity, and balanced life. We value diversity in all dimensions.


Role Specifics

OctoML is growing and looking for a Product Manager to lead our machine learning compiler efforts. In this role, we'll expect you to be both a highly capable individual contributor and a strategic thinker and influencer.


You'll work hand-in-hand with (Octomizer) Product and Engineering leaders to apply product management principles to our efforts at OctoML to improve our compiler stack for users everywhere. This includes user interviews, segmentation, journey definition, prioritization of work, road mapping, all the way to marketing outreach. In addition, you'll work closely with developer advocates to align our roadmaps to the needs of both the open-source community and commercial users.


You'll be expected to have demonstrated superior performance across the spectrum of software product management duties, including user research, competitive analysis, launch, maintenance, customer acquisition/growth, etc.


Ideal candidates will have demonstrated experience with open source projects in coordination with paid services and products. Experience with both startups and large organizations is preferred. However, we value aptitude over experience and are most interested in future colleagues who are able to apply their product competencies to an ever-changing array of awesome problems and possible solutions.


Basic qualifications include:

  • At least five years of experience in software product management roles where your job was to work in fast-moving fields, defining user personas, shaping and prioritizing requirements, and working closely with highly technical engineering teams to ship complex software.
  • Familiarity with open-source software development processes and communities
  • Experience working with highly technical tools and platforms.
  • Strong understanding of machine learning use cases and workflows.

Core Responsibilities

  • Research and define our machine learning compiler user personas, their specific needs, pain points, and goals that we can help address.
  • Develop, maintain, and coordinate execution on software roadmaps incorporating feedback from users, engineering, and other product stakeholders.
  • Engage with our developer relations team and the TVM community to glean product insights and execute on their needs.
  • Support development of marketing collateral such as website pages, blogs, white papers, webinars, and videos supporting the needs of the growth of our open-source platform.

Ideal candidates will have the following:

  • Demonstrated experience in both startup and large organizations
  • Experience developing and growing a machine learning infrastructure code base for highly technical user persona.
  • Multiple years of experience in product management of AI/ML-based products.

However, we value aptitude over experience and are most interested in future colleagues who adjust their deep product competencies to an ever-changing array of challenging business problems.


Location: Onsite (post-pandemic) in Seattle, WA or Remote


Our Benefits:

OctoML aims to provide the resources that employees need to be healthy and comfortable.

  • 4 weeks paid personal time off + company paid holidays and company downtime 2x per year
  • 100% employer paid premium (for employee and dependents) with a low-deductible plan
  • Family & Medical Paid Time Off (includes Maternity, Paternity, Adoption, among others)
  • Remote and telework setups for employees (post-COVID)
  • Flexible work hours


OctoML is committed to creating a diverse environment and is proud to be an equal opportunity employer. We hire based on an evaluation of abilities and effectiveness. We don't discriminate against employees on the basis of any other personal characteristic or any classification protected by federal, state or local law. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.