RemoteWLBRemote only
Back to all jobs
Lambda logo
Remote role · staff-so

Staff Software Engineer - Inference

Lambda

Salary$186,000/yr - $294,000/yr
Distributed SystemsSoftware EngineeringMachine LearningTeam LeadershipSystem Architecture
Role brief

What You’ll Do

  • Help design, build and improve our new inference and ML computation platform, acting as technical lead for one or more of our implementation teams.
  • Work with management, product and other internal business partners to drive technical decisions based on business and market needs
  • Work on the architecture of our distributed systems to ensure best-in-class reliability and efficiency, while helping to minimize operational costs and toil work
  • Provide your team empathetic leadership as well as mentorship to grow their own skills and abilities
  • Build products around a large range of ML models and types, including industry-leading research
  • Help build safety and fraud systems, around both inference and other ML systems
  • Handle interesting and dynamic scaling, hardware and scheduling challenges in a very dynamic and rapidly changing industry sector

You

  • Are an experienced lead software engineer with ten or more years of working on business-critical distributed systems.
  • Have a history of leading projects from inception to production, including making technical decisions, authoring design and decision documents, and advising on staffing needs.
  • Have significant experience architecting systems around relational databases, document databases, queue datastores, block storage, object storage, unreliable networks, and caches.
  • Have a deep understanding of the balance between initial build costs and operational costs, and what it takes to launch a product quickly but with a good technical foundation.
  • Can write both Go and Python to a high level, and can pick up other languages as needed.
  • Are very familiar with building integrated test frameworks and using CI/CD systems
  • Are product-oriented and focused on great user experiences, and are invested in building the best product possible for users.
  • Are good at working cross-functionally and solving problems across teams, including empathetic conflict resolution when working alongside teams with different priorities.
  • Have recent team leadership experience (on a team of four or more people) 

Nice to Have

  • Experience writing Kubernetes operators or other Kubernetes integrations
  • Experience running ML/GPU workloads in production
  • Experience with computation dispatch and orchestration systems
  • Bare-metal hardware experience

Salary Range Information 

Based on market data and other factors, the salary range for this position is $186,000 - $294,000. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.