CanIBeHired
MenuClose
Inferact

Member of Technical Staff, Inference

Listed by employer · Checked

Older posting · still listed ·

  • onsite
  • FullTime
  • Research & Engineering
  • San Francisco
Work arrangement
onsite
Employment
FullTime
Stated compensation
USD 200,000–400,000 1 YEAR
Apply on company website ↗
01 / A QUICK CHECK BEFORE YOU APPLY

Does the location policy fit?

Choose where you would work from. We’ll compare it with the posting’s stated requirements.

Choose the country you will work from. You can change this anytime.

Country and sponsorship changes take effect when you click Check eligibility.

Choose a country to check geographic compatibility. The source requirements are available below.

Source: ashbyChecked Original posting ↗
This is an older posting.

The employer’s posting date is more than 60 days ago. It remained listed at our last successful check; it may be a long-running or evergreen opening. Confirm availability on the original posting before applying.

Browse jobs posted in the past 60 days →

This checks the posting’s stated requirements, not your legal right to work. Confirm details with the employer.

Requirements

2 with evidence7 unclear or unstated
Remote policy
onsite
“Provider workplace type: onsite”
From employer posting metadata
Employer sponsorship
Sponsorship is conditional or uncertain
“Visa sponsorship: We sponsor visas on a case-by-case basis.”
See matched passage in original description ↓
Geographic scope
US
“Will consider remote in the US for exceptional candidates.”
See matched passage in original description ↓
Employment type
FullTime
Compensation
USD 200,000–400,000 1 YEAR
6 fields not stated in this posting
Degree requirement
Not specified
Security clearance
Not mentioned
Timezone / hours
Not specified
Citizenship requirement
Not mentioned
Minimum experience (years)
Not specified
Work authorization
Not specified

These details were not stated in the tracked posting. Confirm with the employer.

READ IT IN THE EMPLOYER’S OWN WORDS

Original job description

Reading view uses normalized posting text so exact evidence excerpts can be highlighted.

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build. About the Role We're looking for an inference runtime engineer to push the boundaries of what's possible in LLM and diffusion model serving. Models grow larger. Architectures shift: mixture-of-experts, multimodal, agentic. Every breakthrough demands innovations on the inference engine itself. You'll work at the core of vLLM, optimizing how models execute across diverse hardware and architectures. Your work will directly impact how the world runs AI inference.
Read full descriptionShow less description
Skills and Qualifications Minimum qualifications: Bachelor's degree or equivalent experience in computer science, engineering, or similar. Deep understanding of transformer architectures and their variants. Strong programming skills in Python with experience in PyTorch internals. Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI). Ability to read and implement model architectures and inference techniques from research papers. Demonstrate the ability to contribute performant and maintainable code and debug in complex ML codebases. Preferred qualifications: Deep understanding of KV-cache memory management, prefix caching, and hybrid model serving. Familiarity with RL frameworks and algorithms for LLMs. Experience with multimodal inference (audio/image/video/text). Contributions to open-source ML or system infrastructure projects. Bonus points if you have: Implemented core features in vLLM or other inference engine projects. Contributed to vLLM integrations (verl, OpenRLHF, Unsloth, LlamaFactory, etc). Written widely-shared technical blogs or side projects on vLLM or LLM inference. Logistics Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates. Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity. Visa sponsorship: We sponsor visas on a case-by-case basis. Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
Original formatting and links

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.

About the Role

We're looking for an inference runtime engineer to push the boundaries of what's possible in LLM and diffusion model serving. Models grow larger. Architectures shift: mixture-of-experts, multimodal, agentic. Every breakthrough demands innovations on the inference engine itself. You'll work at the core of vLLM, optimizing how models execute across diverse hardware and architectures. Your work will directly impact how the world runs AI inference.

Skills and Qualifications

Minimum qualifications:

  • Bachelor's degree or equivalent experience in computer science, engineering, or similar.

  • Deep understanding of transformer architectures and their variants.

  • Strong programming skills in Python with experience in PyTorch internals.

  • Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI).

  • Ability to read and implement model architectures and inference techniques from research papers.

  • Demonstrate the ability to contribute performant and maintainable code and debug in complex ML codebases.

Preferred qualifications:

  • Deep understanding of KV-cache memory management, prefix caching, and hybrid model serving.

  • Familiarity with RL frameworks and algorithms for LLMs.

  • Experience with multimodal inference (audio/image/video/text).

  • Contributions to open-source ML or system infrastructure projects.

Bonus points if you have:

  • Implemented core features in vLLM or other inference engine projects.

  • Contributed to vLLM integrations (verl, OpenRLHF, Unsloth, LlamaFactory, etc).

  • Written widely-shared technical blogs or side projects on vLLM or LLM inference.

Logistics

  • Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.

  • Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.

  • Visa sponsorship: We sponsor visas on a case-by-case basis.

  • Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.

Similar roles

All Inferact jobs →

No similar roles found yet — browse all Inferact jobs.

THE JOB ELIGIBILITY CHECKER

Check a job