Data, AI and tech job titles

102 titles · 9,340 open roles

LLMOps Engineer job title trend since Apr 2011

Engineering · Emerging · in 0% of HN hiring posts · 1 open roles at 1 company · median $208k

First sighting

Runs language models in production: serving, prompt and model versions, evals in CI, cost and latency.

first seen Jul 2024, Hacker News

Why it exists

Written from the sources below

Running language model apps in production added work that classic MLOps did not cover: prompt versioning, evaluation, cost tracking and serving large models. Vendors named it LLMOps in 2023, and the title followed as an MLOps specialisation.

  1. DefinedWhat is LLMOps?Databricks, Jun 2023 · backs: LLMOps as operations practices for LLM applications
  2. DefinedMLOpsWikipedia, 2026 · backs: MLOps as the parent practice

Where it is posted

Sectors

  • AI infrastructure1

Cities

  • San Francisco1

Countries and remote

  • United States1
Remote option100%

Posted pay

Median $208k from 1 postings that state a base range (USD a year).

Who is hiring for it

Open postings on their own job boards, read 5h ago
#CompanyOpen roles
1AnyscaleAn AI infrastructure company hiring most for Staff Engineer and Security Engineer.1

Open roles

Open role$170k to $245k

Distributed LLM Inference Engineer

San Francisco

Role
Distributed LLM Inference EngineerAnyscaleSan Francisco$170k to $245k

Lineage

Share of Hacker News hiring posts

3 posts since Apr 2011
November 2026 0 of 207 postings, 0%
3-month averageEach monthFirst sighting
About this title

Runs language models in production: serving, prompt and model versions, evals in CI, cost and latency.

Also counted: LLM Ops, LLM platform engineer, LLM infrastructure

First sighting
Aircover AI | Sr. LLM Infrastructure Engineer and Sr. Flutter Engineer | San Francisco Bay Area, Los...
Aircover AI, Ask HN: Who is hiring? (July 2024)

Median posted salary $208k from 1 postings that state a base pay range (the median of their midpoints, USD a year). Not a survey of what people earn.