ML Inference Engineer – Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM)

About this role

Toptal is hiring an ML Inference Engineer – Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM) — a remote role open to applicants worldwide. We are building a benchmark that tests how well AI agents handle real expert work in a terminal. We are hiring ML inference and serving experts to turn real, paid tasks from their jobs into expert-level Terminal-Bench challenges.

Skills & tools

• Python
• Docker
• Git
• PyTorch
• LLM