Member of Technical Staff, AMD GPU Performance Engineering Job at Inferact, Remote

NnVqeEJzc1gvVEhXMVdVZERzNjVKbFVuekE9PQ==
  • Inferact
  • Remote

Job Description

Role Description

We're looking for an AMD GPU performance engineer to make vLLM a first-class inference engine across the AMD accelerator ecosystem. You'll build and optimize AMD GPU backends, kernels, runtime paths, and benchmarking infrastructure using ROCm, HIP, Triton, CK, AITER, and related tooling so vLLM can deliver frontier inference performance on AMD GPUs.

You'll work at the boundary of inference systems, kernels, compilers, and hardware architecture, improving performance-critical paths such as:

  • Attention
  • GEMM
  • Sampling
  • KV cache
  • Communication-heavy operations

Your work will help make AMD GPU support in vLLM usable, fast, benchmarked, and maintainable.

Qualifications

  • Bachelor's degree or equivalent experience in computer science, engineering, systems, machine learning, or similar.
  • Hands-on experience optimizing AMD GPU workloads using ROCm, HIP, Triton, CK, AITER, or similar AMD ecosystem tools.
  • Deep understanding of AMD GPU execution, memory behavior, toolchains, kernel performance, and backend-specific performance constraints.
  • Experience optimizing ML kernels or inference paths such as attention, GEMM, sampling, KV cache, fused kernels, or communication-heavy runtime paths.
  • Strong performance profiling and benchmarking skills, with the ability to use measurements, hardware counters, correctness tests, and reproducible benchmarks to guide optimization work.

Requirements

  • Experience with vLLM, SGLang, TensorRT-LLM, ROCm-based serving, or other LLM inference systems.
  • Familiarity with batching, KV cache, decoding, serving tradeoffs, and backend performance constraints in production inference systems.
  • Experience with compiler and kernel technologies such as Triton, MLIR, LLVM, CK, AITER, HIP, or other kernel DSLs and backend libraries.
  • Knowledge of quantization methods such as INT8, FP8, mixed precision, or AMD hardware-specific numeric formats, including accuracy and performance tradeoffs.

Benefits

  • Generous health, dental, and vision benefits.
  • 401(k) company match.

Job Tags

Full time

Similar Jobs

Global Channel Management

Remote Program Manager Job at Global Channel Management

 ...Remote Program Manager Atlanta, Georgia, United States $ 105.00 - 106.00 (US Dollar) Remote Program Manager needs 5 years project and program management experience Remote Program Manager requires: ~5 years Business process development and management experience... 

Down East Community Hospital

MEDICAL ASSISTANT - PRN Job at Down East Community Hospital

 ...Medical Assistant Essential Job Functions Greets and prepares patient for office visit or outpatient procedure. Obtains vital signs and weighs each patient. Updates problem and medication list at each patient visit. Assists in procedures requested by the... 

Lending Pros LLC

Loan Officer Trainee Job at Lending Pros LLC

 ...motivated and goal-driven Mortgage Sales Representative to join our team with a unique opportunity to grow into a licensed Loan Officer. This is an entry-level role designed for individuals who are eager to learn the mortgage and lending industry from the ground up. The ideal... 

Charter Aarrowcast

Production Worker - Machine Operator Job at Charter Aarrowcast

 ...phones, travel, automotive, and more!3 Positions Available at Charter Casting 2900 E Richmond St, Shawano, WI 54166 Melt Deck Operator | 3rd Shift (12-hour shifts, 6pm-6am) | $27/hr Transport melting materials and supplies; Operate melting furnace charging... 

Sdsoybean

Education Program Specialist I Job at Sdsoybean

 ...strengthening schools? Then this job may be for you! The South Dakota Department of Education is seeking a dedicated, collaborative and detail-oriented Education Program Specialist to join the Office of Title Programs. In this role, you will contribute to the implementation...