Senior Machine Learning Engineer

*Telecommuting permitted: work may be performed within normal commuting distance from the Red Hat, LLC office in Boston, MA.

Lead the design and implementation of high-performance Python, C++, CUDA, and Triton code for vLLM-based inference systems, GPU kernels, and numerical computing components in production-scale LLM serving environments.

What You Will Do

Architect, develop, and optimize advanced LLM inference algorithms, including quantization, sparsification, speculative decoding, paged at…