GitHub

Holistic Evaluation of Language Models (HELM)

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent ...
GitHub

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently ...

[08/05] Running a High-Performance GPT-OSS-120B Inference Server with TensorRT LLM ️ link [08/01] Scaling Expert Parallelism in TensorRT LLM (Part 2: Performance Status and Optimization) ️ link [07/26 ...