GitHub

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently ...

[08/05] Running a High-Performance GPT-OSS-120B Inference Server with TensorRT LLM ️ link [08/01] Scaling Expert Parallelism in TensorRT LLM (Part 2: Performance Status and Optimization) ️ link [07/26 ...
GitHub

Pipestream AI Platform Libraries

platform-libraries/ ├── bom/ # Bill of Materials for dependency management │ ├── build.gradle # BOM and version catalog publishing │ └── README.md # BOM documentation │ ├── devservices/ # Quarkus ...