[08/05] Running a High-Performance GPT-OSS-120B Inference Server with TensorRT LLM ️ link [08/01] Scaling Expert Parallelism in TensorRT LLM (Part 2: Performance Status and Optimization) ️ link [07/26 ...
A SwiftUI application that creates an OpenAI-compatible API server using Apple's on-device Foundation Models. This allows you to use Apple Intelligence models locally through familiar OpenAI API ...