XDA Developers on MSN

I'm running a 120B local LLM on 24GB of VRAM, and now it powers my smart home

Paired with Whisper for quick voice to text transcription, we can transcribe text, ship the transcription to our local LLM, ...