docker run -d -e DISCORD_TOKEN={INSERT BOT TOKEN HERE} -e CHANNEL_ID={Insert channel ID for role management} -v PATH/TO/LOCAL/config.json:/app/config/config.json ...
So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...