I run a local LLM server on my M4 Pro Mac mini with 48 GB of RAM. It handles everything from my Hermes agent backend to quick chat queries on my phone.
register or log in to get more services such as weather report, extended news articles and web search