This LLM CLI tool from Simon Willison is cool. I learned about it when he posted about it on Mastodon today
If you're a Homebrew user this might now be one of the quickest and easiest ways to start running a LLM locally on your own machine - it's just three steps:
Simon Willison, Mastodon
brew install llm
llm install llm-gpt4all
llm -m 'ggml-vicuna-7b-1' 'ten fun names for a pet pelican'