Running models locally

• https://github.com/jmorganca/ollama & https://ollama.ai/ - Get up and running with large language models, locally.
• https://github.com/BerriAI/litellm & https://docs.litellm.ai/ - a light package to simplify calling OpenAI, Azure, Cohere, Anthropic, Huggingface API Endpoints.
• https://github.com/ggerganov/llama.cpp &