DotNet&More #179: (продолжение) PC или Mac для локальных LLM, тестируем и не только

Ссылки:
- https://www.jan.ai : Удобный UI для моделей
LFM
- https://huggingface.co/LiquidAI/LFM2.5-8B-A1B-GGUF
- https://huggingface.co/LiquidAI/LFM2.5-8B-A1B-MLX-8bit
Qwen
- https://huggingface.co/bartowski/Qwen2.5-Coder-14B-Instruct-GGUF
- https://huggingface.co/mlx-community/Qwen2.5-Coder-14B-Instruct-4bit
DeepSeek
- https://huggingface.co/bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF
- https://huggingface.co/mlx-community/DeepSeek-Coder-V2-Lite-Instruct-4bit
Codestral
- https://huggingface.co/bartowski/Codestral-22B-v0.1-GGUF
- https://huggingface.co/mlx-community/Codestral-22B-v0.1-4bit
Llama
- https://huggingface.co/bartowski/Meta-Llama-3.1-8B-Instruct-GGUF
- https://huggingface.co/mlx-community/Meta-Llama-3.1-8B-Instruct-4bit
Phi
- https://huggingface.co/bartowski/Phi-3-medium-128k-instruct-GGUF
- https://huggingface.co/mlx-community/Phi-3-medium-128k-instruct-4bit