Etiket

#vllm

#vllm etiketi ile ilgili tüm yazılar. Bu etikette toplam 2 yazı bulunuyor.

Yazılar

Self-Hosted LLMs in 2026: Run AI Locally for Privacy & Savings

We analyze the ways of running AI models on your own system in 2026, hardware requirements, and the most efficient software tools (Ollama, llama.cpp, vLLM).

29 May

Development Tools

Dwarfed by Giant MoE Models: Local Qwen3.6-27B Setup

I'm explaining how to run Alibaba's latest AI marvel, the Qwen3.6-27B model, on local hardware (RTX 3090/5090, Apple Silicon, AMD Strix Halo) and connect it...