الدروس التعليمية

Yes, for its core job. Local inference runs entirely on your machine — prompts and outputs are not sent anywhere. […]

The default Ollama port is 11434, served over plain HTTP and bound to 127.0.0.1 (localhost only). Change it with the OLLAMA_HOST environment variable — e.g.

vLLM is an open-source inference engine for serving LLMs on GPUs at high throughput, exposing them through an OpenAI-compatible HTTP API.Its two core techniques — PagedAttention and continuous batching — let one GPU handle many concurrent requests without wasting VRAM.Install with pip install vllm in a fresh Python environment on Linux (NVIDIA GPU, compute capability 7.0+), then start a server with vllm serve <model>.It is built for serving many users or apps.

GGUF هو تنسيق ملفاتٍ يُستخدم لتشغيل النماذج اللغوية الكبيرة محليًّا.

Windows: press Ctrl+Shift+Esc → Performance → GPU and read Dedicated GPU memory.