{"id":2182,"date":"2026-08-12T20:06:35","date_gmt":"2026-08-12T20:06:35","guid":{"rendered":"https:\/\/convly.ai\/?p=2182"},"modified":"2026-08-12T20:06:35","modified_gmt":"2026-08-12T20:06:35","slug":"text-generation-webui-guide","status":"publish","type":"post","link":"https:\/\/convly.ai\/ar\/text-generation-webui-guide\/","title":{"rendered":"\u0648\u0627\u062c\u0647\u0629 \u0648\u064a\u0628 \u0644\u062a\u0648\u0644\u064a\u062f \u0627\u0644\u0646\u0635\u0648\u0635 (Oobabooga): \u062f\u0644\u064a\u0644 \u0627\u0644\u062a\u062b\u0628\u064a\u062a\u060c \u0648\u0648\u062d\u062f\u0627\u062a \u0627\u0644\u062a\u062d\u0645\u064a\u0644\u060c \u0648\u0627\u0644\u0627\u0633\u062a\u062e\u062f\u0627\u0645"},"content":{"rendered":"<div class=\"convly-tldr\">\n<ul>\n<li>text-generation-webui (\u064a\u064f\u0634\u0627\u0631 \u0625\u0644\u064a\u0647\u0627 \u0639\u0644\u0649 \u0646\u0637\u0627\u0642 \u0648\u0627\u0633\u0639 \u0628\u0627\u0633\u0645 <em>oobabooga<\/em> \u062a\u0645\u0627\u0645\u064b\u0627 \u062a\u064a\u0645\u0646\u064b\u0627 \u0628\u0627\u0633\u0645 \u0645\u0624\u0644\u0641\u0647\u0627 \u0639\u0644\u0649 \u0645\u0648\u0642\u0639 GitHub) \u0647\u064a \u0648\u0627\u062c\u0647\u0629 \u0645\u0641\u062a\u0648\u062d\u0629 \u0627\u0644\u0645\u0635\u062f\u0631 \u0645\u062c\u0627\u0646\u064a\u0629 \u0642\u0627\u0626\u0645\u0629 \u0639\u0644\u0649 \u0627\u0644\u0645\u062a\u0635\u0641\u062d \u0644\u062a\u0634\u063a\u064a\u0644 \u0646\u0645\u0627\u0630\u062c \u0627\u0644\u0644\u063a\u0629 \u0627\u0644\u0643\u0628\u064a\u0631\u0629 (LLMs) \u0645\u062d\u0644\u064a\u064b\u0651\u0627 \u0639\u0644\u0649 \u0623\u062c\u0647\u0632\u062a\u0643 \u0627\u0644\u062e\u0627\u0635\u0629.<\/li>\n<li>\u0642\u0645 \u0628\u0627\u0644\u062a\u062b\u0628\u064a\u062a \u0639\u0628\u0631 \u0646\u0635\u0648\u0635 \u0628\u0631\u0645\u062c\u064a\u0629 \u0628\u0646\u0642\u0631\u0629 \u0648\u0627\u062d\u062f\u0629 \u2014 <code>start_windows.bat<\/code>, <code>start_linux.sh<\/code>\u0623\u0648 <code>start_macos.sh<\/code> \u2014 \u062f\u0648\u0646 \u0627\u0644\u062d\u0627\u062c\u0629 \u0625\u0644\u0649 \u0625\u0639\u062f\u0627\u062f \u064a\u062f\u0648\u064a \u0644\u0628\u064a\u0626\u0629 \u0628\u0627\u064a\u062b\u0648\u0646.<\/li>\n<li>\u062a\u062f\u0639\u0645 \u0639\u062f\u0629 \u0648\u0627\u062c\u0647\u0627\u062a \u062a\u0646\u0641\u064a\u0630 \u062e\u0644\u0641\u064a\u0629 (backends): llama.cpp \u0644\u0644\u0645\u0644\u0641\u0627\u062a \u0628\u0635\u064a\u063a\u0629 GGUF\u060c \u0648ExLlamaV2 \u0644\u0645\u0644\u0641\u0627\u062a EXL2\/GPTQ \u0639\u0644\u0649 \u0648\u062d\u062f\u0627\u062a \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u0627\u062a \u0645\u0646 \u0634\u0631\u0643\u0629 NVIDIA\u060c \u0648Transformers \u0644\u0646\u0645\u0627\u0630\u062c Hugging Face.<\/li>\n<li>\u062a\u0634\u0645\u0644 \u0627\u0645\u062a\u062f\u0627\u062f\u064b\u0627 \u0645\u062a\u0648\u0627\u0641\u0642\u064b\u0627 \u0645\u0639 \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u062a\u0637\u0628\u064a\u0642\u0627\u062a OpenAI (<code>--extensions openai<\/code>) \u0628\u062d\u064a\u062b \u064a\u0645\u0643\u0646 \u0644\u062a\u0637\u0628\u064a\u0642\u0627\u062a \u0623\u062e\u0631\u0649 \u0627\u0644\u0627\u062a\u0635\u0627\u0644 \u0628\u0646\u0645\u0648\u0630\u062c\u0643 \u0627\u0644\u0645\u062d\u0644\u064a \u062f\u0648\u0646 \u0627\u0644\u062d\u0627\u062c\u0629 \u0625\u0644\u0649 \u0625\u062c\u0631\u0627\u0621 \u0623\u064a \u062a\u063a\u064a\u064a\u0631\u0627\u062a \u0641\u064a \u0627\u0644\u0643\u0648\u062f.<\/li>\n<\/ul>\n<\/div>\n<p>text-generation-webui \u0647\u064a \u0648\u0627\u062c\u0647\u0629 \u0648\u064a\u0628 \u0645\u0641\u062a\u0648\u062d\u0629 \u0627\u0644\u0645\u0635\u062f\u0631 \u0648\u0645\u064f\u0633\u062a\u0636\u0627\u0641\u0629 \u0630\u0627\u062a\u064a\u064b\u0651\u0627 \u0644\u062a\u0634\u063a\u064a\u0644 \u0646\u0645\u0627\u0630\u062c \u0627\u0644\u0644\u063a\u0629 \u0627\u0644\u0643\u0628\u064a\u0631\u0629 \u0645\u062d\u0644\u064a\u064b\u0651\u0627. \u0648\u062a\u064f\u062f\u0627\u0631 \u0639\u0644\u0649 \u0645\u0648\u0642\u0639 GitHub \u0628\u0627\u0633\u0645 <strong>oobabooga\/text-generation-webui<\/strong>\u060c \u0648\u062a\u0639\u0645\u0644 \u062f\u0627\u062e\u0644 \u0645\u062a\u0635\u0641\u062d\u0643 \u0639\u0644\u0649 \u0627\u0644\u0639\u0646\u0648\u0627\u0646 <code>http:\/\/localhost:7860<\/code>, supports a wide range of model formats through swappable inference backends, and exposes an OpenAI-compatible REST API. It is the most feature-complete local LLM frontend available, at the cost of a steeper setup curve than desktop apps like LM Studio.<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_86 counter-flat ez-toc-counter ez-toc-container-direction\">\n<label for=\"ez-toc-cssicon-toggle-item-6a7d13eb29aed\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">\u062a\u0628\u062f\u064a\u0644<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #000000;color:#000000\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #000000;color:#000000\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewbox=\"0 0 24 24\" version=\"1.2\" baseprofile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a7d13eb29aed\"  aria-label=\"\u062a\u0628\u062f\u064a\u0644\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1' ><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/convly.ai\/ar\/text-generation-webui-guide\/#What_text-generation-webui_Is_and_Why_People_Call_It_Oobabooga\" >\u0645\u0627 \u0647\u064a text-generation-webui (\u0648\u0644\u0645\u0627\u0630\u0627 \u064a\u0637\u0644\u0642 \u0639\u0644\u064a\u0647\u0627 \u0627\u0644\u0646\u0627\u0633 \u0627\u0633\u0645 Oobabooga)<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/convly.ai\/ar\/text-generation-webui-guide\/#Installing_text-generation-webui\" >\u062a\u062b\u0628\u064a\u062a text-generation-webui<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/convly.ai\/ar\/text-generation-webui-guide\/#Model_Loaders_Which_One_to_Use\" >\u0648\u062d\u062f\u0627\u062a \u062a\u062d\u0645\u064a\u0644 \u0627\u0644\u0646\u0645\u0627\u0630\u062c: \u0623\u064a \u0645\u0646\u0647\u0627 \u064a\u062c\u0628 \u0623\u0646 \u062a\u0633\u062a\u062e\u062f\u0645\u061f<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/convly.ai\/ar\/text-generation-webui-guide\/#Loading_a_GGUF_Model_Step_by_Step\" >\u062a\u062d\u0645\u064a\u0644 \u0646\u0645\u0648\u0630\u062c \u0628\u0635\u064a\u063a\u0629 GGUF \u062e\u0637\u0648\u0629 \u0628\u062e\u0637\u0648\u0629<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/convly.ai\/ar\/text-generation-webui-guide\/#The_OpenAI-Compatible_API_Extension\" >\u0627\u0645\u062a\u062f\u0627\u062f \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u0627\u0644\u062a\u0637\u0628\u064a\u0642\u0627\u062a \u0627\u0644\u0645\u062a\u0648\u0627\u0641\u0642\u0629 \u0645\u0639 OpenAI<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/convly.ai\/ar\/text-generation-webui-guide\/#text-generation-webui_vs_LM_Studio_vs_Jan\" >\u0645\u0642\u0627\u0631\u0646\u0629 \u0628\u064a\u0646 text-generation-webui \u0648LM Studio \u0648Jan<\/a><\/li><li class='ez-toc-page-1'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/convly.ai\/ar\/text-generation-webui-guide\/#Frequently_Asked_Questions\" >\u0627\u0644\u0623\u0633\u0626\u0644\u0629 \u0627\u0644\u0634\u0627\u0626\u0639\u0629<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"What_text-generation-webui_Is_and_Why_People_Call_It_Oobabooga\"><\/span>\u0645\u0627 \u0647\u064a text-generation-webui (\u0648\u0644\u0645\u0627\u0630\u0627 \u064a\u0637\u0644\u0642 \u0639\u0644\u064a\u0647\u0627 \u0627\u0644\u0646\u0627\u0633 \u0627\u0633\u0645 Oobabooga)<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0627\u0633\u0645 \u0627\u0644\u0645\u0633\u062a\u062e\u062f\u0645 \u0627\u0644\u062e\u0627\u0635 \u0628\u0627\u0644\u0645\u0634\u0631\u0648\u0639 \u0639\u0644\u0649 \u0645\u0648\u0642\u0639 GitHub \u0647\u0648 <em>oobabooga<\/em>\u060c \u0648\u0627\u0644\u0630\u064a \u0623\u0635\u0628\u062d \u0627\u0644\u0645\u0635\u0637\u0644\u062d \u0627\u0644\u0634\u0627\u0626\u0639 \u0641\u064a \u0627\u0644\u0645\u062c\u062a\u0645\u0639 \u0644\u0644\u0625\u0634\u0627\u0631\u0629 \u0625\u0644\u0649 \u0627\u0644\u0623\u062f\u0627\u0629 \u0646\u0641\u0633\u0647\u0627. \u0648\u0643\u0644\u0627 \u0627\u0644\u0627\u0633\u0645\u064a\u0646 \u064a\u0634\u064a\u0631\u0627\u0646 \u0625\u0644\u0649 \u0646\u0641\u0633 \u0627\u0644\u0645\u0634\u0631\u0648\u0639 \u0627\u0644\u0645\u0648\u062c\u0648\u062f \u0639\u0644\u0649 <a href=\"https:\/\/github.com\/oobabooga\/text-generation-webui\" rel=\"noopener noreferrer\" target=\"_blank\">github.com\/oobabooga\/text-generation-webui<\/a>.<\/p>\n<p>\u0648\u0642\u062f \u0628\u064f\u0646\u064a\u062a \u0627\u0644\u0648\u0627\u062c\u0647\u0629 \u0628\u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0625\u0637\u0627\u0631 Gradio\u060c \u0648\u062a\u0639\u0645\u0644 \u0628\u0627\u0644\u0643\u0627\u0645\u0644 \u0639\u0644\u0649 \u062c\u0647\u0627\u0632\u0643 \u0627\u0644\u0645\u062d\u0644\u064a \u2014 \u0641\u0644\u0627 \u062a\u062e\u0631\u062c \u0623\u064a \u0628\u064a\u0627\u0646\u0627\u062a \u0645\u0646 \u0646\u0638\u0627\u0645\u0643. \u0648\u0628\u062c\u0627\u0646\u0628 \u0648\u0636\u0639 \u0627\u0644\u062f\u0631\u062f\u0634\u0629 \u0627\u0644\u0623\u0633\u0627\u0633\u064a\u060c \u0641\u0625\u0646\u0647\u0627 \u062a\u062f\u0639\u0645 \u0645\u0627 \u064a\u0644\u064a:<\/p>\n<ul>\n<li>\u062b\u0644\u0627\u062b\u0629 \u0623\u0648\u0636\u0627\u0639 \u0625\u062f\u062e\u0627\u0644: \u0627\u0644\u062f\u0631\u062f\u0634\u0629 (\u0627\u0644\u062a\u0648\u062c\u064a\u0647)\u060c \u0648\u0627\u0644\u062f\u0631\u062f\u0634\u0629 (\u0627\u0644\u062a\u0645\u062b\u064a\u0644 \u0627\u0644\u062f\u0648\u0631\u0627\u0646\u064a \u0645\u0639 \u0628\u0637\u0627\u0642\u0627\u062a \u0627\u0644\u0634\u062e\u0635\u064a\u0627\u062a)\u060c \u0648\u062f\u0641\u062a\u0631 \u0627\u0644\u0645\u0644\u0627\u062d\u0638\u0627\u062a (\u0625\u0643\u0645\u0627\u0644 \u0646\u0635\u064a \u062e\u0627\u0645)<\/li>\n<li>\u062a\u062d\u0645\u064a\u0644 \u0645\u064f\u0639\u062f\u0650\u0651\u0644\u0627\u062a LoRA \u0644\u062f\u0645\u062c \u0623\u0648\u0632\u0627\u0646 \u0627\u0644\u062a\u062e\u0635\u064a\u0635 \u0627\u0644\u062f\u0642\u064a\u0642 \u0641\u0648\u0642 \u0646\u0645\u0648\u0630\u062c \u0623\u0633\u0627\u0633\u064a<\/li>\n<li>\u0646\u0638\u0627\u0645 \u0627\u0645\u062a\u062f\u0627\u062f\u0627\u062a \u064a\u0636\u0645 \u0625\u0636\u0627\u0641\u0627\u062a \u0645\u0646 \u0627\u0644\u0645\u062c\u062a\u0645\u0639 \u0644\u0623\u062f\u0627\u0621 \u0645\u0647\u0627\u0645 \u0645\u062b\u0644 \u0627\u0644\u062a\u0644\u062e\u064a\u0635\u060c \u0648\u062a\u062d\u0648\u064a\u0644 \u0627\u0644\u0646\u0635 \u0625\u0644\u0649 \u0643\u0644\u0627\u0645\u060c \u0648\u062a\u0633\u0645\u064a\u0629 \u0627\u0644\u0635\u0648\u0631\u060c \u0648\u063a\u064a\u0631\u0647\u0627 \u0627\u0644\u0643\u062b\u064a\u0631<\/li>\n<li>\u0646\u0642\u0637\u0629 \u0646\u0647\u0627\u064a\u0629 \u0644\u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u062a\u0637\u0628\u064a\u0642\u0627\u062a \u0645\u062a\u0648\u0627\u0641\u0642\u0629 \u0645\u0639 OpenAI \u0644\u0631\u0628\u0637 \u0627\u0644\u0639\u0645\u0644\u0627\u0621 \u0627\u0644\u062a\u0627\u0628\u0639\u064a\u0646 \u0644\u062c\u0647\u0627\u062a \u062e\u0627\u0631\u062c\u064a\u0629 \u0648\u0628\u0631\u0627\u0645\u062c \u0627\u0644\u0623\u062a\u0645\u062a\u0629<\/li>\n<\/ul>\n<p>\u0642\u0628\u0644 \u0627\u062e\u062a\u064a\u0627\u0631 \u0646\u0645\u0648\u0630\u062c \u0645\u0627\u060c \u0627\u0633\u062a\u062e\u062f\u0645 <a href=\"https:\/\/convly.ai\/ar\/llm-vram-calculator\/\">\u062d\u0627\u0633\u0628\u0629 \u0627\u0644\u0630\u0627\u0643\u0631\u0629 VRAM<\/a> \u0644\u062a\u0623\u0643\u064a\u062f \u0625\u0645\u0643\u0627\u0646\u064a\u0629 \u0627\u0633\u062a\u064a\u0639\u0627\u0628 \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u0627\u062a (GPU) \u0644\u062f\u064a\u0643 \u0644\u0647\u0630\u0627 \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u2014 \u0641\u062a\u062a\u0641\u0627\u0648\u062a \u0627\u0644\u0645\u062a\u0637\u0644\u0628\u0627\u062a \u0627\u062e\u062a\u0644\u0627\u0641\u064b\u0627 \u0643\u0628\u064a\u0631\u064b\u0627 \u062d\u0633\u0628 \u062d\u062c\u0645 \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u0648\u0645\u0633\u062a\u0648\u0649 \u0627\u0644\u062a\u0643\u0645\u064a\u0645 (quantization).<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Installing_text-generation-webui\"><\/span>\u062a\u062b\u0628\u064a\u062a text-generation-webui<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0627\u0644\u0637\u0631\u064a\u0642\u0629 \u0627\u0644\u0645\u0648\u0635\u0649 \u0628\u0647\u0627 \u0644\u0644\u062a\u062b\u0628\u064a\u062a \u0639\u0644\u0649 \u062c\u0645\u064a\u0639 \u0627\u0644\u0645\u0646\u0635\u0627\u062a \u0647\u064a \u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0627\u0644\u0628\u0631\u0646\u0627\u0645\u062c \u0627\u0644\u0646\u0635\u064a \u0628\u062a\u062b\u0628\u064a\u062a \u0628\u0646\u0642\u0631\u0629 \u0648\u0627\u062d\u062f\u0629. \u0641\u0647\u0648 \u064a\u0646\u0634\u0626 \u0628\u064a\u0626\u0629 Conda \u0645\u0639\u0632\u0648\u0644\u0629 \u0648\u064a\u0642\u0648\u0645 \u0628\u062a\u062b\u0628\u064a\u062a \u062c\u0645\u064a\u0639 \u062a\u0628\u0639\u064a\u0627\u062a \u0628\u0627\u064a\u062b\u0648\u0646 \u062a\u0644\u0642\u0627\u0626\u064a\u064b\u0651\u0627. \u0648\u0644\u0627 \u064a\u064f\u0646\u0635\u062d \u0628\u062a\u062b\u0628\u064a\u062a\u0647 \u0641\u064a \u0628\u064a\u0626\u0629 \u0628\u0627\u064a\u062b\u0648\u0646 \u0627\u0644\u0646\u0638\u0627\u0645 \u0625\u0644\u0627 \u0625\u0630\u0627 \u0643\u0627\u0646\u062a \u0644\u062f\u064a\u0643 \u0623\u0633\u0628\u0627\u0628 \u0645\u062d\u062f\u062f\u0629 \u0644\u0630\u0644\u0643.<\/p>\n<h3>\u0648\u064a\u0646\u062f\u0648\u0632<\/h3>\n<ol>\n<li>\u0627\u0633\u062a\u0646\u0633\u062e \u0627\u0644\u0645\u0633\u062a\u0648\u062f\u0639 \u0623\u0648 \u0646\u0632\u0651\u0644 \u0645\u0644\u0641 ZIP \u0644\u0625\u0635\u062f\u0627\u0631 \u0645\u0639\u064a\u0646 \u0645\u0646 \u0635\u0641\u062d\u0629 \u0627\u0644\u0645\u0634\u0631\u0648\u0639 \u0639\u0644\u0649 GitHub:<br \/><code>git clone https:\/\/github.com\/oobabooga\/text-generation-webui<\/code><\/li>\n<li>\u0627\u0646\u0642\u0631 \u0646\u0642\u0631\u064b\u0627 \u0645\u0632\u062f\u0648\u062c\u064b\u0627 \u0639\u0644\u0649 <code>start_windows.bat<\/code> \u062f\u0627\u062e\u0644 \u0627\u0644\u0645\u062c\u0644\u062f \u0627\u0644\u0630\u064a \u062a\u0645 \u0627\u0633\u062a\u0646\u0633\u0627\u062e\u0647.<\/li>\n<li>\u0648\u064a\u0643\u062a\u0634\u0641 \u0627\u0644\u0628\u0631\u0646\u0627\u0645\u062c \u0627\u0644\u0646\u0635\u064a \u0646\u0648\u0639 \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u0627\u062a \u0627\u0644\u062e\u0627\u0635\u0629 \u0628\u0643 (NVIDIA \u0623\u0648 AMD \u0623\u0648 CPU \u0641\u0642\u0637) \u0648\u064a\u0642\u0648\u0645 \u0628\u062a\u062b\u0628\u064a\u062a \u0627\u0644\u062a\u0628\u0639\u064a\u0627\u062a \u0627\u0644\u0645\u0646\u0627\u0633\u0628\u0629 \u0644\u0647\u0627 \u2014 \u0627\u062e\u062a\u0631 \u0627\u0644\u062e\u064a\u0627\u0631 \u0627\u0644\u0645\u0644\u0627\u0626\u0645 \u0639\u0646\u062f \u0627\u0644\u0645\u0637\u0627\u0644\u0628\u0629 \u0628\u0630\u0644\u0643.<\/li>\n<li>\u0648\u0628\u0639\u062f \u0627\u0643\u062a\u0645\u0627\u0644 \u0627\u0644\u0625\u0639\u062f\u0627\u062f\u060c \u064a\u062a\u0645 \u062a\u0634\u063a\u064a\u0644 \u0627\u0644\u062e\u0627\u062f\u0645 \u062a\u0644\u0642\u0627\u0626\u064a\u064b\u0651\u0627. \u0627\u0641\u062a\u062d <code>http:\/\/localhost:7860<\/code> \u0641\u064a \u0645\u062a\u0635\u0641\u062d\u0643.<\/li>\n<\/ol>\n<p>\u0648\u0641\u064a \u0627\u0644\u062a\u0634\u063a\u064a\u0644\u0627\u062a \u0627\u0644\u0644\u0627\u062d\u0642\u0629\u060c \u0627\u0646\u0642\u0631 \u0645\u0631\u062a\u064a\u0646 \u0639\u0644\u0649 <code>start_windows.bat<\/code> \u0645\u0631\u0629 \u0623\u062e\u0631\u0649. \u062a\u0643\u0648\u0646 \u0628\u064a\u0626\u0629 Conda \u0642\u062f \u0623\u064f\u0646\u0634\u0626\u062a \u0645\u0633\u0628\u0642\u064b\u0627\u061b \u0648\u0628\u0627\u0644\u062a\u0627\u0644\u064a \u0644\u0627 \u064a\u0633\u062a\u063a\u0631\u0642 \u0628\u062f\u0621 \u0627\u0644\u062a\u0634\u063a\u064a\u0644 \u0633\u0648\u0649 \u0628\u0636\u0639 \u062b\u0648\u0627\u0646\u064d.<\/p>\n<h3>\u0644\u064a\u0646\u0643\u0633<\/h3>\n<ol>\n<li>\u0627\u0633\u062a\u0646\u0633\u062e \u0627\u0644\u0645\u0633\u062a\u0648\u062f\u0639 \u0648\u0627\u0630\u0647\u0628 \u0625\u0644\u0649 \u0627\u0644\u062f\u0644\u064a\u0644:\n<pre><code>git clone https:\/\/github.com\/oobabooga\/text-generation-webui\ncd text-generation-webui<\/code><\/pre>\n<\/li>\n<li>\u0627\u062c\u0639\u0644 \u0627\u0644\u0628\u0631\u0646\u0627\u0645\u062c \u0627\u0644\u0646\u0635\u064a \u0642\u0627\u0628\u0644\u0627\u064b \u0644\u0644\u062a\u0646\u0641\u064a\u0630 \u062b\u0645 \u0634\u063a\u0651\u0644\u0647:\n<pre><code>chmod +x start_linux.sh\n.\/start_linux.sh<\/code><\/pre>\n<\/li>\n<li>\u0627\u062e\u062a\u0631 \u0646\u0648\u0639 \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u0627\u062a \u0639\u0646\u062f \u0627\u0644\u0645\u0637\u0627\u0644\u0628\u0629: NVIDIA \u0623\u0648 AMD \u0623\u0648 CPU \u0641\u0642\u0637 \u0623\u0648 Apple Silicon (\u063a\u064a\u0631 \u0645\u062a\u0627\u062d \u0639\u0644\u0649 Linux\u060c \u0644\u0643\u0646 \u0627\u0644\u0645\u0637\u0627\u0644\u0628\u0629 \u062a\u0638\u0647\u0631 \u0631\u063a\u0645 \u0630\u0644\u0643).<\/li>\n<li>\u0627\u0641\u062a\u062d \u0648\u0627\u062c\u0647\u0629 \u0627\u0644\u0645\u0633\u062a\u062e\u062f\u0645 \u0639\u0644\u0649 \u0627\u0644\u0639\u0646\u0648\u0627\u0646 <code>http:\/\/localhost:7860<\/code> \u0628\u0645\u062c\u0631\u062f \u0623\u0646 \u064a\u0628\u062f\u0623 \u0627\u0644\u062e\u0627\u062f\u0645 \u0628\u0627\u0644\u0639\u0645\u0644.<\/li>\n<\/ol>\n<h3>macOS<\/h3>\n<ol>\n<li>\u0627\u0633\u062a\u0646\u0633\u062e \u0627\u0644\u0645\u0633\u062a\u0648\u062f\u0639 \u0648\u0634\u063a\u0651\u0644 \u0627\u0644\u0628\u0631\u0646\u0627\u0645\u062c \u0627\u0644\u0646\u0635\u064a:\n<pre><code>git clone https:\/\/github.com\/oobabooga\/text-generation-webui\ncd text-generation-webui\n.\/start_macos.sh<\/code><\/pre>\n<\/li>\n<li>\u0627\u062e\u062a\u0631 \u0627\u0644\u062e\u064a\u0627\u0631 D (Apple Silicon \/ Metal) \u0623\u0648 C (CPU \u0641\u0642\u0637) \u0639\u0646\u062f \u0627\u0644\u0645\u0637\u0627\u0644\u0628\u0629.<\/li>\n<li>\u062a\u0633\u062a\u062e\u062f\u0645 \u0648\u0627\u062c\u0647\u0629 \u0627\u0644\u062a\u0646\u0641\u064a\u0630 \u0627\u0644\u062e\u0644\u0641\u064a\u0629 llama.cpp \u062a\u0642\u0646\u064a\u0629 Metal \u0644\u062a\u062d\u0642\u064a\u0642 \u062a\u0633\u0631\u064a\u0639 GPU \u0639\u0644\u0649 \u0631\u0642\u0627\u0626\u0642 \u0633\u0644\u0633\u0644\u0629 M \u2014 \u0648\u0644\u0627 \u064a\u062a\u0637\u0644\u0628 \u0627\u0644\u0623\u0645\u0631 \u0648\u062c\u0648\u062f CUDA.<\/li>\n<\/ol>\n<p>\u064a\u0642\u062a\u0635\u0631 \u0645\u0633\u062a\u062e\u062f\u0645\u0648 \u0646\u0638\u0627\u0645 macOS \u0639\u0644\u0649 \u0648\u062d\u062f\u062a\u064a \u062a\u062d\u0645\u064a\u0644 llama.cpp \u0648Transformers \u0641\u0642\u0637. \u0623\u0645\u0627 \u0648\u062d\u062f\u0629 ExLlamaV2 \u0641\u0647\u064a \u062a\u062a\u0637\u0644\u0628 CUDA \u0648\u0644\u0627 \u062a\u0639\u0645\u0644 \u0639\u0644\u0649 \u0631\u0642\u0627\u0626\u0642 Apple Silicon.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Model_Loaders_Which_One_to_Use\"><\/span>\u0648\u062d\u062f\u0627\u062a \u062a\u062d\u0645\u064a\u0644 \u0627\u0644\u0646\u0645\u0627\u0630\u062c: \u0623\u064a \u0645\u0646\u0647\u0627 \u064a\u062c\u0628 \u0623\u0646 \u062a\u0633\u062a\u062e\u062f\u0645\u061f<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u062a\u064f\u0641\u0635\u0650\u0651\u0644 text-generation-webui \u0645\u062d\u0631\u0643 \u0627\u0644\u0627\u0633\u062a\u0646\u062a\u0627\u062c \u0639\u0646 \u0627\u0644\u0648\u0627\u062c\u0647\u0629. \u0648\u064a\u0645\u0643\u0646\u0643 \u062a\u062d\u062f\u064a\u062f \u0648\u062d\u062f\u0629 \u062a\u062d\u0645\u064a\u0644 \u0644\u0643\u0644 \u0646\u0645\u0648\u0630\u062c \u0645\u0646 \u0639\u0644\u0627\u0645\u0629 \u0627\u0644\u062a\u0628\u0648\u064a\u0628 <strong>\u0627\u0644\u0646\u0645\u0648\u0630\u062c<\/strong> .<\/p>\n<table>\n<thead>\n<tr>\n<th>\u0648\u062d\u062f\u0629 \u0627\u0644\u062a\u062d\u0645\u064a\u0644<\/th>\n<th>\u0627\u0644\u0635\u064a\u063a\u0629<\/th>\n<th>\u0627\u0644\u0623\u062c\u0647\u0632\u0629<\/th>\n<th>\u0645\u062a\u0649 \u062a\u064f\u0633\u062a\u062e\u062f\u0645<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>llama.cpp<\/td>\n<td>GGUF<\/td>\n<td>\u0646\u0641\u064a\u062f\u064a\u0627\u060c \u0625\u064a\u0647 \u0625\u0645 \u062f\u064a\u060c \u0634\u0631\u0627\u0626\u062d \u0623\u0628\u0644\u060c \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0645\u0631\u0643\u0632\u064a\u0629<\/td>\n<td>\u0627\u0644\u0648\u0636\u0639 \u0627\u0644\u0627\u0641\u062a\u0631\u0627\u0636\u064a \u0644\u0645\u0644\u0641\u0627\u062a GGUF\u061b \u0627\u0644\u0623\u0643\u062b\u0631 \u062a\u0646\u0642\u0644\u064b\u0627 \u0639\u0628\u0631 \u0627\u0644\u0645\u0646\u0635\u0627\u062a<\/td>\n<\/tr>\n<tr>\n<td>\u0625\u0643\u0633-\u0644\u0627\u0645\u0627V2<\/td>\n<td>\u0625\u0643\u0633-\u0625\u06442\u060c \u062c\u064a \u0628\u064a \u062a\u064a \u0643\u064a\u0648<\/td>\n<td>\u062e\u0627\u0635\u0629 \u0628\u0640CUDA \u0645\u0646 \u0646\u0641\u064a\u062f\u064a\u0627 \u0641\u0642\u0637<\/td>\n<td>\u0623\u0639\u0644\u0649 \u0623\u062f\u0627\u0621 \u0644\u0625\u0646\u062a\u0627\u062c \u0627\u0644\u0646\u0635\u0648\u0635 \u0639\u0644\u0649 \u0648\u062d\u062f\u0627\u062a \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u0627\u062a \u0645\u0646 \u0646\u0641\u064a\u062f\u064a\u0627\u061b \u064a\u064f\u0641\u0636\u064e\u0651\u0644 \u0627\u0633\u062a\u062e\u062f\u0627\u0645\u0647\u0627 \u0628\u062f\u0644\u064b\u0627 \u0645\u0646 \u0623\u0648\u062a\u0648 \u062c\u064a \u0628\u064a \u062a\u064a \u0643\u064a\u0648 \u0644\u0644\u0646\u0645\u0627\u0630\u062c \u0627\u0644\u062c\u062f\u064a\u062f\u0629<\/td>\n<\/tr>\n<tr>\n<td>\u0627\u0644\u0645\u062d\u0648\u0644\u0627\u062a<\/td>\n<td>\u0647\u0627\u063a\u064a\u0646\u063a \u0641\u064a\u0633 (fp16\u060c bf16\u060c int8\u060c int4)<\/td>\n<td>\u0646\u0641\u064a\u062f\u064a\u0627\u060c \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0645\u0631\u0643\u0632\u064a\u0629<\/td>\n<td>\u0627\u0644\u0646\u0645\u0627\u0630\u062c \u0627\u0644\u0623\u0635\u0644\u064a\u0629 \u0645\u0646 \u0647\u0627\u063a\u064a\u0646\u063a \u0641\u064a\u0633\u061b \u0623\u0628\u0637\u0623 \u0641\u064a \u0627\u0644\u0623\u062f\u0627\u0621 \u0644\u0643\u0646\u0647\u0627 \u062a\u0648\u0641\u0631 \u0623\u0642\u0635\u0649 \u062a\u0648\u0627\u0641\u0642 \u0645\u0645\u0643\u0646<\/td>\n<\/tr>\n<tr>\n<td>\u0623\u0648\u062a\u0648 \u0625\u064a\u0647 \u062f\u0628\u0644\u064a\u0648 \u0643\u064a\u0648<\/td>\n<td>AWQ<\/td>\n<td>CUDA \u0645\u0646 \u0646\u0641\u064a\u062f\u064a\u0627<\/td>\n<td>\u0646\u0645\u0627\u0630\u062c \u0645\u064f\u0643\u0645\u064e\u0651\u0646\u0629 \u0628\u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u062a\u0642\u0646\u064a\u0629 AWQ<\/td>\n<\/tr>\n<tr>\n<td>\u0623\u0648\u062a\u0648 \u062c\u064a \u0628\u064a \u062a\u064a \u0643\u064a\u0648<\/td>\n<td>GPTQ<\/td>\n<td>CUDA \u0645\u0646 \u0646\u0641\u064a\u062f\u064a\u0627<\/td>\n<td>\u0646\u0645\u0627\u0630\u062c \u062c\u064a \u0628\u064a \u062a\u064a \u0643\u064a\u0648 \u0627\u0644\u0642\u062f\u064a\u0645\u0629\u061b \u0625\u0643\u0633-\u0644\u0627\u0645\u0627V2 \u0623\u0633\u0631\u0639 \u0641\u064a \u062a\u0646\u0641\u064a\u0630 \u0646\u0641\u0633 \u0627\u0644\u062a\u0646\u0633\u064a\u0642<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>\u0627\u0644\u0642\u064a\u0645\u0629 \u0627\u0644\u0627\u0641\u062a\u0631\u0627\u0636\u064a\u0629 \u0627\u0644\u0639\u0645\u0644\u064a\u0629:<\/strong> \u0625\u0630\u0627 \u0642\u0645\u062a \u0628\u062a\u0646\u0632\u064a\u0644 \u0645\u0644\u0641 <code>.gguf<\/code> (\u0648\u0647\u0648 \u0627\u0644\u062a\u0646\u0633\u064a\u0642 \u0627\u0644\u0623\u0643\u062b\u0631 \u0634\u064a\u0648\u0639\u064b\u0627 \u0641\u064a \u0635\u0641\u062d\u0627\u062a \u0646\u0645\u0627\u0630\u062c \u0647\u0627\u063a\u064a\u0646\u063a \u0641\u064a\u0633)\u060c \u0641\u0627\u0633\u062a\u062e\u062f\u0645 <strong>llama.cpp<\/strong>. \u0623\u0645\u0627 \u0625\u0630\u0627 \u0643\u0627\u0646\u062a \u0644\u062f\u064a\u0643 \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0631\u0633\u0648\u0645\u0627\u062a \u0645\u0646 \u0646\u0641\u064a\u062f\u064a\u0627 \u0648\u062a\u0631\u064a\u062f \u0623\u0642\u0635\u0649 \u0633\u0631\u0639\u0629 \u0645\u0645\u0643\u0646\u0629 \u0641\u064a \u062a\u0648\u0644\u064a\u062f \u0627\u0644\u0646\u0635\u0648\u0635\u060c \u0641\u0627\u0628\u062d\u062b \u0639\u0646 \u0646\u0633\u062e\u0629 \u0645\u064f\u0643\u0645\u064e\u0651\u0646\u0629 \u0628\u0635\u064a\u063a\u0629 EXL2 \u0645\u0646 \u0646\u0641\u0633 \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u0648\u0627\u0633\u062a\u062e\u062f\u0645 <strong>\u0625\u0643\u0633-\u0644\u0627\u0645\u0627V2<\/strong>.<\/p>\n<p>\u0644\u0645\u0639\u0631\u0641\u0629 \u0627\u0644\u062a\u0641\u0627\u0635\u064a\u0644 \u0627\u0644\u0643\u0627\u0645\u0644\u0629 \u062d\u0648\u0644 \u0627\u0644\u0646\u0645\u0627\u0630\u062c \u0627\u0644\u062a\u064a \u064a\u0645\u0643\u0646 \u062a\u0634\u063a\u064a\u0644\u0647\u0627 \u0641\u0639\u0644\u064a\u064b\u0651\u0627 \u0639\u0644\u0649 \u0643\u0644 \u0646\u0648\u0639 \u0645\u0646 \u0648\u062d\u062f\u0627\u062a \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u0627\u062a\u060c \u0631\u0627\u062c\u0639 <a href=\"https:\/\/convly.ai\/ar\/vram-requirements-every-major-llm-2026\/\">\u0645\u062a\u0637\u0644\u0628\u0627\u062a \u0630\u0627\u0643\u0631\u0629 VRAM \u0644\u0644\u0646\u0645\u0627\u0630\u062c \u0627\u0644\u0644\u063a\u0648\u064a\u0629 \u0627\u0644\u0643\u0628\u064a\u0631\u0629 \u0627\u0644\u0631\u0626\u064a\u0633\u064a\u0629<\/a>.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Loading_a_GGUF_Model_Step_by_Step\"><\/span>\u062a\u062d\u0645\u064a\u0644 \u0646\u0645\u0648\u0630\u062c \u0628\u0635\u064a\u063a\u0629 GGUF \u062e\u0637\u0648\u0629 \u0628\u062e\u0637\u0648\u0629<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ol>\n<li><strong>\u0627\u0646\u0633\u062e \u0627\u0644\u0645\u0644\u0641<\/strong> \u0625\u0644\u0649 \u0627\u0644\u0645\u062c\u0644\u062f <code>text-generation-webui\/models\/<\/code>. \u0648\u062a\u064f\u0648\u0636\u0639 \u0645\u0644\u0641\u0627\u062a GGUF \u0630\u0627\u062a \u0627\u0644\u0645\u0644\u0641 \u0627\u0644\u0648\u0627\u062d\u062f \u0645\u0628\u0627\u0634\u0631\u0629\u064b (\u0645\u062b\u0644: <code>mistral-7b-instruct.Q4_K_M.gguf<\/code>) \u0641\u064a \u0647\u0630\u0627 \u0627\u0644\u0645\u062c\u0644\u062f \u0645\u0628\u0627\u0634\u0631\u0629\u064b. \u0623\u0645\u0627 \u0627\u0644\u0645\u0644\u0641\u0627\u062a \u0627\u0644\u0645\u0642\u0633\u0645\u0629 \u0625\u0644\u0649 \u0623\u062c\u0632\u0627\u0621 \u0645\u062a\u0639\u062f\u062f\u0629 \u0641\u064a\u062c\u0628 \u0648\u0636\u0639\u0647\u0627 \u062f\u0627\u062e\u0644 \u0645\u062c\u0644\u062f \u0641\u0631\u0639\u064a \u0628\u0627\u0633\u0645 \u062e\u0627\u0635.<\/li>\n<li><strong>\u0627\u0641\u062a\u062d \u0639\u0644\u0627\u0645\u0629 \u0627\u0644\u062a\u0628\u0648\u064a\u0628 \"\u0627\u0644\u0646\u0645\u0648\u0630\u062c\"<\/strong> \u0641\u064a \u0627\u0644\u0645\u0643\u062a\u0628\u0629 \u0627\u0644\u0631\u0633\u0645\u064a\u0629 \u0625\u0644\u0649 <code>http:\/\/localhost:7860<\/code>.<\/li>\n<li>\u0648\u0627\u062e\u062a\u0631 \u0645\u0644\u0641\u0643 \u0645\u0646 \u0642\u0627\u0626\u0645\u0629 \u0627\u0644\u0646\u0645\u0627\u0630\u062c \u0627\u0644\u0645\u0646\u0633\u062f\u0644\u0629 (\u0648\u0627\u0646\u0642\u0631 \u0639\u0644\u0649 \u0623\u064a\u0642\u0648\u0646\u0629 \u0627\u0644\u062a\u062d\u062f\u064a\u062b \u0625\u0630\u0627 \u0644\u0645 \u064a\u0638\u0647\u0631 \u0627\u0644\u0645\u0644\u0641).<\/li>\n<li>\u0639\u064a\u0651\u0646 \u0627\u0644\u0645\u062a\u063a\u064a\u0631 <strong>\u0648\u062d\u062f\u0629 \u0627\u0644\u062a\u062d\u0645\u064a\u0644<\/strong> \u0641\u064a \u0639\u0645\u064a\u0644 OpenAI \u0627\u0644\u062e\u0627\u0635 \u0628\u0643 \u0625\u0644\u0649 <code>llama.cpp<\/code>.<\/li>\n<li>\u0639\u064a\u0651\u0646 \u0627\u0644\u0645\u062a\u063a\u064a\u0631 <strong>n-gpu-layers<\/strong> \u0644\u0644\u062a\u062d\u0643\u0645 \u0641\u064a \u062a\u062d\u0645\u064a\u0644 \u0627\u0644\u0637\u0628\u0642\u0627\u062a \u0639\u0644\u0649 \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u0627\u062a. \u0623\u062f\u062e\u0644 \u0631\u0642\u0645\u064b\u0627 \u0643\u0628\u064a\u0631\u064b\u0627 (\u0645\u062b\u0644: <code>999<\/code>) \u0644\u062a\u062d\u0645\u064a\u0644 \u0623\u0643\u0628\u0631 \u0639\u062f\u062f \u0645\u0645\u0643\u0646 \u0645\u0646 \u0627\u0644\u0637\u0628\u0642\u0627\u062a \u0641\u064a \u0630\u0627\u0643\u0631\u0629 VRAM\u061b \u0648\u0623\u062f\u062e\u0644 <code>0<\/code> \u0644\u0644\u0627\u0633\u062a\u0646\u062a\u0627\u062c \u0628\u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0648\u062d\u062f\u0629 \u0627\u0644\u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0645\u0631\u0643\u0632\u064a\u0629 \u0641\u0642\u0637.<\/li>\n<li>\u0627\u0646\u0642\u0631 <strong>\u0627\u0636\u063a\u0637 \u0639\u0644\u0649 \u0632\u0631 \"\u062a\u062d\u0645\u064a\u0644\"<\/strong>. \u0648\u064a\u0638\u0647\u0631 \u0631\u0633\u0627\u0644\u0629 \u062a\u0623\u0643\u064a\u062f \u0641\u064a \u0645\u0631\u0628\u0639 \u0627\u0644\u062d\u0627\u0644\u0629 \u0628\u0645\u062c\u0631\u062f \u0623\u0646 \u064a\u0635\u0628\u062d \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u062c\u0627\u0647\u0632\u064b\u0627.<\/li>\n<\/ol>\n<p>\u0627\u0646\u062a\u0642\u0644 \u0625\u0644\u0649 \u0639\u0644\u0627\u0645\u0629 \u0627\u0644\u062a\u0628\u0648\u064a\u0628 <strong>\u0627\u0644\u062f\u0631\u062f\u0634\u0629<\/strong> \u0644\u0628\u062f\u0621 \u0645\u062d\u0627\u062f\u062b\u0629\u060c \u0623\u0648 \u0625\u0644\u0649 \u0639\u0644\u0627\u0645\u0629 \u0627\u0644\u062a\u0628\u0648\u064a\u0628 <strong>\u0627\u0641\u062a\u0631\u0627\u0636\u064a<\/strong> \u0625\u0643\u0645\u0627\u0644 \u0627\u0644\u0645\u0648\u062c\u0647\u0627\u062a <strong>\u0642\u0627\u0644\u0628 \u0627\u0644\u062a\u0639\u0644\u064a\u0645\u0627\u062a<\/strong> \u0627\u0644\u0645\u0648\u062c\u0648\u062f\u0629 \u0641\u064a \u0639\u0644\u0627\u0645\u0629 \u0627\u0644\u062a\u0628\u0648\u064a\u0628 \"\u0627\u0644\u0645\u0639\u0644\u0645\u0627\u062a\".<\/p>\n<h2><span class=\"ez-toc-section\" id=\"The_OpenAI-Compatible_API_Extension\"><\/span>\u0627\u0645\u062a\u062f\u0627\u062f \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u0627\u0644\u062a\u0637\u0628\u064a\u0642\u0627\u062a \u0627\u0644\u0645\u062a\u0648\u0627\u0641\u0642\u0629 \u0645\u0639 OpenAI<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0627\u0644\u0627\u0645\u062a\u062f\u0627\u062f \u0627\u0644\u0645\u062f\u0645\u062c <code>openai<\/code> \u064a\u0639\u0631\u0636 \u0646\u0642\u0627\u0637 \u0646\u0647\u0627\u064a\u0629 \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u0627\u0644\u062a\u0637\u0628\u064a\u0642\u0627\u062a (REST) \u0627\u0644\u062a\u064a \u062a\u062d\u0627\u0643\u064a \u062a\u0646\u0633\u064a\u0642 \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u062a\u0637\u0628\u064a\u0642\u0627\u062a OpenAI \u0627\u0644\u062e\u0627\u0635\u0629 \u0628\u062a\u0648\u0644\u064a\u062f \u0627\u0644\u0631\u0633\u0627\u0626\u0644 \u0648\u0627\u0644\u0646\u0635. \u0648\u064a\u0645\u0643\u0646 \u0644\u0623\u064a \u0639\u0645\u064a\u0644 \u064a\u062f\u0639\u0645 \u062a\u0639\u064a\u064a\u0646 \u0639\u0646\u0648\u0627\u0646 URL \u0623\u0633\u0627\u0633\u064a \u0645\u062e\u0635\u0635 \u2014 \u0645\u062b\u0644 LangChain \u0623\u0648 Open WebUI \u0623\u0648 Continue.dev \u0623\u0648 \u062d\u062a\u0649 \u0646\u0635 \u0628\u0631\u0645\u062c\u064a \u0639\u0627\u062f\u064a \u0628\u0644\u063a\u0629 <code>curl<\/code> \u0628\u0627\u064a\u062b\u0648\u0646<\/p>\n<p>\u0641\u0639\u0651\u0644\u0647 \u0639\u0628\u0631 \u062a\u0645\u0631\u064a\u0631 \u0639\u0644\u0627\u0645\u0629 \u0639\u0646\u062f \u0628\u062f\u0621 \u0627\u0644\u062a\u0634\u063a\u064a\u0644:<\/p>\n<pre><code># \u0644\u064a\u0646\u0643\u0633 \/ \u0645\u0627\u0643 \u0623\u0648 \u0625\u0633\n.\/start_linux.sh --extensions openai\n\n# \u0623\u0648 \u0634\u063a\u0651\u0644 server.py \u0645\u0628\u0627\u0634\u0631\u0629\u064b \u062f\u0627\u062e\u0644 \u0628\u064a\u0626\u0629 Conda\npython server.py --extensions openai<\/code><\/pre>\n<p>\u0648\u0628\u0627\u0644 alternatively\u060c \u064a\u0645\u0643\u0646\u0643 \u062a\u0641\u0639\u064a\u0644\u0647 \u0645\u0646 \u0639\u0644\u0627\u0645\u0629 \u0627\u0644\u062a\u0628\u0648\u064a\u0628 <strong>\u0627\u0644\u062c\u0644\u0633\u0629<\/strong> \u0641\u064a \u0648\u0627\u062c\u0647\u0629 \u0627\u0644\u0645\u0633\u062a\u062e\u062f\u0645\u060c \u062b\u0645 \u0627\u0646\u0642\u0631 \u0639\u0644\u0649 <strong>\u062a\u0637\u0628\u064a\u0642 \u0627\u0644\u0639\u0644\u0627\u0645\u0627\u062a \/ \u0625\u0639\u0627\u062f\u0629 \u0627\u0644\u062a\u0634\u063a\u064a\u0644<\/strong>.<\/p>\n<p>\u0648\u0628\u0634\u0643\u0644 \u0627\u0641\u062a\u0631\u0627\u0636\u064a\u060c \u062a\u0633\u062a\u0645\u0639 \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u0627\u0644\u062a\u0637\u0628\u064a\u0642\u0627\u062a \u0647\u0630\u0647 \u0639\u0644\u0649 \u0627\u0644\u0645\u0646\u0641\u0630 5000\u060c \u0648\u0647\u0648 \u0645\u0646\u0641\u0635\u0644 \u0639\u0646 \u0648\u0627\u062c\u0647\u0629 Gradio \u0627\u0644\u062a\u064a \u062a\u0639\u0645\u0644 \u0639\u0644\u0649 \u0627\u0644\u0645\u0646\u0641\u0630 7860. \u0648\u062c\u0651\u0647 \u0639\u0645\u064a\u0644\u0643 \u0625\u0644\u0649 \u0627\u0644\u0639\u0646\u0648\u0627\u0646 \u0627\u0644\u062a\u0627\u0644\u064a:<\/p>\n<pre><code>base_url = \"http:\/\/localhost:5000\/v1\"\napi_key  = \"anything\"  # \u0645\u0637\u0644\u0648\u0628\u0629 \u0645\u0646 \u0645\u0639\u0638\u0645 \u0627\u0644\u0639\u0645\u0644\u0627\u0621 \u0644\u0643\u0646\u0647\u0627 \u063a\u064a\u0631 \u0645\u064f\u062d\u0642\u064e\u0651\u0642\u0629 \u0645\u062d\u0644\u064a\u064b\u0651\u0627<\/code><\/pre>\n<p>\u062a\u0634\u0645\u0644 \u0646\u0642\u0627\u0637 \u0627\u0644\u0646\u0647\u0627\u064a\u0629 \u0627\u0644\u0645\u062f\u0639\u0648\u0645\u0629 <code>\/v1\/chat\/completions<\/code>, <code>\/v1\/completions<\/code>\u060c \u0648 <code>\/v1\/models<\/code>. \u0648\u064a\u0645\u0643\u0646 \u062a\u063a\u064a\u064a\u0631 \u0627\u0644\u0645\u0646\u0641\u0630 \u0639\u0628\u0631 \u0639\u0644\u0627\u0645\u0629 \u0628\u062f\u0621 \u0627\u0644\u062a\u0634\u063a\u064a\u0644 <code>--api-port<\/code> .<\/p>\n<h2><span class=\"ez-toc-section\" id=\"text-generation-webui_vs_LM_Studio_vs_Jan\"><\/span>\u0645\u0642\u0627\u0631\u0646\u0629 \u0628\u064a\u0646 text-generation-webui \u0648LM Studio \u0648Jan<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u062a\u0642\u0648\u0645 \u062c\u0645\u064a\u0639 \u0627\u0644\u0623\u062f\u0648\u0627\u062a \u0627\u0644\u062b\u0644\u0627\u062b \u0628\u062a\u0634\u063a\u064a\u0644 \u0627\u0644\u0646\u0645\u0627\u0630\u062c \u0645\u062d\u0644\u064a\u064b\u0651\u0627 \u062f\u0648\u0646 \u0627\u0644\u0627\u0639\u062a\u0645\u0627\u062f \u0639\u0644\u0649 \u0627\u0644\u062e\u062f\u0645\u0627\u062a \u0627\u0644\u0633\u062d\u0627\u0628\u064a\u0629. \u0648\u0647\u064a \u0645\u0648\u062c\u064e\u0651\u0647\u0629 \u0644\u0645\u062c\u0645\u0648\u0639\u0627\u062a \u0645\u0633\u062a\u062e\u062f\u0645\u064a\u0646 \u0648\u062d\u0627\u0644\u0627\u062a \u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0645\u062e\u062a\u0644\u0641\u0629.<\/p>\n<table>\n<thead>\n<tr>\n<th><\/th>\n<th>text-generation-webui<\/th>\n<th>LM Studio<\/th>\n<th>\u064a\u0646\u0627\u064a\u0631<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>\u0627\u0644\u0648\u0627\u062c\u0647\u0629<\/td>\n<td>\u0627\u0644\u0645\u062a\u0635\u0641\u062d (Gradio)<\/td>\n<td>\u0633\u0637\u062d \u0627\u0644\u0645\u0643\u062a\u0628 \u0627\u0644\u0623\u0635\u0644\u064a<\/td>\n<td>\u0633\u0637\u062d \u0627\u0644\u0645\u0643\u062a\u0628 \u0627\u0644\u0623\u0635\u0644\u064a<\/td>\n<\/tr>\n<tr>\n<td>\u062f\u0631\u062c\u0629 \u062a\u0639\u0642\u064a\u062f \u0627\u0644\u0625\u0639\u062f\u0627\u062f<\/td>\n<td>\u0645\u062a\u0648\u0633\u0637 (\u0628\u0631\u0646\u0627\u0645\u062c \u0646\u0635\u064a \u0628\u0646\u0642\u0631\u0629 \u0648\u0627\u062d\u062f\u0629)<\/td>\n<td>\u0645\u0646\u062e\u0641\u0636 (\u0645\u064f\u062b\u0628\u0650\u0651\u062a \u0648\u0627\u062c\u0647\u0629 \u0631\u0633\u0648\u0645\u064a\u0629)<\/td>\n<td>\u0645\u0646\u062e\u0641\u0636 (\u0645\u064f\u062b\u0628\u0650\u0651\u062a \u0648\u0627\u062c\u0647\u0629 \u0631\u0633\u0648\u0645\u064a\u0629)<\/td>\n<\/tr>\n<tr>\n<td>\u0635\u064a\u063a \u0627\u0644\u0646\u0645\u0627\u0630\u062c<\/td>\n<td>GGUF\u060c EXL2\u060c GPTQ\u060c AWQ\u060c HF fp16<\/td>\n<td>GGUF \u0628\u0634\u0643\u0644 \u0631\u0626\u064a\u0633\u064a<\/td>\n<td>GGUF \u0628\u0634\u0643\u0644 \u0631\u0626\u064a\u0633\u064a<\/td>\n<\/tr>\n<tr>\n<td>\u0645\u0633\u062a\u0639\u0631\u0636 \u0646\u0645\u0627\u0630\u062c \u0645\u062f\u0645\u062c<\/td>\n<td>\u0644\u0627<\/td>\n<td>\u0646\u0639\u0645<\/td>\n<td>\u0646\u0639\u0645<\/td>\n<\/tr>\n<tr>\n<td>\u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u062a\u0637\u0628\u064a\u0642\u0627\u062a \u0645\u062a\u0648\u0627\u0641\u0642\u0629 \u0645\u0639 OpenAI<\/td>\n<td>\u0646\u0639\u0645 (\u0627\u0645\u062a\u062f\u0627\u062f)<\/td>\n<td>\u0646\u0639\u0645 (\u0645\u062f\u0645\u062c)<\/td>\n<td>\u0646\u0639\u0645 (\u0645\u062f\u0645\u062c)<\/td>\n<\/tr>\n<tr>\n<td>\u0646\u0638\u0627\u0645 \u0627\u0644\u0627\u0645\u062a\u062f\u0627\u062f\u0627\u062a\/\u0627\u0644\u0645\u0644\u062d\u0642\u0627\u062a<\/td>\n<td>\u0646\u0639\u0645<\/td>\n<td>\u0645\u062d\u062f\u0648\u062f<\/td>\n<td>\u0645\u062d\u062f\u0648\u062f<\/td>\n<\/tr>\n<tr>\n<td>\u0631\u0642\u0627\u0642\u0627\u062a \u0623\u0628\u0644 Silicon (Metal)<\/td>\n<td>\u0646\u0639\u0645 (llama.cpp)<\/td>\n<td>\u0646\u0639\u0645<\/td>\n<td>\u0646\u0639\u0645<\/td>\n<\/tr>\n<tr>\n<td>\u0627\u0644\u0623\u0641\u0636\u0644 \u0644\u0640<\/td>\n<td>\u0627\u0644\u0645\u0633\u062a\u062e\u062f\u0645\u0648\u0646 \u0627\u0644\u0645\u062a\u0642\u062f\u0651\u0645\u0648\u0646\u060c \u0648\u0627\u0644\u0623\u062a\u0645\u062a\u0629\u060c \u0648\u0627\u0644\u0628\u062d\u062b \u0627\u0644\u0639\u0644\u0645\u064a<\/td>\n<td>\u0627\u0644\u0645\u0628\u062a\u062f\u0626\u0648\u0646\u060c \u0648\u0627\u0644\u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0627\u0644\u064a\u0648\u0645\u064a \u0644\u0644\u062f\u0631\u062f\u0634\u0629<\/td>\n<td>\u0627\u0644\u0645\u0633\u062a\u062e\u062f\u0645\u0648\u0646 \u0627\u0644\u0630\u064a\u0646 \u064a\u0631\u0643\u0651\u0632\u0648\u0646 \u0639\u0644\u0649 \u0627\u0644\u0645\u0635\u0627\u062f\u0631 \u0627\u0644\u0645\u0641\u062a\u0648\u062d\u0629<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>\u0627\u062e\u062a\u0631 text-generation-webui<\/strong> \u0639\u0646\u062f\u0645\u0627 \u062a\u062d\u062a\u0627\u062c \u0625\u0644\u0649 \u0639\u062f\u0629 \u0648\u0627\u062c\u0647\u0627\u062a \u062a\u062d\u0645\u064a\u0644 \u0644\u0644\u0646\u0645\u0627\u0630\u062c\u060c \u0623\u0648 \u0623\u062f\u0627\u0621\u064b \u0645\u062a\u0641\u0648\u0642\u064b\u0627 \u0644\u0640 EXL2 \u0639\u0644\u0649 \u0628\u0637\u0627\u0642\u0627\u062a NVIDIA \u0627\u0644\u0631\u0633\u0648\u0645\u064a\u0629\u060c \u0623\u0648 \u062f\u0639\u0645 \u062a\u062d\u0645\u064a\u0644 \u0646\u0645\u0627\u0630\u062c LoRA\u060c \u0623\u0648 \u0646\u0638\u0627\u0645 \u0627\u0644\u0627\u0645\u062a\u062f\u0627\u062f\u0627\u062a \u0627\u0644\u063a\u0646\u064a\u060c \u0623\u0648 \u0627\u0644\u0648\u0635\u0648\u0644 \u0627\u0644\u0628\u0631\u0645\u062c\u064a \u0639\u0628\u0631 \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u0627\u0644\u062a\u0637\u0628\u064a\u0642\u0627\u062a (API) \u0644\u0623\u062a\u0645\u062a\u0629 \u0633\u064a\u0631 \u0627\u0644\u0639\u0645\u0644 \u0648\u062a\u0637\u0648\u064a\u0631\u0647.<\/p>\n<p><strong>\u0627\u062e\u062a\u0631 LM Studio \u0623\u0648 Jan<\/strong> \u0639\u0646\u062f\u0645\u0627 \u062a\u0631\u063a\u0628 \u0641\u064a \u0645\u064f\u062b\u0628\u0650\u0651\u062a\u064d \u062c\u0627\u0647\u0632\u064d \u0648\u0645\u064f\u062d\u0633\u064e\u0651\u0646\u060c \u0645\u0639 \u062e\u0627\u0635\u064a\u0629 \u0627\u0644\u0628\u062d\u062b \u0627\u0644\u0645\u062f\u0645\u062c\u0629 \u0639\u0646 \u0627\u0644\u0646\u0645\u0627\u0630\u062c \u0648\u062a\u0646\u0632\u064a\u0644\u0647\u0627 \u0628\u0646\u0642\u0631\u0629 \u0648\u0627\u062d\u062f\u0629\u060c \u0648\u0628\u0623\u0642\u0644 \u0642\u062f\u0631 \u0645\u0645\u0643\u0646 \u0645\u0646 \u0627\u0644\u062a\u0647\u064a\u0626\u0629. \u0631\u0627\u062c\u0639 <a href=\"https:\/\/convly.ai\/ar\/lm-studio-complete-guide-2026\/\">\u0627\u0644\u062f\u0644\u064a\u0644 \u0627\u0644\u0643\u0627\u0645\u0644 \u0644\u0640 LM Studio<\/a> \u0644\u0644\u0627\u0637\u0651\u0644\u0627\u0639 \u0639\u0644\u0649 \u0634\u0631\u062d\u064d \u062a\u0641\u0635\u064a\u0644\u064a\u064d\u0651 \u0644\u0647\u0630\u0647 \u0627\u0644\u062e\u064a\u0627\u0631\u0627\u062a.<\/p>\n<p>\u0625\u0630\u0627 \u0643\u0646\u062a \u062a\u062a\u0633\u0627\u0621\u0644 \u0639\u0645\u0627 \u0625\u0630\u0627 \u0643\u0627\u0646\u062a \u0627\u0644\u0627\u0633\u062a\u0646\u062a\u0627\u062c\u0627\u062a \u0627\u0644\u0645\u062d\u0644\u064a\u0629 \u062a\u0633\u062a\u062d\u0642 \u0627\u0644\u062a\u0643\u0644\u0641\u0629 \u0627\u0644\u0645\u0627\u062f\u064a\u0629 \u0644\u0644\u0623\u062c\u0647\u0632\u0629 \u0623\u0645 \u0644\u0627\u060c \u0641\u0625\u0646 <a href=\"https:\/\/convly.ai\/ar\/self-hosting-vs-api-calculator\/\">\u062d\u0627\u0633\u0628\u0629 \u0646\u0642\u0637\u0629 \u0627\u0644\u062a\u0639\u0627\u062f\u0644 \u0628\u064a\u0646 \u0627\u0644\u0627\u0633\u062a\u0636\u0627\u0641\u0629 \u0627\u0644\u0645\u062d\u0644\u064a\u0629 \u0648\u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u0627\u0644\u062a\u0637\u0628\u064a\u0642\u0627\u062a (API)<\/a> \u064a\u0645\u0643\u0646 \u0623\u0646 \u064a\u064f\u0642\u064a\u0651\u0645 \u0628\u062f\u0642\u0629 \u0627\u0644\u062a\u0648\u0627\u0632\u0646 \u0628\u064a\u0646 \u0647\u0630\u0647 \u0627\u0644\u062a\u0643\u0644\u0641\u0629 \u0648\u0628\u064a\u0646 \u062f\u0641\u0639 \u0631\u0633\u0648\u0645 \u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u0627\u0644\u062a\u0637\u0628\u064a\u0642\u0627\u062a (API) \u0648\u0641\u0642\u064b\u0627 \u0644\u062d\u062c\u0645 \u0627\u0633\u062a\u062e\u062f\u0627\u0645\u0643.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Frequently_Asked_Questions\"><\/span>\u0627\u0644\u0623\u0633\u0626\u0644\u0629 \u0627\u0644\u0634\u0627\u0626\u0639\u0629<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3>\u0644\u0645\u0627\u0630\u0627 \u064a\u0633\u062a\u063a\u0631\u0642 \u0627\u0644\u0645\u064f\u062b\u0628\u0650\u0651\u062a \u0628\u0646\u0642\u0631\u0629 \u0648\u0627\u062d\u062f\u0629 \u0648\u0642\u062a\u064b\u0627 \u0637\u0648\u064a\u0644\u0627\u064b \u0641\u064a \u0627\u0644\u0645\u0631\u0629 \u0627\u0644\u0623\u0648\u0644\u0649\u061f<\/h3>\n<p>\u0644\u0623\u0646\u0647 \u064a\u0642\u0648\u0645 \u0628\u062a\u0646\u0632\u064a\u0644 Miniconda \u0648\u0628\u0646\u0627\u0621 \u0628\u064a\u0626\u0629 \u0628\u0627\u064a\u062b\u0648\u0646 \u0645\u0639\u0632\u0648\u0644\u0629 \u062a\u062d\u062a\u0648\u064a \u0639\u0644\u0649 \u0645\u0643\u062a\u0628\u0629 PyTorch \u0648\u062c\u0645\u064a\u0639 \u0645\u0643\u062a\u0628\u0627\u062a \u062a\u062d\u0645\u064a\u0644 \u0627\u0644\u0646\u0645\u0627\u0630\u062c \u0645\u0646 \u0627\u0644\u0635\u0641\u0631. \u0648\u0639\u0644\u0649 \u0627\u062a\u0635\u0627\u0644 \u0633\u0631\u064a\u0639\u060c \u064a\u0633\u062a\u063a\u0631\u0642 \u0630\u0644\u0643 \u0639\u0627\u062f\u0629\u064b \u0645\u0627 \u0628\u064a\u0646 \u0665 \u0648\u0661\u0665 \u062f\u0642\u064a\u0642\u0629. \u0623\u0645\u0627 \u0627\u0644\u062a\u0634\u063a\u064a\u0644\u0627\u062a \u0627\u0644\u0644\u0627\u062d\u0642\u0629 \u0641\u062a\u062a\u062c\u0627\u0648\u0632 \u0647\u0630\u0647 \u0627\u0644\u062e\u0637\u0648\u0629 \u0648\u062a\u0628\u062f\u0623 \u062e\u0644\u0627\u0644 \u0628\u0636\u0639 \u062b\u0648\u0627\u0646\u064d \u0641\u0642\u0637.<\/p>\n<h3>\u0647\u0644 \u064a\u0645\u0643\u0646\u0646\u064a \u062a\u0634\u063a\u064a\u0644 text-generation-webui \u0628\u062f\u0648\u0646 \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0631\u0633\u0648\u0645\u064a\u0629 (GPU)\u061f<\/h3>\n<p>\u0646\u0639\u0645. \u0627\u062e\u062a\u0631 \u062e\u064a\u0627\u0631 \u00abCPU-only\u00bb \u0623\u062b\u0646\u0627\u0621 \u0627\u0644\u062a\u062b\u0628\u064a\u062a\u060c \u062b\u0645 \u0639\u064a\u0651\u0646 <code>n-gpu-layers<\/code> \u0641\u064a \u0639\u0645\u064a\u0644 OpenAI \u0627\u0644\u062e\u0627\u0635 \u0628\u0643 \u0625\u0644\u0649 <code>0<\/code> \u0639\u0646\u062f \u062a\u062d\u0645\u064a\u0644 \u0646\u0645\u0648\u0630\u062c \u0628\u0635\u064a\u063a\u0629 GGUF. \u0648\u0642\u062f \u064a\u0648\u0644\u0651\u062f \u0646\u0645\u0648\u0630\u062c \u0628\u062d\u062c\u0645 \u0667 \u0645\u0644\u064a\u0627\u0631 \u0645\u0639\u0644\u0645\u0629 (7B) \u0645\u0627 \u0628\u064a\u0646 \u0662 \u0648\u0665 \u0631\u0645\u0648\u0632 \u0641\u064a \u0627\u0644\u062b\u0627\u0646\u064a\u0629 \u0639\u0644\u0649 \u0648\u062d\u062f\u0629 \u0645\u0639\u0627\u0644\u062c\u0629 \u0645\u0631\u0643\u0632\u064a\u0629 \u062d\u062f\u064a\u062b\u0629 \u0644\u0633\u0637\u062d \u0627\u0644\u0645\u0643\u062a\u0628 \u2014 \u0648\u0647\u064a \u0633\u0631\u0639\u0629 \u0643\u0627\u0641\u064a\u0629 \u0644\u0644\u0627\u062e\u062a\u0628\u0627\u0631\u060c \u0644\u0643\u0646\u0647\u0627 \u0628\u0637\u064a\u0626\u0629 \u062c\u062f\u064b\u0651\u0627 \u0644\u0644\u062f\u0631\u062f\u0634\u0629 \u0627\u0644\u0639\u0627\u062f\u064a\u0629. \u0643\u0645\u0627 \u0623\u0646 \u0627\u0644\u062a\u0643\u0645\u064a\u0646\u0627\u062a \u0627\u0644\u0623\u0635\u063a\u0631 (\u0645\u062b\u0644 Q4 \u0648\u0645\u0627 \u062f\u0648\u0646\u0647\u0627) \u062a\u062d\u0633\u0651\u0646 \u0627\u0644\u0623\u062f\u0627\u0621. \u064a\u0645\u0643\u0646\u0643 \u0627\u0644\u0627\u0637\u0651\u0644\u0627\u0639 \u0639\u0644\u0649 <a href=\"https:\/\/convly.ai\/ar\/best-gpus-for-local-llms-2026\/\">\u0623\u0641\u0636\u0644 \u0648\u062d\u062f\u0627\u062a \u0645\u0639\u0627\u0644\u062c\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u064a\u0627\u062a \u0644\u062a\u0634\u063a\u064a\u0644 \u0646\u0645\u0627\u0630\u062c \u0627\u0644\u0644\u063a\u0629 \u0627\u0644\u0643\u0628\u064a\u0631\u0629 \u0645\u062d\u0644\u064a\u064b\u0651\u0627<\/a> \u0625\u0630\u0627 \u0643\u0646\u062a \u062a\u0641\u0643\u0631 \u0641\u064a \u062a\u0631\u0642\u064a\u0629 \u0623\u062c\u0647\u0632\u062a\u0643.<\/p>\n<h3>\u0643\u064a\u0641 \u0623\u064f\u062d\u062f\u0650\u0651\u062b text-generation-webui\u061f<\/h3>\n<p>\u062a\u0634\u063a\u064a\u0644 <code>git pull<\/code> \u062f\u0627\u062e\u0644 \u062f\u0644\u064a\u0644 \u0627\u0644\u0645\u0633\u062a\u0648\u062f\u0639 \u0644\u0627\u0633\u062a\u0631\u062c\u0627\u0639 \u0623\u062d\u062f\u062b \u0627\u0644\u0634\u064a\u0641\u0631\u0629\u060c \u062b\u0645 \u0623\u0639\u062f \u062a\u0634\u063a\u064a\u0644 \u0646\u0635 \u0628\u062f\u0621 \u0627\u0644\u062a\u0634\u063a\u064a\u0644. \u0648\u064a\u0643\u062a\u0634\u0641 \u0627\u0644\u0646\u0635 \u062a\u0644\u0642\u0627\u0626\u064a\u064b\u0651\u0627 \u0623\u064a \u062a\u063a\u064a\u0651\u0631\u0627\u062a \u0641\u064a \u0627\u0644\u0628\u064a\u0626\u0629 \u0648\u064a\u062d\u062f\u0651\u062b \u0627\u0644\u062a\u0628\u0639\u064a\u0627\u062a \u062a\u0644\u0642\u0627\u0626\u064a\u064b\u0651\u0627. \u0643\u0645\u0627 \u064a\u0645\u0643\u0646\u0643 \u062a\u0646\u0641\u064a\u0630 \u0627\u0644\u0623\u0645\u0631 <code>\u062a\u062b\u0628\u064a\u062a \u0646\u0642\u0637\u0629 \u062a\u062b\u0628\u064a\u062a -r requirements.txt<\/code> \u064a\u062f\u0648\u064a\u064b\u0651\u0627 \u062f\u0627\u062e\u0644 \u0628\u064a\u0626\u0629 Conda \u0627\u0644\u0646\u0634\u0637\u0629 \u0625\u0630\u0627 \u0641\u0636\u0651\u0644\u062a \u062a\u062d\u062f\u064a\u062b\u064b\u0627 \u0623\u0643\u062b\u0631 \u062a\u062d\u062f\u064a\u062f\u064b\u0627.<\/p>\n<h3>\u0645\u0627 \u0627\u0644\u0641\u0631\u0642 \u0628\u064a\u0646 GGUF \u0648EXL2\u061f<\/h3>\n<p>\u0643\u0644\u0627 \u0627\u0644\u062a\u0646\u0633\u064a\u0642\u064a\u0646 \u0647\u0645\u0627 \u062a\u0646\u0633\u064a\u0642\u0627\u0646 \u0645\u0643\u0645\u0651\u0646\u0627\u0646 \u064a\u0642\u0644\u0651\u0644\u0627\u0646 \u0645\u0646 \u062d\u062c\u0645 \u0645\u0644\u0641 \u0627\u0644\u0646\u0645\u0648\u0630\u062c \u0648\u0645\u062a\u0637\u0644\u0628\u0627\u062a \u0627\u0644\u0630\u0627\u0643\u0631\u0629 \u0627\u0644\u0631\u0633\u0648\u0645\u064a\u0629 (VRAM). \u0648\u064a\u0639\u0645\u0644 GGUF (\u0639\u0628\u0631 llama.cpp) \u0639\u0644\u0649 \u0628\u0637\u0627\u0642\u0627\u062a NVIDIA \u0648AMD \u0648\u0631\u0642\u0627\u0642\u0627\u062a \u0623\u0628\u0644 Silicon\u060c \u0648\u0647\u0648 \u0627\u0644\u062e\u064a\u0627\u0631 \u0627\u0644\u0623\u0643\u062b\u0631 \u062a\u0646\u0642\u0644\u064b\u0627 \u0648\u064a\u062a\u0648\u0641\u0631 \u0639\u0644\u064a\u0647 \u0623\u0643\u0628\u0631 \u0639\u062f\u062f \u0645\u0646 \u0627\u0644\u0646\u0645\u0627\u0630\u062c. \u0623\u0645\u0627 EXL2 (\u0639\u0628\u0631 ExLlamaV2) \u0641\u0647\u0648 \u0645\u062e\u0635\u0635 \u0641\u0642\u0637 \u0644\u0628\u0637\u0627\u0642\u0627\u062a NVIDIA\u060c \u0644\u0643\u0646\u0647 \u0639\u0627\u062f\u0629\u064b \u0645\u0627 \u064a\u0648\u0644\u0651\u062f \u0627\u0644\u0631\u0645\u0648\u0632 \u0623\u0633\u0631\u0639 \u0639\u0646\u062f \u062c\u0648\u062f\u0629 \u0645\u0643\u0627\u0641\u0626\u0629. \u0641\u0625\u0630\u0627 \u0643\u0627\u0646\u062a \u0644\u062f\u064a\u0643 \u0628\u0637\u0627\u0642\u0629 \u0631\u0633\u0648\u0645\u064a\u0629 \u0645\u0646 NVIDIA \u0648\u0643\u0627\u0646\u062a \u0627\u0644\u0633\u0631\u0639\u0629 \u0647\u064a \u0623\u0648\u0644\u0648\u064a\u062a\u0643 \u0627\u0644\u0642\u0635\u0648\u0649\u060c \u0641\u0625\u0646 \u0627\u0633\u062a\u062e\u062f\u0627\u0645 EXL2 \u064a\u0633\u062a\u062d\u0642 \u0627\u0644\u0645\u062d\u0627\u0648\u0644\u0629.<\/p>\n<h3>\u0623\u064a\u0646 \u064a\u062a\u0645 \u062d\u0641\u0638 \u0633\u062c\u0644\u0627\u062a \u0627\u0644\u0645\u062d\u0627\u062f\u062b\u0627\u062a\u061f<\/h3>\n<p>\u064a\u062a\u0645 \u062a\u062e\u0632\u064a\u0646 \u0627\u0644\u0633\u062c\u0644\u0627\u062a \u0636\u0645\u0646 \u0627\u0644\u0645\u062c\u0644\u062f <code>text-generation-webui\/logs\/<\/code>. \u0648\u064a\u064f\u062d\u0641\u0638 \u0643\u0644 \u0645\u062d\u0627\u062f\u062b\u0629 \u0643\u0645\u0644\u0641 JSON. \u0643\u0645\u0627 \u064a\u0645\u0643\u0646\u0643 \u062a\u0635\u062f\u064a\u0631 \u0627\u0644\u0633\u062c\u0644\u0627\u062a \u0645\u0628\u0627\u0634\u0631\u0629\u064b \u0645\u0646 \u0648\u0627\u062c\u0647\u0629 \u0639\u0644\u0627\u0645\u0629 \u0627\u0644\u062a\u0628\u0648\u064a\u0628 \u00abChat\u00bb \u0628\u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0632\u0631 \u0627\u0644\u062a\u0646\u0632\u064a\u0644 \u0627\u0644\u0645\u0648\u062c\u0648\u062f \u0623\u0633\u0641\u0644 \u0646\u0627\u0641\u0630\u0629 \u0627\u0644\u0645\u062d\u0627\u062f\u062b\u0629.<\/p>\n<h3>\u0647\u0644 \u064a\u0645\u0643\u0646 \u0644\u0639\u062f\u0629 \u0645\u0633\u062a\u062e\u062f\u0645\u064a\u0646 \u0627\u0644\u0627\u062a\u0635\u0627\u0644 \u0628\u0645\u062b\u0628\u0651\u062a \u0648\u0627\u062d\u062f\u061f<\/h3>\n<p>\u0627\u0644\u0640 <code>--listen<\/code> \u064a\u062c\u0639\u0644 \u0627\u0644\u062e\u0627\u062f\u0645 \u0645\u062a\u0627\u062d\u064b\u0627 \u0639\u0628\u0631 \u0634\u0628\u0643\u062a\u0643 \u0627\u0644\u0645\u062d\u0644\u064a\u0629 \u0628\u062f\u0644\u064b\u0627 \u0645\u0646 \u0623\u0646 \u064a\u0643\u0648\u0646 \u0645\u062d\u0635\u0648\u0631\u064b\u0627 \u0639\u0644\u0649 localhost \u0641\u0642\u0637. \u0648\u0645\u0639 \u0630\u0644\u0643\u060c \u0644\u0645 \u064a\u064f\u0635\u0645\u064e\u0651\u0645 text-generation-webui \u0644\u0644\u0627\u0633\u062a\u062e\u062f\u0627\u0645 \u0627\u0644\u0625\u0646\u062a\u0627\u062c\u064a \u0645\u062a\u0639\u062f\u062f \u0627\u0644\u0645\u0633\u062a\u062e\u062f\u0645\u064a\u0646 \u2014 \u0625\u0630 \u0644\u0627 \u064a\u062d\u062a\u0648\u064a \u0639\u0644\u0649 \u0622\u0644\u064a\u0629 \u0645\u0635\u0627\u062f\u0642\u0629 \u0645\u062f\u0645\u062c\u0629\u060c \u0648\u0648\u0627\u062c\u0647\u0629 Gradio \u0627\u0644\u062e\u0627\u0635\u0629 \u0628\u0647 \u062a\u0639\u0645\u0644 \u0636\u0645\u0646 \u062c\u0644\u0633\u0629 \u0648\u0627\u062d\u062f\u0629 \u0641\u0642\u0637. \u0623\u0645\u0627 \u0627\u0645\u062a\u062f\u0627\u062f \u0648\u0627\u062c\u0647\u0629 \u0628\u0631\u0645\u062c\u0629 \u062a\u0637\u0628\u064a\u0642\u0627\u062a OpenAI \u0641\u064a\u062a\u0639\u0627\u0645\u0644 \u0645\u0639 \u0637\u0644\u0628\u0627\u062a \u0627\u0644\u0648\u0627\u062c\u0647\u0629 \u0627\u0644\u0628\u0631\u0645\u062c\u064a\u0629 \u0627\u0644\u0645\u062a\u0632\u0627\u0645\u0646\u0629 \u0628\u0643\u0641\u0627\u0621\u0629 \u0623\u0639\u0644\u0649 \u0645\u0646 \u0648\u0627\u062c\u0647\u0629 \u0627\u0644\u0648\u064a\u0628 \u0641\u064a \u0627\u0644\u0633\u064a\u0646\u0627\u0631\u064a\u0648\u0647\u0627\u062a \u0627\u0644\u062a\u064a \u062a\u062a\u0636\u0645\u0651\u0646 \u0639\u062f\u0629 \u0639\u0645\u0644\u0627\u0621\u060c \u0644\u0643\u0646\u0643 \u064a\u062c\u0628 \u0623\u0646 \u062a\u0636\u064a\u0641 \u0648\u0643\u064a\u0644 \u0639\u0643\u0633\u064a\u0629 (reverse proxy) \u0645\u0632\u0648\u0651\u062f\u064b\u0627 \u0628\u0645\u064a\u0632\u0629 \u0627\u0644\u0645\u0635\u0627\u062f\u0642\u0629 \u0623\u0645\u0627\u0645\u0647 \u0625\u0630\u0627 \u0643\u0646\u062a \u062a\u0646\u0648\u064a \u0625\u062a\u0627\u062d\u062a\u0647 \u062e\u0627\u0631\u062c \u0646\u0637\u0627\u0642 localhost.<\/p>","protected":false},"excerpt":{"rendered":"<p>text-generation-webui (widely called oobabooga after its GitHub author) is a free, open-source, browser-based interface for running LLMs locally on your [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2183,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[7],"tags":[],"class_list":["post-2182","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-news"],"_links":{"self":[{"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/posts\/2182","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/comments?post=2182"}],"version-history":[{"count":1,"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/posts\/2182\/revisions"}],"predecessor-version":[{"id":2184,"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/posts\/2182\/revisions\/2184"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/media\/2183"}],"wp:attachment":[{"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/media?parent=2182"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/categories?post=2182"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/convly.ai\/ar\/wp-json\/wp\/v2\/tags?post=2182"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}