{"id":10020814,"date":"2025-06-05T19:20:33","date_gmt":"2025-06-05T11:20:33","guid":{"rendered":"https:\/\/itmax.cn\/?p=10020814"},"modified":"2025-06-05T19:20:33","modified_gmt":"2025-06-05T11:20:33","slug":"%f0%9f%9a%80-%e5%bd%bb%e5%ba%95%e5%91%8a%e5%88%ab%e4%bb%98%e8%b4%b9-api%ef%bc%81%e6%9c%ac%e5%9c%b0%e9%83%a8%e7%bd%b2%ef%bc%8c%e6%89%93%e9%80%a0%e6%97%a0%e9%99%90-token-ai-%e7%bc%96%e7%a8%8b%e5%8a%a9","status":"publish","type":"post","link":"https:\/\/itmax.cn\/?p=10020814","title":{"rendered":"\ud83d\ude80 \u5f7b\u5e95\u544a\u522b\u4ed8\u8d39 API\uff01\u672c\u5730\u90e8\u7f72\uff0c\u6253\u9020\u65e0\u9650 Token AI \u7f16\u7a0b\u52a9\u624b \ud83d\ude80"},"content":{"rendered":"<ul>\n<li>\u8fd8\u5728\u4e3a OpenAI API \u7684\u9ad8\u989d\u8d26\u5355\u548c Token \u9650\u5236\u800c\u70e6\u607c\u5417\uff1f<\/li>\n<li>\u8fd8\u5728\u62c5\u5fe7\u4ee3\u7801\u548c\u914d\u7f6e\u88ab AI \u7f16\u7801\u5de5\u5177\u4e0a\u4f20\u5230\u4e91\u7aef\u5417\uff1f<\/li>\n<li>\u8fd8\u5728\u88ab\u79bb\u7ebf\u5f00\u53d1\u6298\u78e8\u5417\uff1f<\/li>\n<li>\u60f3\u62e5\u6709\u4e00\u4e2a\u5b8c\u5168\u7531\u4f60\u638c\u63a7\u3001\u79c1\u5bc6\u5b89\u5168\u3001\u514d\u8d39\u65e0\u9650\u91cf Token \u7684 AI \u7f16\u7a0b\u4f19\u4f34\u5417\uff1f<\/li>\n<\/ul>\n<p>\u4eca\u5929\uff0c\u6211\u5c31\u624b\u628a\u624b\u5e26\u4f60\u89e3\u9501\u8fd9\u4e2a\u7ec8\u6781\u5965\u4e49\uff1a\u5229\u7528\u5f3a\u5927\u7684 Ollama \u8fd0\u884c\u6700\u65b0\u7684 devstral:latest \u6a21\u578b\uff0c\u914d\u5408 Windows Docker Desktop \u90e8\u7f72\u9177\u70ab\u7684 OpenWebUI\uff0c\u6700\u540e\u65e0\u7f1d\u96c6\u6210\u5230 VS Code \u7684 CodeGPT (\u539f\u540d Codegpt a.k.a. Cline) \u6269\u5c55\u4e2d\uff0c\u8ba9\u4f60\u5728\u7f16\u7801\u4e16\u754c\u4e2d\u5982\u864e\u6dfb\u7ffc\uff0c\u7075\u611f\u65e0\u9650\uff01<\/p>\n<p>\u4f60\u5c06\u83b7\u5f97\uff1a<br \/>\u2705 \u5b8c\u5168\u514d\u8d39\uff1a\u544a\u522b\u6309 Token \u8ba1\u8d39\u7684\u65f6\u4ee3\u3002<br \/>\u2705 \u65e0\u9650 Token\uff1a\u53ea\u8981\u4f60\u7684\u786c\u4ef6\u9876\u5f97\u4f4f\uff0c\u60f3\u5199\u591a\u957f\u5c31\u5199\u591a\u957f\u3002<br \/>\u2705 \u672c\u5730\u8fd0\u884c\uff0c\u6570\u636e\u79c1\u5bc6\uff1a\u4ee3\u7801\u548c\u5bf9\u8bdd\u6570\u636e\u4e0d\u51fa\u672c\u5730\uff0c\u5b89\u5168\u653e\u5fc3\u3002<br \/>\u2705 \u9ad8\u6027\u80fd\u7f16\u7801\u6a21\u578b\uff1a\u4f53\u9a8c\u4e13\u4e3a\u5f00\u53d1\u8005\u4f18\u5316\u7684 Devstral \u6a21\u578b\u3002<br \/>\u2705 \u4e1d\u6ed1\u7684 VS Code \u96c6\u6210\uff1a\u5728\u6700\u719f\u6089\u7684\u7f16\u8f91\u5668\u4e2d\u4eab\u53d7 AI \u8f85\u52a9\u3002<\/p>\n<p>\u542c\u8d77\u6765\u662f\u4e0d\u662f\u5df2\u7ecf\u70ed\u8840\u6cb8\u817e\u4e86\uff1f\u8ba9\u6211\u4eec\u5f00\u59cb\u5427\uff01<\/p>\n<h2>\ud83d\udee0\ufe0f \u7b2c\u4e00\u6b65\uff1aOllama \u52a0\u6301\uff0c\u8bf7\u51fa Devstral \u5927\u795e<\/h2>\n<p>Ollama \u662f\u4e00\u4e2a\u8ba9\u4f60\u5728\u672c\u5730\u8f7b\u677e\u8fd0\u884c\u5f00\u6e90\u5927\u8bed\u8a00\u6a21\u578b\u7684\u5de5\u5177\u3002devstral \u662f Mistral AI \u63a8\u51fa\u7684\u4e13\u4e3a\u5f00\u53d1\u8005\u8bbe\u8ba1\u7684\u6a21\u578b\uff0c\u4ee3\u7801\u751f\u6210\u3001\u89e3\u91ca\u3001\u8c03\u8bd5\u80fd\u529b\u8d85\u5f3a\u3002<\/p>\n<h3>\u5b89\u88c5 Ollama:<\/h3>\n<p>\u8bbf\u95ee Ollama \u5b98\u7f51\u3002\u4e0b\u8f7d\u5e76\u5b89\u88c5\u9002\u5408\u4f60\u64cd\u4f5c\u7cfb\u7edf\uff08Windows, macOS, Linux\uff09\u7684 Ollama\u3002Windows \u7528\u6237\u5b89\u88c5\u540e\uff0cOllama \u4f1a\u5728\u540e\u53f0\u8fd0\u884c\uff0c\u5e76\u901a\u8fc7\u4efb\u52a1\u680f\u56fe\u6807\u8bbf\u95ee\u3002<\/p>\n<p>\u8fd0\u884c Devstral \u6a21\u578b:<br \/>\u6253\u5f00\u4f60\u7684\u547d\u4ee4\u884c\u7ec8\u7aef\uff08Windows \u7528\u6237\u53ef\u4ee5\u4f7f\u7528 PowerShell \u6216 CMD\uff09\uff1a<\/p>\n<pre><code class=\"bash\">ollama pull devstral:latest\nUse code with caution.<\/code><\/pre>\n<p>\u8fd9\u4e2a\u547d\u4ee4\u4f1a\u4e0b\u8f7d\u6700\u65b0\u7684 devstral \u6a21\u578b\u3002\u6a21\u578b\u6587\u4ef6\u8f83\u5927 ( 14GB )\uff0c\u8bf7\u8010\u5fc3\u7b49\u5f85\u3002<br \/>\u4e0b\u8f7d\u5b8c\u6210\u540e\uff0c\u4f60\u53ef\u4ee5\u5c1d\u8bd5\u8fd0\u884c\u4e00\u4e0b\uff08\u53ef\u9009\uff0c\u4e3b\u8981\u4e3a\u4e86\u786e\u8ba4\u6a21\u578b\u53ef\u7528\uff09\uff1a<\/p>\n<pre><code class=\"Bash\">ollama run devstral:latest &quot;write a python function to download a file from a url&quot;\nUse code with caution.<\/code><\/pre>\n<p>\u770b\u5230\u6a21\u578b\u8f93\u51fa Python \u4ee3\u7801\uff0c\u5c31\u8bf4\u660e Ollama \u548c Devstral \u5df2\u7ecf\u51c6\u5907\u5c31\u7eea\uff01Ollama \u9ed8\u8ba4\u4f1a\u5728 <a href=\"https:\/\/link.segmentfault.com\/?enc=tOxbfJxYOt8olO2a1Ksoog%3D%3D.BOCfy%2FJGMUAg0MOyRrXUHqzJ3XvRjars0c3CVsabKW4%3D\" rel=\"nofollow noopener noreferrer\" target=\"_blank\">http:\/\/localhost:11434<\/a> \u63d0\u4f9b API \u670d\u52a1\u3002<\/p>\n<h2>\ud83d\udc33 \u7b2c\u4e8c\u6b65\uff1aWindows Docker Desktop \u90e8\u7f72 OpenWebUI<\/h2>\n<p>OpenWebUI (\u524d\u8eab\u662f Ollama WebUI) \u63d0\u4f9b\u4e86\u4e00\u4e2a\u7f8e\u89c2\u4e14\u529f\u80fd\u4e30\u5bcc\u7684\u804a\u5929\u754c\u9762\uff0c\u53ef\u4ee5\u8fde\u63a5\u5230 Ollama\uff0c\u5e76\u4e14\u80fd\u63d0\u4f9b OpenAI \u517c\u5bb9\u7684 API \u63a5\u53e3\uff0c\u8fd9\u662f\u6211\u4eec\u540e\u7eed\u8fde\u63a5 VS Code \u7684\u5173\u952e\u3002<br \/>\u5b89\u88c5 Docker Desktop for Windows:<br \/>\u5982\u679c\u4f60\u7684 Windows \u8fd8\u6ca1\u6709\u5b89\u88c5 Docker Desktop\uff0c\u8bf7\u524d\u5f80 Docker \u5b98\u7f51 \u4e0b\u8f7d\u5e76\u5b89\u88c5\u3002<br \/>\u786e\u4fdd Docker Desktop \u6b63\u5728\u8fd0\u884c\uff0c\u5e76\u4e14\u5df2\u7ecf\u5207\u6362\u5230\u4f7f\u7528 WSL 2 \u540e\u7aef\uff08\u901a\u5e38\u662f\u9ed8\u8ba4\u8bbe\u7f6e\uff09\u3002<br \/>\u8fd0\u884c OpenWebUI \u5bb9\u5668:<br \/>\u6253\u5f00 PowerShell \u6216 CMD\uff0c\u6267\u884c\u4ee5\u4e0b\u547d\u4ee4\uff1a<\/p>\n<pre><code>docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:\/app\/backend\/data -e OLLAMA_BASE_URL=http:\/\/host.docker.internal:11434 --name open-webui --restart always ghcr.io\/open-webui\/open-webui:main<\/code><\/pre>\n<p>\u547d\u4ee4\u89e3\u91ca\uff1a<\/p>\n<p>-d: \u540e\u53f0\u8fd0\u884c\u5bb9\u5668\u3002<br \/>-p 3000:8080: \u5c06\u5bb9\u5668\u5185\u7684 8080 \u7aef\u53e3\u6620\u5c04\u5230\u4e3b\u673a\u7684 3000 \u7aef\u53e3\u3002\u8fd9\u6837\u4f60\u5c31\u53ef\u4ee5\u901a\u8fc7 <a href=\"https:\/\/link.segmentfault.com\/?enc=jk%2BPIuRjzgQgQHox47fNaw%3D%3D.tESgrGWtDxBL2DyUGk1pnNjbQqGiqAeR10nCOtELrgY%3D\" rel=\"nofollow noopener noreferrer\" target=\"_blank\">http:\/\/localhost:3000<\/a> \u8bbf\u95ee OpenWebUI\u3002<br \/>&#8211;add-host=host.docker.internal:host-gateway: \u5173\u952e\u6b65\u9aa4\uff01 \u8fd9\u5141\u8bb8 Docker \u5bb9\u5668\u5185\u7684 OpenWebUI \u8bbf\u95ee\u5230\u8fd0\u884c\u5728 Windows \u4e3b\u673a\u4e0a\u7684 Ollama \u670d\u52a1\uff08Ollama \u76d1\u542c\u5728 localhost:11434\uff0c\u5bf9\u4e8e\u5bb9\u5668\u6765\u8bf4\u5c31\u662f host.docker.internal:11434\uff09\u3002<br \/>-v open-webui:\/app\/backend\/data: \u5c06 OpenWebUI \u7684\u6570\u636e\u6301\u4e45\u5316\u5230\u540d\u4e3a open-webui \u7684 Docker volume \u4e2d\uff0c\u9632\u6b62\u5bb9\u5668\u5220\u9664\u540e\u6570\u636e\u4e22\u5931\u3002<br \/>-e OLLAMA_BASE_URL=<a href=\"https:\/\/link.segmentfault.com\/?enc=0xfYcw7ENVBbu%2BPcHfTILA%3D%3D.RKOu7xsl990EoWeddcH4Ns4yF3tm6JBN5ys9VlNrntiTTWrnG6wh2azhpw4G80xT\" rel=\"nofollow noopener noreferrer\" target=\"_blank\">http:\/\/host.docker.internal:11434:<\/a> \u5173\u952e\u6b65\u9aa4\uff01 \u544a\u8bc9 OpenWebUI \u53bb\u54ea\u91cc\u627e Ollama \u7684 API\u3002<br \/>&#8211;name open-webui: \u7ed9\u5bb9\u5668\u53d6\u4e2a\u540d\u5b57\uff0c\u65b9\u4fbf\u7ba1\u7406\u3002<br \/>&#8211;restart always: \u5bb9\u5668\u9000\u51fa\u65f6\u603b\u662f\u81ea\u52a8\u91cd\u542f\u3002<br \/>ghcr.io\/open-webui\/open-webui:main: OpenWebUI \u7684\u5b98\u65b9 Docker \u955c\u50cf\u3002<\/p>\n<p>\u8bbf\u95ee OpenWebUI \u5e76\u521b\u5efa\u8d26\u6237:<br \/>\u7b49\u5f85\u7247\u523b\uff0c\u8ba9\u5bb9\u5668\u542f\u52a8\u3002<br \/>\u6253\u5f00\u6d4f\u89c8\u5668\uff0c\u8bbf\u95ee <a href=\"https:\/\/link.segmentfault.com\/?enc=Tbz9CNO12FtgIx5wfMsUfA%3D%3D.zcI%2BL4RlKW8dywL8h5ynj6uBF%2BhJ7Mj0r8worAb%2BuVw%3D\" rel=\"nofollow noopener noreferrer\" target=\"_blank\">http:\/\/localhost:3000<\/a>\u3002<br \/>\u9996\u6b21\u8bbf\u95ee\uff0c\u4f1a\u63d0\u793a\u4f60\u6ce8\u518c\u4e00\u4e2a\u7ba1\u7406\u5458\u8d26\u6237\u3002\u586b\u5199\u90ae\u7bb1\u3001\u7528\u6237\u540d\u548c\u5bc6\u7801\u5373\u53ef\u3002<br \/>\u8fde\u63a5\u6a21\u578b\u5e76\u751f\u6210 API Key:<br \/>\u767b\u5f55 OpenWebUI \u540e\uff0c\u5b83\u5e94\u8be5\u4f1a\u81ea\u52a8\u68c0\u6d4b\u5230\u4f60\u672c\u5730 Ollama \u4e2d\u7684 devstral:latest \u6a21\u578b\u3002\u4f60\u53ef\u4ee5\u5728\u804a\u5929\u754c\u9762\u9009\u62e9\u5b83\u3002<\/p>\n<p>\u70b9\u51fb\u5de6\u4e0b\u89d2\u4f60\u7684\u7528\u6237\u540d -&gt; &#8220;\u8bbe\u7f6e&#8221;\u3002<br \/>\u5728\u8bbe\u7f6e\u83dc\u5355\u4e2d\uff0c\u627e\u5230 &#8220;API \u5bc6\u94a5&#8221; (API Keys) \u9009\u9879\u3002<br \/>\u70b9\u51fb &#8220;\u65b0\u5efa\u5bc6\u94a5&#8221; (Create new key)\uff0c\u7ed9\u5b83\u53d6\u4e2a\u540d\u5b57\uff08\u4f8b\u5982 vscode-key\uff09\uff0c\u8bbe\u7f6e\u8fc7\u671f\u65f6\u95f4\uff08\u6216\u6c38\u4e0d\u8fc7\u671f\uff09\uff0c\u7136\u540e\u70b9\u51fb\u521b\u5efa\u3002<\/p>\n<p>\u590d\u5236\u5e76\u4fdd\u5b58\u597d\u751f\u6210\u7684 API Key\uff0c\u4f8b\u5982 sk-xxxxx&#8230;\u3002\u8fd9\u4e2a Key \u975e\u5e38\u91cd\u8981\uff0c\u6211\u4eec\u9a6c\u4e0a\u4f1a\u7528\u5230\u3002<br \/>\u73b0\u5728\uff0c\u4f60\u7684 OpenWebUI \u5df2\u7ecf\u914d\u7f6e\u5b8c\u6210\uff0c\u5e76\u4e14\u63d0\u4f9b\u4e86\u4e00\u4e2a OpenAI \u517c\u5bb9\u7684 API \u63a5\u53e3\uff0c\u5730\u5740\u662f <a href=\"https:\/\/link.segmentfault.com\/?enc=XhrB5HMBrO%2BodIA0KnY5ow%3D%3D.7jGVD8lGtf%2BwANdAc11ZzQHfmlQrW4EPHq%2F%2BYepg43A%3D\" rel=\"nofollow noopener noreferrer\" target=\"_blank\">http:\/\/localhost:3000\/v1<\/a>\u3002<\/p>\n<h2>\ud83d\udcbb \u7b2c\u4e09\u6b65\uff1aVS Code + Cline \u6269\u5c55\uff0c\u91ca\u653e AI \u7f16\u7a0b\u8d85\u80fd\u529b<\/h2>\n<p>Cline ( cline.bot ) \u662f VS Code \u4e0a\u4e00\u6b3e\u975e\u5e38\u6d41\u884c\u7684 AI \u8f85\u52a9\u7f16\u7a0b\u6269\u5c55\u3002<br \/>\u5b89\u88c5 CodeGPT \u6269\u5c55:<br \/>\u6253\u5f00 VS Code\u3002<br \/>\u8fdb\u5165\u6269\u5c55\u5e02\u573a (\u5feb\u6377\u952e Ctrl+Shift+X)\u3002<br \/>\u641c\u7d22 &#8220;Cline&#8221; \u5e76\u5b89\u88c5\u5b83\uff08\u901a\u5e38\u662f cline.bot \u5f00\u53d1\u7684\u90a3\u4e2a\uff09\u3002<br \/>\u914d\u7f6e Cline \u8fde\u63a5\u5230 OpenWebUI:<br \/>\u5728 VSCode \u7684\u754c\u9762\u5de6\u4fa7\u5bfc\u822a\u56fe\u6807\u680f\u76ee\u4e2d\u70b9\u51fb\u5916\u661f\u4eba\u5934\u50cf\u4e00\u6837\u7684\u90a3\u4e2a\u56fe\u6807 \uff08\u5c0f\u7535\u89c6\u4e2d\u95f4\u4e24\u4e2a\u5927\u7684\u7ad6\u70b9\uff09<br \/>Provider: \u9009\u62e9 OpenAI compatible (\u6216\u8005\u5982\u679c\u5b83\u6709 OpenAI Compatible \u7c7b\u4f3c\u7684\u9009\u9879\uff0c\u9009\u90a3\u4e2a)\u3002<br \/>API Key: \u7c98\u8d34\u4f60\u521a\u624d\u4ece OpenWebUI \u751f\u6210\u7684 API Key (\u4f8b\u5982 sk-xxxxx&#8230;)\u3002<br \/>API Base URL \/ Endpoint: \u8f93\u5165 <a href=\"https:\/\/link.segmentfault.com\/?enc=lSIB1pQ441QcFDdub8w9RQ%3D%3D.YnwSRyYwEN1da5pX5gMsfFYBo5LYF3EGVDEjUpVUnF8%3D\" rel=\"nofollow noopener noreferrer\" target=\"_blank\">http:\/\/localhost:3000\/api\/<\/a> (\u8fd9\u662f OpenWebUI \u63d0\u4f9b\u7684 OpenAI \u517c\u5bb9 API \u5730\u5740)\u3002<br \/>Model: \u9009\u62e9\u6216\u624b\u52a8\u8f93\u5165\u6a21\u578b\u540d\u79f0\u3002\u7531\u4e8e OpenWebUI \u5df2\u7ecf\u8fde\u63a5\u4e86 Ollama\uff0c\u8fd9\u91cc\u4f60\u5e94\u8be5\u53ef\u4ee5\u586b\u5165 devstral:latest<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"509\" height=\"461\" referrerpolicy=\"no-referrer\" src=\"https:\/\/segmentfault.com\/img\/bVdjJ8y\" alt=\"image.png\" title=\"image.png\"><br \/>(\u8fd9\u662f\u4e00\u4e2a\u793a\u610f\u56fe\uff0c\u5177\u4f53UI\u53ef\u80fd\u968f\u7248\u672c\u66f4\u65b0)<\/p>\n<p>\u8bf7\u6ce8\u610f: \u6839\u636e Cline \u6269\u5c55\u7248\u672c\u7684\u4e0d\u540c\uff0c\u8bbe\u7f6e\u9879\u7684\u540d\u79f0\u548c\u4f4d\u7f6e\u53ef\u80fd\u7565\u6709\u5dee\u5f02\u3002\u5173\u952e\u662f\u627e\u5230\u8bbe\u7f6e API Key\u3001Base URL \u548c Model \u7684\u5730\u65b9\u3002<\/p>\n<p>\u5f00\u59cb\u4f60\u7684\u65e0\u9650 Token AI \u7f16\u7a0b\u4e4b\u65c5:<br \/>\u914d\u7f6e\u5b8c\u6210\u540e\uff0c\u4f60\u5c31\u53ef\u4ee5\u5728 VS Code \u4e2d\u4f7f\u7528 Cline \u4e86\uff01<br \/>\u63d0\u95ee\/\u804a\u5929\uff1a\u6253\u5f00 Cline \u7684\u804a\u5929\u4fa7\u8fb9\u680f\uff0c\u9009\u62e9 devstral:latest \u6a21\u578b\uff0c\u5f00\u59cb\u5bf9\u8bdd\uff0c\u8ba9\u5b83\u5e2e\u4f60\u89e3\u91ca\u4ee3\u7801\u3001\u751f\u6210\u4ee3\u7801\u7247\u6bb5\u3001debug \u7b49\u3002<br \/>\u4ee3\u7801\u64cd\u4f5c\uff1a\u9009\u4e2d\u4e00\u6bb5\u4ee3\u7801\uff0c\u53f3\u952e\u70b9\u51fb\uff0c\u4f60\u4f1a\u770b\u5230 Cline \u63d0\u4f9b\u7684\u5404\u79cd\u529f\u80fd\uff0c\u5982 &#8220;Explain &#8220;\u3001&#8221;Refactor Cline&#8221;\u3001&#8221;Generate Unit Test Cline&#8221; \u7b49\u3002<\/p>\n<p>\u56e0\u4e3a\u6240\u6709\u8bf7\u6c42\u90fd\u53d1\u9001\u5230\u4f60\u672c\u5730\u7684 OpenWebUI -&gt; Ollama -&gt; Devstral\uff0c\u6240\u4ee5\u5b8c\u5168\u514d\u8d39\uff0c\u4e14\u6ca1\u6709 Token \u9650\u5236\uff01<\/p>\n<h2>\ud83c\udf89 \u603b\u7ed3\u4e0e\u5c55\u671b<\/h2>\n<p>\u606d\u559c\u4f60\uff01\u73b0\u5728\u4f60\u62e5\u6709\u4e86\u4e00\u5957\u5b8c\u5168\u672c\u5730\u5316\u3001\u514d\u8d39\u4e14\u65e0 Token \u9650\u5236\u7684 AI \u7f16\u7a0b\u73af\u5883\u3002\u4ece Ollama \u8fd0\u884c\u5f3a\u5927\u7684 Devstral \u6a21\u578b\uff0c\u5230 Docker \u90e8\u7f72\u7f8e\u89c2\u7684 OpenWebUI\uff0c\u518d\u5230 VS Code \u7684\u65e0\u7f1d\u96c6\u6210\uff0c\u6bcf\u4e00\u6b65\u90fd\u8ba9\u4f60\u79bb AI \u8f85\u52a9\u5f00\u53d1\u7684\u81ea\u7531\u66f4\u8fd1\u4e00\u6b65\u3002<\/p>\n<p>\u6e29\u99a8\u63d0\u793a\uff1a<br \/>\u786c\u4ef6\u8d44\u6e90\uff1a\u8fd0\u884c\u5927\u578b\u8bed\u8a00\u6a21\u578b\u5bf9 CPU\u3001\u5185\u5b58\uff08RAM\uff09\u548c\u663e\u5361\uff08GPU VRAM\uff0c\u5982\u679c Ollama \u4f7f\u7528 GPU \u52a0\u901f\uff09\u6709\u4e00\u5b9a\u8981\u6c42\u3002\u5982\u679c\u611f\u89c9\u5361\u987f\uff0c\u53ef\u4ee5\u5c1d\u8bd5\u8fd0\u884c\u66f4\u5c0f\u7684\u6a21\u578b\uff0c\u6216\u8005\u68c0\u67e5\u4f60\u7684\u786c\u4ef6\u914d\u7f6e\u3002<br \/>\u9632\u706b\u5899\uff1a\u786e\u4fdd Windows \u9632\u706b\u5899\u6ca1\u6709\u963b\u6b62 Docker Desktop \u6216 Ollama \u7684\u7f51\u7edc\u8bbf\u95ee\uff0c\u7279\u522b\u662f host.docker.internal \u7684\u901a\u4fe1\u3002<br \/>Ollama GPU \u652f\u6301\uff1a\u5982\u679c\u4f60\u7684 Windows \u7cfb\u7edf\u6709 NVIDIA \u663e\u5361\uff0cOllama \u53ef\u4ee5\u5229\u7528\u5b83\u8fdb\u884c\u52a0\u901f\u3002\u786e\u4fdd\u4f60\u7684 NVIDIA \u9a71\u52a8\u662f\u6700\u65b0\u7684\uff0c\u5e76\u4e14 Ollama \u80fd\u6b63\u786e\u8bc6\u522b\u3002<br \/>\u6a21\u578b\u9009\u62e9\uff1adevstral \u5f88\u68d2\uff0c\u4f46 Ollama \u652f\u6301\u4f17\u591a\u6a21\u578b\uff0c\u4f60\u4e5f\u53ef\u4ee5\u5c1d\u8bd5 codellama, mistral, llama3 \u7b49\u5176\u4ed6\u6a21\u578b\uff0c\u770b\u770b\u54ea\u4e2a\u6700\u5408\u4f60\u53e3\u5473\u3002<br \/>\u73b0\u5728\uff0c\u5c3d\u60c5\u4eab\u53d7\u7f16\u7801\u7684\u4e50\u8da3\uff0c\u8ba9\u8fd9\u4e2a\u672c\u5730 AI \u4f19\u4f34\u52a9\u4f60\u4e00\u81c2\u4e4b\u529b\uff0c\u521b\u9020\u66f4\u591a\u53ef\u80fd\u5427\uff01\u5982\u679c\u4f60\u89c9\u5f97\u8fd9\u7bc7\u6559\u7a0b\u6709\u7528\uff0c\u522b\u5fd8\u4e86\u5206\u4eab\u7ed9\u4f60\u7684\u670b\u53cb\u4eec\uff01<\/p>\n<p>\u5e0c\u671b\u8fd9\u7bc7\u535a\u5ba2\u80fd\u5e2e\u5230\u4f60\uff01<\/p>\n<p><a href=\"https:\/\/segmentfault.com\/a\/1190000046612259\">https:\/\/segmentfault.com\/a\/1190000046612259<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u8fd8\u5728\u4e3a OpenAI API \u7684\u9ad8\u989d\u8d26\u5355\u548c Token \u9650\u5236\u800c\u70e6\u607c\u5417\uff1f \u8fd8\u5728\u62c5\u5fe7\u4ee3\u7801\u548c\u914d\u7f6e\u88ab AI \u7f16\u7801\u5de5\u5177\u4e0a [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[4],"tags":[],"class_list":["post-10020814","post","type-post","status-publish","format-standard","hentry","category-share"],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/itmax.cn\/index.php?rest_route=\/wp\/v2\/posts\/10020814","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/itmax.cn\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/itmax.cn\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/itmax.cn\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/itmax.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=10020814"}],"version-history":[{"count":0,"href":"https:\/\/itmax.cn\/index.php?rest_route=\/wp\/v2\/posts\/10020814\/revisions"}],"wp:attachment":[{"href":"https:\/\/itmax.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=10020814"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/itmax.cn\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=10020814"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/itmax.cn\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=10020814"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}