self-hosted-llm-agent-on-your-own-laptop-or-edge-device-nanokek-zha-e-ping-shu-kun-yi-sui-shi-kek-fa-llm-agent-michael-yuan-second-state.pdf

《self-hosted-llm-agent-on-your-own-laptop-or-edge-device-nanokek-zha-e-ping-shu-kun-yi-sui-shi-kek-fa-llm-agent-michael-yuan-second-state.pdf》由会员分享，可在线阅读，更多相关《self-hosted-llm-agent-on-your-own-laptop-or-edge-device-nanokek-zha-e-ping-shu-kun-yi-sui-shi-kek-fa-llm-agent-michael-yuan-second-state.pdf（20页珍藏版）》请在三个皮匠报告上搜索。

1、Run LLM agents on self-hosted devicesMichael Yuanx:juntao github:juntaoWasmEdge Runtime:https:/ Demo:The easiest way to chat with an open-source LLM on your own deviceDownload and install the softwarecurl-sSfL https:/ with a Qwen2 1.5b modelgaianet init-config https:/ the chatbotgaianet startChat!ht

2、tp:/localhost:8080/https:/docs.gaianet.ai/node-guide/quick-start Unique featuresLightweightPortable across OSes/CPUs/GPUs/NPUsSupports a wide variety of modelsSimple and transparent model managementEasily embeddable into applicationsThe next frontier of AIWhy?Privacy and controlSpeedReliabilityAlign

3、ment and biasUse finetuned model for each agentic taskTightly couple models with applicationsTech stackWasmEdge:https:/ LlamaEdge:https:/ Gaia Network:https:/ Demo:Enhance the model with your personal knowledge Download and install the softwarecurl-sSfL https:/ with a Llama 3.1 model with a Samsung

4、smartphone manualgaianet init-config https:/ the chatbotgaianet startChat!http:/localhost:8080/https:/docs.gaianet.ai/node-guide/quick-start Demo:Use the local LLM to control your local device Download and install the softwarecurl-sSfL https:/ with a finetuned Llama 3 model with tool call supportgaianet init-config https:/ the API servergaianet startRun the agentgit clone https:/ llm_todopip install-r requirements.txtexport OPENAI_MODEL_NAME=llama-3-groq-8bexport OPENAI_BASE_URL=http:/127.0.0.1:8080/v1python main.pyI want an UI!Moxin:https:/ Thank youLearn more:https:/ https:/