mindie部署qwen3-8b

参考:
https://www.hiascend.com/document/detail/zh/mindie/230/quickstart/mindie_quickstart_0004.html

https://www.hiascend.com/document/detail/zh/mindie/230/mindiellm/llmdev/mindie_service0285.html

mkdir /root/tmp
modelscope download --model Qwen/Qwen3-8B --local_dir /root/tmp/
将Qwen3-8B直接放到tmp中,目录结构为
/root/tmp/Qwen3-8B/config.json

1. 拉取镜像
docker pull --platform=arm64 swr.cn-south-1.myhuaweicloud.com/ascendhub/mindie:2.3.0-300I-Duo-py311-openeuler24.03-lts

docker images |grep 2.3.0-300I-Duo-py311-openeuler24.03-lts

2.启动容器
docker run -it -d --net=host --shm-size=4g \
       --name  qwen3-8b\
       -w /home \
       --device=/