单卡3090成功运行 Yi-34B-Chat-AWQ 34B参数模型 #2582
Closed
knifecaojia
started this conversation in
Show and tell
Replies: 2 comments
-
|
能问一下你的python、cuda的版本吗？我这边部署会报很多错。 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
可以的，就是载入方式要自己整 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
无聊逛知乎发现这篇文章
https://zhuanlan.zhihu.com/p/669147983
我想试试在3090单卡环境是否能够运行
Beta Was this translation helpful? Give feedback.
All reactions