加载微调模型,应该在LLM对话加载,还是知识库问答加载? #4217
zixiaotan21
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
目标是做一个知识库问答机器人,我想通过Llama Factory微调后的模型,来提高问答的准确率。
模型微调后,我发现有两种方法可以加载出我的微调模型。
方法一:因为我已经有知识库文档,选择“知识库问答”,加载微调模型。
![image](https://private-user-images.githubusercontent.com/142043181/340615967-b09c032f-106f-41da-acc1-1116fdb10b3d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjAxOTA5MDYsIm5iZiI6MTcyMDE5MDYwNiwicGF0aCI6Ii8xNDIwNDMxODEvMzQwNjE1OTY3LWIwOWMwMzJmLTEwNmYtNDFkYS1hY2MxLTExMTZmZGIxMGIzZC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzA1JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcwNVQxNDQzMjZaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1lY2Y3ZDYyZTc5OWNjZDRkZWRlZTFmYTg0MGE4NGEzNDc0ZWZhMTNlZTg5Zjc3MWM3Zjg5OTcwNWMwYWQ1YWJjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.JBHUsfGqwa7E954HMrB-JImA4E5fnoFMJSJDMhZWzf0)
由于我提的问题都在知识库里面,这样问答的时候,能用上原来知识库的知识。
方法二:在“LLM对话”加载微调模型
我觉得方法二,是更自然的加载微调模型的方法。但方法一似乎也行?两种方法问答的准确率似乎也差不多?
Beta Was this translation helpful? Give feedback.
All reactions