You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
hi,bro
When I run the dev branch using the local ollama qwen2:72b model, should I use OllamaFunctions when loading the ollama model with the get_llm() method in the llm.py file?
The OllamaFunctions class inherits from the ChatOllama class and looks like has the with_stuctured_output() , but there is another issue where with_stuctured_output() seems to only output in JSON format.
If you use this method, you also need to change the schema_extraction_from_text() method in the schema_extraction.py file , for example
hi,bro
When I run the dev branch using the local ollama qwen2:72b model, should I use OllamaFunctions when loading the ollama model with the
get_llm()
method in thellm.py
file?The
OllamaFunctions
class inherits from theChatOllama
class and looks like has thewith_stuctured_output()
, but there is another issue wherewith_stuctured_output()
seems to only output in JSON format.If you use this method, you also need to change the
schema_extraction_from_text()
method in theschema_extraction.py
file , for exampleand change the
get_graph_document_list()
method in thellm.py
fileThe text was updated successfully, but these errors were encountered: