Standardize SparkLLM

[maang-h]

• Description: Standardize SparkLLM, include:
  • docs, the issue Standardize LLM Docs #24803
  • to support stream
  • update api url
  • model init arg names, the issue Standardized model init arg names #20085

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
langchain	⬜️ Ignored (Inspect)	Visit Preview		Aug 13, 2024 1:22pm

[ccurme]

Thanks @maang-h, appreciate your contributions here. Would you mind updating this to match the LLM template in the Appendix here? #24803

The LLM template is different from the chat model template. The chat model template uses message objects with roles (e.g., system, human, etc). Although LLM classes accept these messages, the roles are ignored and the contents are cast to string, as described in the docs here. The template deliberately makes this explicit by passing in strings.

[maang-h]

Thanks @maang-h, appreciate your contributions here. Would you mind updating this to match the LLM template in the Appendix here? #24803

The LLM template is different from the chat model template. The chat model template uses message objects with roles (e.g., system, human, etc). Although LLM classes accept these messages, the roles are ignored and the contents are cast to string, as described in the docs here. The template deliberately makes this explicit by passing in strings.

Done!