Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Nougat model #2098

Closed
2 of 4 tasks
sherlcok314159 opened this issue Aug 8, 2024 · 1 comment
Closed
2 of 4 tasks

Add support for Nougat model #2098

sherlcok314159 opened this issue Aug 8, 2024 · 1 comment
Assignees
Labels
not a bug Some known limitation, but not a bug. triaged Issue has been triaged by maintainers

Comments

@sherlcok314159
Copy link

sherlcok314159 commented Aug 8, 2024

System Info

...

Who can help?

No response

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction

The nougat source code is here: https://github.com/facebookresearch/nougat.

Expected behavior

Hope we can use TensorRTLLM with Nougat.

actual behavior

Nougat is not in support.

additional notes

Thanks for your contribution!

@sherlcok314159 sherlcok314159 added the bug Something isn't working label Aug 8, 2024
@lfr-0531 lfr-0531 added triaged Issue has been triaged by maintainers not a bug Some known limitation, but not a bug. and removed bug Something isn't working labels Sep 4, 2024
@lfr-0531 lfr-0531 self-assigned this Sep 4, 2024
@lfr-0531
Copy link
Collaborator

lfr-0531 commented Sep 4, 2024

TensorRT-LLM can support Nougat model, please refer to the multimodal examples: https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/multimodal#nougat

@lfr-0531 lfr-0531 closed this as completed Sep 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
not a bug Some known limitation, but not a bug. triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

2 participants