Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question]: as a local project, Does it`s runtime depend on GPU ? #1326

Open
qinlg opened this issue Jul 1, 2024 · 1 comment
Open

[Question]: as a local project, Does it`s runtime depend on GPU ? #1326

qinlg opened this issue Jul 1, 2024 · 1 comment
Labels
question Further information is requested

Comments

@qinlg
Copy link

qinlg commented Jul 1, 2024

Describe your problem

as a local project, Does it`s runtime depend on GPU source? I saw in the readme that it needs CPU >= 4 cores RAM >= 16 GB , but it also needs cuda to launch the service
@qinlg qinlg added the question Further information is requested label Jul 1, 2024
@KevinHuSh
Copy link
Collaborator

No, it does not. But GPU will accelerate embedding procedure when parsing file or retrieving chunks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@KevinHuSh @qinlg