Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ai video cli endpoint for pool info #3036

Open
wants to merge 4 commits into
base: ai-video
Choose a base branch
from

Conversation

ad-astra-video
Copy link
Contributor

What does this pull request do? Explain your changes. (required)
Adds a cli webserver endpoint /getAIPools to provide some data on warm and cold pools for each selector ( [capability]_[model id] ).

Note that selectors are built after first request for capability/model.

Specific updates (required)

  • Add route to webserver.go and handler to handlers.go in server package
  • Including header of "Show-Detail" adds the Orchestrators field to the warm and cold pools. If not included, only the InUse, SizeandSuspended` fields are included in the response.

How did you test each of these updates (required)

Added endpoint, requested a AI job and ran:
curl -H "Show-Detail: yes" http://127.0.0.1:5935/getAIPools
Response:
{"27_ByteDance/SDXL-Lightning":{"Cold":{"InUse":0,"Orchestrators":[{"InFlight":0,"Latency":0,"Url":"https://ai-testnet.ad-astra.video:9955"}],"Size":1,"Suspended":2},"Warm":{"InUse":0,"Orchestrators":null,"Size":0,"Suspended":2}}}commits and

Does this pull request close any open issues?

Checklist:

@github-actions github-actions bot added the AI Issues and PR related to the AI-video branch. label Apr 29, 2024
@ad-astra-video ad-astra-video force-pushed the ai-video-cli-endpoint-for-pool-info branch from 8af5e3f to d1b05e5 Compare May 3, 2024 18:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
AI Issues and PR related to the AI-video branch.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant