{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":767658461,"defaultBranch":"main","name":"vllm","ownerLogin":"IBM","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2024-03-05T17:18:51.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/1459110?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1725926227.0","currentOid":""},"activityList":{"items":[{"before":"00dd50917dbbd49a86608071a06f5bafcdfe3591","after":"fee40df55859513915151e4c4e448223ce47f834","ref":"refs/heads/jfialho-odh-vllm-doc","pushedAt":"2024-09-10T14:59:38.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"fialhocoelho","name":"Jeff Fialho","path":"/fialhocoelho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14850636?s=80&v=4"},"commit":{"message":"adjust spaces","shortMessageHtmlLink":"adjust spaces"}},{"before":"cf3a78c9f0a2df031666490e14fe3ffc8d8a222f","after":"00dd50917dbbd49a86608071a06f5bafcdfe3591","ref":"refs/heads/jfialho-odh-vllm-doc","pushedAt":"2024-09-10T14:58:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"fialhocoelho","name":"Jeff Fialho","path":"/fialhocoelho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14850636?s=80&v=4"},"commit":{"message":"add tip to delete any existing branch with the same name","shortMessageHtmlLink":"add tip to delete any existing branch with the same name"}},{"before":"e6e39f48a16fe305dc29314b81b2c27e067c029e","after":"cf3a78c9f0a2df031666490e14fe3ffc8d8a222f","ref":"refs/heads/jfialho-odh-vllm-doc","pushedAt":"2024-09-10T14:54:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"fialhocoelho","name":"Jeff Fialho","path":"/fialhocoelho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14850636?s=80&v=4"},"commit":{"message":"build steps using odh repo","shortMessageHtmlLink":"build steps using odh repo"}},{"before":null,"after":"e6e39f48a16fe305dc29314b81b2c27e067c029e","ref":"refs/heads/jfialho-odh-vllm-doc","pushedAt":"2024-09-09T23:57:07.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"fialhocoelho","name":"Jeff Fialho","path":"/fialhocoelho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14850636?s=80&v=4"},"commit":{"message":"Create vllm_odh.md\n\nnew docs\n\nSigned-off-by: Jeff Fialho <jfialho@ibm.com>","shortMessageHtmlLink":"Create vllm_odh.md"}},{"before":null,"after":"de7c07678b339e374a1bbad72a323d3a66d21b94","ref":"refs/heads/312-test","pushedAt":"2024-09-03T21:32:39.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":alembic: try 3.12 on official vllm\n\nSigned-off-by: Joe Runde <Joseph.Runde@ibm.com>","shortMessageHtmlLink":"⚗️ try 3.12 on official vllm"}},{"before":"fb902162b46842e397176b55494fae416fbdcaa2","after":null,"ref":"refs/heads/6587-fix-branch","pushedAt":"2024-07-23T18:31:36.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"}},{"before":"7222ea00e2cb1457caebeeb514eb7b07c469196d","after":"9c35843420a68085d41b7e6f4cd338e4d0963ed7","ref":"refs/heads/release","pushedAt":"2024-07-22T19:33:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":bug: no deps\n\nSigned-off-by: Joe Runde <Joseph.Runde@ibm.com>","shortMessageHtmlLink":"🐛 no deps"}},{"before":"93820dbe235256535e51be775174b6a9d530cea9","after":"7222ea00e2cb1457caebeeb514eb7b07c469196d","ref":"refs/heads/release","pushedAt":"2024-07-22T19:28:27.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":bug: name the stage\n\nSigned-off-by: Joe Runde <Joseph.Runde@ibm.com>","shortMessageHtmlLink":"🐛 name the stage"}},{"before":"cab287bb92797e3a1701d55f9947082eaae2c7d0","after":"93820dbe235256535e51be775174b6a9d530cea9","ref":"refs/heads/release","pushedAt":"2024-07-22T19:26:53.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":bug: force reinstall adapter\n\nSigned-off-by: Joe Runde <Joseph.Runde@ibm.com>","shortMessageHtmlLink":"🐛 force reinstall adapter"}},{"before":"2a60ad3728ab961a2df9cff8618a43c747b82eee","after":"cab287bb92797e3a1701d55f9947082eaae2c7d0","ref":"refs/heads/release","pushedAt":"2024-07-22T19:22:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":alembic: try to fix everything\n\nSigned-off-by: Joe Runde <joerunde@wecm-9-67-17-3.wecm.ibm.com>","shortMessageHtmlLink":"⚗️ try to fix everything"}},{"before":"b3f982326b6b45b4f96631fb2fc2b5f602ea879e","after":"fb902162b46842e397176b55494fae416fbdcaa2","ref":"refs/heads/6587-fix-branch","pushedAt":"2024-07-22T18:40:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"},"commit":{"message":"🚧 set parallelization to 2\n\nSigned-off-by: Prashant Gupta <prashantgupta@us.ibm.com>","shortMessageHtmlLink":"🚧 set parallelization to 2"}},{"before":"9ab19319ebe3f867072e88d8647358a63ecd0659","after":"b3f982326b6b45b4f96631fb2fc2b5f602ea879e","ref":"refs/heads/6587-fix-branch","pushedAt":"2024-07-22T18:38:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"},"commit":{"message":"🚧 add github folder\n\nSigned-off-by: Prashant Gupta <prashantgupta@us.ibm.com>","shortMessageHtmlLink":"🚧 add github folder"}},{"before":null,"after":"9ab19319ebe3f867072e88d8647358a63ecd0659","ref":"refs/heads/6587-fix-branch","pushedAt":"2024-07-22T18:36:52.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"},"commit":{"message":"Update Dockerfile.ubu to install vllm-tgis-adapter from main branch","shortMessageHtmlLink":"Update Dockerfile.ubu to install vllm-tgis-adapter from main branch"}},{"before":"141cb87822a85a12a4d01c4dc68f84316fd35102","after":"1b9c20ac891e03195b5583003c81f1aa771586ba","ref":"refs/heads/ibm-dev","pushedAt":"2024-07-19T20:56:17.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"fialhocoelho","name":"Jeff Fialho","path":"/fialhocoelho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14850636?s=80&v=4"},"commit":{"message":"Add Repo for temporary validation to disallow seed with pipeline parallel\n\nSigned-off-by: Jefferson Fialho <jfialho@ibm.com>","shortMessageHtmlLink":"Add Repo for temporary validation to disallow seed with pipeline para…"}},{"before":null,"after":"141cb87822a85a12a4d01c4dc68f84316fd35102","ref":"refs/heads/ibm-dev","pushedAt":"2024-07-19T14:40:34.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"fialhocoelho","name":"Jeff Fialho","path":"/fialhocoelho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14850636?s=80&v=4"},"commit":{"message":"Merge branch 'main' of github.com:opendatahub-io/vllm into odh_vllm_release_07182024","shortMessageHtmlLink":"Merge branch 'main' of github.com:opendatahub-io/vllm into odh_vllm_r…"}},{"before":"5f6524eb63fc913ac266eea9ec0226ab81c5fec1","after":null,"ref":"refs/heads/wip-upstream","pushedAt":"2024-07-17T23:21:55.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"}},{"before":"4fbef929a6b2197332b7dd85803c1d1d8e2414f7","after":null,"ref":"refs/heads/jeff-token-truncate","pushedAt":"2024-07-12T23:58:55.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"}},{"before":"5bd1f7302f2e03b4da2c19da3035b9fec6e25503","after":null,"ref":"refs/heads/tensorizer","pushedAt":"2024-07-10T21:50:00.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"tjohnson31415","name":"Travis Johnson","path":"/tjohnson31415","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/7907693?s=80&v=4"}},{"before":"6cee8b5186d9ce1a42f25f24f11e9617150689f5","after":null,"ref":"refs/heads/max-odh-main","pushedAt":"2024-07-03T13:56:59.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"maxdebayser","name":"Maximilien de Bayser","path":"/maxdebayser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1291418?s=80&v=4"}},{"before":null,"after":"6cee8b5186d9ce1a42f25f24f11e9617150689f5","ref":"refs/heads/max-odh-main","pushedAt":"2024-07-03T13:55:59.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"maxdebayser","name":"Maximilien de Bayser","path":"/maxdebayser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1291418?s=80&v=4"},"commit":{"message":"test\n\nSigned-off-by: Max de Bayser <mbayser@br.ibm.com>","shortMessageHtmlLink":"test"}},{"before":"ad0a0005c2e77b07f5e479dce262e4a13a5bf2db","after":null,"ref":"refs/tags/upstream-merge-test.ad0a0005","pushedAt":"2024-06-28T17:36:04.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"}},{"before":"ad0a0005c2e77b07f5e479dce262e4a13a5bf2db","after":"5f6524eb63fc913ac266eea9ec0226ab81c5fec1","ref":"refs/heads/wip-upstream","pushedAt":"2024-06-28T17:33:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"},"commit":{"message":"🚧 push images\n\nSigned-off-by: Prashant Gupta <prashantgupta@us.ibm.com>","shortMessageHtmlLink":"🚧 push images"}},{"before":null,"after":"ad0a0005c2e77b07f5e479dce262e4a13a5bf2db","ref":"refs/heads/wip-upstream","pushedAt":"2024-06-28T17:26:34.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"prashantgupta24","name":"Prashant Gupta","path":"/prashantgupta24","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9909241?s=80&v=4"},"commit":{"message":"[Bugfix] Fix compute datatype for cutlass 3.x epilogues (#5931)","shortMessageHtmlLink":"[Bugfix] Fix compute datatype for cutlass 3.x epilogues (#5931)"}},{"before":"b093a352668a577e39420d74241414660877e601","after":"2a60ad3728ab961a2df9cff8618a43c747b82eee","ref":"refs/heads/release","pushedAt":"2024-06-21T16:07:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":bug: change fork to spawn\n\nSigned-off-by: Joe Runde <joe@joerun.de>","shortMessageHtmlLink":"🐛 change fork to spawn"}},{"before":"7174f67608ae87b7c8850541fc555e7142e02671","after":"b093a352668a577e39420d74241414660877e601","ref":"refs/heads/release","pushedAt":"2024-06-19T17:58:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":arrow_up: bump ubi tag (#51)\n\nto 9.4-1134\r\n\r\nSigned-off-by: Joe Runde <joe@joerun.de>","shortMessageHtmlLink":"⬆️ bump ubi tag (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2362879125\" data-permission-text=\"Title is private\" data-url=\"https://github.com/IBM/vllm/issues/51\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/IBM/vllm/pull/51/hovercard\" href=\"https://github.com/IBM/vllm/pull/51\">#51</a>)"}},{"before":"573a126221859a4066ee3cf037680995bac1dcc3","after":null,"ref":"refs/heads/ubi-update","pushedAt":"2024-06-19T17:58:06.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"}},{"before":"3122d24aa32891f32de17c43c86ead8b21e9e13f","after":"095df75cff1ce3b05b1681077c5faad1354d4635","ref":"refs/heads/main","pushedAt":"2024-06-19T17:58:03.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":arrow_up: bump ubi tag (#51)\n\nto 9.4-1134\r\n\r\nSigned-off-by: Joe Runde <joe@joerun.de>","shortMessageHtmlLink":"⬆️ bump ubi tag (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2362879125\" data-permission-text=\"Title is private\" data-url=\"https://github.com/IBM/vllm/issues/51\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/IBM/vllm/pull/51/hovercard\" href=\"https://github.com/IBM/vllm/pull/51\">#51</a>)"}},{"before":null,"after":"573a126221859a4066ee3cf037680995bac1dcc3","ref":"refs/heads/ubi-update","pushedAt":"2024-06-19T17:44:34.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":":arrow_up: bump ubi tag\n\nSigned-off-by: Joe Runde <joe@joerun.de>","shortMessageHtmlLink":"⬆️ bump ubi tag"}},{"before":"a550ef06016a1f47271cb77350c0904b56b2f314","after":"7174f67608ae87b7c8850541fc555e7142e02671","ref":"refs/heads/release","pushedAt":"2024-06-19T16:58:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":"Apply inferface change to duplicated code in the tgis layer (#50)\n\nIn the upstream code the `init_state()` method was removed from the\r\nOutlines logits processor classes but the call to this method was still\r\nin our tgis layer causing this error:\r\n\r\n```\r\nERROR 06-19 16:12:57 logs.py:77] generate{input=[b'Hello, I am here to'] prefix_id= adapter_id= input_chars=[19] params=decoding { format: JSON }: 'CFGLogitsProcessor' object has no attribute 'init_state'\r\nERROR 06-19 16:12:57 grpc_server.py:86] Generate failed\r\nERROR 06-19 16:12:57 grpc_server.py:86] Traceback (most recent call last):\r\nERROR 06-19 16:12:57 grpc_server.py:86]   File \"/opt/vllm/lib/python3.11/site-packages/vllm/entrypoints/grpc/grpc_server.py\", line 103, in func_with_log\r\nERROR 06-19 16:12:57 grpc_server.py:86]     return await func(*args, **kwargs)\r\nERROR 06-19 16:12:57 grpc_server.py:86]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^\r\nERROR 06-19 16:12:57 grpc_server.py:86]   File \"/opt/vllm/lib/python3.11/site-packages/vllm/entrypoints/grpc/grpc_server.py\", line 153, in Generate\r\nERROR 06-19 16:12:57 grpc_server.py:86]     sampling_params, deadline = await self._validate_and_convert_params(\r\nERROR 06-19 16:12:57 grpc_server.py:86]                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\r\nERROR 06-19 16:12:57 grpc_server.py:86]   File \"/opt/vllm/lib/python3.11/site-packages/vllm/entrypoints/grpc/grpc_server.py\", line 430, in _validate_and_convert_params\r\nERROR 06-19 16:12:57 grpc_server.py:86]     await get_outlines_guided_decoding_logits_processor(decoding,\r\nERROR 06-19 16:12:57 grpc_server.py:86]   File \"/opt/vllm/lib/python3.11/site-packages/vllm/tgis_utils/guided_decoding.py\", line 44, in get_outlines_guided_decoding_logits_processor\r\nERROR 06-19 16:12:57 grpc_server.py:86]     logits_processor.init_state()\r\nERROR 06-19 16:12:57 grpc_server.py:86]     ^^^^^^^^^^^^^^^^^^^^^^^^^^^\r\n```\r\n\r\n---------\r\n\r\nSigned-off-by: Max de Bayser <mbayser@br.ibm.com>","shortMessageHtmlLink":"Apply inferface change to duplicated code in the tgis layer (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2362770065\" data-permission-text=\"Title is private\" data-url=\"https://github.com/IBM/vllm/issues/50\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/IBM/vllm/pull/50/hovercard\" href=\"https://github.com/IBM/vllm/pull/50\">#50</a>)"}},{"before":"7ee1c10ff21e0f8ff89b507b4e941fd83e023517","after":"3122d24aa32891f32de17c43c86ead8b21e9e13f","ref":"refs/heads/main","pushedAt":"2024-06-19T16:57:09.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"joerunde","name":"Joe Runde","path":"/joerunde","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/1646872?s=80&v=4"},"commit":{"message":"Apply inferface change to duplicated code in the tgis layer (#50)\n\nIn the upstream code the `init_state()` method was removed from the\r\nOutlines logits processor classes but the call to this method was still\r\nin our tgis layer causing this error:\r\n\r\n```\r\nERROR 06-19 16:12:57 logs.py:77] generate{input=[b'Hello, I am here to'] prefix_id= adapter_id= input_chars=[19] params=decoding { format: JSON }: 'CFGLogitsProcessor' object has no attribute 'init_state'\r\nERROR 06-19 16:12:57 grpc_server.py:86] Generate failed\r\nERROR 06-19 16:12:57 grpc_server.py:86] Traceback (most recent call last):\r\nERROR 06-19 16:12:57 grpc_server.py:86]   File \"/opt/vllm/lib/python3.11/site-packages/vllm/entrypoints/grpc/grpc_server.py\", line 103, in func_with_log\r\nERROR 06-19 16:12:57 grpc_server.py:86]     return await func(*args, **kwargs)\r\nERROR 06-19 16:12:57 grpc_server.py:86]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^\r\nERROR 06-19 16:12:57 grpc_server.py:86]   File \"/opt/vllm/lib/python3.11/site-packages/vllm/entrypoints/grpc/grpc_server.py\", line 153, in Generate\r\nERROR 06-19 16:12:57 grpc_server.py:86]     sampling_params, deadline = await self._validate_and_convert_params(\r\nERROR 06-19 16:12:57 grpc_server.py:86]                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\r\nERROR 06-19 16:12:57 grpc_server.py:86]   File \"/opt/vllm/lib/python3.11/site-packages/vllm/entrypoints/grpc/grpc_server.py\", line 430, in _validate_and_convert_params\r\nERROR 06-19 16:12:57 grpc_server.py:86]     await get_outlines_guided_decoding_logits_processor(decoding,\r\nERROR 06-19 16:12:57 grpc_server.py:86]   File \"/opt/vllm/lib/python3.11/site-packages/vllm/tgis_utils/guided_decoding.py\", line 44, in get_outlines_guided_decoding_logits_processor\r\nERROR 06-19 16:12:57 grpc_server.py:86]     logits_processor.init_state()\r\nERROR 06-19 16:12:57 grpc_server.py:86]     ^^^^^^^^^^^^^^^^^^^^^^^^^^^\r\n```\r\n\r\n---------\r\n\r\nSigned-off-by: Max de Bayser <mbayser@br.ibm.com>","shortMessageHtmlLink":"Apply inferface change to duplicated code in the tgis layer (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2362770065\" data-permission-text=\"Title is private\" data-url=\"https://github.com/IBM/vllm/issues/50\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/IBM/vllm/pull/50/hovercard\" href=\"https://github.com/IBM/vllm/pull/50\">#50</a>)"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEsjOl8gA","startCursor":null,"endCursor":null}},"title":"Activity · IBM/vllm"}