add chatglm3-6b and glm-4-9b-chat model support #2220
Annotations
3 errors
bench-server-baseline (phi-2, f16)
Canceling since a higher priority waiting request for 'Benchmark-refs/heads/master-chatglm3-' exists
|
bench-server-baseline (phi-2, q8_0)
Canceling since a higher priority waiting request for 'Benchmark-refs/heads/master-chatglm3-' exists
|
bench-server-baseline (phi-2, q4_0)
Canceling since a higher priority waiting request for 'Benchmark-refs/heads/master-chatglm3-' exists
|