We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
command is ` python -m fastchat.serve.model_worker --model-names Triplex --model-path /data/cache/Triplex --controller-address http://127.0.0.1:21001 --worker-address http://127.0.0.1:8082 --host 0.0.0.0 --port 8082
this is the log 2024-08-08 14:43:27 | ERROR | stderr | ^MLoading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] 2024-08-08 14:43:29 | ERROR | stderr | ^MLoading checkpoint shards: 50%|█████ | 1/2 [00:01<00:01, 1.59s/it] 2024-08-08 14:43:30 | ERROR | stderr | ^MLoading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.15s/it] 2024-08-08 14:43:30 | ERROR | stderr | ^MLoading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.22s/it] 2024-08-08 14:43:30 | ERROR | stderr | 2024-08-08 14:43:32 | ERROR | stderr | Traceback (most recent call last): 2024-08-08 14:43:32 | ERROR | stderr | File "/data/anaconda3/envs/fastchat/lib/python3.10/runpy.py", line 196, in _run_module_as_main 2024-08-08 14:43:32 | ERROR | stderr | return _run_code(code, main_globals, None, 2024-08-08 14:43:32 | ERROR | stderr | File "/data/anaconda3/envs/fastchat/lib/python3.10/runpy.py", line 86, in _run_code 2024-08-08 14:43:32 | ERROR | stderr | exec(code, run_globals) 2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 415, in 2024-08-08 14:43:32 | ERROR | stderr | args, worker = create_model_worker() 2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 386, in create_model_worker 2024-08-08 14:43:32 | ERROR | stderr | worker = ModelWorker( 2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 96, in init 2024-08-08 14:43:32 | ERROR | stderr | self.context_len = get_context_length(self.model.config) 2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/utils.py", line 367, in get_context_length 2024-08-08 14:43:32 | ERROR | stderr | rope_scaling_factor = config.rope_scaling["factor"] 2024-08-08 14:43:32 | ERROR | stderr | KeyError: 'factor' `
this is the log
The text was updated successfully, but these errors were encountered:
This is the same for phi-3.5
Sorry, something went wrong.
No branches or pull requests
command is
`
python -m fastchat.serve.model_worker --model-names Triplex --model-path /data/cache/Triplex --controller-address http://127.0.0.1:21001 --worker-address http://127.0.0.1:8082 --host 0.0.0.0 --port 8082
this is the log
2024-08-08 14:43:27 | ERROR | stderr | ^MLoading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s]
2024-08-08 14:43:29 | ERROR | stderr | ^MLoading checkpoint shards: 50%|█████ | 1/2 [00:01<00:01, 1.59s/it]
2024-08-08 14:43:30 | ERROR | stderr | ^MLoading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.15s/it]
2024-08-08 14:43:30 | ERROR | stderr | ^MLoading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.22s/it]
2024-08-08 14:43:30 | ERROR | stderr |
2024-08-08 14:43:32 | ERROR | stderr | Traceback (most recent call last):
2024-08-08 14:43:32 | ERROR | stderr | File "/data/anaconda3/envs/fastchat/lib/python3.10/runpy.py", line 196, in _run_module_as_main
2024-08-08 14:43:32 | ERROR | stderr | return _run_code(code, main_globals, None,
2024-08-08 14:43:32 | ERROR | stderr | File "/data/anaconda3/envs/fastchat/lib/python3.10/runpy.py", line 86, in _run_code
2024-08-08 14:43:32 | ERROR | stderr | exec(code, run_globals)
2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 415, in
2024-08-08 14:43:32 | ERROR | stderr | args, worker = create_model_worker()
2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 386, in create_model_worker
2024-08-08 14:43:32 | ERROR | stderr | worker = ModelWorker(
2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 96, in init
2024-08-08 14:43:32 | ERROR | stderr | self.context_len = get_context_length(self.model.config)
2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/utils.py", line 367, in get_context_length
2024-08-08 14:43:32 | ERROR | stderr | rope_scaling_factor = config.rope_scaling["factor"]
2024-08-08 14:43:32 | ERROR | stderr | KeyError: 'factor'
`
The text was updated successfully, but these errors were encountered: