Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

【bug】KeyError: 'factor' when use Triplex #3470

Open
ForgetThatNight opened this issue Aug 8, 2024 · 1 comment
Open

【bug】KeyError: 'factor' when use Triplex #3470

ForgetThatNight opened this issue Aug 8, 2024 · 1 comment

Comments

@ForgetThatNight
Copy link

command is
`
python -m fastchat.serve.model_worker --model-names Triplex --model-path /data/cache/Triplex --controller-address http://127.0.0.1:21001 --worker-address http://127.0.0.1:8082 --host 0.0.0.0 --port 8082

this is the log
2024-08-08 14:43:27 | ERROR | stderr | ^MLoading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s]
2024-08-08 14:43:29 | ERROR | stderr | ^MLoading checkpoint shards: 50%|█████ | 1/2 [00:01<00:01, 1.59s/it]
2024-08-08 14:43:30 | ERROR | stderr | ^MLoading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.15s/it]
2024-08-08 14:43:30 | ERROR | stderr | ^MLoading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.22s/it]
2024-08-08 14:43:30 | ERROR | stderr |
2024-08-08 14:43:32 | ERROR | stderr | Traceback (most recent call last):
2024-08-08 14:43:32 | ERROR | stderr | File "/data/anaconda3/envs/fastchat/lib/python3.10/runpy.py", line 196, in _run_module_as_main
2024-08-08 14:43:32 | ERROR | stderr | return _run_code(code, main_globals, None,
2024-08-08 14:43:32 | ERROR | stderr | File "/data/anaconda3/envs/fastchat/lib/python3.10/runpy.py", line 86, in _run_code
2024-08-08 14:43:32 | ERROR | stderr | exec(code, run_globals)
2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 415, in
2024-08-08 14:43:32 | ERROR | stderr | args, worker = create_model_worker()
2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 386, in create_model_worker
2024-08-08 14:43:32 | ERROR | stderr | worker = ModelWorker(
2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/serve/model_worker.py", line 96, in init
2024-08-08 14:43:32 | ERROR | stderr | self.context_len = get_context_length(self.model.config)
2024-08-08 14:43:32 | ERROR | stderr | File "/data/env/FastChat/fastchat/utils.py", line 367, in get_context_length
2024-08-08 14:43:32 | ERROR | stderr | rope_scaling_factor = config.rope_scaling["factor"]
2024-08-08 14:43:32 | ERROR | stderr | KeyError: 'factor'
`

@surak
Copy link
Collaborator

surak commented Sep 2, 2024

This is the same for phi-3.5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants