Skip to content

Issues: allenai/OLMo

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

49 Open 140 Closed
49 Open 140 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Performance degrades after converting checkpoint to HF type/question An issue that's a question
#716 opened Aug 28, 2024 by ahmadshapiro
Expected Data Format type/question An issue that's a question
#715 opened Aug 27, 2024 by aflah02
Which mmlu validation setting is recommend? type/question An issue that's a question
#714 opened Aug 27, 2024 by mathfinder
Criteria for Selecting acc vs. len_norm Metrics type/question An issue that's a question
#713 opened Aug 24, 2024 by mathfinder
OLMoThreadError: generator thread data thread 0 failed type/question An issue that's a question
#706 opened Aug 18, 2024 by ybdesire
[Quick question]: How do I turn off FSDP? type/question An issue that's a question
#703 opened Aug 15, 2024 by candygocandy
1
RuntimeError: Triton Error [CUDA]: invalid device context type/bug An issue about a bug
#700 opened Aug 13, 2024 by andymvp2018
4
slurm script for: configs/official/OLMo-7B.yaml type/question An issue that's a question
#699 opened Aug 13, 2024 by andymvp2018
3
Number of tokens Olmo-1B was trained: 2T or 3T? type/question An issue that's a question
#697 opened Aug 9, 2024 by jyk13579
1
Gflops computation is faulty for FSDP due to bug in OLMo.num_params()
#695 opened Aug 7, 2024 by AkshitaB
1
why CrossEntropyLoss is zero,i type/question An issue that's a question
#692 opened Aug 6, 2024 by aizhweiwei
2
Olmo 0724 -hf checkpoints don't load the proper config when instantiating with OLMoForCausalLM type/bug An issue about a bug
#689 opened Aug 5, 2024 by sarahwie
2
Model ladder has no documentation type/documentation An issue or pull request related to documentation
#683 opened Jul 31, 2024 by IanMagnusson
1
Initial Loss increased from 10 (0.3.0 v) to 60 (0.4.0) ! type/bug An issue about a bug
#678 opened Jul 29, 2024 by Xuekai-Zhu
9
mlp_ratio not adjusted in config if mlp_hidden_size is set type/bug An issue about a bug
#673 opened Jul 21, 2024 by Muennighoff
Does global_train_batch_size support gradient accumulation? type/question An issue that's a question
#672 opened Jul 21, 2024 by jinzhuoran
1
Is there explicitly instruction-following data in the version of Dolma used to train v1? type/question An issue that's a question
#658 opened Jul 15, 2024 by john-hewitt
1
Can long text be splitted into short texts? type/question An issue that's a question
#655 opened Jul 12, 2024 by CoinCheung
Cannot convert internal OLMo checkpoint to HF type/bug An issue about a bug
#654 opened Jul 11, 2024 by viking-sudo-rm
2
start_index not getting reset in data loader when moving to new epoch type/bug An issue about a bug
#650 opened Jul 10, 2024 by leon-g-xu
4
Issue with tokenizer wrapper type/question An issue that's a question
#644 opened Jul 8, 2024 by davidbrandfonbrener
What did OLMo 1B converge to? type/question An issue that's a question
#642 opened Jul 4, 2024 by sidereior
1
Resuming training on unsharded checkpoint type/bug An issue about a bug
#641 opened Jul 4, 2024 by lecifire
5
Multi node training type/question An issue that's a question
#640 opened Jul 3, 2024 by shahizat
How the 1B and 7B model are initialized? type/question An issue that's a question
#632 opened Jun 24, 2024 by sanyalsunny111
ProTip! Mix and match filters to narrow down what you’re looking for.