Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump Megatron LM example from 0.4 to 0.7 (or latest as option) #370

Open
perifaws opened this issue Jul 3, 2024 · 0 comments
Open

Bump Megatron LM example from 0.4 to 0.7 (or latest as option) #370

perifaws opened this issue Jul 3, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@perifaws
Copy link
Contributor

perifaws commented Jul 3, 2024

The MegatronLM sample is set to 0.4 and needs an update to a later version starting at 0.7. The version should be configurable with a default in the docker file (top).

This is the part to update but there will be dependencies changes, for example on transformers and NCCL + OFI.

RUN cd /workspace && git clone --depth 1 --branch core_v0.4.0 https://github.com/NVIDIA/Megatron-LM.git \
	&& cd Megatron-LM \
	&& python3 -m pip install nltk  \
	&& python -m pip install .
@perifaws perifaws added the enhancement New feature or request label Jul 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants