MLM Analysis of ChatGPT using NLP

[AgrawalTitiksha]

Pull Request for DL-Simplified 💡

Issue Title : MLM Analysis of ChatGPT using NLP #412

• Info about the related issue (Aim of the project) : The aim of this project is to analyze the MLM model using NLP methods.
• Name: Titiksha Agrawal
• GitHub ID: https://www.github.com/AgrawalTitiksha/
• Email ID: [email protected]
• Idenitfy yourself: (Mention in which program you are contributing in. Eg. For a JWOC 2022 participant it's, JWOC Participant) GSSOC 2024 Contributor

Closes: #412

Describe the add-ons or changes you've made 📃

Implemented and fine-tuned MLM models.
Conducted exploratory data analysis on the dataset.
Evaluated model performance metrics.

Type of change ☑️

What sort of change have you made:

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Code style update (formatting, local variables)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• This change requires a documentation update

How Has This Been Tested? ⚙️

Analyzed the distribution of masked tokens.
Investigated common patterns and themes in the dataset.
Achieved high accuracy in predicting masked tokens using the trained MLM model.

Checklist: ☑️

• My code follows the guidelines of this project.
• I have performed a self-review of my own code.
• I have commented my code, particularly wherever it was hard to understand.
• I have made corresponding changes to the documentation.
• My changes generate no new warnings.
• I have added things that prove my fix is effective or that my feature works.
• Any dependent changes have been merged and published in downstream modules.

[github-actions]

Our team will soon review your PR. Thanks @AgrawalTitiksha :)

[abhisheks008]

Need to create a separate folder as Images and insert the EDA results there.

[abhisheks008]

Hi @AgrawalTitiksha

1. Upload the images inside the Images folder.
2. Add the visualization images inside the Model/README file under Data Visualization tag.

[abhisheks008]

Looks good to me. Approved ✅
@AgrawalTitiksha