Update dependency sentencepiece to v0.2.0 #58
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
==0.1.3
->==0.2.0
Release Notes
google/sentencepiece (sentencepiece)
v0.2.0
Compare Source
Major changes
N/A
New features
C++ Sample
Bug fixes & minor changes
v0.1.99
Compare Source
Major changes
N/A
New features
N/A
Bug fixes & minor changes
v0.1.98
Compare Source
Major changes
New features
--pretokenization_delimiter
) flagBug fixes & minor changes
v0.1.97
Compare Source
Major changes
New features
spm.__version__
Bug fixes & minor changes
v0.1.96
Compare Source
Updates
New features
allow_whitespace_only_pieces
mode.v0.1.95
Compare Source
Updates
v0.1.94
Compare Source
Updates
Bug fixes
v0.1.92
Compare Source
Bug fix
Minor upgrade
v0.1.91
Compare Source
New API
https://github.com/google/sentencepiece/tree/master/python#training-without-local-filesystem
https://github.com/google/sentencepiece/tree/master/python#training-without-local-filesystem
Bug Fix
v0.1.90
Compare Source
Renamed v0.1.9 to v0.1.90 because PyPI doesn't recognize 0.1.9 as the latest release.
v0.1.86
Compare Source
v0.1.85
Compare Source
Support tf 1.15 and Python3.8 on Windows
v0.1.83
Compare Source
v0.1.82
Compare Source
Bug fix: fixed the behavior of is_unknown method in Python module.
v0.1.81
Compare Source
Fix: support tensorflow 0.13.1
v0.1.8
Compare Source
Feature: Get rid of the dependency to external protobuf
Feature: added (Encode|Decode)AsSerializedProto interface so Python module can get full access to the SentencePieceText proto including the byte offsets/aligments
Feature: added --treat_whitespace_as_suffix option to make _ be a suffix of word.
Feature: Added normalization rules to remove control characters in the default nmt_* normalizers
Minor fix: simplify the error messager
Minor fix: do not emit full source path in LOG(INFO)
For more detail: google/sentencepiece@v0.1.7...v0.1.8
v0.1.7
Compare Source
Deprecated:
--mining_sentence_size
and--training_sentence_size
. Load all sentences by default.--input_sentence_size
can be specified to limit the sentences to be loadedFeature: added
--unk_piece/--bos_piece/--eos_piece/--pad_piece
flags to change the surface representations of these special symbols.Bug fix: added third_party directory for cmake's subdirectory.
For more detail:
v0.1.6
Compare Source
For more detail: google/sentencepiece@v0.1.5...master
v0.1.5
Compare Source
v0.1.4
Initial SentencePiece releases
Configuration
📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about this update again.
This PR was generated by Mend Renovate. View the repository job log.