NeMo/.gitignore

177 lines
2.3 KiB
Plaintext
Raw Normal View History

# log and data files
*.model
*.pkl
#*.ipynb
output
result
*.pt
tests/data/asr
.DS_Store
bert.pt.json
work
TalkNet preliminary part (#680) * Durations extraction with script draft. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Durations extraction notebooks. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Finished bulk part of durations predictor. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add tensorboard logging. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add general-style train logger. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Change LibriSpeech parts order and move train logger callback to core. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add one big file durs saving. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Big batch params change. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add full pad option to data loader as default. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Complete durs pipeline with evaluation. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Rename durs ngc script. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Adjust duration main script default for ngc run. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Fix problem with torch.bool dist eval. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add LibriTTS processing. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add FasterSpeech full pipeline reaching about 0.4 MSE for LibriTTS. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add QN retrain NGC pipeline, new dur XE steps loss and mel Griffin-Lim sampling. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add train logging for mel with audio sampling and super sampler. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add length sampler. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Set SSS as default and introduce local shuffling. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * New defaults. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * W&B Support, new speaker system and some refactoring Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add simple durs aug. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * New baseline (1) Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Fix trim bug and make default O2. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add pad16. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Fix dist eval error and add variable steps. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add WaveGlow inference and fix pad16 bug. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Generalize mel loss. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Generalize pad op. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Move pad16 logic to loss. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add fmin/fmax to griffin-lim vocoding. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Move model params to config. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add denoiser argument to WaveGlow inference. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add new durs with all 1s by default. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * New baseline (3) Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * New baseline (4) Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * New baseline (5) Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Refactor durs predictor script. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Durs predictor baseline Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Adjusted durs scirpt for NGC. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * New durs lj baseline Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Update durs baseline params. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Add durs/blanks acc metrics. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Fix durs baseline. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Current state Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Update NGC scripts and implement shake_all aug. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Update augmentations implementations. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Bunch of things Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Change name to TalkNet. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Latest notebooks changes Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Working scripts with latest master changes Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Finished trimming durs predictor code. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Trimmed mels part. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Delete dev folder. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Fix style errors. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Fix LGTM errors. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Revert simple logging changes. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Fix problems. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Fix problems. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com> * Remove WG inference and add type hints for data layer. Signed-off-by: Stanislav Beliaev <stasbelyaev96@gmail.com>
2020-06-04 19:37:45 +02:00
runs
fastspeech_output
.hydra
# Byte-compiled / optimized / DLL files
__pycache__/
*.py[cod]
*$py.class
**.pyc
# C extensions
*.so
# Distribution / packaging
.idea
.Python
wandb
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
2019-09-02 22:48:47 +02:00
#parts/
sdist/
var/
wheels/
pip-wheel-metadata/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST
# PyInstaller
# Usually these files are written by a python script from a template
# before PyInstaller builds the exe, so as to inject date/other infos into it.
*.manifest
*.spec
# Installer logs
pip-log.txt
pip-delete-this-directory.txt
# Unit test / coverage reports
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
.hypothesis/
.pytest_cache/
# Translations
*.mo
*.pot
# Django stuff:
*.log
local_settings.py
db.sqlite3
# Flask stuff:
instance/
.webassets-cache
# Scrapy stuff:
.scrapy
# Sphinx documentation
docs/build
# PyBuilder
target/
# Jupyter Notebook
.ipynb_checkpoints
# IPython
profile_default/
ipython_config.py
# pyenv
.python-version
# pipenv
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
# However, in case of collaboration, if having platform-specific dependencies or dependencies
# having no cross-platform support, pipenv may install dependencies that dont work, or not
# install all needed dependencies.
#Pipfile.lock
# celery beat schedule file
celerybeat-schedule
# SageMath parsed files
*.sage.py
# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/
# VSCode project settins
.vscode/
# Spyder project settings
.spyderproject
.spyproject
# Rope project settings
.ropeproject
# mkdocs documentation
/site
/docs/html
/docs/docs_zh/zh
# mypy
.mypy_cache/
.dmypy.json
dmypy.json
# Pyre type checker
.pyre/
# Emacs backup files
*~
cifar-10-batches-py
*.tar.gz
# Test data.
tests/.data
tests/data
# outputs folder
examples/*/outputs
TTS Collection (#874) * add structure Signed-off-by: Jason <jasoli@nvidia.com> * add files Signed-off-by: Jason <jasoli@nvidia.com> * add init Signed-off-by: Jason <jasoli@nvidia.com> * fix init Signed-off-by: Jason <jasoli@nvidia.com> * update taco Signed-off-by: Jason <jasoli@nvidia.com> * format Signed-off-by: Jason <jasoli@nvidia.com> * typo Signed-off-by: Jason <jasoli@nvidia.com> * val change Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * add header Signed-off-by: Jason <jasoli@nvidia.com> * add waveglow Signed-off-by: Jason <jasoli@nvidia.com> * waveglow fix Signed-off-by: Jason <jasoli@nvidia.com> * waveglow fix Signed-off-by: Jason <jasoli@nvidia.com> * waveglow fix Signed-off-by: Jason <jasoli@nvidia.com> * add O1 Signed-off-by: Jason <jasoli@nvidia.com> * add todo Signed-off-by: Jason <jasoli@nvidia.com> * change batch sizes Signed-off-by: Jason <jasoli@nvidia.com> * move Signed-off-by: Jason <jasoli@nvidia.com> * move Signed-off-by: Jason <jasoli@nvidia.com> * V1 Signed-off-by: Jason <jasoli@nvidia.com> * V1 Signed-off-by: Jason <jasoli@nvidia.com> * structure Signed-off-by: Jason <jasoli@nvidia.com> * clean up Signed-off-by: Jason <jasoli@nvidia.com> * fix tacotron2 Signed-off-by: Jason <jasoli@nvidia.com> * add files Signed-off-by: Jason <jasoli@nvidia.com> * update yamls Signed-off-by: Jason <jasoli@nvidia.com> * fix waveglow 1/2 Signed-off-by: Jason <jasoli@nvidia.com> * fix waveglow 2/3 Signed-off-by: Jason <jasoli@nvidia.com> * fix waveglow 3/? Signed-off-by: Jason <jasoli@nvidia.com> * merge asr and tts Signed-off-by: Jason <jasoli@nvidia.com> * update waveglow Signed-off-by: Jason <jasoli@nvidia.com> * isort Signed-off-by: Jason <jasoli@nvidia.com> * update configs Signed-off-by: Jason <jasoli@nvidia.com> * update waveglow's dataloader Signed-off-by: Jason <jasoli@nvidia.com> * update and refactor Signed-off-by: Jason <jasoli@nvidia.com> * update t2 and waveglow Signed-off-by: Jason <jasoli@nvidia.com> * enforce dictconfig; style Signed-off-by: Jason <jasoli@nvidia.com> * add fastdevruns Signed-off-by: Jason <jasoli@nvidia.com> * name Signed-off-by: Jason <jasoli@nvidia.com> * import Signed-off-by: Jason <jasoli@nvidia.com> * update tests Signed-off-by: Jason <jasoli@nvidia.com> * yaml Signed-off-by: Jason <jasoli@nvidia.com> * use hydra rnner Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * move callback to common Signed-off-by: Jason <jasoli@nvidia.com> * fixed tacotron 2; add typing to all neuralmodules Signed-off-by: Jason <jasoli@nvidia.com> * flatten Signed-off-by: Jason <jasoli@nvidia.com> * Style Signed-off-by: Jason <jasoli@nvidia.com> * patch jenkins Signed-off-by: Jason <jasoli@nvidia.com> * change typeheck logic Signed-off-by: Jason <jasoli@nvidia.com> * fix t2 Signed-off-by: Jason <jasoli@nvidia.com> * fix wg Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * update configs Signed-off-by: Jason <jasoli@nvidia.com> * add num_workers Signed-off-by: Jason <jasoli@nvidia.com> * update config Signed-off-by: Jason <jasoli@nvidia.com> * update gitignore Signed-off-by: Jason <jasoli@nvidia.com> * config Signed-off-by: Jason <jasoli@nvidia.com> * enable fp16 on t2 Signed-off-by: Jason <jasoli@nvidia.com> * enable fp16 on t2 Signed-off-by: Jason <jasoli@nvidia.com> * enable fp16 on t2 Signed-off-by: Jason <jasoli@nvidia.com> * fix t2 Signed-off-by: Jason <jasoli@nvidia.com> * fixes Signed-off-by: Jason <jasoli@nvidia.com> * add typing to models; use nemo loss class Signed-off-by: Jason <jasoli@nvidia.com> * make wg work Signed-off-by: Jason <jasoli@nvidia.com> * make t2 work Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * fix wg Signed-off-by: Jason <jasoli@nvidia.com> * add better debug info to shape check Signed-off-by: Jason <jasoli@nvidia.com> * lgtm import error Signed-off-by: Jason <jasoli@nvidia.com> * lower batch size for testing Signed-off-by: Jason <jasoli@nvidia.com> * address comments Signed-off-by: Jason <jasoli@nvidia.com> * address comments and remove experimental Signed-off-by: Jason <jasoli@nvidia.com> * standardize Signed-off-by: Jason <jasoli@nvidia.com> * mark back as experimental Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * experimental Signed-off-by: Jason <jasoli@nvidia.com>
2020-07-30 19:46:16 +02:00
examples/*/NeMo_experiments
examples/*/nemo_experiments
TTS Collection (#874) * add structure Signed-off-by: Jason <jasoli@nvidia.com> * add files Signed-off-by: Jason <jasoli@nvidia.com> * add init Signed-off-by: Jason <jasoli@nvidia.com> * fix init Signed-off-by: Jason <jasoli@nvidia.com> * update taco Signed-off-by: Jason <jasoli@nvidia.com> * format Signed-off-by: Jason <jasoli@nvidia.com> * typo Signed-off-by: Jason <jasoli@nvidia.com> * val change Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * add header Signed-off-by: Jason <jasoli@nvidia.com> * add waveglow Signed-off-by: Jason <jasoli@nvidia.com> * waveglow fix Signed-off-by: Jason <jasoli@nvidia.com> * waveglow fix Signed-off-by: Jason <jasoli@nvidia.com> * waveglow fix Signed-off-by: Jason <jasoli@nvidia.com> * add O1 Signed-off-by: Jason <jasoli@nvidia.com> * add todo Signed-off-by: Jason <jasoli@nvidia.com> * change batch sizes Signed-off-by: Jason <jasoli@nvidia.com> * move Signed-off-by: Jason <jasoli@nvidia.com> * move Signed-off-by: Jason <jasoli@nvidia.com> * V1 Signed-off-by: Jason <jasoli@nvidia.com> * V1 Signed-off-by: Jason <jasoli@nvidia.com> * structure Signed-off-by: Jason <jasoli@nvidia.com> * clean up Signed-off-by: Jason <jasoli@nvidia.com> * fix tacotron2 Signed-off-by: Jason <jasoli@nvidia.com> * add files Signed-off-by: Jason <jasoli@nvidia.com> * update yamls Signed-off-by: Jason <jasoli@nvidia.com> * fix waveglow 1/2 Signed-off-by: Jason <jasoli@nvidia.com> * fix waveglow 2/3 Signed-off-by: Jason <jasoli@nvidia.com> * fix waveglow 3/? Signed-off-by: Jason <jasoli@nvidia.com> * merge asr and tts Signed-off-by: Jason <jasoli@nvidia.com> * update waveglow Signed-off-by: Jason <jasoli@nvidia.com> * isort Signed-off-by: Jason <jasoli@nvidia.com> * update configs Signed-off-by: Jason <jasoli@nvidia.com> * update waveglow's dataloader Signed-off-by: Jason <jasoli@nvidia.com> * update and refactor Signed-off-by: Jason <jasoli@nvidia.com> * update t2 and waveglow Signed-off-by: Jason <jasoli@nvidia.com> * enforce dictconfig; style Signed-off-by: Jason <jasoli@nvidia.com> * add fastdevruns Signed-off-by: Jason <jasoli@nvidia.com> * name Signed-off-by: Jason <jasoli@nvidia.com> * import Signed-off-by: Jason <jasoli@nvidia.com> * update tests Signed-off-by: Jason <jasoli@nvidia.com> * yaml Signed-off-by: Jason <jasoli@nvidia.com> * use hydra rnner Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * move callback to common Signed-off-by: Jason <jasoli@nvidia.com> * fixed tacotron 2; add typing to all neuralmodules Signed-off-by: Jason <jasoli@nvidia.com> * flatten Signed-off-by: Jason <jasoli@nvidia.com> * Style Signed-off-by: Jason <jasoli@nvidia.com> * patch jenkins Signed-off-by: Jason <jasoli@nvidia.com> * change typeheck logic Signed-off-by: Jason <jasoli@nvidia.com> * fix t2 Signed-off-by: Jason <jasoli@nvidia.com> * fix wg Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * update configs Signed-off-by: Jason <jasoli@nvidia.com> * add num_workers Signed-off-by: Jason <jasoli@nvidia.com> * update config Signed-off-by: Jason <jasoli@nvidia.com> * update gitignore Signed-off-by: Jason <jasoli@nvidia.com> * config Signed-off-by: Jason <jasoli@nvidia.com> * enable fp16 on t2 Signed-off-by: Jason <jasoli@nvidia.com> * enable fp16 on t2 Signed-off-by: Jason <jasoli@nvidia.com> * enable fp16 on t2 Signed-off-by: Jason <jasoli@nvidia.com> * fix t2 Signed-off-by: Jason <jasoli@nvidia.com> * fixes Signed-off-by: Jason <jasoli@nvidia.com> * add typing to models; use nemo loss class Signed-off-by: Jason <jasoli@nvidia.com> * make wg work Signed-off-by: Jason <jasoli@nvidia.com> * make t2 work Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * fix wg Signed-off-by: Jason <jasoli@nvidia.com> * add better debug info to shape check Signed-off-by: Jason <jasoli@nvidia.com> * lgtm import error Signed-off-by: Jason <jasoli@nvidia.com> * lower batch size for testing Signed-off-by: Jason <jasoli@nvidia.com> * address comments Signed-off-by: Jason <jasoli@nvidia.com> * address comments and remove experimental Signed-off-by: Jason <jasoli@nvidia.com> * standardize Signed-off-by: Jason <jasoli@nvidia.com> * mark back as experimental Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * experimental Signed-off-by: Jason <jasoli@nvidia.com>
2020-07-30 19:46:16 +02:00
examples/*/.hydra
examples/*/wandb
examples/*/data
wandb
2019-09-02 22:48:47 +02:00
dump.py
Unittest for documentation Added (#423) * work on unit tests - mocking up the i/o read/wrote Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> * work on unit tests - mocking up the i/o read/wrote Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> * a file write mockup Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> * doc fix of configuration tutorials Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> * Unittest for documentation Signed-off-by: DEKHTIARJonathan <contact@jonathandekhtiar.eu> * Docs Bugs Fix Signed-off-by: DEKHTIARJonathan <contact@jonathandekhtiar.eu> * Unnecessary env var removed Signed-off-by: DEKHTIARJonathan <contact@jonathandekhtiar.eu> * polish Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> * Update test_documentation.py Signed-off-by: Jason <jasoli@nvidia.com> * Add NeMoUnitTest Base Class Signed-off-by: Jason <jasoli@nvidia.com> * run unittest of documentation last Signed-off-by: Jason <jasoli@nvidia.com> * make it last Signed-off-by: Jason <jasoli@nvidia.com> * polish Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> Signed-off-by: DEKHTIARJonathan <contact@jonathandekhtiar.eu> * autodoc_mock_imports added Signed-off-by: DEKHTIARJonathan <contact@jonathandekhtiar.eu> * Test Requirements Fix Signed-off-by: DEKHTIARJonathan <contact@jonathandekhtiar.eu> * setting of pytest updated Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> * formatting fix Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> * formatting fixes in conf.py - external bug, who merged that with master? Signed-off-by: Tomasz Kornuta <tkornuta@nvidia.com> Co-authored-by: Tomasz Kornuta <56979727+tkornuta-nvidia@users.noreply.github.com> Co-authored-by: Jason <jasoli@nvidia.com>
2020-02-26 02:09:19 +01:00
docs/sources/source/test_build/
# Checkpoints, config files and temporary files created in tutorials.
examples/neural_graphs/*.chkpt
examples/neural_graphs/*.yml
Nmt Model (#1574) * Machine translation modules ported from release 0.10.1_p_c (#1275) * Fix parameter name Signed-off-by: PeganovAnton <peganoff2@mail.ru> * remove vocab parameter from encoder constructor call Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix model params Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Test connection to github Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove excess parameter from decoder constructor call Signed-off-by: PeganovAnton <peganoff2@mail.ru> * remove foo Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove excess parameter from beam search constructor Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix parameter names in beam search constructor call Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix parameter name in function call Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Change gpu settings Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix forward function of mt model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Return to logits type Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add pl callback Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix docstring Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Replace logger.info with print Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backou Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove debug prints and fix several bugs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Detach beam results earlier Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Improve config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove debug prints and fix several bugs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * merge Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add ngc config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add NeMo to PYTHONPATH in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Improve the way nemo path is set Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add debug print to ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size in ngc model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce validation batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Set result path and reduce batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update hp Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update hp Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Rename job Signed-off-by: PeganovAnton <peganoff2@mail.ru> * add de en config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Move logging to model, improve config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Disable progress bar Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove mt callback from trainer Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update 2 gpu config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix test dataset in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update configs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update ngc debug commands Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add model converting to float Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Separate train and test Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add de->en config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce seq len Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bash syntax error and reduce batch Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix Error in config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Increase num steps Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Migrate to pl 1.0.2 Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bash syntax error Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update OmegaConf & Hydra (#1303) * update req Signed-off-by: Jason <jasoli@nvidia.com> * update jenkins Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * remove print Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix file name Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add debug print into ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Replace exp dir with best ckpt path Signed-off-by: PeganovAnton <peganoff2@mail.ru> * disable test (#1310) Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix checkpoint path saving Signed-off-by: PeganovAnton <peganoff2@mail.ru> * TTS Collection Cleanup (#1304) * update yamls Signed-off-by: Jason <jasoli@nvidia.com> * OperationMode change Signed-off-by: Jason <jasoli@nvidia.com> * drop experimental and unneeded functions, fix dataclass Signed-off-by: Jason <jasoli@nvidia.com> * update notebook Signed-off-by: Jason <jasoli@nvidia.com> * update docs; ipython notebook; fixes Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * unused import Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * update pad_value Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * fix Preprocessor dataclass Signed-off-by: Jason <jasoli@nvidia.com> * update tacotron2 labels Signed-off-by: Jason <jasoli@nvidia.com> * move labels Signed-off-by: Jason <jasoli@nvidia.com> * typo Signed-off-by: Jason <jasoli@nvidia.com> * typos Signed-off-by: Jason <jasoli@nvidia.com> * update taco2 Signed-off-by: Jason <jasoli@nvidia.com> Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix yaml configs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * minor changes to PTL 1.0 support (#1312) * PTL 1.0 support Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * ipdb removal Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * fix to unequal length of correct counts Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * fixed test Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Close opened file to prevent IOError (#1308) * Close opened file to prevent IOError Close an opened text file when done, in order to prevent reaching the number of opened files. Signed-off-by: Mpho Mphego <mpho112@gmail.com> * style Signed-off-by: Jason <jasoli@nvidia.com> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Signed-off-by: PeganovAnton <peganoff2@mail.ru> * moved all tensorboard logs to self.log (#1317) * moved all tensorboard logs to self.log Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> * PTL upgrade change for classification models Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Patch QA training_step (#1316) * fix training_step Signed-off-by: ericharper <complex451@gmail.com> * limit jenkins run with train_ds.num_samples rather than trainer.max_steps Signed-off-by: ericharper <complex451@gmail.com> * limit jenkins run with train_ds.num_samples rather than trainer.max_steps Signed-off-by: ericharper <complex451@gmail.com> * limit jenkins run with train_ds.num_samples rather than trainer.max_steps Signed-off-by: ericharper <complex451@gmail.com> * limit jenkins run with train_ds.num_samples rather than trainer.max_steps Signed-off-by: ericharper <complex451@gmail.com> Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix config names Signed-off-by: PeganovAnton <peganoff2@mail.ru> * upgrade to PTL 1.0.2 (#1318) Signed-off-by: nithinraok <nithinrao.koluguri@gmail.com> Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix config names Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bug in squeezing excess dimension Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix num tokens in batch Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix num steps Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix Licence section Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove unused import Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove unused local variables Signed-off-by: PeganovAnton <peganoff2@mail.ru> * init Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove vim swp files Signed-off-by: PeganovAnton <peganoff2@mail.ru> * back up draft of nmt model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add tokenizer model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Expand user in tokenizer model paths Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Expand user in tokenizer model paths Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix typo Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add paths to data to config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Expand user Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Expand user Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update gitignore Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove excess newlines Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Replace distributed sampler with random sampler Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Make mt train on test Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Make mt train on test Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Make mt train on test Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix shuffle param Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix batch size parameter Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix typo Signed-off-by: PeganovAnton <peganoff2@mail.ru> * fix retrieving params from config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix parameter name Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove embedding dropout from encoder parameters Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix parameter name Signed-off-by: PeganovAnton <peganoff2@mail.ru> * remove vocab parameter from encoder constructor call Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix model params Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Test connection to github Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove excess parameter from decoder constructor call Signed-off-by: PeganovAnton <peganoff2@mail.ru> * remove foo Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove excess parameter from beam search constructor Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix parameter names in beam search constructor call Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix parameter name in function call Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Change gpu settings Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix forward function of mt model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Return to logits type Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add pl callback Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix docstring Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Replace logger.info with print Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backou Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove debug prints and fix several bugs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Detach beam results earlier Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Improve config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove debug prints and fix several bugs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * merge Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add ngc config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add NeMo to PYTHONPATH in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Improve the way nemo path is set Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add debug print to ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size in ngc model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce validation batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Set result path and reduce batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update hp Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update hp Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Rename job Signed-off-by: PeganovAnton <peganoff2@mail.ru> * add de en config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Move logging to model, improve config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Disable progress bar Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove mt callback from trainer Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update 2 gpu config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix test dataset in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backup Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update configs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update ngc debug commands Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add model converting to float Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Separate train and test Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add de->en config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce seq len Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bash syntax error and reduce batch Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix Error in config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Increase num steps Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Replace logger.info with print Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove debug prints and fix several bugs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * init Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove vim swp files Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix typo Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add paths to data to config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update gitignore Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove excess newlines Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Make mt train on test Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Make mt train on test Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix batch size parameter Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix typo Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Test connection to github Signed-off-by: PeganovAnton <peganoff2@mail.ru> * remove foo Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Change gpu settings Signed-off-by: PeganovAnton <peganoff2@mail.ru> * backou Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove debug prints and fix several bugs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Detach beam results earlier Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Improve config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove debug prints and fix several bugs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * merge Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add ngc config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add NeMo to PYTHONPATH in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Improve the way nemo path is set Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add debug print to ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size in ngc model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce validation batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Set result path and reduce batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update hp Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update hp Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Rename job Signed-off-by: PeganovAnton <peganoff2@mail.ru> * add de en config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Move logging to model, improve config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Disable progress bar Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update 2 gpu config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix test dataset in ngc command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce seq len Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix Error in config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Increase num steps Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bug in squeezing excess dimension Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix num steps Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix Licence section Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove unused local variables Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix problems after rebase Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add configs with large batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * fix rebase consequences Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Rebalance emb and W, rm excess conf, inc vocab sz Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix en de vocab size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Replace py scalar with tensor, add fp32 confs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Adjust parameters Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Make minor fixes Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix jobs names Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bug in beam search len penalty Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce test and validation batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix PEP 8 Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Try to bypass illegal mem access error Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce eval batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Replace byte with bool and fix indents Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Refactor future mask computation Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove dev code Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add debug print Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add debug print Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce init range Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce init range Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix init range Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce init range Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Move embeddings factor to initialization Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add params stats collection script Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bugs in stats collection Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add step logging when collecting stats Signed-off-by: PeganovAnton <peganoff2@mail.ru> * fix code style Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Adjust initialization according to paper Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Restore typecheck command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix arg name Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix arg name Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix init range Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update docker image Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix argument passing Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove weights logging Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix init range Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Replace init scaling with multiplication Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add draft of circe command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update circe command Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Reduce batch size Signed-off-by: PeganovAnton <peganoff2@mail.ru> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Co-authored-by: Mpho Mphego <mmphego@ska.ac.za> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * undo ASR example Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * clean up some unnecessary changes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Fix default config names Signed-off-by: PeganovAnton <peganoff2@mail.ru> * updates Signed-off-by: Oleksii Kuchaiev <kuchaev@gmail.com> * style fix Signed-off-by: Oleksii Kuchaiev <kuchaev@gmail.com> * Change inheritance to NeMo Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add Facebook copyright to fairseq tokenizer Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Switch to sacrebleu lib, remove callback Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Pring examples in debug config Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Migrate to sacrebleu package Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove ngc and circe commands Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove eda Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix minor bug and create ckpt to best model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add configs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * working copy and train-on-test examples Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Fix code style Signed-off-by: PeganovAnton <peganoff2@mail.ru> * minor fixes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * fix dataloader param reading Signed-off-by: Oleksii Kuchaiev <kuchaev@gmail.com> * add 4 gpu example Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Add perplexity to transformer mt model Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix code style Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Minor fix Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove non existent tokens from beam results Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix best ckpt link creation Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bugs in id filtering Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove non existent tokens from beam results Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix bleu logging Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Adding nmt_transformer_infer.py script Fixing bugs in .translate method Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Comment out scaling in translate method Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Update configs Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix device placement bug Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Remove hacky hack Signed-off-by: PeganovAnton <peganoff2@mail.ru> * initial service commit Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * updates Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * disable grads in beam search Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * undo hack Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * style fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Update logging procedure Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Optimize beam search Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix code style Signed-off-by: PeganovAnton <peganoff2@mail.ru> * magin memory fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * delete quant reqs Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Add fast inference instruments Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Fix code style Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Change logging message a little Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Encoder-Decoder NMT Refactor (#1471) * add EncDecNLPModel and refactor nmt Signed-off-by: ericharper <complex451@gmail.com> * was refactoring the wrong model Signed-off-by: ericharper <complex451@gmail.com> * add encoder-decoder nlp base model Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * adding enc dec tokenizers Signed-off-by: ericharper <complex451@gmail.com> * adding enc dec tokenizers Signed-off-by: ericharper <complex451@gmail.com> * add vocab_divisible_by_eight config Signed-off-by: ericharper <complex451@gmail.com> * add enc_dec_nmt example script Signed-off-by: ericharper <complex451@gmail.com> * addded enc dec example Signed-off-by: ericharper <complex451@gmail.com> * adding embeddings Signed-off-by: ericharper <complex451@gmail.com> * can instantiate embedding layers Signed-off-by: ericharper <complex451@gmail.com> * can instantiate embedding layers Signed-off-by: ericharper <complex451@gmail.com> * adding transformer encoder Signed-off-by: ericharper <complex451@gmail.com> * adding transformer encoder and decoder Signed-off-by: ericharper <complex451@gmail.com> * instaniate encoder and decoder Signed-off-by: ericharper <complex451@gmail.com> * instantiate head Signed-off-by: ericharper <complex451@gmail.com> * instantiate beam search Signed-off-by: ericharper <complex451@gmail.com> * instantiate loss Signed-off-by: ericharper <complex451@gmail.com> * setup optimizer Signed-off-by: ericharper <complex451@gmail.com> * delete unnec comment Signed-off-by: ericharper <complex451@gmail.com> * add datasets Signed-off-by: ericharper <complex451@gmail.com> * add datasets Signed-off-by: ericharper <complex451@gmail.com> * add cache_ids argument to translation dataset Signed-off-by: ericharper <complex451@gmail.com> * cache dataset ids per node Signed-off-by: ericharper <complex451@gmail.com> * add caching per node argument Signed-off-by: ericharper <complex451@gmail.com> * cache dataset ids per node Signed-off-by: ericharper <complex451@gmail.com> * cache dataset ids per node Signed-off-by: ericharper <complex451@gmail.com> * bug Signed-off-by: ericharper <complex451@gmail.com> * style fixes so that CI can proceed Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * fixing optim Signed-off-by: ericharper <complex451@gmail.com> * add Optional where needed in dataclasses Signed-off-by: ericharper <complex451@gmail.com> * move dataclass Signed-off-by: ericharper <complex451@gmail.com> * training is working Signed-off-by: ericharper <complex451@gmail.com> * refactor from structured config to hybrid config Signed-off-by: ericharper <complex451@gmail.com> * clean Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * transformers version upper bound Signed-off-by: ericharper <complex451@gmail.com> * remove num_samples from config Signed-off-by: ericharper <complex451@gmail.com> * add exp_manager Signed-off-by: ericharper <complex451@gmail.com> * lower default max_generation_delta Signed-off-by: ericharper <complex451@gmail.com> * clean up Signed-off-by: ericharper <complex451@gmail.com> * change val_check_interval default Signed-off-by: ericharper <complex451@gmail.com> * clean up imports Signed-off-by: ericharper <complex451@gmail.com> * in progress refactor Signed-off-by: ericharper <complex451@gmail.com> * in progress refactor Signed-off-by: ericharper <complex451@gmail.com> * refactor Signed-off-by: ericharper <complex451@gmail.com> * fixes Signed-off-by: ericharper <complex451@gmail.com> * add yaml Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * remove unused import Signed-off-by: ericharper <complex451@gmail.com> * add jenkins test Signed-off-by: ericharper <complex451@gmail.com> * add jenkins test Signed-off-by: ericharper <complex451@gmail.com> * remove old megabert test Signed-off-by: ericharper <complex451@gmail.com> * add jenkins test Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * typo Signed-off-by: ericharper <complex451@gmail.com> * remove vocab size setter Signed-off-by: ericharper <complex451@gmail.com> * remove vocab size setter Signed-off-by: ericharper <complex451@gmail.com> * remove vocab size setter Signed-off-by: ericharper <complex451@gmail.com> * remove vocab size setter Signed-off-by: ericharper <complex451@gmail.com> * move dataclass to config.py Signed-off-by: ericharper <complex451@gmail.com> * update docstring Signed-off-by: ericharper <complex451@gmail.com> * remove vocab divis by 8 cfg Signed-off-by: ericharper <complex451@gmail.com> * remove unnec comments Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Bug fixes to EncDec MT model (#1525) * bugfixes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * update jenkins test Signed-off-by: ericharper <complex451@gmail.com> * update jenkins test Signed-off-by: ericharper <complex451@gmail.com> * small fixes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * config fixes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * remove pplx Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: ericharper <complex451@gmail.com> * minor fixes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Properly register tokenizers inside EncDecNLPModel Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * add pre_ln option Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * cleanups Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * batch size change Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Add entire dataset caching via a preproc script, bpe dropout and deto… (#1601) * Add entire dataset caching via a preproc script, bpe dropout and detokenization Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Removed unused code and allow reverse lang direction in dataset Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix unused imports Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * fix style Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * bugfix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * bugfix to bugfix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * get rid of ModelPTConfig Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * fixing a test fail Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * unittest fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * set logger as False by default in TrainerConfig Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * exp manager logger fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * address some review feedback, bugfixes Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * add tensorboard logger back Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * NMT combine embedding plus encoder/decoder into one neural module. (#1611) * adding transformer encoder and ecoder neural modules Signed-off-by: ericharper <complex451@gmail.com> * encoder decoder neural modules Signed-off-by: ericharper <complex451@gmail.com> * update configs and forward Signed-off-by: ericharper <complex451@gmail.com> * fix import Signed-off-by: ericharper <complex451@gmail.com> * fix import Signed-off-by: ericharper <complex451@gmail.com> * forgot subclass Signed-off-by: ericharper <complex451@gmail.com> * change comment Signed-off-by: ericharper <complex451@gmail.com> * interpolate hidden size and add todo comment Signed-off-by: ericharper <complex451@gmail.com> * remove instantiate Signed-off-by: ericharper <complex451@gmail.com> * add EncoderModule and DecoderModule to typing Signed-off-by: ericharper <complex451@gmail.com> * cleaning configs Signed-off-by: ericharper <complex451@gmail.com> * using named arguments Signed-off-by: ericharper <complex451@gmail.com> * using named arguments Signed-off-by: ericharper <complex451@gmail.com> * bug fix Signed-off-by: ericharper <complex451@gmail.com> * bug fix Signed-off-by: ericharper <complex451@gmail.com> * bug fix Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * schema not allowing + Signed-off-by: ericharper <complex451@gmail.com> * merge configs with update_model_config Signed-off-by: ericharper <complex451@gmail.com> * small fixes to Transformer neural modules Signed-off-by: ericharper <complex451@gmail.com> * small fixes to Transformer neural modules Signed-off-by: ericharper <complex451@gmail.com> * add abstract properties to encoder and decoder nms Signed-off-by: ericharper <complex451@gmail.com> * small bugfix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * check if bert_model is there Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Add load cached dataset and reverse lang direction to translation data config class Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Add source lang tokenization and punct normalization to model translate function Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * nmt webservice Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * style fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * fix bug in configs Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * updates to nmt service Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * add index.html Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * some webapp ui improvements Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * try-catch in webservice Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * Set beam size and len pen during inference Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * average eval loss Signed-off-by: PeganovAnton <peganoff2@mail.ru> * fix mnist test Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * sgdqa fix Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * sgdqa fix attempt 2 Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * fixing sgdqa Signed-off-by: Oleksii Kuchaiev <okuchaiev@nvidia.com> * jenkinstest to main Signed-off-by: ericharper <complex451@gmail.com> * remove comment Signed-off-by: ericharper <complex451@gmail.com> * add types to args Signed-off-by: ericharper <complex451@gmail.com> * add types to args Signed-off-by: ericharper <complex451@gmail.com> * add todo Signed-off-by: ericharper <complex451@gmail.com> * remove comments Signed-off-by: ericharper <complex451@gmail.com> * remove docstring for forward Signed-off-by: ericharper <complex451@gmail.com> * remove comment Signed-off-by: ericharper <complex451@gmail.com> * remove comment Signed-off-by: ericharper <complex451@gmail.com> * remove comment Signed-off-by: ericharper <complex451@gmail.com> * add typecheck Signed-off-by: ericharper <complex451@gmail.com> * remove kwargs Signed-off-by: ericharper <complex451@gmail.com> * use ptl defaults Signed-off-by: ericharper <complex451@gmail.com> * upper bound ptl to 1.13 Signed-off-by: ericharper <complex451@gmail.com> * style Signed-off-by: ericharper <complex451@gmail.com> * fix jenkins test Signed-off-by: ericharper <complex451@gmail.com> * fix jenkins test Signed-off-by: ericharper <complex451@gmail.com> * revert typecheck Signed-off-by: ericharper <complex451@gmail.com> * adding enable_pl_optimizer to trainer config Signed-off-by: ericharper <complex451@gmail.com> Co-authored-by: PeganovAnton <peganoff2@mail.ru> Co-authored-by: Jason <jasoli@nvidia.com> Co-authored-by: Nithin Rao <nithinrao.koluguri@gmail.com> Co-authored-by: ericharper <complex451@gmail.com> Co-authored-by: Mpho Mphego <mmphego@ska.ac.za> Co-authored-by: Aleksey Grinchuk (Oleksii Hrinchuk) <grinchuk.alexey@gmail.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Somshubra Majumdar <titu1994@gmail.com>
2021-01-25 23:07:47 +01:00
.hydra/
nemo_experiments/