4f2ea4913c
* squash Signed-off-by: Jason <jasoli@nvidia.com> * add comments Signed-off-by: Jason <jasoli@nvidia.com> * style and cleanup Signed-off-by: Jason <jasoli@nvidia.com> * cleanup Signed-off-by: Jason <jasoli@nvidia.com> * add new test file Signed-off-by: Jason <jasoli@nvidia.com> * syntax Signed-off-by: Jason <jasoli@nvidia.com> * style Signed-off-by: Jason <jasoli@nvidia.com> * typo Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * update Signed-off-by: Jason <jasoli@nvidia.com> * try again Signed-off-by: Jason <jasoli@nvidia.com> * wip Signed-off-by: Jason <jasoli@nvidia.com> * style; ci should fail Signed-off-by: Jason <jasoli@nvidia.com> * final Signed-off-by: Jason <jasoli@nvidia.com>
19 lines
202 B
Plaintext
19 lines
202 B
Plaintext
boto3
|
|
h5py
|
|
matplotlib>=3.3.2
|
|
sentencepiece
|
|
youtokentome>=1.0.5
|
|
numpy
|
|
rapidfuzz
|
|
gdown
|
|
megatron-lm==2.2.0
|
|
inflect
|
|
sacrebleu[ja]
|
|
sacremoses>=0.0.43
|
|
nltk==3.6.2
|
|
wordninja==2.0.0
|
|
fasttext
|
|
opencc
|
|
pangu
|
|
jieba
|