NeMo/nemo_text_processing
Yang Zhang 663c76a972
Tn clean upsample (#3024)
* init

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* renamed file

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* adding all cleaning scripts

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* skip sentence if error

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* remove I-SAME

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* fix tyle

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* remove I the first from training

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* remove DM and Da from upsampling

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* remove I -> one/first, also add space around dash for alphanumerical context, remove rare currency from being upsampled

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* remove dalton and DM from being verbalized

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* remove Da and DM sentences competely

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* addressed review feedback, added data folder in examples

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* refactored code, added data utils functions

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* fix lgtm

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* fix lgtm

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* added electronic wfst for english neural TN

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

* header and lgtm

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
2021-11-02 10:26:17 -07:00
..
inverse_text_normalization Itn fr (#2947) 2021-10-05 13:13:03 -07:00
text_normalization Tn clean upsample (#3024) 2021-11-02 10:26:17 -07:00
__init__.py Text processing docs (#2046) 2021-04-09 18:11:40 -07:00
README.md Update text norm docs (#2137) 2021-04-29 14:59:25 -07:00
setup.sh Text processing docs (#2046) 2021-04-09 18:11:40 -07:00

nemo_text_processing

Introduction

NeMo's nemo_text_processing is a Python package that is installed with the nemo_toolkit. See documentation for details.