4 commits

Author	SHA1	Message	Date
Przemek Strzelczyk	a70896405d	Updating BERT/PyT ... * Use LAMB from APEX * Code cleanup * Bug fix in BertAdam optimizer	2019-11-18 23:07:24 +01:00
Przemek Strzelczyk	6fe463fe27	[BERT/PyT] Support for multi-node	2019-09-10 17:21:52 +02:00
Sharath T S	3d59216cec	[BERT] [PyTorch] Data prep fix (#171) ... * add dgx1-16g and dgx2 specific pretraining instructions * fix typo in readme * fix data prep and reflect changes in pretraining * remove .ide files * remove data files * Point to right SQUAD location * remove garbage [[]] * default accumulation in fp32 * remove ide files * fix phase2 DATADIR path * remove readme in data folder	2019-08-22 07:52:18 +02:00
Przemek Strzelczyk	0663b67c1a	Updating models	2019-07-08 22:51:28 +02:00