12 commits

Author	SHA1	Message	Date
Jason Volk	6e7e56f081	ircd::gpt::pipe: Add conf item for default source paths and opts for now.	2021-09-14 23:39:55 -07:00
Jason Volk	c3cb249f78	ircd::gpt: Split debug related; improve flush options; minor cleanup.	2021-05-14 05:57:47 -07:00
Jason Volk	37b1d47c8d	ircd::gpt: Reorganize task options and control blocks.	2021-05-11 20:56:09 -07:00
Jason Volk	3e9c2d1b56	ircd::simt: Abstract the three-piece softmax, mean state related.	2021-05-11 20:56:09 -07:00
Jason Volk	536594b487	ircd::gpt::pipe: Consolidate loop; improve access pattern; various reorg.	2021-05-11 20:56:08 -07:00
Jason Volk	5392ba0c7d	ircd::gpt::pipe: Expansions to the context size.	2021-04-22 12:27:57 -07:00
Jason Volk	f61239a52c	ircd::gpt::pipe: Various statistical instrumentation.	2021-04-22 12:27:57 -07:00
Jason Volk	b76d1f32ee	ircd::gpt::pipe: Improve self attention; various.	2021-04-22 12:27:57 -07:00
Jason Volk	d5eb1e3a87	ircd::gpt: Add backpropagation pipe.	2021-04-22 12:27:57 -07:00
Jason Volk	9c062d9c3f	ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize.	2021-04-22 12:27:57 -07:00
Jason Volk	1870c364f4	ircd::gpt: Reorganize interface.	2021-04-22 12:27:57 -07:00
Jason Volk	29e74ec9e1	ircd::gpt: Transformer Pipe.	2021-04-22 12:27:56 -07:00