17 commits

Author	SHA1	Message	Date
Jason Volk	1f947f982c	ircd::gpt: Cache pipe::code instance in shared_ptr for task reuse.	2022-07-31 02:46:05 -07:00
Jason Volk	d68f261036	ircd::gpt::pipe: Simplify init/fini w/ run::level::QUIT handler.	2022-06-30 16:04:31 -07:00
Jason Volk	78848925ee	ircd::gpt: Various refactoring.	2022-06-19 20:14:22 -07:00
Jason Volk	b7b1328352	ircd::gpt::pipe: Reuse logsm buffer for logexp intermediate values.	2022-06-17 21:11:53 -07:00
Jason Volk	a7560b5cfc	ircd::gpt::pipe::code: Preliminary reorg for legacy NIR build cache.	2022-06-17 21:11:53 -07:00
Jason Volk	8a3eeb46f9	ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.	2021-10-06 13:13:47 -07:00
Jason Volk	79b6d4b9da	ircd::gpt::pipe: Unify descriptor allocations.	2021-10-06 13:13:47 -07:00
Jason Volk	ce9abfb321	ircd::gpt::model: Optimize left-attention mask.	2021-10-06 13:13:47 -07:00
Jason Volk	6e7e56f081	ircd::gpt::pipe: Add conf item for default source paths and opts for now.	2021-09-14 23:39:55 -07:00
Jason Volk	c3cb249f78	ircd::gpt: Split debug related; improve flush options; minor cleanup.	2021-05-14 05:57:47 -07:00
Jason Volk	2a3c54afa2	ircd::gpt::pipe: Add model invalidation for device resynchronization.	2021-04-22 12:27:57 -07:00
Jason Volk	bd460a80ce	ircd::gpt::pipe::model: Additional sub-buffering for lmhead.	2021-04-22 12:27:57 -07:00
Jason Volk	d5eb1e3a87	ircd::gpt: Add backpropagation pipe.	2021-04-22 12:27:57 -07:00
Jason Volk	14a1561cad	ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs.	2021-04-22 12:27:57 -07:00
Jason Volk	9c062d9c3f	ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize.	2021-04-22 12:27:57 -07:00
Jason Volk	1870c364f4	ircd::gpt: Reorganize interface.	2021-04-22 12:27:57 -07:00
Jason Volk	29e74ec9e1	ircd::gpt: Transformer Pipe.	2021-04-22 12:27:56 -07:00