24 commits

Author	SHA1	Message	Date
Jason Volk	1f947f982c	ircd::gpt: Cache pipe::code instance in shared_ptr for task reuse.	2022-07-31 02:46:05 -07:00
Jason Volk	d68f261036	ircd::gpt::pipe: Simplify init/fini w/ run::level::QUIT handler.	2022-06-30 16:04:31 -07:00
Jason Volk	61d558fc9d	ircd: Define all IRCD_USE_ as integers for constexprs.	2022-06-23 09:36:44 -07:00
Jason Volk	78848925ee	ircd::gpt: Various refactoring.	2022-06-19 20:14:22 -07:00
Jason Volk	400b306833	ircd::gpt::pipe: Split pipe::code into separate unit.	2022-06-17 21:11:53 -07:00
Jason Volk	b7b1328352	ircd::gpt::pipe: Reuse logsm buffer for logexp intermediate values.	2022-06-17 21:11:53 -07:00
Jason Volk	a7560b5cfc	ircd::gpt::pipe::code: Preliminary reorg for legacy NIR build cache.	2022-06-17 21:11:53 -07:00
Jason Volk	8a3eeb46f9	ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.	2021-10-06 13:13:47 -07:00
Jason Volk	79b6d4b9da	ircd::gpt::pipe: Unify descriptor allocations.	2021-10-06 13:13:47 -07:00
Jason Volk	ce9abfb321	ircd::gpt::model: Optimize left-attention mask.	2021-10-06 13:13:47 -07:00
Jason Volk	20162fd7d5	ircd::gpt: Splits and renames; various reorg.	2021-09-15 01:44:36 -07:00
Jason Volk	6e7e56f081	ircd::gpt::pipe: Add conf item for default source paths and opts for now.	2021-09-14 23:39:55 -07:00
Jason Volk	c3cb249f78	ircd::gpt: Split debug related; improve flush options; minor cleanup.	2021-05-14 05:57:47 -07:00
Jason Volk	37b1d47c8d	ircd::gpt: Reorganize task options and control blocks.	2021-05-11 20:56:09 -07:00
Jason Volk	5392ba0c7d	ircd::gpt::pipe: Expansions to the context size.	2021-04-22 12:27:57 -07:00
Jason Volk	2a3c54afa2	ircd::gpt::pipe: Add model invalidation for device resynchronization.	2021-04-22 12:27:57 -07:00
Jason Volk	bd460a80ce	ircd::gpt::pipe::model: Additional sub-buffering for lmhead.	2021-04-22 12:27:57 -07:00
Jason Volk	b76d1f32ee	ircd::gpt::pipe: Improve self attention; various.	2021-04-22 12:27:57 -07:00
Jason Volk	d5eb1e3a87	ircd::gpt: Add backpropagation pipe.	2021-04-22 12:27:57 -07:00
Jason Volk	14a1561cad	ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs.	2021-04-22 12:27:57 -07:00
Jason Volk	eba5d7f586	ircd::gpt: Improve build related; debug/assertions.	2021-04-22 12:27:57 -07:00
Jason Volk	9c062d9c3f	ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize.	2021-04-22 12:27:57 -07:00
Jason Volk	1870c364f4	ircd::gpt: Reorganize interface.	2021-04-22 12:27:57 -07:00
Jason Volk	29e74ec9e1	ircd::gpt: Transformer Pipe.	2021-04-22 12:27:56 -07:00