31 commits

Author	SHA1	Message	Date
Jason Volk	2609c21913	ircd::gpt::pipe: Enable mutable model; fixes for backpropagation; range stub.	2022-10-18 22:01:35 +00:00
Jason Volk	1ac69df8cd	ircd::gpt::pipe::range: Use opts for construction.	2022-10-16 01:34:03 +00:00
Jason Volk	2afaa4fa4f	ircd::gpt::pipe: Remove cruft.	2022-10-06 22:05:52 +00:00
Jason Volk	442dad869d	ircd::gpt: Resolve cycle count sampling; add debug log; fix count.	2022-10-06 22:01:41 +00:00
Jason Volk	0917a1f041	ircd::gpt::pipe: Resolve control page sync at ends of sample.	2022-10-06 18:54:29 +00:00
Jason Volk	be3fd4be62	ircd::gpt::pipe: Add 5th profile col for OpenCL 2.0; graceful default output.	2022-10-05 13:53:52 -07:00
Jason Volk	a9709568b4	ircd::gpt::pipe: Move the frame mapping command to the cycle.	2022-10-05 20:10:31 +00:00
Jason Volk	1f947f982c	ircd::gpt: Cache pipe::code instance in shared_ptr for task reuse.	2022-07-31 02:46:05 -07:00
Jason Volk	d68f261036	ircd::gpt::pipe: Simplify init/fini w/ run::level::QUIT handler.	2022-06-30 16:04:31 -07:00
Jason Volk	61d558fc9d	ircd: Define all IRCD_USE_ as integers for constexprs.	2022-06-23 09:36:44 -07:00
Jason Volk	78848925ee	ircd::gpt: Various refactoring.	2022-06-19 20:14:22 -07:00
Jason Volk	400b306833	ircd::gpt::pipe: Split pipe::code into separate unit.	2022-06-17 21:11:53 -07:00
Jason Volk	b7b1328352	ircd::gpt::pipe: Reuse logsm buffer for logexp intermediate values.	2022-06-17 21:11:53 -07:00
Jason Volk	a7560b5cfc	ircd::gpt::pipe::code: Preliminary reorg for legacy NIR build cache.	2022-06-17 21:11:53 -07:00
Jason Volk	8a3eeb46f9	ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.	2021-10-06 13:13:47 -07:00
Jason Volk	79b6d4b9da	ircd::gpt::pipe: Unify descriptor allocations.	2021-10-06 13:13:47 -07:00
Jason Volk	ce9abfb321	ircd::gpt::model: Optimize left-attention mask.	2021-10-06 13:13:47 -07:00
Jason Volk	20162fd7d5	ircd::gpt: Splits and renames; various reorg.	2021-09-15 01:44:36 -07:00
Jason Volk	6e7e56f081	ircd::gpt::pipe: Add conf item for default source paths and opts for now.	2021-09-14 23:39:55 -07:00
Jason Volk	c3cb249f78	ircd::gpt: Split debug related; improve flush options; minor cleanup.	2021-05-14 05:57:47 -07:00
Jason Volk	37b1d47c8d	ircd::gpt: Reorganize task options and control blocks.	2021-05-11 20:56:09 -07:00
Jason Volk	5392ba0c7d	ircd::gpt::pipe: Expansions to the context size.	2021-04-22 12:27:57 -07:00
Jason Volk	2a3c54afa2	ircd::gpt::pipe: Add model invalidation for device resynchronization.	2021-04-22 12:27:57 -07:00
Jason Volk	bd460a80ce	ircd::gpt::pipe::model: Additional sub-buffering for lmhead.	2021-04-22 12:27:57 -07:00
Jason Volk	b76d1f32ee	ircd::gpt::pipe: Improve self attention; various.	2021-04-22 12:27:57 -07:00
Jason Volk	d5eb1e3a87	ircd::gpt: Add backpropagation pipe.	2021-04-22 12:27:57 -07:00
Jason Volk	14a1561cad	ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs.	2021-04-22 12:27:57 -07:00
Jason Volk	eba5d7f586	ircd::gpt: Improve build related; debug/assertions.	2021-04-22 12:27:57 -07:00
Jason Volk	9c062d9c3f	ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize.	2021-04-22 12:27:57 -07:00
Jason Volk	1870c364f4	ircd::gpt: Reorganize interface.	2021-04-22 12:27:57 -07:00
Jason Volk	29e74ec9e1	ircd::gpt: Transformer Pipe.	2021-04-22 12:27:56 -07:00