38 commits

Author	SHA1	Message	Date
Jason Volk	110d4e7b17	ircd::gpt: Remove hostside backprop branch for now; simplify sample tokenizer.	2022-11-03 18:28:53 +00:00
Jason Volk	db549a64ca	ircd::gpt: Add values for custom timestamp range to ctrl prof block.	2022-11-03 18:28:53 +00:00
Jason Volk	e89703aa97	ircd::gpt::gpu: Limit dispatch to the number of control frame buffers.	2022-10-30 18:44:50 +00:00
Jason Volk	2609c21913	ircd::gpt::pipe: Enable mutable model; fixes for backpropagation; range stub.	2022-10-18 22:01:35 +00:00
Jason Volk	c1168fcc30	ircd::gpt: Resolve behavior of opts.limit: 0=analysis, -n=unlimited, n=limited.	2022-10-09 03:13:09 +00:00
Jason Volk	4c44125d37	ircd::gpt::samp: Split dispatch branch into memfun.	2022-10-06 22:28:23 +00:00
Jason Volk	442dad869d	ircd::gpt: Resolve cycle count sampling; add debug log; fix count.	2022-10-06 22:01:41 +00:00
Jason Volk	0917a1f041	ircd::gpt::pipe: Resolve control page sync at ends of sample.	2022-10-06 18:54:29 +00:00
Jason Volk	a9709568b4	ircd::gpt::pipe: Move the frame mapping command to the cycle.	2022-10-05 20:10:31 +00:00
Jason Volk	a2826400a8	ircd::gpt::samp: Sample is done when dispatch=0 on interrupt without accept.	2022-08-27 01:52:05 -07:00
Jason Volk	1dd22c8e05	ircd::gpt::task: Count tokens at start rather than input vector size.	2022-08-19 20:57:35 -07:00
Jason Volk	1f947f982c	ircd::gpt: Cache pipe::code instance in shared_ptr for task reuse.	2022-07-31 02:46:05 -07:00
Jason Volk	6d2da3b4f1	ircd::gpt::task: Refactor generator interface to member functions.	2022-07-01 20:17:56 -07:00
Jason Volk	5a4a395fc2	Add noexcept to various lambdas (gcc-11).	2022-06-29 14:42:42 -07:00
Jason Volk	78848925ee	ircd::gpt: Various refactoring.	2022-06-19 20:14:22 -07:00
Jason Volk	26ce330d6d	ircd::gpt: Add layer count to model section of opts.	2022-06-17 21:11:53 -07:00
Jason Volk	c92e97f02a	ircd::gpt: Remove unnecessary alignas.	2022-06-17 21:11:53 -07:00
Jason Volk	aea6c79fc2	ircd::gpt: Add top N and target label result register control block.	2021-10-06 13:13:47 -07:00
Jason Volk	8bd78af128	ircd::gpt: Additional task header/interface simplification.	2021-10-06 13:13:47 -07:00
Jason Volk	c1f3e580c3	ircd::gpt: Add top_p lmhead selector, quantized for now.	2021-10-06 13:13:47 -07:00
Jason Volk	8a3eeb46f9	ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.	2021-10-06 13:13:47 -07:00
Jason Volk	20162fd7d5	ircd::gpt: Splits and renames; various reorg.	2021-09-15 01:44:36 -07:00
Jason Volk	5518daf197	ircd::gpt: Remove branch by assuming loop body always taken.	2021-08-01 03:22:14 -07:00
Jason Volk	c3cb249f78	ircd::gpt: Split debug related; improve flush options; minor cleanup.	2021-05-14 05:57:47 -07:00
Jason Volk	37b1d47c8d	ircd::gpt: Reorganize task options and control blocks.	2021-05-11 20:56:09 -07:00
Jason Volk	1f49f71530	ircd::gpt: Backpropagate adaptive moment estimations.	2021-04-22 12:27:57 -07:00
Jason Volk	f61239a52c	ircd::gpt::pipe: Various statistical instrumentation.	2021-04-22 12:27:57 -07:00
Jason Volk	d5eb1e3a87	ircd::gpt: Add backpropagation pipe.	2021-04-22 12:27:57 -07:00
Jason Volk	14a1561cad	ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs.	2021-04-22 12:27:57 -07:00
Jason Volk	9c062d9c3f	ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize.	2021-04-22 12:27:57 -07:00
Jason Volk	1870c364f4	ircd::gpt: Reorganize interface.	2021-04-22 12:27:57 -07:00
Jason Volk	4ac7e1b19d	ircd::gpt: Abstractor various backend subroutines; generator loop.	2021-04-22 12:27:56 -07:00
Jason Volk	29fb7910b7	ircd::gpt: Model structural tweaks; task structure; various.	2021-04-22 12:27:56 -07:00
Jason Volk	4da7d2ae43	ircd::gpt: Add task struct; mmap cached model directly; improve init.	2021-03-16 12:58:22 -07:00
Jason Volk	33a1ffd4bf	ircd::gpt: Add basic interface; add options, context.	2021-03-09 04:50:19 -08:00
Jason Volk	4458235dfa	ircd::gpt: More Matrix Than Matrix.	2021-03-09 04:50:19 -08:00
Jason Volk	29b99dcf4d	ircd::gpt: Split vocab related into separate unit.	2021-03-02 11:13:59 -08:00
Jason Volk	57f9d3fdfb	ircd::gpt: Add vocabulary tokenization; byte-pair merge encoding for natural language.	2021-02-26 14:52:33 -08:00