11 commits

Author	SHA1	Message	Date
Jason Volk	6d2da3b4f1	ircd::gpt::task: Refactor generator interface to member functions.	2022-07-01 20:17:56 -07:00
Jason Volk	78848925ee	ircd::gpt: Various refactoring.	2022-06-19 20:14:22 -07:00
Jason Volk	b7b1328352	ircd::gpt::pipe: Reuse logsm buffer for logexp intermediate values.	2022-06-17 21:11:53 -07:00
Jason Volk	8f90e7c0cd	ircd::gpt: Optimizations for matrix multiply.	2021-10-06 13:13:47 -07:00
Jason Volk	aea6c79fc2	ircd::gpt: Add top N and target label result register control block.	2021-10-06 13:13:47 -07:00
Jason Volk	8bd78af128	ircd::gpt: Additional task header/interface simplification.	2021-10-06 13:13:47 -07:00
Jason Volk	c1f3e580c3	ircd::gpt: Add top_p lmhead selector, quantized for now.	2021-10-06 13:13:47 -07:00
Jason Volk	8a3eeb46f9	ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.	2021-10-06 13:13:47 -07:00
Jason Volk	c5f159ad58	ircd::gpt: Cleanup/improve work item related prologues.	2021-10-06 13:13:47 -07:00
Jason Volk	ce9abfb321	ircd::gpt::model: Optimize left-attention mask.	2021-10-06 13:13:47 -07:00
Jason Volk	20162fd7d5	ircd::gpt: Splits and renames; various reorg.	2021-09-15 01:44:36 -07:00

Renamed from ircd/gpt_cl.cl (Browse further)