0
0
Fork 0
mirror of https://github.com/matrix-construct/construct synced 2024-12-12 00:22:58 +01:00
Commit graph

31 commits

Author SHA1 Message Date
Jason Volk
2609c21913 ircd::gpt::pipe: Enable mutable model; fixes for backpropagation; range stub. 2022-10-18 22:01:35 +00:00
Jason Volk
1ac69df8cd ircd::gpt::pipe::range: Use opts for construction. 2022-10-16 01:34:03 +00:00
Jason Volk
2afaa4fa4f ircd::gpt::pipe: Remove cruft. 2022-10-06 22:05:52 +00:00
Jason Volk
442dad869d ircd::gpt: Resolve cycle count sampling; add debug log; fix count. 2022-10-06 22:01:41 +00:00
Jason Volk
0917a1f041 ircd::gpt::pipe: Resolve control page sync at ends of sample. 2022-10-06 18:54:29 +00:00
Jason Volk
be3fd4be62 ircd::gpt::pipe: Add 5th profile col for OpenCL 2.0; graceful default output. 2022-10-05 13:53:52 -07:00
Jason Volk
a9709568b4 ircd::gpt::pipe: Move the frame mapping command to the cycle. 2022-10-05 20:10:31 +00:00
Jason Volk
1f947f982c ircd::gpt: Cache pipe::code instance in shared_ptr for task reuse. 2022-07-31 02:46:05 -07:00
Jason Volk
d68f261036 ircd::gpt::pipe: Simplify init/fini w/ run::level::QUIT handler. 2022-06-30 16:04:31 -07:00
Jason Volk
61d558fc9d ircd: Define all IRCD_USE_ as integers for constexprs. 2022-06-23 09:36:44 -07:00
Jason Volk
78848925ee ircd::gpt: Various refactoring. 2022-06-19 20:14:22 -07:00
Jason Volk
400b306833 ircd::gpt::pipe: Split pipe::code into separate unit. 2022-06-17 21:11:53 -07:00
Jason Volk
b7b1328352 ircd::gpt::pipe: Reuse logsm buffer for logexp intermediate values. 2022-06-17 21:11:53 -07:00
Jason Volk
a7560b5cfc ircd::gpt::pipe::code: Preliminary reorg for legacy NIR build cache. 2022-06-17 21:11:53 -07:00
Jason Volk
8a3eeb46f9 ircd::gpt::pipe: Optimize pipeline to cache attention state for generations. 2021-10-06 13:13:47 -07:00
Jason Volk
79b6d4b9da ircd::gpt::pipe: Unify descriptor allocations. 2021-10-06 13:13:47 -07:00
Jason Volk
ce9abfb321 ircd::gpt::model: Optimize left-attention mask. 2021-10-06 13:13:47 -07:00
Jason Volk
20162fd7d5 ircd::gpt: Splits and renames; various reorg. 2021-09-15 01:44:36 -07:00
Jason Volk
6e7e56f081 ircd::gpt::pipe: Add conf item for default source paths and opts for now. 2021-09-14 23:39:55 -07:00
Jason Volk
c3cb249f78 ircd::gpt: Split debug related; improve flush options; minor cleanup. 2021-05-14 05:57:47 -07:00
Jason Volk
37b1d47c8d ircd::gpt: Reorganize task options and control blocks. 2021-05-11 20:56:09 -07:00
Jason Volk
5392ba0c7d ircd::gpt::pipe: Expansions to the context size. 2021-04-22 12:27:57 -07:00
Jason Volk
2a3c54afa2 ircd::gpt::pipe: Add model invalidation for device resynchronization. 2021-04-22 12:27:57 -07:00
Jason Volk
bd460a80ce ircd::gpt::pipe::model: Additional sub-buffering for lmhead. 2021-04-22 12:27:57 -07:00
Jason Volk
b76d1f32ee ircd::gpt::pipe: Improve self attention; various. 2021-04-22 12:27:57 -07:00
Jason Volk
d5eb1e3a87 ircd::gpt: Add backpropagation pipe. 2021-04-22 12:27:57 -07:00
Jason Volk
14a1561cad ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs. 2021-04-22 12:27:57 -07:00
Jason Volk
eba5d7f586 ircd::gpt: Improve build related; debug/assertions. 2021-04-22 12:27:57 -07:00
Jason Volk
9c062d9c3f ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize. 2021-04-22 12:27:57 -07:00
Jason Volk
1870c364f4 ircd::gpt: Reorganize interface. 2021-04-22 12:27:57 -07:00
Jason Volk
29e74ec9e1 ircd::gpt: Transformer Pipe. 2021-04-22 12:27:56 -07:00