Jason Volk
|
e85ed0e0dd
|
ircd::gpt: Remove various cruft.
|
2022-09-24 16:40:39 -07:00 |
|
Jason Volk
|
6d2da3b4f1
|
ircd::gpt::task: Refactor generator interface to member functions.
|
2022-07-01 20:17:56 -07:00 |
|
Jason Volk
|
78848925ee
|
ircd::gpt: Various refactoring.
|
2022-06-19 20:14:22 -07:00 |
|
Jason Volk
|
b7b1328352
|
ircd::gpt::pipe: Reuse logsm buffer for logexp intermediate values.
|
2022-06-17 21:11:53 -07:00 |
|
Jason Volk
|
8f90e7c0cd
|
ircd::gpt: Optimizations for matrix multiply.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
aea6c79fc2
|
ircd::gpt: Add top N and target label result register control block.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
8bd78af128
|
ircd::gpt: Additional task header/interface simplification.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
c1f3e580c3
|
ircd::gpt: Add top_p lmhead selector, quantized for now.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
8a3eeb46f9
|
ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
c5f159ad58
|
ircd::gpt: Cleanup/improve work item related prologues.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
ce9abfb321
|
ircd::gpt::model: Optimize left-attention mask.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
20162fd7d5
|
ircd::gpt: Splits and renames; various reorg.
|
2021-09-15 01:44:36 -07:00 |
|