Jason Volk
|
c92e97f02a
|
ircd::gpt: Remove unnecessary alignas.
|
2022-06-17 21:11:53 -07:00 |
|
Jason Volk
|
aea6c79fc2
|
ircd::gpt: Add top N and target label result register control block.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
8bd78af128
|
ircd::gpt: Additional task header/interface simplification.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
c1f3e580c3
|
ircd::gpt: Add top_p lmhead selector, quantized for now.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
8a3eeb46f9
|
ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
20162fd7d5
|
ircd::gpt: Splits and renames; various reorg.
|
2021-09-15 01:44:36 -07:00 |
|
Jason Volk
|
5518daf197
|
ircd::gpt: Remove branch by assuming loop body always taken.
|
2021-08-01 03:22:14 -07:00 |
|
Jason Volk
|
c3cb249f78
|
ircd::gpt: Split debug related; improve flush options; minor cleanup.
|
2021-05-14 05:57:47 -07:00 |
|
Jason Volk
|
37b1d47c8d
|
ircd::gpt: Reorganize task options and control blocks.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
1f49f71530
|
ircd::gpt: Backpropagate adaptive moment estimations.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
f61239a52c
|
ircd::gpt::pipe: Various statistical instrumentation.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
d5eb1e3a87
|
ircd::gpt: Add backpropagation pipe.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
14a1561cad
|
ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
9c062d9c3f
|
ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
1870c364f4
|
ircd::gpt: Reorganize interface.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
4ac7e1b19d
|
ircd::gpt: Abstractor various backend subroutines; generator loop.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
29fb7910b7
|
ircd::gpt: Model structural tweaks; task structure; various.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
4da7d2ae43
|
ircd::gpt: Add task struct; mmap cached model directly; improve init.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
33a1ffd4bf
|
ircd::gpt: Add basic interface; add options, context.
|
2021-03-09 04:50:19 -08:00 |
|
Jason Volk
|
4458235dfa
|
ircd::gpt: More Matrix Than Matrix.
|
2021-03-09 04:50:19 -08:00 |
|
Jason Volk
|
29b99dcf4d
|
ircd::gpt: Split vocab related into separate unit.
|
2021-03-02 11:13:59 -08:00 |
|
Jason Volk
|
57f9d3fdfb
|
ircd::gpt: Add vocabulary tokenization; byte-pair merge encoding for natural language.
|
2021-02-26 14:52:33 -08:00 |
|