Jason Volk
|
c1f3e580c3
|
ircd::gpt: Add top_p lmhead selector, quantized for now.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
8a3eeb46f9
|
ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
c5f159ad58
|
ircd::gpt: Cleanup/improve work item related prologues.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
79b6d4b9da
|
ircd::gpt::pipe: Unify descriptor allocations.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
9628585f43
|
ircd:🆑 Add condition for null size slice construction.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
d0c2674b3e
|
ircd:🆑 Add data::offset() to interface.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
ce9abfb321
|
ircd::gpt::model: Optimize left-attention mask.
|
2021-10-06 13:13:47 -07:00 |
|
Jason Volk
|
9ca95591ff
|
ircd::gpt::model: Improve cache open mode related.
|
2021-09-15 02:37:45 -07:00 |
|
Jason Volk
|
5d837f9e87
|
ircd:🆑 Increase the device extensions info string receptacle.
|
2021-09-15 01:44:36 -07:00 |
|
Jason Volk
|
6ea6a003dc
|
ircd::db: ABI fixes for RocksDB v6.19+.
|
2021-09-15 01:44:36 -07:00 |
|
Jason Volk
|
7cd34cba0a
|
ircd::db: API fixes for RocksDB v6.22+.
|
2021-09-15 01:44:36 -07:00 |
|
Jason Volk
|
e6e6191e3e
|
ircd::magic: Minor additional branch expect labels.
|
2021-09-15 01:44:36 -07:00 |
|
Jason Volk
|
a82e7bf280
|
ircd: Reduce code generated for argument prep in assert block; jump directly to lfence.
|
2021-09-15 01:44:36 -07:00 |
|
Jason Volk
|
0293924544
|
ircd::fmt: Add missing float alignment policies.
|
2021-09-15 01:44:36 -07:00 |
|
Jason Volk
|
20162fd7d5
|
ircd::gpt: Splits and renames; various reorg.
|
2021-09-15 01:44:36 -07:00 |
|
Jason Volk
|
00a4e8c7b8
|
ircd::gpt: Force inlining for R600 support w/ attributes for now (clang-12).
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
adbb974af0
|
ircd::mapi: Fix for non-standard-layout unique_ptr impl.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
77d53e6a71
|
ircd:🆑 Remove build success stub assertion; add stub debuglog.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
120a382398
|
ircd::net::dns: Split delegate service_init/fini; fix error.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
ec3209b6d5
|
ircd::fs: Add missing base::include path definition.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
6e7e56f081
|
ircd::gpt::pipe: Add conf item for default source paths and opts for now.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
3859a13293
|
ircd::gpt::model: Add conf items for model/cache opts related.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
d2b9e88a65
|
ircd::gpt::vocab: Simplify masks w/ sign extension.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
782379aeb4
|
ircd::gpt::vocab: Simplify UTF-8 length gauge.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
3e6fcf3a47
|
ircd::utf: Split header; improve decode codegen; inline length.
|
2021-09-14 23:39:55 -07:00 |
|
Jason Volk
|
71b1b44a7f
|
ircd::utf: Rename encode() to encode_sparse().
|
2021-08-08 09:47:02 -07:00 |
|
Jason Volk
|
f1e76604d0
|
ircd::utf: Complete the branchless UTF-8 decoder.
|
2021-08-01 03:34:27 -07:00 |
|
Jason Volk
|
5518daf197
|
ircd::gpt: Remove branch by assuming loop body always taken.
|
2021-08-01 03:22:14 -07:00 |
|
Jason Volk
|
4f97dcf456
|
ircd: Vector initialization fixes for GCC.
|
2021-05-14 05:57:47 -07:00 |
|
Jason Volk
|
7576c11897
|
ircd: Makefile conditions for clang; minor reorg opt vars.
|
2021-05-14 05:57:47 -07:00 |
|
Jason Volk
|
c3cb249f78
|
ircd::gpt: Split debug related; improve flush options; minor cleanup.
|
2021-05-14 05:57:47 -07:00 |
|
Jason Volk
|
8c077cfe15
|
ircd:🆑 Default enable.
|
2021-05-12 00:05:09 -07:00 |
|
Jason Volk
|
2c243be19a
|
ircd:🆑 Add conf items for configuration environment; tweak loghead.
|
2021-05-12 00:05:09 -07:00 |
|
Jason Volk
|
467108f09a
|
ircd:🆑 Add nice/intensity'ish rate-shaping option.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
37b1d47c8d
|
ircd::gpt: Reorganize task options and control blocks.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
3e9c2d1b56
|
ircd::simt: Abstract the three-piece softmax, mean state related.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
d4e41218b0
|
ircd::ctx::pool: Simplify notify on work completion.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
5534672a07
|
ircd::fs: Move madvise suite to allocator unit.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
f0fe13e8e5
|
ircd::ctx::ole: Split missing worker_remove() definition; enable pthread for seq.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
d0c9a16770
|
ircd:🆑 Add interface for plat/dev info dump w/ console cmd.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
8233cf1db3
|
ircd:🆑 Add check for primary context in sync impl.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
3097161198
|
ircd:🆑 Add device type to banner; improve header.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
536594b487
|
ircd::gpt::pipe: Consolidate loop; improve access pattern; various reorg.
|
2021-05-11 20:56:08 -07:00 |
|
Jason Volk
|
1f49f71530
|
ircd::gpt: Backpropagate adaptive moment estimations.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
5011e20c2e
|
ircd::json: Attribute aadditional known hot functions.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
5392ba0c7d
|
ircd::gpt::pipe: Expansions to the context size.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
f61239a52c
|
ircd::gpt::pipe: Various statistical instrumentation.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
2a3c54afa2
|
ircd::gpt::pipe: Add model invalidation for device resynchronization.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
bd460a80ce
|
ircd::gpt::pipe::model: Additional sub-buffering for lmhead.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
665eeb6cd7
|
ircd::gpt::vocab: No-split mask for trailing punctuation.
|
2021-04-22 12:27:57 -07:00 |
|