0
0
Fork 0
mirror of https://github.com/matrix-construct/construct synced 2024-12-24 14:34:00 +01:00
Commit graph

5579 commits

Author SHA1 Message Date
Jason Volk
c1f3e580c3 ircd::gpt: Add top_p lmhead selector, quantized for now. 2021-10-06 13:13:47 -07:00
Jason Volk
8a3eeb46f9 ircd::gpt::pipe: Optimize pipeline to cache attention state for generations. 2021-10-06 13:13:47 -07:00
Jason Volk
c5f159ad58 ircd::gpt: Cleanup/improve work item related prologues. 2021-10-06 13:13:47 -07:00
Jason Volk
79b6d4b9da ircd::gpt::pipe: Unify descriptor allocations. 2021-10-06 13:13:47 -07:00
Jason Volk
9628585f43 ircd:🆑 Add condition for null size slice construction. 2021-10-06 13:13:47 -07:00
Jason Volk
d0c2674b3e ircd:🆑 Add data::offset() to interface. 2021-10-06 13:13:47 -07:00
Jason Volk
ce9abfb321 ircd::gpt::model: Optimize left-attention mask. 2021-10-06 13:13:47 -07:00
Jason Volk
9ca95591ff ircd::gpt::model: Improve cache open mode related. 2021-09-15 02:37:45 -07:00
Jason Volk
5d837f9e87 ircd:🆑 Increase the device extensions info string receptacle. 2021-09-15 01:44:36 -07:00
Jason Volk
6ea6a003dc ircd::db: ABI fixes for RocksDB v6.19+. 2021-09-15 01:44:36 -07:00
Jason Volk
7cd34cba0a ircd::db: API fixes for RocksDB v6.22+. 2021-09-15 01:44:36 -07:00
Jason Volk
e6e6191e3e ircd::magic: Minor additional branch expect labels. 2021-09-15 01:44:36 -07:00
Jason Volk
a82e7bf280 ircd: Reduce code generated for argument prep in assert block; jump directly to lfence. 2021-09-15 01:44:36 -07:00
Jason Volk
0293924544 ircd::fmt: Add missing float alignment policies. 2021-09-15 01:44:36 -07:00
Jason Volk
20162fd7d5 ircd::gpt: Splits and renames; various reorg. 2021-09-15 01:44:36 -07:00
Jason Volk
00a4e8c7b8 ircd::gpt: Force inlining for R600 support w/ attributes for now (clang-12). 2021-09-14 23:39:55 -07:00
Jason Volk
adbb974af0 ircd::mapi: Fix for non-standard-layout unique_ptr impl. 2021-09-14 23:39:55 -07:00
Jason Volk
77d53e6a71 ircd:🆑 Remove build success stub assertion; add stub debuglog. 2021-09-14 23:39:55 -07:00
Jason Volk
120a382398 ircd::net::dns: Split delegate service_init/fini; fix error. 2021-09-14 23:39:55 -07:00
Jason Volk
ec3209b6d5 ircd::fs: Add missing base::include path definition. 2021-09-14 23:39:55 -07:00
Jason Volk
6e7e56f081 ircd::gpt::pipe: Add conf item for default source paths and opts for now. 2021-09-14 23:39:55 -07:00
Jason Volk
3859a13293 ircd::gpt::model: Add conf items for model/cache opts related. 2021-09-14 23:39:55 -07:00
Jason Volk
d2b9e88a65 ircd::gpt::vocab: Simplify masks w/ sign extension. 2021-09-14 23:39:55 -07:00
Jason Volk
782379aeb4 ircd::gpt::vocab: Simplify UTF-8 length gauge. 2021-09-14 23:39:55 -07:00
Jason Volk
3e6fcf3a47 ircd::utf: Split header; improve decode codegen; inline length. 2021-09-14 23:39:55 -07:00
Jason Volk
71b1b44a7f ircd::utf: Rename encode() to encode_sparse(). 2021-08-08 09:47:02 -07:00
Jason Volk
f1e76604d0 ircd::utf: Complete the branchless UTF-8 decoder. 2021-08-01 03:34:27 -07:00
Jason Volk
5518daf197 ircd::gpt: Remove branch by assuming loop body always taken. 2021-08-01 03:22:14 -07:00
Jason Volk
4f97dcf456 ircd: Vector initialization fixes for GCC. 2021-05-14 05:57:47 -07:00
Jason Volk
7576c11897 ircd: Makefile conditions for clang; minor reorg opt vars. 2021-05-14 05:57:47 -07:00
Jason Volk
c3cb249f78 ircd::gpt: Split debug related; improve flush options; minor cleanup. 2021-05-14 05:57:47 -07:00
Jason Volk
8c077cfe15 ircd:🆑 Default enable. 2021-05-12 00:05:09 -07:00
Jason Volk
2c243be19a ircd:🆑 Add conf items for configuration environment; tweak loghead. 2021-05-12 00:05:09 -07:00
Jason Volk
467108f09a ircd:🆑 Add nice/intensity'ish rate-shaping option. 2021-05-11 20:56:09 -07:00
Jason Volk
37b1d47c8d ircd::gpt: Reorganize task options and control blocks. 2021-05-11 20:56:09 -07:00
Jason Volk
3e9c2d1b56 ircd::simt: Abstract the three-piece softmax, mean state related. 2021-05-11 20:56:09 -07:00
Jason Volk
d4e41218b0 ircd::ctx::pool: Simplify notify on work completion. 2021-05-11 20:56:09 -07:00
Jason Volk
5534672a07 ircd::fs: Move madvise suite to allocator unit. 2021-05-11 20:56:09 -07:00
Jason Volk
f0fe13e8e5 ircd::ctx::ole: Split missing worker_remove() definition; enable pthread for seq. 2021-05-11 20:56:09 -07:00
Jason Volk
d0c9a16770 ircd:🆑 Add interface for plat/dev info dump w/ console cmd. 2021-05-11 20:56:09 -07:00
Jason Volk
8233cf1db3 ircd:🆑 Add check for primary context in sync impl. 2021-05-11 20:56:09 -07:00
Jason Volk
3097161198 ircd:🆑 Add device type to banner; improve header. 2021-05-11 20:56:09 -07:00
Jason Volk
536594b487 ircd::gpt::pipe: Consolidate loop; improve access pattern; various reorg. 2021-05-11 20:56:08 -07:00
Jason Volk
1f49f71530 ircd::gpt: Backpropagate adaptive moment estimations. 2021-04-22 12:27:57 -07:00
Jason Volk
5011e20c2e ircd::json: Attribute aadditional known hot functions. 2021-04-22 12:27:57 -07:00
Jason Volk
5392ba0c7d ircd::gpt::pipe: Expansions to the context size. 2021-04-22 12:27:57 -07:00
Jason Volk
f61239a52c ircd::gpt::pipe: Various statistical instrumentation. 2021-04-22 12:27:57 -07:00
Jason Volk
2a3c54afa2 ircd::gpt::pipe: Add model invalidation for device resynchronization. 2021-04-22 12:27:57 -07:00
Jason Volk
bd460a80ce ircd::gpt::pipe::model: Additional sub-buffering for lmhead. 2021-04-22 12:27:57 -07:00
Jason Volk
665eeb6cd7 ircd::gpt::vocab: No-split mask for trailing punctuation. 2021-04-22 12:27:57 -07:00