0
0
Fork 0
mirror of https://github.com/matrix-construct/construct synced 2024-11-26 00:32:35 +01:00
Commit graph

5389 commits

Author SHA1 Message Date
Jason Volk
d0c2674b3e ircd:🆑 Add data::offset() to interface. 2021-10-06 13:13:47 -07:00
Jason Volk
ce9abfb321 ircd::gpt::model: Optimize left-attention mask. 2021-10-06 13:13:47 -07:00
Jason Volk
f1051cf56b ircd::simt: Implement bitonic sort; replace stub. 2021-09-15 01:44:36 -07:00
Jason Volk
a82e7bf280 ircd: Reduce code generated for argument prep in assert block; jump directly to lfence. 2021-09-15 01:44:36 -07:00
Jason Volk
20162fd7d5 ircd::gpt: Splits and renames; various reorg. 2021-09-15 01:44:36 -07:00
Jason Volk
adbb974af0 ircd::mapi: Fix for non-standard-layout unique_ptr impl. 2021-09-14 23:39:55 -07:00
Jason Volk
120a382398 ircd::net::dns: Split delegate service_init/fini; fix error. 2021-09-14 23:39:55 -07:00
Jason Volk
6e7e56f081 ircd::gpt::pipe: Add conf item for default source paths and opts for now. 2021-09-14 23:39:55 -07:00
Jason Volk
a67b93b8c6 ircd::buffer: Split buffers:: related into header. 2021-09-14 23:39:55 -07:00
Jason Volk
3e6fcf3a47 ircd::utf: Split header; improve decode codegen; inline length. 2021-09-14 23:39:55 -07:00
Jason Volk
880f089169 ircd::simd: Add pack convenience template funcro. 2021-09-14 23:39:55 -07:00
Jason Volk
6723539997 ircd::simd: Add template function for consistent lane-to-lane shufs. 2021-09-14 23:39:55 -07:00
Jason Volk
395bcf0789 ircd::simd: Split lane_id related into header. 2021-09-14 23:39:55 -07:00
Jason Volk
26a6fb50b6 ircd::simd: Inline accoutrements for lane_cast; cleanup asm annotes. 2021-09-14 23:39:55 -07:00
Jason Volk
705c1cc776 ircd::ios: Structure documentation briefs. [ci skip] 2021-09-14 23:39:55 -07:00
Jason Volk
a30f06d80b ircd: Move scalar shorthand typedefs to stdinc.h. 2021-09-14 23:39:55 -07:00
Jason Volk
49fb5b13a2 ircd:🆑 Simplify parameter pack w/ fold expression; thanks @jonesmz 2021-08-08 09:47:02 -07:00
Jason Volk
71b1b44a7f ircd::utf: Rename encode() to encode_sparse(). 2021-08-08 09:47:02 -07:00
Jason Volk
1eec9bfd64 ircd::gpt: Remove unnecessary packed attribute. 2021-08-01 03:34:27 -07:00
Jason Volk
99f087afbe ircd::buffer: Fix anonymous scope ambiguity for gcc-10. 2021-05-14 05:57:47 -07:00
Jason Volk
4f97dcf456 ircd: Vector initialization fixes for GCC. 2021-05-14 05:57:47 -07:00
Jason Volk
c3cb249f78 ircd::gpt: Split debug related; improve flush options; minor cleanup. 2021-05-14 05:57:47 -07:00
Jason Volk
179d9abcf7 ircd::simd: Improve typedefs for fp16; relax requirement. 2021-05-14 05:57:47 -07:00
Jason Volk
2c243be19a ircd:🆑 Add conf items for configuration environment; tweak loghead. 2021-05-12 00:05:09 -07:00
Jason Volk
467108f09a ircd:🆑 Add nice/intensity'ish rate-shaping option. 2021-05-11 20:56:09 -07:00
Jason Volk
37b1d47c8d ircd::gpt: Reorganize task options and control blocks. 2021-05-11 20:56:09 -07:00
Jason Volk
3e9c2d1b56 ircd::simt: Abstract the three-piece softmax, mean state related. 2021-05-11 20:56:09 -07:00
Jason Volk
5e91d51e6a ircd::simt: Add dressings for cross-inclusion. 2021-05-11 20:56:09 -07:00
Jason Volk
d4e41218b0 ircd::ctx::pool: Simplify notify on work completion. 2021-05-11 20:56:09 -07:00
Jason Volk
5534672a07 ircd::fs: Move madvise suite to allocator unit. 2021-05-11 20:56:09 -07:00
Jason Volk
d0c9a16770 ircd:🆑 Add interface for plat/dev info dump w/ console cmd. 2021-05-11 20:56:09 -07:00
Jason Volk
f61239a52c ircd::gpt::pipe: Various statistical instrumentation. 2021-04-22 12:27:57 -07:00
Jason Volk
2a3c54afa2 ircd::gpt::pipe: Add model invalidation for device resynchronization. 2021-04-22 12:27:57 -07:00
Jason Volk
bd460a80ce ircd::gpt::pipe::model: Additional sub-buffering for lmhead. 2021-04-22 12:27:57 -07:00
Jason Volk
b6e2876af4 ircd::math: Add simd template wrapping for sqrt(). 2021-04-22 12:27:57 -07:00
Jason Volk
d5eb1e3a87 ircd::gpt: Add backpropagation pipe. 2021-04-22 12:27:57 -07:00
Jason Volk
14a1561cad ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs. 2021-04-22 12:27:57 -07:00
Jason Volk
4ed6582472 ircd:🆑 Allow no-op exec construction. 2021-04-22 12:27:57 -07:00
Jason Volk
bc98835b3c ircd::simt: Simplify interface; internalize workitem functions. 2021-04-22 12:27:57 -07:00
Jason Volk
075b40400a ircd::simt: Split reduce tools; add float4 horizontal add. 2021-04-22 12:27:57 -07:00
Jason Volk
eba5d7f586 ircd::gpt: Improve build related; debug/assertions. 2021-04-22 12:27:57 -07:00
Jason Volk
de166dfab8 ircd::simt: Simplify various loop/mask conditionals; minor cleanup. 2021-04-22 12:27:57 -07:00
Jason Volk
9c062d9c3f ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize. 2021-04-22 12:27:57 -07:00
Jason Volk
20f81c55ea ircd: Move some typedefs to portable; minor reorg. 2021-04-22 12:27:57 -07:00
Jason Volk
a476df4ca1 ircd::math: Simplify fmma template. 2021-04-22 12:27:57 -07:00
Jason Volk
86d985a42f ircd:🆑 Add kernel workgroup info convenience interface. 2021-04-22 12:27:57 -07:00
Jason Volk
1870c364f4 ircd::gpt: Reorganize interface. 2021-04-22 12:27:57 -07:00
Jason Volk
f096e7fcf5 ircd: Typedef uchar if necessary. 2021-04-22 12:27:56 -07:00
Jason Volk
5962a58c1e ircd::simt: Start a CLC toolchest. 2021-04-22 12:27:56 -07:00
Jason Volk
29e74ec9e1 ircd::gpt: Transformer Pipe. 2021-04-22 12:27:56 -07:00
Jason Volk
29fb7910b7 ircd::gpt: Model structural tweaks; task structure; various. 2021-04-22 12:27:56 -07:00
Jason Volk
cb45dcc840 ircd:🆑 Add subbuffer region handles to interface. 2021-04-22 12:27:56 -07:00
Jason Volk
2a730b2799 ircd:🆑:exec: Add more specific size/offset argument for map closure related. 2021-04-22 12:27:56 -07:00
Jason Volk
9e795acd72 ircd:🆑 Assert cl::data object not included in parameter template. 2021-04-22 12:27:56 -07:00
Jason Volk
d5f1a490db ircd:🆑 Add flush and sync exec opts; reorg post-submit related. 2021-04-22 12:27:56 -07:00
Jason Volk
dbf19fcf4b ircd:🆑:kern: Add argument setter template for various/integral inputs. 2021-04-22 12:27:56 -07:00
Jason Volk
6ca5f8b18f ircd:🆑:code: Add binary construction. 2021-04-22 12:27:56 -07:00
Jason Volk
034170cb30 ircd:🆑 Add status argument to work::wait(); improve dtors. 2021-04-22 12:27:56 -07:00
Jason Volk
54c1be6ec3 ircd:🆑 Add conf item for queue profiling flag. 2021-04-22 12:27:56 -07:00
Jason Volk
000102cf4e ircd:🆑 Add argument-ordered ergonomic constructor. 2021-04-22 12:27:56 -07:00
Jason Volk
21472fcc5b ircd:🆑 Add buffer to buffer copy to interface. 2021-04-22 12:27:56 -07:00
Jason Volk
07dd934602 ircd:🆑:exec: Add the no-implicit-dependency option for exec. 2021-04-22 12:27:56 -07:00
Jason Volk
4ab97bd1a3 ircd::buffer: Minor qualifiers; minor cleanup. 2021-04-22 12:27:56 -07:00
Jason Volk
51d2ac4b33 ircd:🆑 Reorder the kern::range lists for common construction; minor fixes. 2021-04-22 12:27:56 -07:00
Jason Volk
a21589654a ircd:🆑 Re-attempt pre-SVM mapping w/ synchronous closure. 2021-03-17 18:55:56 -07:00
Jason Volk
d69f8ffb9c ircd:🆑:data: Add basic property interface wrappings. 2021-03-17 18:55:56 -07:00
Jason Volk
60e66cb273 ircd:🆑 Move work wait function out of dtor into member; assert handle. 2021-03-17 18:55:56 -07:00
Jason Volk
3389c23feb ircd::math: Add softmax functions. 2021-03-17 18:55:56 -07:00
Jason Volk
31425a5ca0 ircd::math: Add vector fallbacks for standard exp. 2021-03-17 18:55:56 -07:00
Jason Volk
480722b3b8 ircd::math: Additional fallback overloads for explicit precisions. 2021-03-17 18:55:56 -07:00
Jason Volk
74d7747fa3 ircd::math: Add fallback for vectorized single-precision power of. 2021-03-17 18:55:56 -07:00
Jason Volk
152ea2df0a ircd::math: Add normalization template. 2021-03-17 18:55:56 -07:00
Jason Volk
70bb5c257a ircd::math: Allow increased mean template precision. 2021-03-17 18:55:56 -07:00
Jason Volk
05a3e505cc ircd::simd: Add horizontal adder template. 2021-03-17 18:55:56 -07:00
Jason Volk
90f88cf78d ircd: Allow restricted pointer constructions for string_view/vector_view. 2021-03-17 18:55:56 -07:00
Jason Volk
0cef0848e1 ircd::vector_view: Use proper typedefs in places. 2021-03-17 18:55:56 -07:00
Jason Volk
8032454415 ircd::math: Add matrix fused-multiply-add template. 2021-03-17 18:55:56 -07:00
Jason Volk
7505783cc7 ircd::math: Add fallback for vectorized hyperbolic tangent. 2021-03-16 12:58:22 -07:00
Jason Volk
d6d18f7b08 ircd::buffer: Add non-char array convenience cast constructions. 2021-03-16 12:58:22 -07:00
Jason Volk
5d6554b1a3 ircd:🆑 Improve data construction; add initialization xfer to ctor. 2021-03-16 12:58:22 -07:00
Jason Volk
44521ce019 ircd:🆑 Add variadic argument template pack construction. 2021-03-16 12:58:22 -07:00
Jason Volk
c7fa7a07ee ircd::simd: Fix attribute ns. 2021-03-16 12:58:22 -07:00
Jason Volk
ca1d715702 ircd:🆑 Expose enable conf item to interface. 2021-03-16 12:58:22 -07:00
Jason Volk
699d15e8c9 ircd:🆑 Add options for exec; improve dependency related. 2021-03-16 12:58:22 -07:00
Jason Volk
b1bfa7640d ircd:🆑 Add missing move ctor and move assign inlines. 2021-03-16 12:58:22 -07:00
Jason Volk
59106f9456 ircd::fs::map: Add hugepage related to interface opts. 2021-03-16 12:58:22 -07:00
Jason Volk
fdd052da87 ircd::fs::map: Add MAP_LOCKED wrapper to interface opts. 2021-03-16 12:58:22 -07:00
Jason Volk
43b85dad87 ircd:🆑 Offload blocking wait to thread; integrate dependencies with ircd::ctx. 2021-03-16 12:58:22 -07:00
Jason Volk
d115d88e6c ircd::ctx: Simplify main thread conditions with tls bit. 2021-03-16 12:58:22 -07:00
Jason Volk
dea1118bda ircd:🆑 Build code on construction unless coerced otherwise. 2021-03-16 12:58:22 -07:00
Jason Volk
4da7d2ae43 ircd::gpt: Add task struct; mmap cached model directly; improve init. 2021-03-16 12:58:22 -07:00
Jason Volk
6f3adfd160 ircd::fs::map: Add static opts instance w/ default ctor argument. 2021-03-16 12:58:22 -07:00
Jason Volk
734948863f ircd::gpt::vocab: Add token debug string tool. 2021-03-09 04:50:19 -08:00
Jason Volk
33a1ffd4bf ircd::gpt: Add basic interface; add options, context. 2021-03-09 04:50:19 -08:00
Jason Volk
4458235dfa ircd::gpt: More Matrix Than Matrix. 2021-03-09 04:50:19 -08:00
Jason Volk
53c4260a21 ircd::gpt: Add Basic Latin (lower) and C0 replacement LUT; various. 2021-03-09 04:50:19 -08:00
Jason Volk
c014fa2bbe ircd::vector_view: Add size masked composition construction. 2021-03-09 04:50:19 -08:00
Jason Volk
17f72c96c8 ircd::simd: Improve streaming tokens template. 2021-03-07 23:35:58 -08:00
Jason Volk
925eee5209 ircd::fpe: Add classification reflector; additional noexcept linkages. 2021-03-07 23:35:58 -08:00
Jason Volk
9058e203c0 ircd::simd: Add convenience debug print template direct to stdout. 2021-03-05 15:34:54 -08:00