Jason Volk
|
99f087afbe
|
ircd::buffer: Fix anonymous scope ambiguity for gcc-10.
|
2021-05-14 05:57:47 -07:00 |
|
Jason Volk
|
4f97dcf456
|
ircd: Vector initialization fixes for GCC.
|
2021-05-14 05:57:47 -07:00 |
|
Jason Volk
|
c3cb249f78
|
ircd::gpt: Split debug related; improve flush options; minor cleanup.
|
2021-05-14 05:57:47 -07:00 |
|
Jason Volk
|
179d9abcf7
|
ircd::simd: Improve typedefs for fp16; relax requirement.
|
2021-05-14 05:57:47 -07:00 |
|
Jason Volk
|
2c243be19a
|
ircd:🆑 Add conf items for configuration environment; tweak loghead.
|
2021-05-12 00:05:09 -07:00 |
|
Jason Volk
|
467108f09a
|
ircd:🆑 Add nice/intensity'ish rate-shaping option.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
37b1d47c8d
|
ircd::gpt: Reorganize task options and control blocks.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
3e9c2d1b56
|
ircd::simt: Abstract the three-piece softmax, mean state related.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
5e91d51e6a
|
ircd::simt: Add dressings for cross-inclusion.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
d4e41218b0
|
ircd::ctx::pool: Simplify notify on work completion.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
5534672a07
|
ircd::fs: Move madvise suite to allocator unit.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
d0c9a16770
|
ircd:🆑 Add interface for plat/dev info dump w/ console cmd.
|
2021-05-11 20:56:09 -07:00 |
|
Jason Volk
|
f61239a52c
|
ircd::gpt::pipe: Various statistical instrumentation.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
2a3c54afa2
|
ircd::gpt::pipe: Add model invalidation for device resynchronization.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
bd460a80ce
|
ircd::gpt::pipe::model: Additional sub-buffering for lmhead.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
b6e2876af4
|
ircd::math: Add simd template wrapping for sqrt().
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
d5eb1e3a87
|
ircd::gpt: Add backpropagation pipe.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
14a1561cad
|
ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
4ed6582472
|
ircd:🆑 Allow no-op exec construction.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
bc98835b3c
|
ircd::simt: Simplify interface; internalize workitem functions.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
075b40400a
|
ircd::simt: Split reduce tools; add float4 horizontal add.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
eba5d7f586
|
ircd::gpt: Improve build related; debug/assertions.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
de166dfab8
|
ircd::simt: Simplify various loop/mask conditionals; minor cleanup.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
9c062d9c3f
|
ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
20f81c55ea
|
ircd: Move some typedefs to portable; minor reorg.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
a476df4ca1
|
ircd::math: Simplify fmma template.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
86d985a42f
|
ircd:🆑 Add kernel workgroup info convenience interface.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
1870c364f4
|
ircd::gpt: Reorganize interface.
|
2021-04-22 12:27:57 -07:00 |
|
Jason Volk
|
f096e7fcf5
|
ircd: Typedef uchar if necessary.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
5962a58c1e
|
ircd::simt: Start a CLC toolchest.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
29e74ec9e1
|
ircd::gpt: Transformer Pipe.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
29fb7910b7
|
ircd::gpt: Model structural tweaks; task structure; various.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
cb45dcc840
|
ircd:🆑 Add subbuffer region handles to interface.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
2a730b2799
|
ircd:🆑:exec: Add more specific size/offset argument for map closure related.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
9e795acd72
|
ircd:🆑 Assert cl::data object not included in parameter template.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
d5f1a490db
|
ircd:🆑 Add flush and sync exec opts; reorg post-submit related.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
dbf19fcf4b
|
ircd:🆑:kern: Add argument setter template for various/integral inputs.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
6ca5f8b18f
|
ircd:🆑:code: Add binary construction.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
034170cb30
|
ircd:🆑 Add status argument to work::wait(); improve dtors.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
54c1be6ec3
|
ircd:🆑 Add conf item for queue profiling flag.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
000102cf4e
|
ircd:🆑 Add argument-ordered ergonomic constructor.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
21472fcc5b
|
ircd:🆑 Add buffer to buffer copy to interface.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
07dd934602
|
ircd:🆑:exec: Add the no-implicit-dependency option for exec.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
4ab97bd1a3
|
ircd::buffer: Minor qualifiers; minor cleanup.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
51d2ac4b33
|
ircd:🆑 Reorder the kern::range lists for common construction; minor fixes.
|
2021-04-22 12:27:56 -07:00 |
|
Jason Volk
|
a21589654a
|
ircd:🆑 Re-attempt pre-SVM mapping w/ synchronous closure.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
d69f8ffb9c
|
ircd:🆑:data: Add basic property interface wrappings.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
60e66cb273
|
ircd:🆑 Move work wait function out of dtor into member; assert handle.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
3389c23feb
|
ircd::math: Add softmax functions.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
31425a5ca0
|
ircd::math: Add vector fallbacks for standard exp.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
480722b3b8
|
ircd::math: Additional fallback overloads for explicit precisions.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
74d7747fa3
|
ircd::math: Add fallback for vectorized single-precision power of.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
152ea2df0a
|
ircd::math: Add normalization template.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
70bb5c257a
|
ircd::math: Allow increased mean template precision.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
05a3e505cc
|
ircd::simd: Add horizontal adder template.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
90f88cf78d
|
ircd: Allow restricted pointer constructions for string_view/vector_view.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
0cef0848e1
|
ircd::vector_view: Use proper typedefs in places.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
8032454415
|
ircd::math: Add matrix fused-multiply-add template.
|
2021-03-17 18:55:56 -07:00 |
|
Jason Volk
|
7505783cc7
|
ircd::math: Add fallback for vectorized hyperbolic tangent.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
d6d18f7b08
|
ircd::buffer: Add non-char array convenience cast constructions.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
5d6554b1a3
|
ircd:🆑 Improve data construction; add initialization xfer to ctor.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
44521ce019
|
ircd:🆑 Add variadic argument template pack construction.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
c7fa7a07ee
|
ircd::simd: Fix attribute ns.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
ca1d715702
|
ircd:🆑 Expose enable conf item to interface.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
699d15e8c9
|
ircd:🆑 Add options for exec; improve dependency related.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
b1bfa7640d
|
ircd:🆑 Add missing move ctor and move assign inlines.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
59106f9456
|
ircd::fs::map: Add hugepage related to interface opts.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
fdd052da87
|
ircd::fs::map: Add MAP_LOCKED wrapper to interface opts.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
43b85dad87
|
ircd:🆑 Offload blocking wait to thread; integrate dependencies with ircd::ctx.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
d115d88e6c
|
ircd::ctx: Simplify main thread conditions with tls bit.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
dea1118bda
|
ircd:🆑 Build code on construction unless coerced otherwise.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
4da7d2ae43
|
ircd::gpt: Add task struct; mmap cached model directly; improve init.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
6f3adfd160
|
ircd::fs::map: Add static opts instance w/ default ctor argument.
|
2021-03-16 12:58:22 -07:00 |
|
Jason Volk
|
734948863f
|
ircd::gpt::vocab: Add token debug string tool.
|
2021-03-09 04:50:19 -08:00 |
|
Jason Volk
|
33a1ffd4bf
|
ircd::gpt: Add basic interface; add options, context.
|
2021-03-09 04:50:19 -08:00 |
|
Jason Volk
|
4458235dfa
|
ircd::gpt: More Matrix Than Matrix.
|
2021-03-09 04:50:19 -08:00 |
|
Jason Volk
|
53c4260a21
|
ircd::gpt: Add Basic Latin (lower) and C0 replacement LUT; various.
|
2021-03-09 04:50:19 -08:00 |
|
Jason Volk
|
c014fa2bbe
|
ircd::vector_view: Add size masked composition construction.
|
2021-03-09 04:50:19 -08:00 |
|
Jason Volk
|
17f72c96c8
|
ircd::simd: Improve streaming tokens template.
|
2021-03-07 23:35:58 -08:00 |
|
Jason Volk
|
925eee5209
|
ircd::fpe: Add classification reflector; additional noexcept linkages.
|
2021-03-07 23:35:58 -08:00 |
|
Jason Volk
|
9058e203c0
|
ircd::simd: Add convenience debug print template direct to stdout.
|
2021-03-05 15:34:54 -08:00 |
|
Jason Volk
|
0721f8ca5a
|
ircd::fmt: Add several class comment briefs. [ci skip]
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
954105d1ac
|
ircd::math: Add mean suite.
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
015ef698a3
|
ircd::math: Add modular inversion utility.
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
014d0281d7
|
ircd::math: Start supplemental library; move log2 constexprs from util.
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
44683b01f3
|
ircd::simd: Add all-bit mask constexpr undef for floating point lanes.
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
29b47e8890
|
ircd::simd: Add constexprs for some lane traits.
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
cd2c6630bc
|
ircd::simd: Additional distinguishing type trait constexpr.
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
b55d670af1
|
ircd::spirit: Fixes for thread_local generator_state linkage related.
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
cc9df943a7
|
ircd: Refactor lex_cast impl to boost spirit rather than boost conversions.
|
2021-03-05 13:02:12 -08:00 |
|
Jason Volk
|
29b99dcf4d
|
ircd::gpt: Split vocab related into separate unit.
|
2021-03-02 11:13:59 -08:00 |
|
Jason Volk
|
5bd4255006
|
ircd::rand: Remove inline noexcepts.
|
2021-02-27 13:01:02 -08:00 |
|
Jason Volk
|
2be7c0ff6f
|
ircd::simd: Improve lane size traits basis; fix conflicting templates.
|
2021-02-27 13:01:02 -08:00 |
|
Jason Volk
|
14662b51ce
|
ircd::rand: Add random distribution vector generation.
|
2021-02-27 13:00:36 -08:00 |
|
Jason Volk
|
9d1316b412
|
ircd::simd: Use _Float16 / __fp16 for half-precision when available.
|
2021-02-26 14:55:15 -08:00 |
|
Jason Volk
|
57f9d3fdfb
|
ircd::gpt: Add vocabulary tokenization; byte-pair merge encoding for natural language.
|
2021-02-26 14:52:33 -08:00 |
|
Jason Volk
|
394858ff91
|
ircd::simd: Start character string tools suite; add strlen(); add strcat().
|
2021-02-26 14:52:33 -08:00 |
|
Jason Volk
|
ee904d9b33
|
ircd::simd: Add preliminary character print utils to suite.
|
2021-02-25 14:38:52 -08:00 |
|
Jason Volk
|
9b1f2b4268
|
ircd::spirit: Import inf into namespace.
|
2021-02-25 14:38:52 -08:00 |
|
Jason Volk
|
4915ced6ce
|
ircd::icu: Add bulk vector utility overloads.
|
2021-02-25 14:38:52 -08:00 |
|