5679 commits

Author	SHA1	Message	Date
Jason Volk	c1f3e580c3	ircd::gpt: Add top_p lmhead selector, quantized for now.	2021-10-06 13:13:47 -07:00
Jason Volk	8a3eeb46f9	ircd::gpt::pipe: Optimize pipeline to cache attention state for generations.	2021-10-06 13:13:47 -07:00
Jason Volk	c5f159ad58	ircd::gpt: Cleanup/improve work item related prologues.	2021-10-06 13:13:47 -07:00
Jason Volk	79b6d4b9da	ircd::gpt::pipe: Unify descriptor allocations.	2021-10-06 13:13:47 -07:00
Jason Volk	9628585f43	ircd:🆑 Add condition for null size slice construction.	2021-10-06 13:13:47 -07:00
Jason Volk	d0c2674b3e	ircd:🆑 Add data::offset() to interface.	2021-10-06 13:13:47 -07:00
Jason Volk	ce9abfb321	ircd::gpt::model: Optimize left-attention mask.	2021-10-06 13:13:47 -07:00
Jason Volk	9ca95591ff	ircd::gpt::model: Improve cache open mode related.	2021-09-15 02:37:45 -07:00
Jason Volk	5d837f9e87	ircd:🆑 Increase the device extensions info string receptacle.	2021-09-15 01:44:36 -07:00
Jason Volk	6ea6a003dc	ircd::db: ABI fixes for RocksDB v6.19+.	2021-09-15 01:44:36 -07:00
Jason Volk	7cd34cba0a	ircd::db: API fixes for RocksDB v6.22+.	2021-09-15 01:44:36 -07:00
Jason Volk	e6e6191e3e	ircd::magic: Minor additional branch expect labels.	2021-09-15 01:44:36 -07:00
Jason Volk	a82e7bf280	ircd: Reduce code generated for argument prep in assert block; jump directly to lfence.	2021-09-15 01:44:36 -07:00
Jason Volk	0293924544	ircd::fmt: Add missing float alignment policies.	2021-09-15 01:44:36 -07:00
Jason Volk	20162fd7d5	ircd::gpt: Splits and renames; various reorg.	2021-09-15 01:44:36 -07:00
Jason Volk	00a4e8c7b8	ircd::gpt: Force inlining for R600 support w/ attributes for now (clang-12).	2021-09-14 23:39:55 -07:00
Jason Volk	adbb974af0	ircd::mapi: Fix for non-standard-layout unique_ptr impl.	2021-09-14 23:39:55 -07:00
Jason Volk	77d53e6a71	ircd:🆑 Remove build success stub assertion; add stub debuglog.	2021-09-14 23:39:55 -07:00
Jason Volk	120a382398	ircd::net::dns: Split delegate service_init/fini; fix error.	2021-09-14 23:39:55 -07:00
Jason Volk	ec3209b6d5	ircd::fs: Add missing base::include path definition.	2021-09-14 23:39:55 -07:00
Jason Volk	6e7e56f081	ircd::gpt::pipe: Add conf item for default source paths and opts for now.	2021-09-14 23:39:55 -07:00
Jason Volk	3859a13293	ircd::gpt::model: Add conf items for model/cache opts related.	2021-09-14 23:39:55 -07:00
Jason Volk	d2b9e88a65	ircd::gpt::vocab: Simplify masks w/ sign extension.	2021-09-14 23:39:55 -07:00
Jason Volk	782379aeb4	ircd::gpt::vocab: Simplify UTF-8 length gauge.	2021-09-14 23:39:55 -07:00
Jason Volk	3e6fcf3a47	ircd::utf: Split header; improve decode codegen; inline length.	2021-09-14 23:39:55 -07:00
Jason Volk	71b1b44a7f	ircd::utf: Rename encode() to encode_sparse().	2021-08-08 09:47:02 -07:00
Jason Volk	f1e76604d0	ircd::utf: Complete the branchless UTF-8 decoder.	2021-08-01 03:34:27 -07:00
Jason Volk	5518daf197	ircd::gpt: Remove branch by assuming loop body always taken.	2021-08-01 03:22:14 -07:00
Jason Volk	4f97dcf456	ircd: Vector initialization fixes for GCC.	2021-05-14 05:57:47 -07:00
Jason Volk	7576c11897	ircd: Makefile conditions for clang; minor reorg opt vars.	2021-05-14 05:57:47 -07:00
Jason Volk	c3cb249f78	ircd::gpt: Split debug related; improve flush options; minor cleanup.	2021-05-14 05:57:47 -07:00
Jason Volk	8c077cfe15	ircd:🆑 Default enable.	2021-05-12 00:05:09 -07:00
Jason Volk	2c243be19a	ircd:🆑 Add conf items for configuration environment; tweak loghead.	2021-05-12 00:05:09 -07:00
Jason Volk	467108f09a	ircd:🆑 Add nice/intensity'ish rate-shaping option.	2021-05-11 20:56:09 -07:00
Jason Volk	37b1d47c8d	ircd::gpt: Reorganize task options and control blocks.	2021-05-11 20:56:09 -07:00
Jason Volk	3e9c2d1b56	ircd::simt: Abstract the three-piece softmax, mean state related.	2021-05-11 20:56:09 -07:00
Jason Volk	d4e41218b0	ircd::ctx::pool: Simplify notify on work completion.	2021-05-11 20:56:09 -07:00
Jason Volk	5534672a07	ircd::fs: Move madvise suite to allocator unit.	2021-05-11 20:56:09 -07:00
Jason Volk	f0fe13e8e5	ircd::ctx::ole: Split missing worker_remove() definition; enable pthread for seq.	2021-05-11 20:56:09 -07:00
Jason Volk	d0c9a16770	ircd:🆑 Add interface for plat/dev info dump w/ console cmd.	2021-05-11 20:56:09 -07:00
Jason Volk	8233cf1db3	ircd:🆑 Add check for primary context in sync impl.	2021-05-11 20:56:09 -07:00
Jason Volk	3097161198	ircd:🆑 Add device type to banner; improve header.	2021-05-11 20:56:09 -07:00
Jason Volk	536594b487	ircd::gpt::pipe: Consolidate loop; improve access pattern; various reorg.	2021-05-11 20:56:08 -07:00
Jason Volk	1f49f71530	ircd::gpt: Backpropagate adaptive moment estimations.	2021-04-22 12:27:57 -07:00
Jason Volk	5011e20c2e	ircd::json: Attribute aadditional known hot functions.	2021-04-22 12:27:57 -07:00
Jason Volk	5392ba0c7d	ircd::gpt::pipe: Expansions to the context size.	2021-04-22 12:27:57 -07:00
Jason Volk	f61239a52c	ircd::gpt::pipe: Various statistical instrumentation.	2021-04-22 12:27:57 -07:00
Jason Volk	2a3c54afa2	ircd::gpt::pipe: Add model invalidation for device resynchronization.	2021-04-22 12:27:57 -07:00
Jason Volk	bd460a80ce	ircd::gpt::pipe::model: Additional sub-buffering for lmhead.	2021-04-22 12:27:57 -07:00
Jason Volk	665eeb6cd7	ircd::gpt::vocab: No-split mask for trailing punctuation.	2021-04-22 12:27:57 -07:00
Jason Volk	aaced40d90	ircd::gpt::vocab: Mask erroneous trailing character case; fix pretoken case.	2021-04-22 12:27:57 -07:00
Jason Volk	b2f788e255	ircd::gpt::vocab: Minor reorg pre-tokenize related.	2021-04-22 12:27:57 -07:00
Jason Volk	b76d1f32ee	ircd::gpt::pipe: Improve self attention; various.	2021-04-22 12:27:57 -07:00
Jason Volk	d5eb1e3a87	ircd::gpt: Add backpropagation pipe.	2021-04-22 12:27:57 -07:00
Jason Volk	14a1561cad	ircd::gpt: Add adaptive moment state to pipe model; move task prelim defs.	2021-04-22 12:27:57 -07:00
Jason Volk	fac509e306	ircd:🆑 Zero size data construction no-op.	2021-04-22 12:27:57 -07:00
Jason Volk	eba5d7f586	ircd::gpt: Improve build related; debug/assertions.	2021-04-22 12:27:57 -07:00
Jason Volk	858479b6ab	Move -include options from CPPFLAGS to CXXFLAGS.	2021-04-22 12:27:57 -07:00
Jason Volk	1e08339955	ircd::gpt::vocab: Fixes for additional missing cases.	2021-04-22 12:27:57 -07:00
Jason Volk	8c65e75046	ircd::utf: Fix syntax; comments. [ci skip]	2021-04-22 12:27:57 -07:00
Jason Volk	eeadc15319	ircd::gpt::vocab: Fixes for additional mismatching cases.	2021-04-22 12:27:57 -07:00
Jason Volk	9c062d9c3f	ircd::gpt::pipe: Correctness; compute loss, statistics; pipeline optimize.	2021-04-22 12:27:57 -07:00
Jason Volk	0a6be0efed	ircd::gpt::vocab: Fix string length accumulation.	2021-04-22 12:27:57 -07:00
Jason Volk	0a87754c99	ircd::gpt::vocab: Fix token init missing null terminations.	2021-04-22 12:27:57 -07:00
Jason Volk	c526184508	ircd::json: Minor cleanup; simplify statement.	2021-04-22 12:27:57 -07:00
Jason Volk	5faa82b04d	ircd: Improve bad_lex_cast error string related.	2021-04-22 12:27:57 -07:00
Jason Volk	1328443ee8	ircd:🆑 Checkin the queue property/profiling mess.	2021-04-22 12:27:57 -07:00
Jason Volk	e9c8267219	ircd:🆑 Add ctx::ole offload for radeon drm thread blocking.	2021-04-22 12:27:57 -07:00
Jason Volk	a5565bfdf9	ircd::ctx::ole: Add missing pthread unhooker in offload spawner.	2021-04-22 12:27:57 -07:00
Jason Volk	2838d2c745	ircd:🆑 Additional stats; clover thread blocking related.	2021-04-22 12:27:57 -07:00
Jason Volk	c96609fe7f	ircd::prof: Use non-elided log call covered by outer #ifdef.	2021-04-22 12:27:57 -07:00
Jason Volk	e7083cdde3	ircd:🆑 Additional device information banner related.	2021-04-22 12:27:57 -07:00
Jason Volk	34b7b76ae8	ircd::server: Fix comments. [ci skip]	2021-04-22 12:27:57 -07:00
Jason Volk	e04d734959	ircd:🆑 Add device detail dump via infolog banners; add kernel detail debuglog.	2021-04-22 12:27:57 -07:00
Jason Volk	86d985a42f	ircd:🆑 Add kernel workgroup info convenience interface.	2021-04-22 12:27:57 -07:00
Jason Volk	019f16cb5e	ircd:🆑 Additional info template for confluences of handles.	2021-04-22 12:27:57 -07:00
Jason Volk	1870c364f4	ircd::gpt: Reorganize interface.	2021-04-22 12:27:57 -07:00
Jason Volk	ee64a3937a	ircd:🆑 Additional log info about exec read/write exception.	2021-04-22 12:27:56 -07:00
Jason Volk	77ebbe4528	ircd:🆑 Use non-throwing zero value for profile call when disabled.	2021-04-22 12:27:56 -07:00
Jason Volk	29e74ec9e1	ircd::gpt: Transformer Pipe.	2021-04-22 12:27:56 -07:00
Jason Volk	4ac7e1b19d	ircd::gpt: Abstractor various backend subroutines; generator loop.	2021-04-22 12:27:56 -07:00
Jason Volk	29fb7910b7	ircd::gpt: Model structural tweaks; task structure; various.	2021-04-22 12:27:56 -07:00
Jason Volk	cb45dcc840	ircd:🆑 Add subbuffer region handles to interface.	2021-04-22 12:27:56 -07:00
Jason Volk	6621a5fc4f	ircd:🆑 Fix write-only flag option related.	2021-04-22 12:27:56 -07:00
Jason Volk	2a730b2799	ircd:🆑:exec: Add more specific size/offset argument for map closure related.	2021-04-22 12:27:56 -07:00
Jason Volk	762e3f097a	ircd:🆑 Use override size from opts; zero size for no-op.	2021-04-22 12:27:56 -07:00
Jason Volk	d5f1a490db	ircd:🆑 Add flush and sync exec opts; reorg post-submit related.	2021-04-22 12:27:56 -07:00
Jason Volk	76a8e7f91e	ircd:🆑 Add basic stats for primary context.	2021-04-22 12:27:56 -07:00
Jason Volk	3c95a88bf7	ircd:🆑 Allow zero dimension to ignore exec item.	2021-04-22 12:27:56 -07:00
Jason Volk	e68c8a95ed	ircd:🆑 Skip clRelease calls to destruct null handles.	2021-04-22 12:27:56 -07:00
Jason Volk	dbf19fcf4b	ircd:🆑:kern: Add argument setter template for various/integral inputs.	2021-04-22 12:27:56 -07:00
Jason Volk	6ca5f8b18f	ircd:🆑:code: Add binary construction.	2021-04-22 12:27:56 -07:00
Jason Volk	7561c3a6e0	ircd:🆑 Upgrade queue creation related; mute deps list creation for now.	2021-04-22 12:27:56 -07:00
Jason Volk	034170cb30	ircd:🆑 Add status argument to work::wait(); improve dtors.	2021-04-22 12:27:56 -07:00
Jason Volk	54c1be6ec3	ircd:🆑 Add conf item for queue profiling flag.	2021-04-22 12:27:56 -07:00
Jason Volk	21472fcc5b	ircd:🆑 Add buffer to buffer copy to interface.	2021-04-22 12:27:56 -07:00
Jason Volk	4d27393703	ircd:🆑 Improve build error reporting; split subs from exception handler.	2021-04-22 12:27:56 -07:00
Jason Volk	07dd934602	ircd:🆑:exec: Add the no-implicit-dependency option for exec.	2021-04-22 12:27:56 -07:00
Jason Volk	1c8a7ac645	ircd: Use buffer::move for possibly overlapping uses.	2021-04-22 12:27:56 -07:00
Jason Volk	51d2ac4b33	ircd:🆑 Reorder the kern::range lists for common construction; minor fixes.	2021-04-22 12:27:56 -07:00
Jason Volk	e403565029	ircd:🆑 Improve event wait related.	2021-04-22 12:27:34 -07:00
Jason Volk	519d2e3f45	ircd:🆑 Refactor for ctx::dock notify.	2021-03-17 18:55:56 -07:00
Jason Volk	a21589654a	ircd:🆑 Re-attempt pre-SVM mapping w/ synchronous closure.	2021-03-17 18:55:56 -07:00
Jason Volk	d69f8ffb9c	ircd:🆑:data: Add basic property interface wrappings.	2021-03-17 18:55:56 -07:00
Jason Volk	60e66cb273	ircd:🆑 Move work wait function out of dtor into member; assert handle.	2021-03-17 18:55:56 -07:00
Jason Volk	c0072f732c	configure: Add function check for mlock(2), mmap(2).	2021-03-17 18:55:56 -07:00
Jason Volk	047eb1a384	ircd:🆑 Preempt callback; improve status checks, error code.	2021-03-17 18:55:56 -07:00
Jason Volk	5d6554b1a3	ircd:🆑 Improve data construction; add initialization xfer to ctor.	2021-03-16 12:58:22 -07:00
Jason Volk	fe666dc52c	ircd::ctx::ole: Add worker pool scaling on demand.	2021-03-16 12:58:22 -07:00
Jason Volk	ca1d715702	ircd:🆑 Expose enable conf item to interface.	2021-03-16 12:58:22 -07:00
Jason Volk	699d15e8c9	ircd:🆑 Add options for exec; improve dependency related.	2021-03-16 12:58:22 -07:00
Jason Volk	59106f9456	ircd::fs::map: Add hugepage related to interface opts.	2021-03-16 12:58:22 -07:00
Jason Volk	fdd052da87	ircd::fs::map: Add MAP_LOCKED wrapper to interface opts.	2021-03-16 12:58:22 -07:00
Jason Volk	43b85dad87	ircd:🆑 Offload blocking wait to thread; integrate dependencies with ircd::ctx.	2021-03-16 12:58:22 -07:00
Jason Volk	5b004be146	ircd::mods: Move unload success log to debug.	2021-03-16 12:58:22 -07:00
Jason Volk	d115d88e6c	ircd::ctx: Simplify main thread conditions with tls bit.	2021-03-16 12:58:22 -07:00
Jason Volk	7e188fa7f6	ircd:🆑 Fix write buffer call.	2021-03-16 12:58:22 -07:00
Jason Volk	dea1118bda	ircd:🆑 Build code on construction unless coerced otherwise.	2021-03-16 12:58:22 -07:00
Jason Volk	4da7d2ae43	ircd::gpt: Add task struct; mmap cached model directly; improve init.	2021-03-16 12:58:22 -07:00
Jason Volk	6f3adfd160	ircd::fs::map: Add static opts instance w/ default ctor argument.	2021-03-16 12:58:22 -07:00
Jason Volk	734948863f	ircd::gpt::vocab: Add token debug string tool.	2021-03-09 04:50:19 -08:00
Jason Volk	33a1ffd4bf	ircd::gpt: Add basic interface; add options, context.	2021-03-09 04:50:19 -08:00
Jason Volk	4458235dfa	ircd::gpt: More Matrix Than Matrix.	2021-03-09 04:50:19 -08:00
Jason Volk	53c4260a21	ircd::gpt: Add Basic Latin (lower) and C0 replacement LUT; various.	2021-03-09 04:50:19 -08:00
Jason Volk	925eee5209	ircd::fpe: Add classification reflector; additional noexcept linkages.	2021-03-07 23:35:58 -08:00
Jason Volk	4abf868b39	ircd: Move db fixes compile flags into make variable.	2021-03-07 23:35:58 -08:00
Jason Volk	014d0281d7	ircd::math: Start supplemental library; move log2 constexprs from util.	2021-03-05 13:02:12 -08:00
Jason Volk	b55d670af1	ircd::spirit: Fixes for thread_local generator_state linkage related.	2021-03-05 13:02:12 -08:00
Jason Volk	cc9df943a7	ircd: Refactor lex_cast impl to boost spirit rather than boost conversions.	2021-03-05 13:02:12 -08:00
Jason Volk	29b99dcf4d	ircd::gpt: Split vocab related into separate unit.	2021-03-02 11:13:59 -08:00
Jason Volk	59f9aca938	ircd::json: Relax fractional precision lexing.	2021-03-01 16:52:57 -08:00
Jason Volk	5a187da4b1	ircd::fs::dev: Add condition to skip non-device name without exception.	2021-03-01 16:52:57 -08:00
Jason Volk	57f9d3fdfb	ircd::gpt: Add vocabulary tokenization; byte-pair merge encoding for natural language.	2021-02-26 14:52:33 -08:00
Jason Volk	3621fe025a	ircd::json: Fix masking around some skipped characters in the unescaper.	2021-02-26 14:52:33 -08:00
Jason Volk	ee904d9b33	ircd::simd: Add preliminary character print utils to suite.	2021-02-25 14:38:52 -08:00
Jason Volk	4915ced6ce	ircd::icu: Add bulk vector utility overloads.	2021-02-25 14:38:52 -08:00
Jason Volk	f35e0749dd	ircd::utf: Simplify scaling to emulated extended vectors.	2021-02-25 14:38:52 -08:00
Jason Volk	47f6053a76	ircd::db: Eliminate the file mgmt thread interposition.	2021-02-13 02:20:35 -08:00
Jason Volk	90ac0d1a63	ircd:🆑 Simplify various casts; minor cleanup.	2021-02-11 03:21:08 -08:00
Jason Volk	328fce79a3	ircd:🆑 Abort the 1.x CL_MAP from interface for now.	2021-02-11 03:21:08 -08:00
Jason Volk	d338e589f5	ircd::allocator: Add trapdoor on size and alignment for hugepage advise.	2021-02-10 23:38:44 -08:00
Jason Volk	b39f574ba9	ircd::info: Probe characteristics for transparent hugepage support.	2021-02-10 02:14:15 -08:00
Jason Volk	336200d646	ircd::db::prefetcher: Increase worker stack size.	2021-02-04 21:25:10 -08:00
Jason Volk	5fb3710d4f	ircd::resource: Add third debuglog for actual request end after chunks xfer.	2021-02-03 18:01:15 -08:00
Jason Volk	39c2c1fc58	ircd::resource: Improve log msg clarity; label branch.	2021-02-03 18:01:15 -08:00
Jason Volk	a1420b25a3	ircd::http: Add log level severity(category) convenience tool; tweak category table.	2021-02-03 18:01:15 -08:00
Jason Volk	66639ee119	ircd::png: Elaborate callback surface; add logger to prevent libpng writes to stderr.	2021-01-23 10:57:01 -08:00
Jason Volk	ddfba500ad	ircd::png: Add acTL info detection to decide animation from buffer.	2021-01-21 22:08:32 -08:00
Jason Volk	690e641e90	ircd::fs: Fix erroneous/redundant fallthrough to blocking flush.	2021-01-21 20:00:32 -08:00
Jason Volk	7aff759abc	ircd::png: Add unit; start header; stub.	2021-01-15 19:55:28 -08:00