545 commits

Author	SHA1	Message	Date
Jason Volk	4ded053406	ircd::db: Add cfid() lookup suite.	2019-01-16 13:21:36 -08:00
Jason Volk	2171cc23e8	ircd::db: Fix cell::load seek validation.	2019-01-15 19:03:52 -08:00
Jason Volk	cbf456a388	ircd: Rename and refactor ircd::assertion interface into ircd::panic.	2019-01-13 16:37:31 -08:00
Jason Volk	655d4e41c6	ircd::db: Configuration package.	2019-01-11 17:37:51 -08:00
Jason Volk	cbc4ddefe4	ircd::db: Fix issues with cache queries.	2019-01-11 17:36:05 -08:00
Jason Volk	d3d5f03b8c	ircd::db: Ensure no internal block cache is created by rocksdb when do not want.	2019-01-11 16:48:57 -08:00
Jason Volk	f55ad72ed5	ircd::db: Maintain our own names for caches.	2019-01-11 16:21:04 -08:00
Jason Volk	9a42fd9f60	ircd::db: Prevent submitting row with one cell to request pool.	2019-01-11 14:01:56 -08:00
Jason Volk	0f20a6a6ba	ircd::db: Improve row seek debugging and related.	2019-01-11 13:57:35 -08:00
Jason Volk	f6c6250fcb	ircd:;db: Add the file size to the table file creation log msg.	2018-12-31 16:26:57 -08:00
Jason Volk	eba727a9db	ircd::db: Add a counter for the env pool tasks.	2018-12-31 16:12:10 -08:00
Jason Volk	b169f0cc80	ircd::db: Log more detailed table creation statistics.	2018-12-31 16:01:24 -08:00
Jason Volk	bc12702ed7	ircd::db: Log more detailed compaction job statistics.	2018-12-31 15:36:25 -08:00
Jason Volk	8f6c17aeb1	ircd::db: Fix log msg.	2018-12-31 14:34:10 -08:00
Jason Volk	7bc1eee991	ircd::db: Add alignment assertion on read callback.	2018-12-30 15:13:29 -08:00
Jason Volk	3bec2c27d4	ircd::db: Set a lower priority io value for the LOW pool.	2018-12-29 19:43:17 -08:00
Jason Volk	5b934c5e71	ircd::db: Tweak error formatting.	2018-12-29 19:43:17 -08:00
Jason Volk	3466597981	ircd::fs: Various reorg; cleanup.	2018-12-29 19:43:17 -08:00
Jason Volk	7e023beb4f	ircd::db: Reduce env debug noise when no compaction callback.	2018-12-28 18:18:13 -08:00
Jason Volk	12401c70aa	ircd::db: Don't start background tasks before runlevel::RUN.	2018-12-28 17:53:26 -08:00
Jason Volk	6784be5be8	ircd::db: Tweak interruption points; cleanup.	2018-12-28 17:14:19 -08:00
Jason Volk	4a47b39298	ircd::ctx: Create and use an options structure for ctx::pool.	2018-12-28 12:57:32 -08:00
Jason Volk	fe0f548496	ircd::db: Update / cleanup / comment various opts related.	2018-12-28 10:55:57 -08:00
Jason Volk	c82382ea2c	ircd::db: Use a zero soft-limit to yield all requests when saturated; prefetch condition.	2018-12-27 17:20:43 -08:00
Jason Volk	62bf807ad2	ircd::db: Wire up more IOPriority and write_opts related.	2018-12-27 14:58:04 -08:00
Jason Volk	29fd84010f	ircd::db: RocksDB does its own read loop for sequential_file.	2018-12-27 14:58:04 -08:00
Jason Volk	beb7a0c180	ircd::db: Bypass call for block_size when not direct io.	2018-12-27 14:58:04 -08:00
Jason Volk	2f5d175957	ircd::db: Add cached membership test to row interface.	2018-12-26 19:45:04 -08:00
Jason Volk	13621feca0	ircd::db: Use better cache membership test.	2018-12-26 19:44:26 -08:00
Jason Volk	c1c11b4aed	ircd::db: Enrich seek(row) opts; add proper error handling and propagation.	2018-12-24 14:33:35 -08:00
Jason Volk	b035bb9824	ircd::db: No need to copy gopts in db::cell related.	2018-12-24 14:32:33 -08:00
Jason Volk	2876398c04	ircd::db: Simplify/Consolidate error hierarchy.	2018-12-24 13:32:22 -08:00
Jason Volk	b5168eb063	ircd::db: Prevent copying log message if unnecessary.	2018-12-23 14:33:22 -08:00
Jason Volk	df7e46722f	ircd::db: Add a ctx::slice_usage_warning message for background task executions.	2018-12-19 14:06:28 -08:00
Jason Volk	605cce9ed1	ircd::db: Propagate the FlushOptions.allow_write_stall option; improve sort cmd.	2018-12-19 13:58:09 -08:00
Jason Volk	f683e60df4	ircd::db: Add reflections for compaction and flush reasons.	2018-12-19 13:39:06 -08:00
Jason Volk	e1af547e16	ircd::db: Minor tweak log message fmt.	2018-12-19 13:09:10 -08:00
Jason Volk	5a0a9989e4	ircd::log: Rename facility to level.	2018-12-19 12:52:08 -08:00
Jason Volk	5d1f17b26e	ircd::db: Checkpoint options default package.	2018-12-18 17:36:51 -08:00
Jason Volk	541b020a19	ircd::db: Add read options for 'aio' and 'all' to file env classes.	2018-12-18 14:44:25 -08:00
Jason Volk	1e1c9c6a1e	ircd::db: Add more information to some file-related env log messages.	2018-12-17 14:01:45 -08:00
Jason Volk	495b70ec6d	ircd::db: Improve shutdown sequence.	2018-12-16 18:37:51 -08:00
Jason Volk	16ea21e9f3	ircd::db: Use appropriate log facility for bad news in events callbacks.	2018-12-16 18:37:51 -08:00
Jason Volk	fae947d433	ircd::db: Add a background cancel interface w/ console cmd.	2018-12-16 18:37:51 -08:00
Jason Volk	55023041b8	ircd::db: Reorg environment task pool related.	2018-12-16 18:37:51 -08:00
Jason Volk	a513ba9cf3	ircd::db: Deinline some env::state related.	2018-12-16 16:27:11 -08:00
Jason Volk	e22162f505	ircd::db: Add noexcept specifiers to all port interfaces.	2018-12-16 16:27:11 -08:00
Jason Volk	94518ded5f	ircd::db: Move env::state related; minor cleanup.	2018-12-16 16:27:11 -08:00
Jason Volk	705033c459	ircd::db: Relax various write-lock and uninterruptible points.	2018-12-16 16:27:10 -08:00
Jason Volk	d6e05aa826	ircd::db: Remove the write lock during manual range compaction.	2018-12-15 23:08:07 -08:00
Jason Volk	d754af2f18	ircd::db: Disable interruption for port operations.	2018-12-15 23:07:42 -08:00
Jason Volk	67ce539759	ircd::db: Improve shutdown sequence for environment.	2018-12-15 23:06:33 -08:00
Jason Volk	d96ddae133	ircd::db: Propagate all errors from db::init_directory().	2018-12-15 20:50:32 -08:00
Jason Volk	3fd689931c	ircd::db: Add state and conditions for AIO operations on sequential_file.	2018-12-15 20:29:54 -08:00
Jason Volk	da97535713	ircd::db: Reduce the severity of the logmsg for ENOENT on a seqfile open().	2018-12-15 20:29:54 -08:00
Jason Volk	bb6ba69f0b	ircd::db: Fix error handling for column_names(); add comments.	2018-12-15 20:29:54 -08:00
Jason Volk	70d4b32c3d	ircd::db: Add interface for pause/continue of background work w/ console cmd.	2018-12-14 17:27:48 -08:00
Jason Volk	c4d5f03725	ircd::fs: Add compat interface for range flush()/sync().	2018-12-13 18:04:48 -08:00
Jason Volk	5e8d5562da	ircd::fs: Simplify interface.	2018-12-13 17:46:08 -08:00
Jason Volk	9d423f84d8	ircd:;fs: Rename various fsync/sync related.	2018-12-13 16:54:09 -08:00
Jason Volk	e2cb79e28d	ircd::db: Minor cleanup; comments.	2018-12-13 13:44:37 -08:00
Jason Volk	b68677cc28	ircd::db: Simplify error handling and translation for env.	2018-12-12 17:32:24 -08:00
Jason Volk	7792f00461	ircd::db: Add more info to log message.	2018-12-12 16:55:11 -08:00
Jason Volk	a2892356d1	ircd::db: Compact range options package.	2018-12-12 16:02:31 -08:00
Jason Volk	62874ff498	ircd::db: Add src and dst level arguments to db::compact files interface.	2018-12-12 15:53:16 -08:00
Jason Volk	9236eeba75	ircd::db: Add dwarning for unaligned write w/ direct io.	2018-12-12 15:30:25 -08:00
Jason Volk	a7a00287bb	ircd::db: Assert the callback thread_id's match up with the current ircd::ctx.	2018-12-12 14:52:04 -08:00
Jason Volk	0b37c03c78	ircd::db: Simplify log message formats on callbacks.	2018-12-12 14:48:06 -08:00
Jason Volk	1cab1fda7e	ircd::db: Use db logger rather than rog for event callbacks.	2018-12-12 13:24:47 -08:00
Jason Volk	8d9b0fb4b1	ircd::db: Options package checkpoint.	2018-12-12 13:16:47 -08:00
Jason Volk	df36a6a4ac	ircd::db: Use proper fs::sync() for sync requests.	2018-12-12 13:16:47 -08:00
Jason Volk	6dc547f8f1	ircd::db: Simplify some rdb event log messages.	2018-12-12 10:42:11 -08:00
Jason Volk	41fd658b24	ircd::db: Add interface to get column and database options.	2018-12-12 10:17:47 -08:00
Jason Volk	a133235f82	ircd::db: Move database::options to db::options.	2018-12-12 10:17:47 -08:00
Jason Volk	c9e9fd3621	ircd::db: Use non-allocating message string for exception translation.	2018-12-12 10:12:24 -08:00
Jason Volk	d7da57e073	ircd::db: Add log level interface w/ console cmd.	2018-12-12 10:12:23 -08:00
Jason Volk	f667b73dac	ircd::db: Minor move database::column closer to database in the unit.	2018-12-12 08:03:59 -08:00
Jason Volk	24d8665695	ircd::db: Convey better compaction compression option.	2018-12-11 16:42:18 -08:00
Jason Volk	a03d28c6a1	ircd::db: Allow < -1 target level to indicate no level change at all.	2018-12-11 16:30:28 -08:00
Jason Volk	8e11620100	ircd::db: Distinguish range compact from files compact in interface.	2018-12-11 16:30:28 -08:00
Jason Volk	cfbf31c587	ircd::db: Fix log msg fmt consistency.	2018-12-10 15:18:27 -08:00
Jason Volk	8d6c7e3576	ircd::db: Add WAL information interface w/ console cmd.	2018-12-10 14:14:55 -08:00
Jason Volk	c3560d4890	ircd::db: Rename database::logs to database::logger.	2018-12-10 13:26:46 -08:00
Jason Volk	45bf911952	ircd::conf: Add feature to toggle whether conf item is persisted in a db.	2018-12-08 16:27:32 -08:00
Jason Volk	1ba22a21ba	ircd: Disperse accumulated global options as conf items in namespaces.	2018-12-08 15:36:34 -08:00
Jason Volk	caf1190c91	ircd::db: Tweak interruption point related.	2018-12-07 12:48:54 -08:00
Jason Volk	760bd0f19c	ircd::db: Workaround allow_fallocate options issue.	2018-12-03 14:31:48 -08:00
Jason Volk	0250c0f2ec	ircd::db: Disable fallocate() use for now.	2018-12-03 13:01:36 -08:00
Jason Volk	47d6fbb35f	ircd::fs: Consolidate support tests and indications into namespace.	2018-12-03 12:55:52 -08:00
Jason Volk	f2ecf617ba	ircd::db: Stub a place to put the runtime loaded library version information.	2018-12-03 12:30:59 -08:00
Jason Volk	6d80be2d7a	ircd::db: Cleanup / comment db options initialization.	2018-12-03 11:54:35 -08:00
Jason Volk	402f0f91f1	ircd::db: Create DBOptions earlier for use when reading column names.	2018-12-02 17:45:36 -08:00
Jason Volk	e8088ce52a	ircd::db: Assert synchronization for sequential file operations; update offset on PositionedRead().	2018-12-02 17:19:13 -08:00
Jason Volk	c1d915db7a	ircd::db: Fix pragma.	2018-12-02 17:16:32 -08:00
Jason Volk	b45b25bdcd	ircd::db: Dressing for C99 array on stack here.	2018-12-01 17:07:15 -08:00
Jason Volk	b31432aae1	ircd::db: Checkpoint some table options for compression.	2018-12-01 16:11:32 -08:00
Jason Volk	711dfacd9a	ircd::fs: Improve strategy for AIO fsync/fdsync related.	2018-12-01 16:10:53 -08:00
Jason Volk	62053e66e2	ircd::db: Minor interruption point tweaks.	2018-12-01 14:55:38 -08:00
Jason Volk	f9def72a89	ircd::db: Fix propagation of column's compression type to compaction options.	2018-11-30 15:19:49 -08:00
Jason Volk	ea0ad518ea	ircd::db: Fix interface / linkage for getting ColumnFamilyOptions ref from database::column.	2018-11-30 15:19:00 -08:00
Jason Volk	c451571108	ircd::db: Fix finding supported compression error.	2018-11-30 15:07:51 -08:00
Jason Volk	3f6ae85f8f	ircd::db: Add automated column drop support; update existing descriptors.	2018-11-30 14:43:51 -08:00
Jason Volk	5db6447c4f	ircd::db: Disable thread tracking; add compression to column open log msg.	2018-11-29 16:47:17 -08:00
Jason Volk	d1bfba2204	ircd::db: Remove critical assertion here and add note.	2018-11-29 16:18:29 -08:00
Jason Volk	60dd8c0eea	ircd::db: Enable block alignment based on compression; Enable O_DIRECT writes.	2018-11-29 15:41:42 -08:00
Jason Volk	731c154b19	ircd::db: Disable AIO for fsync related for now.	2018-11-29 13:08:37 -08:00
Jason Volk	0de55ce111	ircd::db: Attempt at direct IO writable_file (append) implementation.	2018-11-27 17:30:59 -08:00
Jason Volk	49354027a6	ircd::db: Various cleanup; simplify.	2018-11-15 20:54:50 -08:00
Jason Volk	e90f1729f0	ircd::db: Split writable_file into writable_file_direct using vtable for functionality.	2018-11-09 18:24:51 -08:00
Jason Volk	af93d55927	ircd: Minor cleanup: simplify decl; fix comment; relax log level.	2018-11-08 23:05:12 -08:00
Jason Volk	26d7e4e6de	ircd::db: Remove unused path from flush-begin log message.	2018-11-07 00:57:11 -08:00
Jason Volk	cbbfbcac72	ircd::db: Optimize away one of the row ctor's vector heap allocations.	2018-11-05 17:12:29 -08:00
Jason Volk	a5955fc9ae	ircd:Ⓜ️:dbs: Options package; configuration tweak.	2018-11-02 19:15:57 -07:00
Jason Volk	25e6cd1332	ircd::db: Add compression string option to column descriptor.	2018-11-02 18:32:47 -07:00
Jason Volk	8311c1e7ff	ircd::db: Improve supported compressions listing w/ console cmd.	2018-11-02 18:02:27 -07:00
Jason Volk	49bad9f01d	ircd::db: Check for posix_fadvise(); implement InvalidateCache for environment if not direct IO.	2018-11-02 01:30:15 -07:00
Jason Volk	1d03747da3	ircd::db: Toward O_DIRECT writes from writable_file environment.	2018-11-02 01:11:36 -07:00
Jason Volk	95d42686f3	ircd::db: Add reflection for WriteLifeTimeHint.	2018-11-02 01:07:09 -07:00
Jason Volk	7b798645a4	ircd::db: Downgrade error severity to allow administrative resume.	2018-11-02 00:05:21 -07:00
Jason Volk	3385d25c97	ircd::info: Improve various version information gathering.	2018-11-01 20:14:00 -07:00
Jason Volk	5dcc7cd93b	ircd::db: Add error report state w/ interface w/ console cmd.	2018-10-31 15:53:43 -07:00
Jason Volk	0f7e17a519	ircd::db: Add resume from error interface w/ console cmd.	2018-10-31 15:03:32 -07:00
Jason Volk	5da7f20a9a	ircd::db: Add and use reflection for Status::Severity.	2018-10-31 14:48:14 -07:00
Jason Volk	ac01ae0936	ircd::db: Move reflections for WriteStall- and BackgroundError- related.	2018-10-31 14:40:00 -07:00
Jason Volk	ee670af436	ircd::db: Fix WriteStallInfo reflection and log message.	2018-10-31 14:22:31 -07:00
Jason Volk	34e330d77b	ircd::db: Simplify buffer alignment callback related; fix log message.	2018-10-31 14:09:10 -07:00
Jason Volk	f46886e0b8	ircd::db: Support future CanKeysWithDifferentByteContentsBeEqual feature.	2018-10-31 11:25:07 -07:00
Jason Volk	941b4ff8eb	ircd::db: Support passthru stub for comparator feature.	2018-10-31 11:23:55 -07:00
Jason Volk	895c52694e	ircd::db: Deinline database::comparator ctor.	2018-10-31 11:23:30 -07:00
Jason Volk	94fe5090f5	ircd::db: Strict block size deviation; relax read amplification bitmap	2018-10-22 13:53:02 -07:00
Jason Volk	8be65012ec	ircd::db: Refactor column indexing and state to handle dropped columns.	2018-10-22 07:09:55 -07:00
Jason Volk	183be76a3a	ircd::db: Use reference to descriptor in database::column object.	2018-10-22 07:09:16 -07:00
Jason Volk	5544da61b8	ircd::db: Move column alignment check outside of DB::Open ctor closure.	2018-10-22 04:34:05 -07:00
Jason Volk	d3e61abe7d	ircd::db: Implement interface for column dropping.	2018-10-22 04:34:05 -07:00
Jason Volk	87feb65615	ircd::db: Integrate more detailed rocksdb::TableProperties into db::sst::info.	2018-10-21 09:26:02 -07:00
Jason Volk	b1bbbfe50b	ircd::db: Convert sst::info ctors to assignment operators.	2018-10-21 09:15:30 -07:00
Jason Volk	7b4b6c479c	ircd::db: Use dead branch rather than comment for has() regression for now.	2018-10-21 04:41:21 -07:00
Jason Volk	5a82a2e4e5	ircd::db: Move stats ticker hostpoint from database::cache to database::column.	2018-10-20 23:30:27 -07:00
Jason Volk	f9fca347d8	ircd::db: Reverse the compaction priority strategy.	2018-10-18 17:32:18 -07:00
Jason Volk	9da3d20e5c	ircd::db: Precache required buffer alignment of random access file for repeat calls.	2018-10-18 08:27:03 -07:00
Jason Volk	c0058aa53c	ircd::db: Fix debug variable name error.	2018-10-18 08:00:57 -07:00
Jason Volk	bd6f46f488	ircd::db: Column options package; meta column block sizes tweak.	2018-10-17 22:12:41 -07:00
Jason Volk	468c7e6f07	ircd::db: Add metadata block size parameter to the descriptor.	2018-10-16 13:39:43 -07:00
Jason Volk	df4ad6daca	ircd::db: Column table options package post rocksdb v5.15 upgrade.	2018-10-16 09:13:53 -07:00
Jason Volk	167eb18470	ircd::db: Disable use of rocksdb KeyMayExist in db::has() due to regression.	2018-10-16 09:13:53 -07:00
Jason Volk	0ad41ea0ff	ircd::db: Assert no context switch on iterator creation calls.	2018-10-16 09:13:53 -07:00
Jason Volk	bed1d49b6e	ircd::db: Condition filter check on if used for column (rocksdb regression workaround).	2018-10-16 09:13:53 -07:00
Jason Volk	a24270d2bb	deps: RocksDB to v5.15.10.	2018-10-15 22:31:29 -07:00
Jason Volk	37b55e4b11	ircd::db: Options package for table metadata.	2018-10-14 08:53:46 -07:00
Jason Volk	2c054ec9ca	ircd::db: Comment with TODO about cache bloom filtering here.	2018-09-26 19:02:09 -07:00