308 commits

Author	SHA1	Message	Date
Jason Volk	f7fbd0f5d2	ircd::db: Detect O_DIRECT possible for database directory on init.	2018-09-04 02:32:12 -07:00
Jason Volk	4f55dac071	ircd::db: Minor cleanup.	2018-09-03 21:43:31 -07:00
Jason Volk	60a0694853	construct: Add program option to disable direct IO.	2018-09-03 07:59:05 -07:00
Jason Volk	80d0db9f26	ircd::db: Remove unnecessary default to O_DIRECT.	2018-09-03 07:48:23 -07:00
Jason Volk	b0e9107870	ircd::db: Cache size cannot be strict here.	2018-09-03 03:24:37 -07:00
Jason Volk	6f940ab51e	ircd::db: Improve debug msg on column init.	2018-09-02 21:16:49 -07:00
Jason Volk	a5d014d10a	ircd::db: Use our cache wrapping for block and compressed column caches.	2018-09-02 17:53:24 -07:00
Jason Volk	084d434c59	ircd::db: Add internal cache wrapper interface; add comment.	2018-09-02 17:53:24 -07:00
Jason Volk	62426ab210	ircd::db: Add column prefetch.	2018-09-01 07:15:03 -07:00
Jason Volk	ca1ee19a47	ircd::db: Minor simplify.	2018-09-01 07:15:03 -07:00
Jason Volk	ff7d2514a0	ircd::db: Remove the cache prefetch/fetch interface.	2018-09-01 07:15:03 -07:00
Jason Volk	ac3b45604a	ircd::db: Move comment.	2018-08-30 07:21:44 -07:00
Jason Volk	b1aa733d95	ircd::db: Additional critical exclusion and interruption zones.	2018-08-28 21:53:17 -07:00
Jason Volk	5c6874c790	ircd::db: Get better required alignments for direct IO.	2018-08-28 20:15:40 -07:00
Jason Volk	d70ef25711	ircd::db: Simplify port entry checks.	2018-08-28 15:57:49 -07:00
Jason Volk	3833aa70cb	ircd::db: Additional trivial vtable placements.	2018-08-28 15:44:03 -07:00
Jason Volk	a4e4424ede	ircd: Improve main control flow for termination condition during init.	2018-08-28 15:04:23 -07:00
Jason Volk	8340f005da	ircd::db: Use terminate() on the request pool on ~init(); log messages.	2018-08-28 12:06:56 -07:00
Jason Volk	cd74a39330	ircd::db: Move the write mutex to a global and lock for compaction points too.	2018-08-26 20:46:59 -07:00
Jason Volk	0b98144cfe	ircd::db: Minor cleanup; assertions.	2018-08-24 10:59:22 -07:00
Jason Volk	84f4cbd359	ircd::db: Serialize entry to rdb's write impl to circumvent pthread deadlock.	2018-08-24 03:40:37 -07:00
Jason Volk	c94b6f02ca	ircd::db: Options package; no DIO writes	2018-08-24 03:40:25 -07:00
Jason Volk	1450678b83	ircd::db: Plug remaining filesystem operations into ircd::fs / AIO.	2018-08-24 00:40:35 -07:00
Jason Volk	6f2eeaec67	ircd::db: Full dressing on the environment.	2018-08-23 23:08:41 -07:00
Jason Volk	ec0670262e	ircd::db: Give some env callbacks handlers.	2018-08-23 18:57:24 -07:00
Jason Volk	bbcddbcf5b	ircd::db: Use our fs::size() for file sizing env callback.	2018-08-23 05:37:32 -07:00
Jason Volk	29d4ec71d5	ircd::db: Update env exception handlers to propagate to rocksdb.	2018-08-23 04:20:16 -07:00
Jason Volk	f630c28439	ircd::db: Add error_to_status conversion for rocksdb::Status.	2018-08-23 04:19:32 -07:00
Jason Volk	585f6c97c3	ircd::db: Minor cleanup.	2018-08-23 04:16:49 -07:00
Jason Volk	671170afb4	ircd::db: Use an ircd::assertive so failure happens in optimized mode here.	2018-08-23 02:19:28 -07:00
Jason Volk	824e3305a4	ircd::db: Implement WaitForJoin() to wait on all ctx pool joins.	2018-08-23 02:16:44 -07:00
Jason Volk	d01430e64a	ircd::db: Replace default sleep() callback with ctx::sleep().	2018-08-23 02:14:50 -07:00
Jason Volk	5239e49f4f	ircd::db: Improve opts related for random_access_file; minor cleanup.	2018-08-23 01:54:58 -07:00
Jason Volk	7698759d04	ircd::db: Integrate env::sequential_file with AIO.	2018-08-23 01:54:18 -07:00
Jason Volk	b753637385	ircd::db: request pool conf item set callback.	2018-08-22 14:37:52 -07:00
Jason Volk	b964f9520f	ircd::db: max_open_files must NOT be 0 or files are open/close too often.	2018-08-22 13:13:03 -07:00
Jason Volk	de973740e3	ircd::db: Additional db env debug log.	2018-08-22 12:56:17 -07:00
Jason Volk	23d0c7384d	ircd::db: Catch everything here because there's nowhere else to go.	2018-08-21 08:49:11 -07:00
Jason Volk	b3ff44d0fb	ircd::db: Fix the cache insert misapprehensions.	2018-08-21 00:49:40 -07:00
Jason Volk	6d3eb3ae85	fixup! ircd::db: Fix cache iteration interpretation.	2018-08-21 00:42:13 -07:00
Jason Volk	ca0dcd36e4	ircd::db: Supply fs::uuid in this env callback.	2018-08-21 00:21:06 -07:00
Jason Volk	1f8a756f23	ircd::db: Comment / minor cleanup.	2018-08-21 00:20:54 -07:00
Jason Volk	0f021e09d4	ircd::db: Fix cache iteration interpretation.	2018-08-21 00:20:30 -07:00
Jason Volk	11f266aa37	ircd::db: Fix exclusion and lock option required for cache iteration.	2018-08-21 00:19:53 -07:00
Jason Volk	d4c51a2d45	ircd::db: Disable interruption for rocksdb entry surface.	2018-08-19 20:11:41 -07:00
Jason Volk	c7080bf144	ircd::db: Disable interruption for these env surfaces.	2018-08-19 20:11:40 -07:00
Jason Volk	d4b98e04e9	ircd::db: Minor cleanup.	2018-08-19 18:35:42 -07:00
Jason Volk	0dd075ab78	ircd::db: Checkin some options related.	2018-08-19 01:16:49 -07:00
Jason Volk	b8936261b5	ircd::db: Add some exception handlers on these envs.	2018-08-19 01:14:54 -07:00
Jason Volk	e620965d4c	ircd::db: Make request pool size a conf item.	2018-08-18 22:10:39 -07:00
Jason Volk	ff4e20d948	ircd::db: Minor commentary on interruption.	2018-08-18 21:02:42 -07:00
Jason Volk	c2c68e386d	ircd::db: Fix these missing retvals.	2018-08-18 20:59:42 -07:00
Jason Volk	9165c71afd	ircd::db: Concurrent row seek.	2018-08-18 20:59:28 -07:00
Jason Volk	89e920fdd4	ircd::db: Add column cache check util.	2018-08-18 20:40:23 -07:00
Jason Volk	65b18ae7a6	ircd::db: Concurrent row requests.	2018-08-18 19:30:25 -07:00
Jason Volk	1b7e3af966	ircd::db: Simplify internal seek stack; minor cleanup.	2018-08-18 18:41:22 -07:00
Jason Volk	e2c17d2595	ircd::db: Add some arbitrary sanity checks on port structures.	2018-08-18 18:20:38 -07:00
Jason Volk	8537cca439	ircd::db: Improvements to cache interface.	2018-08-18 17:59:31 -07:00
Jason Volk	9cee6a40c9	construct: Interruption point after command.	2018-08-17 14:26:44 -07:00
Jason Volk	bf429e0c9e	ircd::db: Mask interruption for compaction operations.	2018-08-17 14:13:27 -07:00
Jason Volk	eca3a5b85b	ircd::db: No need for adopt_lock here.	2018-08-17 13:38:32 -07:00
Jason Volk	850fd0238a	ircd::db: Remove offload shenanigans.	2018-08-17 12:51:49 -07:00
Jason Volk	31ff4f68cb	ircd::db: Plug env::random_access_file into AIO.	2018-08-17 12:51:48 -07:00
Jason Volk	6db0659c06	ircd::db: Enable port; minimal context pool state.	2018-08-17 12:51:48 -07:00
Jason Volk	26a856acb8	ircd::db: Appropriately case these reflections.	2018-08-17 12:51:48 -07:00
Jason Volk	928e40ada0	ircd::db: Minor cleanup; add additional env log msg.	2018-08-17 12:51:48 -07:00
Jason Volk	a98bd357df	construct/ircd: Add -pitrecdb option to allow point-in-time recovery.	2018-07-06 17:09:33 -07:00
Jason Volk	3ba3ef46af	ircd::db: Fix SST file creation on open; disable sst mgr to remove extra thread spawn.	2018-07-04 16:47:11 -07:00
Jason Volk	5ab8b9bdae	ircd::db: Add init warning for no compression; minor reorg inits.	2018-06-12 01:00:15 -07:00
Jason Volk	960553f279	ircd::db: Checkpoint skeleton state structure for env.	2018-06-09 13:40:21 -07:00
Jason Volk	4ce6b69f69	ircd::db: Additional env debug messages.	2018-06-02 09:18:01 -07:00
Jason Volk	fd41a3b9c1	ircd::db: Add db env debug log msg to WaitForJoin.	2018-06-01 12:36:46 -07:00
Jason Volk	7e25d99cc6	ircd::db: Convert rocksdb::port from pthread to ircd::ctx.	2018-06-01 12:36:46 -07:00
Jason Volk	d56c856573	ircd::db: Reorg to group all thread related env callbacks together.	2018-06-01 06:23:39 -07:00
Jason Volk	7461de8b3d	ircd::db: Condition to check database from ircd::checkdb via -checkdb command line option.	2018-05-31 12:47:37 -07:00
Jason Volk	73fc596cb6	ircd::db: Add experimental port linktime override suite.	2018-05-30 04:59:04 -07:00
Jason Volk	3e6fdbd93d	ircd::db: Use #defines rather than comments for excessive log calls.	2018-05-29 02:52:47 -07:00
Jason Volk	4dd0b6c7b2	ircd::db: Minor syntax cleanups.	2018-05-29 01:42:04 -07:00
Jason Volk	d4c2ec6b22	ircd::db: Fix iterator invalidation from a cache-missing seek.	2018-05-25 06:21:03 -07:00
Jason Volk	2564b28743	ircd::db: Properly maintain db::gopts as iterator state.	2018-05-25 03:07:30 -07:00
Jason Volk	ff21175036	ircd::db: Integrate checkpointing with database name and path schema.	2018-05-24 20:52:49 -07:00
Jason Volk	4ce29f1d22	ircd::db: Add cache clear interface w/ console cmd.	2018-05-24 01:18:58 -07:00
Jason Volk	7bfe9e94a1	ircd::db: Default to no checksums on all reads; add conf item; adjust opts.	2018-05-23 18:45:27 -07:00
Jason Volk	5708d9c36b	ircd::db: Consolidate various stats interfaces into header.	2018-05-23 17:04:02 -07:00
Jason Volk	77755a2ab4	ircd::db: Add interface to rocksdb iostats w/ console cmd.	2018-05-23 16:57:49 -07:00
Jason Volk	1c20df652b	ircd::db: Elaborate interface to the rocksdb perf_context.	2018-05-23 16:27:44 -07:00
Jason Volk	8b15512849	ircd::db: Add database's unique id string interface.	2018-05-22 17:01:01 -07:00
Jason Volk	9d5afc8e87	ircd::db: Add separate check(database); Add log notice when checking on open.	2018-05-22 16:52:34 -07:00
Jason Volk	1afba986b3	ircd::db: Support additional rdb comparator features.	2018-05-21 19:52:18 -07:00
Jason Volk	c2b45aacc3	ircd::db: Use better column count in row ctor.	2018-05-19 23:13:54 -07:00
Jason Volk	296eff7c5d	ircd::db: Removed unused cell features.	2018-05-19 18:49:06 -07:00
Jason Volk	ab4f2b362f	ircd::db: Decrease temp default row cache size.	2018-05-19 18:49:05 -07:00
Jason Volk	47b28d9295	ircd::db: Add cache key remover.	2018-05-19 18:49:04 -07:00
Jason Volk	9e0acde5cf	ircd::db: Add cache entry iteration (experimental).	2018-05-19 18:49:04 -07:00
Jason Volk	8f40fd574a	ircd::db: Interface to test if cache entry exists.	2018-05-19 18:49:04 -07:00
Jason Volk	f97c9fff99	ircd::db: Add interface to database & column caches.	2018-05-19 18:49:04 -07:00
Jason Volk	507b8e4f1c	ircd::db: Minor cleanup.	2018-05-19 18:49:04 -07:00
Jason Volk	9388e65250	ircd::db: Fix constness of colname vector values.	2018-05-19 18:49:02 -07:00
Jason Volk	508baeb4a5	ircd::db: Move vector of colptrs to stack.	2018-05-19 18:49:02 -07:00
Jason Volk	f160963c02	ircd::db: Split column compact range and files operations for interface.	2018-05-10 17:06:35 -07:00