-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support rocksdb backed Hypercore #182
Open
chm-diederichs
wants to merge
45
commits into
main
Choose a base branch
from
rocksdb
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
chm-diederichs
force-pushed
the
rocksdb
branch
from
September 27, 2024 13:40
6981060
to
359db8e
Compare
* make sure we close all opened cores * snapshots should only have one open session * crypto does not live on core anymore * update store to pass preload promise * update wakeup
* add simple append test * add simple reorg test * add memory based store session * only memory view backed sessions are writable * apply writes to a memory batch, which is flushed after * get info from memory views during apply * emit truncate events on reorg * truncate events emit length * getWriterByKey should use applySystem by default * migrate system before making pre ff gets * derive key from memview core * reduce the number of appends in ff tests * pass system to force reset and length to update batch * pass apply system to version check * snapshots should detach before hc state is mutated * always close apply store * close writable core session immediately * bump BootRecord version to v1 * wakeup add is now async because of user data api * hc API is now createUserDataStream * set namespace on original store * enable corestore based tests * set corestore namespace in openPreSystem
* move wakeup extension onto base * views are just hypercores * kill pendingIndexedLength * remove namespace session * initialise indexedLength on open and on ff * applyUpdate returns indexedLength * use getSystemCore method * flush indexes to lengths from indexed system * undo computes checkout from indexed system info * implement autocore catchup and migrate using moveTo * explicitly pass lengths that were previously inferred * flush returns early if nothing indexed * add helper for indexed info * review by @mafintosh * view sessions should never be writable * migrate event emitted from hypercore * rename flushedLength to signedLength * update tests
chm-diederichs
force-pushed
the
rocksdb
branch
from
December 13, 2024 14:03
452a31f
to
2e27d3b
Compare
chm-diederichs
force-pushed
the
rocksdb
branch
from
December 13, 2024 14:17
2e27d3b
to
d0fda4b
Compare
* make flushing writable batches atomic * flushing signed cores is atomic * rename atomizer to atom * userData is flushed atomically with updates * add viewInfo method and refactor undoAll * view migration is now atomic * clearer append values in upgrade test * applying fast forward is now atomic * if bootstrap is writable thats always the local core * defer closing used cores until closure until we have a good flush api * remove dead code * always teardown atom * ensure main fork is used for signatures * test that the fork is bumped on views --------- Co-authored-by: Mathias Buus <[email protected]>
* do not infill on fast forward * rename option to shallow
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.