Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Migrate to sqlite db backend #644

Open
wants to merge 197 commits into
base: main
Choose a base branch
from
Open

Migrate to sqlite db backend #644

wants to merge 197 commits into from

Conversation

tmpfs
Copy link
Collaborator

@tmpfs tmpfs commented Dec 29, 2024 •
edited
Loading

Database Importer

All the main data is being imported but we also need to support:

  • File blobs
  • Preferences
  • Server remote origins
  • Audit logs

Columns

  • Use blob for checksum types

Backend

Update the backend writers to support both file system and database backends:

  • VaultWriter
  • Event Logs
  • Preferences
  • Servers
  • Audit trail
  • Server storage
  • Client storage

Note we would like to use the STRICT table keyword to prevent type coercion but it doesn't work with the DATETIME column type.

@tmpfs tmpfs self-assigned this Dec 29, 2024
tmpfs added 19 commits December 29, 2024 09:45
@tmpfs
Include account events in backup archive.
4106e28
@tmpfs
Include account events, file events and preferences in backup archives.
07417de
@tmpfs
Include remote origins in backup archive format.
18dd409 
Add zip fixture for v2 of the backup archive format.
@tmpfs
Improve database importer logic.
6c2e0e8
@tmpfs
Add join table for identity login folder.
e0705a1
@tmpfs
Rename table.
a1b6980
@tmpfs
Handle device events in database importer.
bb3349d
@tmpfs
Add join for device folder definition.
2a032d2
@tmpfs
Include user folders when importing to database.
b504809
@tmpfs
Tidy db import logic.
3c6f204
@tmpfs
Configure file extract directory in test spec.
8f7d4d9
@tmpfs
Do not enable hooks feature.
50ffa4c 
It won't help us as it only applies to a single process.
@tmpfs
Prepare table for file blobs.
ed1a7ba
@tmpfs
Include file blobs when importing to db.
518b881
@tmpfs
Prepare preferences table.
ea7f12f
@tmpfs
Prepare servers table.
d36c736
@tmpfs
Create servers in db importer.
6c80b69
@tmpfs
Create audit logs in db importer.
25481ff
@tmpfs
Create audit logs in db importer.
32e4e0b
tmpfs added 16 commits January 5, 2025 14:26
@tmpfs
Tidy SyncClient trait methods.
04b9d19 
No need to always pass AccountId as HttpClient now requires it in the
constructor.
@tmpfs
Remove account signing key from the pairing protocol.
d474480
@tmpfs
Remove account signing key.
d5f00de
@tmpfs
Remove Address from the prelude.
ce4434f
@tmpfs
Server authentication is stricter.
68da744 
Remove support for the obsolete recover_address() in bearer token handling.

Remove conversion functions from Address.
@tmpfs
Remove BinaryEcdsaSignature and recover_address().
729dd9b
@tmpfs
Disable WIP recovery code.
379aebd 
Remove Address from BoxedSigner.
@tmpfs
Remove the Address type completely.
9638301
@tmpfs
Remove obsolete subtle dependency.
08dd88b
@tmpfs
Remove obsolete Signature type and dependency.
7249ee3
@tmpfs
Support setting the user agent for requests.
b636848 
The CLI sends "sos-cli/{version}" and the GUI sends "sos-gui/{version}".
@tmpfs
Update dependencies.
49a95d8
@tmpfs
Add generics to Gatekeeper so it can have a dynamic mirror.
ad2c1d0 
Move the VaultWriter to sos_filesystem.
@tmpfs
Tidy imports.
b5dfde5
@tmpfs
Tidy VaultWriter constructor.
5b78d0a
@tmpfs
Rename type.
79d7c4a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@tmpfs tmpfs

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@tmpfs