Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MySQL: Add xbstream unarchiver to wal-g #1707

Draft
wants to merge 18 commits into
base: master
Choose a base branch
from
Draft

Conversation

ostinru
Copy link
Contributor

@ostinru ostinru commented May 13, 2024

Add xbstream unarchiver to wal-g, so we can eliminate xbstream --extract from backup-fetch pipeline and do it on our own.

Note 1: current PR doesn't embed new unarchiver to backup-fetch pipeline.

@ostinru ostinru added the mysql MySQL issue label May 14, 2024
@ostinru
Copy link
Contributor Author

ostinru commented May 19, 2024

For backup that is 123M (zstd compressed) I got exact matching with xbstream:

WAL-G:

WALG_LOG_LEVEL=DEVEL ./main/mysql/wal-g xb extract ~/development/incremental/bk.xb ~/development/incremental/bk/ --decompress
ostinru@ostinru-MBP ~/development/incremental $ find bk -type f | sort -u | xargs cat | md5sum
3ba456093aee2bba2e11b119a47131ec  -

XBSTREAM:

ostinru@ostinru-MBP ~/development/incremental $ cat bk.xb |  xbstream -x -C bk --decompress
ostinru@ostinru-MBP ~/development/incremental $ find bk -type f | sort -u | xargs cat | md5sum
3ba456093aee2bba2e11b119a47131ec  -

And same results without decompress:
WAL-G:

WALG_LOG_LEVEL=DEVEL ./main/mysql/wal-g xb extract ~/development/incremental/bk.xb ~/development/incremental/bk/
ostinru@ostinru-MBP ~/development/incremental $ find bk -type f | sort -u | xargs cat | md5sum
3cb96984d1202d7c7db059aa546738fd  -

XBSTREAM:

ostinru@ostinru-MBP ~/development/incremental $ cat bk.xb |  xbstream -x -C bk
ostinru@ostinru-MBP ~/development/incremental $ find bk -type f | sort -u | xargs cat | md5sum
3cb96984d1202d7c7db059aa546738fd  -

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
mysql MySQL issue
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant