Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider a .tmp extension for incomplete parts instead of .zpaq. This can improve compatibility with file sync applications. #143

Open
mirogeorg opened this issue Nov 3, 2024 · 9 comments
Labels
enhancement New feature or request

Comments

@mirogeorg
Copy link

Franco, I’m syncing .ZPAQ archives to a remote server using Syncthing. While new archive parts (archive0002.zpaq, etc.) are being created, Syncthing attempts to read them to generate hashes. It detects that they are currently being modified and starts over, leading to a repeated cycle.

Is there an option for ZPAQFRANZ to create files with a .tmp extension initially, and then only change the extension to .zpaq once the part is fully completed?

Syncthing doesn’t support exclusions based on date, and the developers refuse to work on such a feature.

@fcorbelli
Copy link
Owner

fcorbelli commented Nov 3, 2024

60_9r.zip

You can try backup with -tmp
(not very tested)

@fcorbelli fcorbelli added the enhancement New feature or request label Nov 3, 2024
@mirogeorg
Copy link
Author

please compile that version so I can test

@fcorbelli
Copy link
Owner

zpaqfranz upgrade -force

@mirogeorg
Copy link
Author

looks good for now...

@mirogeorg
Copy link
Author

With this patch, it is now safe to add to archives and run tests simultaneously.

@fcorbelli
Copy link
Owner

only if the are multipart

@sheckandar
Copy link

Not sure if I should file as a new issue.

-tmp doesn't work when using index files.

To reproduce:

./zpaqfranz a "/volume1/Netbackup/test-??????" "/volume1/homes" -nosynology -tmp -filelist -ssd

That creates a file test-000001.tmp and then renames it to test-000001.zpaq at the end.

Then I extract the index file:

./zpaqfranz x "/volume1/Netbackup/test-??????" -index "/volume1/Netbackup/test.index"

And then I run the backup again, but this time using the index file. The .tmp file is no longer created:

./zpaqfranz a "/volume1/Netbackup/test-??????" "/volume1/homes" -index "/volume1/Netbackup/test.index" -nosynology -tmp -filelist -ssd

@fcorbelli
Copy link
Owner

The index file do nothing in extraction
It is meant to MOVE the .zpaqs on a different storage space

What and why you are doing?

@sheckandar
Copy link

I'm doing that because the backup files are stored in the cloud (BackBlaze) and downloading the data again costs lots of money (5 TB of data downloads every time doesn't make sense). So I use the index files.

I would like to avoid using rclone as it introduces another point of potential failure. So the index files are a perfect solution to that problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants