-
Notifications
You must be signed in to change notification settings - Fork 532
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Efficient attachment downloading for mailbox export #8069
Comments
paw-hub
added a commit
that referenced
this issue
Dec 17, 2024
Closes #8069 Co-authored-by: BijinDev <[email protected]>
BijinDev
added a commit
that referenced
this issue
Dec 18, 2024
close : #8069 Co-authored-by: ivk <[email protected]>
BijinDev
added a commit
that referenced
this issue
Dec 19, 2024
close : #8069 Co-authored-by: ivk <[email protected]>
BijinDev
added a commit
that referenced
this issue
Dec 19, 2024
Use archive tokens when downloading blobs when possible Try to split requests by archive Closes #8069 Co-authored-by: ivk <[email protected]> Co-authored-by: BijinDev <[email protected]>
BijinDev
added a commit
that referenced
this issue
Dec 19, 2024
#8069 Co-authored-by: ivk <[email protected]>
BijinDev
added a commit
that referenced
this issue
Dec 19, 2024
#8069 Co-authored-by: ivk <[email protected]>
paw-hub
added a commit
that referenced
this issue
Dec 20, 2024
Use archive tokens when downloading blobs when possible Try to split requests by archive Closes #8069 Co-authored-by: ivk <[email protected]> Co-authored-by: BijinDev <[email protected]>
paw-hub
pushed a commit
that referenced
this issue
Dec 20, 2024
#8069 Co-authored-by: ivk <[email protected]>
paw-hub
pushed a commit
that referenced
this issue
Dec 20, 2024
#8069 Co-authored-by: ivk <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
We should optimize attachment data downloading for mailbox export.
Naive approach of downloading each blob one by one leads to N+2 requests.
There are two possible optimizations we can apply:
Context
Downloading blobs requires requesting a blob access token first. The tokens can be scoped to individual instances or to the whole archives.
Archives are associated with a group. Sent attachments and externally-received attachments will belong to the mail group archives, while confidentially-received attachments do belong to the archive associated with the sender.
At the moment when downloading raw blobs (like for attachments) client does request tokens for each instance.
Estimated: 24h
Time Taken: 7h + 4h + 5h
The text was updated successfully, but these errors were encountered: