Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Data migration + testing #8854

Merged
merged 76 commits into from
Jul 9, 2024
Merged

Data migration + testing #8854

merged 76 commits into from
Jul 9, 2024

Commits on May 23, 2024

  1. do serialization via objectregistry

    @koenvanderveen
    koenvanderveen committed May 23, 2024
    Configuration menu
    Copy the full SHA
    031dc80 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. added tox test

    @teo-milea
    teo-milea committed May 24, 2024
    Configuration menu
    Copy the full SHA
    644ae70 View commit details
    Browse the repository at this point in the history

  2. added versions to missing classes

    @teo-milea
    teo-milea committed May 24, 2024
    Configuration menu
    Copy the full SHA
    ff8e2da View commit details
    Browse the repository at this point in the history

  3. fix migrations from 0.8.6

    @koenvanderveen
    koenvanderveen committed May 24, 2024
    Configuration menu
    Copy the full SHA
    d0f1591 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. add proper object registry with canonical name and version, add old t… 

    …ypes, refactor serialization, add client facing API's for migration
    @koenvanderveen
    koenvanderveen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    85467f1 View commit details
    Browse the repository at this point in the history

  2. -

    @koenvanderveen
    koenvanderveen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    1c668b5 View commit details
    Browse the repository at this point in the history

  3. merge dev

    @koenvanderveen
    koenvanderveen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    f02bb1f View commit details
    Browse the repository at this point in the history

  4. fix canonical name for non syft objects

    @koenvanderveen
    koenvanderveen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    a88d596 View commit details
    Browse the repository at this point in the history

  5. fix linter

    @koenvanderveen
    koenvanderveen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    7f9e7aa View commit details
    Browse the repository at this point in the history

  6. add some lost changes

    @koenvanderveen
    koenvanderveen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    835fd38 View commit details
    Browse the repository at this point in the history

  7. notebooks

    @koenvanderveen
    koenvanderveen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    077015e View commit details
    Browse the repository at this point in the history

  8. Merge branch 'dev' of github.com:OpenMined/PySyft into migration-tests

    @koenvanderveen
    koenvanderveen committed May 30, 2024
    Configuration menu
    Copy the full SHA
    9e1fc0b View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. clean up services

    @koenvanderveen
    koenvanderveen committed May 31, 2024
    Configuration menu
    Copy the full SHA
    b5c97e9 View commit details
    Browse the repository at this point in the history

  2. clean up services

    @koenvanderveen
    koenvanderveen committed May 31, 2024
    Configuration menu
    Copy the full SHA
    4a29384 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. -

    @koenvanderveen
    koenvanderveen committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    006f4d4 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. fix response repr

    @teo-milea
    teo-milea committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    b1f2fb0 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. proper check on adding workers on node and settings migrations

    @teo-milea
    teo-milea committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    4597798 View commit details
    Browse the repository at this point in the history

  2. proper migration on settings

    @teo-milea
    teo-milea committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    59de872 View commit details
    Browse the repository at this point in the history

  3. added changes to migration service

    @teo-milea
    teo-milea committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    f059b49 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'migration-tests_tox-test' of github.com:OpenMined/PySyf… 

    …t into migration-tests
    @teo-milea
    teo-milea committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    967d5cc View commit details
    Browse the repository at this point in the history

  5. helper methods to save to file

    @teo-milea
    teo-milea committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    f4a4b97 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. data migration for store metadata

    @eelcovdw
    eelcovdw committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    f6b3348 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge pull request #8982 from OpenMined/eelco/migrate-store-metadata 

    migrate store metadata
    @koenvanderveen
    koenvanderveen committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    9341639 View commit details
    Browse the repository at this point in the history

  2. allocate for user

    @eelcovdw
    eelcovdw committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    628fefa View commit details
    Browse the repository at this point in the history

  3. migrate blob storage

    @eelcovdw
    eelcovdw committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    e6908e9 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. merge dev

    @eelcovdw
    eelcovdw committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    68af30d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'eelco/blob-storage-migrations' into migration-tests

    @eelcovdw
    eelcovdw committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    8ae0647 View commit details
    Browse the repository at this point in the history

  3. fix lint+mypy

    @eelcovdw
    eelcovdw committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    c0007b9 View commit details
    Browse the repository at this point in the history

  4. migrate to new client

    @eelcovdw
    eelcovdw committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    efb2061 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. deployment for migration

    @eelcovdw
    eelcovdw committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    3562d0d View commit details
    Browse the repository at this point in the history

  2. finalize migration for local setup

    @eelcovdw
    eelcovdw committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    e1d8c91 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #9006 from OpenMined/eelco/migrate-to-new-node 

    migrate to new node
    @eelcovdw
    eelcovdw committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    87eb464 View commit details
    Browse the repository at this point in the history

  4. remove debug flag

    @eelcovdw
    eelcovdw committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    0479e18 View commit details
    Browse the repository at this point in the history

  5. merge dev

    @eelcovdw
    eelcovdw committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    5c99c69 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. disable migration by default

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    504498b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'dev' into migration-tests

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    7964586 View commit details
    Browse the repository at this point in the history

  3. serde + permissions bugfixes

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    58e8dc4 View commit details
    Browse the repository at this point in the history

  4. migration fixes

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    c1b5c2a View commit details
    Browse the repository at this point in the history

  5. update notebook

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    aa103b8 View commit details
    Browse the repository at this point in the history

  6. merge dev

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    2455d0b View commit details
    Browse the repository at this point in the history

  7. min blob storage = 0

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    301cbd4 View commit details
    Browse the repository at this point in the history

  8. disable blob/local storage tests

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    f4fc883 View commit details
    Browse the repository at this point in the history

  9. Revert "disable blob/local storage tests" 

    This reverts commit f4fc883.
    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    e8b45af View commit details
    Browse the repository at this point in the history

  10. Revert "min blob storage = 0" 

    This reverts commit 301cbd4.
    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    18b9a21 View commit details
    Browse the repository at this point in the history

  11. add unittests

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    8154715 View commit details
    Browse the repository at this point in the history

  12. comments

    @eelcovdw
    eelcovdw committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    efd1030 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. [syft/blob_storage] only add blob persmission for an action object wh… 

    …en its `syft_blob_storage_entry_id` is not None
    @khoaguin
    khoaguin committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    54ba6b3 View commit details
    Browse the repository at this point in the history

  2. [syft/action_service] only add blob permission if the entry's id is n… 

    …ot None
    @khoaguin
    khoaguin committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    787af9b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev' into migration-tests

    @khoaguin
    khoaguin committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    a349876 View commit details
    Browse the repository at this point in the history

  4. revert blob id None check

    @eelcovdw
    eelcovdw committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    c6bef1d View commit details
    Browse the repository at this point in the history

  5. Merge branch 'migration-tests' of github.com:OpenMined/PySyft into mi… 

    …gration-tests
    @eelcovdw
    eelcovdw committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    f36a7c4 View commit details
    Browse the repository at this point in the history

  6. add tox local + k8s tests

    @eelcovdw
    eelcovdw committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    4e6d572 View commit details
    Browse the repository at this point in the history

  7. comments

    @eelcovdw
    eelcovdw committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    df623a9 View commit details
    Browse the repository at this point in the history

  8. merge dev

    @eelcovdw
    eelcovdw committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    a70ed58 View commit details
    Browse the repository at this point in the history

  9. revert

    @eelcovdw
    eelcovdw committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    138877e View commit details
    Browse the repository at this point in the history

  10. bootstrap with formatted uid

    @eelcovdw
    eelcovdw committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    0c9a405 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2024

  1. revert load_user_code change

    @eelcovdw
    eelcovdw committed Jul 6, 2024
    Configuration menu
    Copy the full SHA
    b2d1870 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'dev' into migration-tests

    @eelcovdw
    eelcovdw committed Jul 6, 2024
    Configuration menu
    Copy the full SHA
    c62e5cb View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. fix custom policies

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c860a85 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'migration-tests' of github.com:OpenMined/PySyft into mi… 

    …gration-tests
    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    aa2ae84 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dev' into migration-tests

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    4611178 View commit details
    Browse the repository at this point in the history

  4. add test to CI

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    8c95f48 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'migration-tests' of github.com:OpenMined/PySyft into mi… 

    …gration-tests
    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    d673dec View commit details
    Browse the repository at this point in the history

  6. fix actionobject migration

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    f292cda View commit details
    Browse the repository at this point in the history

  7. add dev install in migration.prepare

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    11e7072 View commit details
    Browse the repository at this point in the history

  8. add pip show

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    0dbce33 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'dev' into migration-tests

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    17eb92a View commit details
    Browse the repository at this point in the history

  10. specify syft version for prepare

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    6ebd203 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'migration-tests' of github.com:OpenMined/PySyft into mi… 

    …gration-tests
    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    acca004 View commit details
    Browse the repository at this point in the history

  12. try to fix pycapnp

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    5f8f125 View commit details
    Browse the repository at this point in the history

  13. add pre flag

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    11038b4 View commit details
    Browse the repository at this point in the history

  14. add pre flag

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    e3b9234 View commit details
    Browse the repository at this point in the history

  15. remove version assert

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    c1754af View commit details
    Browse the repository at this point in the history

  16. mypy

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    8444ba3 View commit details
    Browse the repository at this point in the history

  17. fix protocol

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    0a1026a View commit details
    Browse the repository at this point in the history

  18. ignore version upgrades for notebook tests

    @eelcovdw
    eelcovdw committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    cd944df View commit details
    Browse the repository at this point in the history