You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There is currently a bug / inconsistency in master (which left me puzzled most of the afternoon yesterday as I thought it was introduced in my current change), but seems that there is currently an issue with the relationships between:
The type ModelFramework.TempoPipeline (only if explicitly specified, as otherwise it's set to ModelFramework.CUSTOM)
The dependent models with custom dependencies of a pipeline
The way in which is_remote is used throughout mlserver.py and inside base.py (in tempo)
The issues basically are best reflected when testing the "custom environments background", and is reproducible in master, where the issues are:
Individual custom models freeze when sending requests (explained below)
Pipeline fails as it tries to load all models locally (or at least it fails with the dependencies from the other two models that are used in the pipeline)
The reason for this is primrily explained below:
The models (which don't have internal models) fails as there is a check where any ModelFramework.TempoPipeline get their internal flags set to use_remote / is_remote to true - whilst this is desired for the secondary models, it wouldn't be relevant for subsequent models
The pipeline (which calls the two other models) fail as it seems to also require the dependencies from the two other models
The text was updated successfully, but these errors were encountered:
There is currently a bug / inconsistency in master (which left me puzzled most of the afternoon yesterday as I thought it was introduced in my current change), but seems that there is currently an issue with the relationships between:
The issues basically are best reflected when testing the "custom environments background", and is reproducible in master, where the issues are:
The reason for this is primrily explained below:
The text was updated successfully, but these errors were encountered: