Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] FlyteRemote bug when trying to sync an execution of a workflow with of a dynamic subworkflow that contains a map_task #6101

Open
2 tasks done
pingsutw opened this issue Dec 11, 2024 · 2 comments
Assignees
Labels
bug Something isn't working flytekit FlyteKit Python related issue

Comments

@pingsutw
Copy link
Member

Describe the bug

Create workflow and execute it

import flytekit as fl

@fl.task
def my_task(index: int):
    print(index)

@fl.dynamic
def my_subworkflow(indices: list[int]):
    fl.map_task(my_task)(index=indices)

@fl.workflow
def my_workflow():
    
    indices = [1,2,3]
    my_subworkflow(indices=indices)

Attempt to sync (and its children) it via FlyteRemote:

import flytekit as fl

remote = fl.FlyteRemote.for_endpoint(
    endpoint="demo.hosted.unionai.cloud",
    default_project="flytesnacks",
    default_domain="development",
)

execution = remote.fetch_execution(name="arfcn55qj555x8v7pbc6")

synced = remote.sync(execution, sync_nodes=True)

Expected behavior

should support to sync an execution of a workflow with of a dynamic subworkflow

Additional context to reproduce

No response

Screenshots

No response

Are you sure this issue hasn't been raised already?

  • Yes

Have you read the Code of Conduct?

  • Yes
@pingsutw pingsutw added bug Something isn't working untriaged This issues has not yet been looked at by the Maintainers labels Dec 11, 2024
@pingsutw pingsutw added flytekit FlyteKit Python related issue and removed untriaged This issues has not yet been looked at by the Maintainers labels Dec 11, 2024
@SZL741023
Copy link
Contributor

#take

@pingsutw
Copy link
Member Author

_InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
        status = StatusCode.NOT_FOUND
        details = "missing entity of type TASK with identifier project:"flytesnacks"  domain:"development"  
name:"demos.remote.map_my_task_6b3bd0353da5de6e84d7982921ead2b3-arraynode"  version:"NW01yxgTu_rCvlfyjUWXuA""
        debug_error_string = "UNKNOWN:Error received from peer  {grpc_message:"missing entity of type TASK with 
identifier project:\"flytesnacks\"  domain:\"development\"  
name:\"demos.remote.map_my_task_6b3bd0353da5de6e84d7982921ead2b3-arraynode\"  version:\"NW01yxgTu_rCvlfyjUWXuA\"", 
grpc_status:5, created_time:"2024-12-11T14:31:24.798104-05:00"}"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working flytekit FlyteKit Python related issue
Projects
Status: Backlog
Status: Backlog
Development

No branches or pull requests

2 participants