Is it possible to support DRA(Dynamic Resource Allocation)?

[sesame0224]

In recent years, accelerators have become essential for data processing infrastructure. Is there a plan to support accelerators in the numaflow project?

Recently, DRA has been proposed as a mechanism to easily use accelerators in Kubernetes pods. DRA allocates accelerator resources to pods using a manifest file.

In the following example, a fictional resource driver is defined as a "DeviceClass," and the spec and some metadata for the fictional resources (e.g., GPU, FPGA) managed by this driver are defined as a "ResourceClaimTemplate."

Then, in the pod manifest, a request for the allocation of fictional accelerator resources is made via a "ResourceClaim."

apiVersion: resource.k8s.io/v1alpha3
kind: DeviceClass
name: resource.example.com
spec:
  selectors:
  - cel:
      expression: device.driver == "resource-driver.example.com"
---
apiVersion: resource.k8s.io/v1alpha2
kind: ResourceClaimTemplate
metadata:
  name: large-black-cat-claim-template
spec:
  spec:
    devices:
      requests:
      - name: req-0
        deviceClassName: resource.example.com
        selectors:
        - cel:
           expression: |-
              device.attributes["resource-driver.example.com"].color == "black" &&
              device.attributes["resource-driver.example.com"].size == "large"              
–--
apiVersion: v1
kind: Pod
metadata:
  name: pod-with-cats
spec:
  containers:
  - name: container0
    image: ubuntu:20.04
    command: ["sleep", "9999"]
    resources:
      claims:
      - name: cat-0
  - name: container1
    image: ubuntu:20.04
    command: ["sleep", "9999"]
    resources:
      claims:
      - name: cat-1
  resourceClaims:
  - name: cat-0
    resourceClaimTemplateName: large-black-cat-claim-template
  - name: cat-1
    resourceClaimTemplateName: large-black-cat-claim-template

In this case, resources are allocated to the pod if the device's attributes match, such as having a black color and a large size.

A more practical example can be found here.

With the use of DRA, is it possible that UDFs in numaflow will support the use of accelerator resources?

[whynowy]

@sesame0224 - this is doable, can you convert the discussion to a feature enhancement issue?

[whynowy]

@sesame0224 - BTW, if you don't mind, could you share your use cases of using Numaflow with us?

[sesame0224]

this is doable, can you convert the discussion to a feature enhancement issue?

@whynowy Thank you for your quick reploy. Sure, I convert this disucussion.

if you don't mind, could you share your use cases of using Numaflow with us?

I will write our use cases of Numaflow in the newly created issue.

[sesame0224]

@whynowy I sumitted a new issue #2007.

[whynowy]

Close the discussion as it is now fully supported.