[test] Add integration test for accessing sd sttr in dc

[JiangJiaWei1103]

Tracking issue

flyteorg/flyte#5956

Why are the changes needed?

So far, this patch is tested via single binary, which is limited. The newly released flyte now supports accessing StructuredDataset attribute in a dataclass. Hence, we should add an integration to enhance the robustness.

What changes were proposed in this pull request?

Add an integration test supporting:

1. Upload a single parquet file to minio s3 bucket
2. Access StructuredDataset attribute from a dataclass
3. Open StructuredDataset from a remote path (i.e., the uploaded location)
4. Teardown the uploaded file after workflow is completed

How was this patch tested?

This integration test passes in local run.

Setup process

For local run, the setup process is summarized as follows:

git clone https://github.com/flyteorg/flytekit.git
gh pr checkout 2969
make setup && pip install -e .

After installation, run the following command:

pytest -svvv tests/flytekit/integration/remote/test_remote.py::test_attr_access_sd

Screenshots

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

#2954

Docs link

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 77.53%. Comparing base (92d87a8) to head (fbfac6e).
Report is 33 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2969      +/-   ##
==========================================
- Coverage   82.79%   77.53%   -5.26%     
==========================================
  Files           3      288     +285     
  Lines         186    24695   +24509     
  Branches        0     2729    +2729     
==========================================
+ Hits          154    19148   +18994     
- Misses         32     4786    +4754     
- Partials        0      761     +761     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.