Support Tencent Cloud COS as a Backend for State Store

[realmorrisliu]

Is your feature request related to a problem? Please describe.

Currently, my project uses Tencent Cloud COS as the object storage solution. While it can work with the S3-compatible mode, I believe having native support for COS in the state store would improve ease of use and compatibility. This would also align with the existing support for other cloud providers like Aliyun OSS and Huawei Cloud OBS.

Describe the solution you'd like

I propose adding support for Tencent Cloud COS as a backend for the state store. From my research, I noticed that both Aliyun OSS and Huawei Cloud OBS are supported through the Apache OpenDAL project, which already supports COS as well. Therefore, implementing COS support would primarily involve:

1. Adding a new file, cos.rs, in the directory risingwave/src/object_store/src/object/opendal_engine/, to implement new_cos_engine.
2. Updating the build_remote_object_store function in risingwave/src/object_store/src/object/mod.rs to include the COS adapter.

Describe alternatives you've considered

The alternative is to continue using Tencent Cloud COS in the S3-compatible mode. However, native support would make configurations more straightforward and better optimized for Tencent Cloud’s unique features.

Additional context

Adding native support for COS would enhance compatibility and user experience, especially for projects hosted on Tencent Cloud. The change aligns with existing patterns in the codebase and would leverage Apache OpenDAL for implementation, minimizing the required effort.

[wcy-fdu]

Thank you for your suggestion; we will support it soon.

[wcy-fdu]

If you are interested, contributions are welcome.🙌

[realmorrisliu]

Thank you for considering my suggestion! 🙌
I’m excited to contribute to this feature. I’ll start by setting up the development environment as per the contribution guidelines and then proceed with the implementation. It might take me some time to get everything ready, but I’ll submit a PR as soon as possible. Let me know if there’s anything else I should keep in mind. 😊