Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature: Spanner ChangeStream Input #3067

Open
1 task
anicoll opened this issue Dec 9, 2024 · 0 comments
Open
1 task

Feature: Spanner ChangeStream Input #3067

anicoll opened this issue Dec 9, 2024 · 0 comments
Labels
enhancement inputs Any tasks or issues relating specifically to inputs needs investigation It looks as though have all the information needed but investigation is required

Comments

@anicoll
Copy link

anicoll commented Dec 9, 2024 •
edited
Loading

Spanner Change Data Capture (CDC)

Hi 👋

Looking to up source something that might be helpful to others.
Been using Dataflow/beam to ingest spanner CDC and then process events but this comes with specific challenges if you are not a Java house.

I have built this input to hopefully help people who use spanner and dont want to mess with DataFlow or the complexity of Beam with which I feel Benthos/RPC has a big advantage.

I have raised a PR #3066 which implements this functionality.

Any discussion/feedback is welcome and I look forward to this hopefully being a success!

Tasks
Preview Give feedback
  1. Feat: implement change stream reader from GCP SpannerChangeStream #3066
@mihaitodor mihaitodor added enhancement inputs Any tasks or issues relating specifically to inputs needs investigation It looks as though have all the information needed but investigation is required labels Dec 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement inputs Any tasks or issues relating specifically to inputs needs investigation It looks as though have all the information needed but investigation is required
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mihaitodor @anicoll