Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consumer/processor component #42

Open
Shmuma opened this issue Aug 7, 2021 · 3 comments
Open

Consumer/processor component #42

Shmuma opened this issue Aug 7, 2021 · 3 comments

Comments

@Shmuma
Copy link

Shmuma commented Aug 7, 2021

Current set of components are good to design simple web-based apps, but in practice there are more cases.
For example, almost immediately I missed “consumer” or “processor” - worker which consumes MQ messages and transforms them. In general they can do multiple requests, not just transformations, for example it can consume “crawling requests” which contains domain names, perform the crawling of the website (HTTP requests) and push results into another MQ queue.

@honzaap
Copy link
Owner

honzaap commented Aug 7, 2021

Sounds good, I'll look into it.

@honzaap
Copy link
Owner

honzaap commented Aug 8, 2021

Hi, I'm reading more into this now and can't kinda understand what would make this "processor" component so unique. Right now, you can connect API component as a consumer, which can then send requests to another MQ, I don't see the differece.

@Lockhead
Copy link

For example how could I build a 3 way connection as processor that consumes a queue as input, requests to other services to enrich and then pushes the result into another queue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants