POST method with JSON data

[n0n3mi1y]

Can i send a post request with json postData?

[ngosang]

No sorry. We have some limitations with Puppeteer + Firefox. If we change the technology it could be implemented.

[carcabot]

Can be this a potentialy solution ?

driver.execute_script(""""return fetch(url, {method:"POST",
... options})"""") 

[aprilahijriyan]

For everyone who wants to send JSON requests, I created a module for that. Please try selenium-fetch

[carcabot]

Are you able to create a pull request with this module?

[Zelak312]

I also cooked something of my own to be able to send JSON requests and also passing Headers with FlareSolverr. compared to selenium-fetch, mine the request is actually sent by FlareSolverr and it's not a fetch.

It uses mitmproxy so you spin up FlareSolverr as usual but also the proxy server. When doing a request with FlareSolverr you just proxy it throught the proxy server and follow a special convention for Get or Post for setting headers and send json Post data. The proxy server essentially intercepts the request and modifies the content in flight before it reaches the actual url.

flaresolverr-mitm-proxy

I haven't had time to fully test it but it seemed to work nicely with the few test I made.
The code was made quickly as well so it's messy and it's still in a BETA phase as it is experimental but Pull request are welcomed. There is also a docker container and a docker compose example.

[DRSDavidSoft]

@Zelak312 It's a great idea, also the fact that since you're using mitmproxy, you can set it to use an upstream proxy as well as sending custom headers, or doing any modifications that might be needed.

Great job for the idea! 👍🏻

[carcabot]

Great improvement, thanks.

[xtermed]

I cannot believe that all the valid, legitimate uses of MITMProxy slipped my mind. Really a powerhouse of a tool. Good thinking on that.

[WankkoRee]

#998 is available?

[jjhesk]

nice work