Reduce QPS requirement to 100

[serathius]

In last robustness meeting Nov 20 https://docs.google.com/document/d/1idZ_7tV6F18v223LyQ0WVUn9gXLSKyeLwYTdAgbjxpw/edit?usp=sharing, we identified that reducing QPS would reduce number of flakes from 10->2

We need a better way to monitor and track qps accross tests

[serathius]

cc @jmhbnz

[jmhbnz]

LGTM - Thanks @serathius

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jmhbnz, serathius

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [jmhbnz,serathius]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[codecov-commenter]

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 68.72%. Comparing base (4186283) to head (50be651).
Report is 4 commits behind head on main.

❗ Current head 50be651 differs from pull request most recent head b85c6ba

Please upload reports for the commit b85c6ba to get more accurate results.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

see 20 files with indirect coverage changes

@@            Coverage Diff             @@
##             main   #18928      +/-   ##
==========================================
+ Coverage   68.65%   68.72%   +0.06%     
==========================================
  Files         420      420              
  Lines       35558    35558              
==========================================
+ Hits        24413    24437      +24     
+ Misses       9715     9694      -21     
+ Partials     1430     1427       -3     

---

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4186283...b85c6ba. Read the comment docs.

---- 🚨 Try these New Features:

• Flaky Tests Detection - Detect and resolve failed and flaky tests

[serathius]

And we imminently get a flake. We only got 147 QPS :(

[serathius]

Lowered it down to 100, I think we need to build up instead of getting cut off from the top

[serathius]

/retest