Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Any suggestions how to generate tests for invalid and blank values in request payload in fuzzy tests #564

Open
ehlmnq opened this issue Feb 26, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@ehlmnq
Copy link

ehlmnq commented Feb 26, 2024

Hi, Team

I have certain scenarios in which user wants to validate the invalid and blank values in request payload and then check the responses for
correct messages for example :

  1. {"identifierType":"LOGINID","identifierValue":"XXXXX7771316118","workspace":"Inavalid"}
  2. {"identifierType":"LOGINID","identifierValue":"XXXXX7771316118","workspace":"ADMIN","langauge":""}

Is it possible to generate tests to validate using Fuzzy tests, and if possible please suggest some help.

@thim81
Copy link
Collaborator

thim81 commented Mar 3, 2024

Hi @ehlmnq

The fuzzy generation is based on the OpenAPI definition.
If the property has minLength option defined in OpenAPI, it will generate a fuzzy variance with a less characters.
If the property is marked as required, Fuzzing will drop the property.

For "blank", we don't have any support yet, but we have received this request already a couple of times.

how would you want configure this?
Would you add a certain x-portman-fuzz-blank: true to your OpenAPI or configure it in the Portman config, where you define for which properties?

The insertion "invalid" values is more complex, since what would be the definition of "invalid"? Would it be for ENUM values?

type: object
properties:
  status:
    type: string
    enum: ['Pending', 'Processing', 'Completed', 'Failed']

How would you like to configure it? Would it be based on OpenAPI

@thim81
Copy link
Collaborator

thim81 commented Mar 3, 2024

Linked to #555

@thim81 thim81 added the enhancement New feature or request label Mar 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants