[FLINK-35359][config] General Improvement to Configuration for Flink 2.0

[Sxnan]

What is the purpose of the change

As Flink moves toward version 2.0, we want to provide users with a better experience with the existing configuration. In this PR, we make several improvements to the current configuration.

Brief change log

• Ensure all the ConfigOptions are properly annotated
• Ensure all user-facing configurations are included in the documentation generation process
• Make the existing ConfigOptions use the proper type
• Mark all internally used ConfigOptions with the Internal annotation

Verifying this change

This change is already covered by existing tests

Does this pull request potentially affect one of the following parts:

• Dependencies (does it add or upgrade a dependency): no
• The public API, i.e., is any changed class annotated with @Public(Evolving): yes
• The serializers: no
• The runtime per-record code paths (performance sensitive): no
• Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
• The S3 file system connector: no

Documentation

• Does this pull request introduce a new feature? no
• If yes, how is the feature documented? not applicable

[flinkbot]

CI report:

• 742b9c0 Azure: SUCCESS

Bot commands

The @flinkbot bot supports the following commands:

• @flinkbot run azure re-run the last Azure build

[Sxnan]

@xintongsong Thanks for the review! I updated the PR accordingly. Please take another look.

[xintongsong]

LGTM. Merging.