Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide write-up for APIM scenarios with AI hub #18

Open
krnese opened this issue Feb 16, 2024 · 0 comments
Open

Provide write-up for APIM scenarios with AI hub #18

krnese opened this issue Feb 16, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@krnese
Copy link
Collaborator

krnese commented Feb 16, 2024

Goal state

We need a detailed article that describes the various scenarios where APIM is adding value in context of Azure OpenAI.
Besides dynamic load balancing and retry/throttling logic etc., we must provide prescriptive guidance for known use-cases, such as:

  • Combination of PTU and pay-as-you-go.
  • Same as the above, where organisations can "start small & expand" without any dramatic changes required on the application side.
  • Differen APIM policies to address different scenarios. We should ensure this is reflected and available as options in the reference implementation as we wrap things up.
  • External vs Internal vs Hybrid
  • Single region - and multiple regions
@krnese krnese added enhancement New feature or request good first issue Good for newcomers labels Feb 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants