Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

📘 docs: Portkey AI custom endpoint in librechat.example.yaml #4625

Merged
merged 2 commits into from
Nov 23, 2024

Conversation

siddharthsambharia-portkey
Copy link
Contributor

Summary

Portkey AI Custom Endpoint Integration

Added configuration for the Portkey AI custom endpoint in librechat.example.yaml. This enables LibreChat users to connect directly to the Portkey API and utilize its specialized models with settings for headers, model display, and title conversations.

Key additions:

  • Endpoint configuration for Portkey API
  • Headers for authentication with Portkey API
  • Model list and label customizations

Change Type

  • New feature (non-breaking change which adds functionality)

Testing

Tested the Portkey endpoint configuration by setting up the API connection with provided keys and verifying model fetching, header configurations, and response outputs. Validated model retrieval and display settings align with expected Portkey model responses.

Test Configuration:

  1. Set PORTKEY_API_KEY and PORTKEY_OPENAI_VIRTUAL_KEY in environment variables.
  2. Enabled caching and verified the model display label.
  3. Tested response latency and accuracy for models specified in the configuration.

Checklist

  • My code adheres to this project's style guidelines
  • I have performed a self-review of my own code
  • I have commented in any complex areas of my code
  • I have made pertinent documentation changes
  • My changes do not introduce new warnings
  • I have written tests demonstrating that my changes are effective
  • Local unit tests pass with my changes

@siddharthsambharia-portkey
Copy link
Contributor Author

Hey @danny-avila can you take a look at this? Thanks!

librechat.example.yaml Outdated Show resolved Hide resolved
@danny-avila danny-avila changed the title Update Portkey AI custom endpoint in librechat.example.yaml 📘 docs: Portkey AI custom endpoint in librechat.example.yaml Nov 23, 2024
@danny-avila danny-avila merged commit ecaf24d into danny-avila:main Nov 23, 2024
owengo pushed a commit to openwengo/LibreChat that referenced this pull request Nov 26, 2024
…-avila#4625)

* Update librechat.example.yaml with Portkey AI example

* Update librechat.example.yaml

---------

Co-authored-by: Danny Avila <[email protected]>
BertKiv pushed a commit to BertKiv/LibreChat that referenced this pull request Dec 10, 2024
…-avila#4625)

* Update librechat.example.yaml with Portkey AI example

* Update librechat.example.yaml

---------

Co-authored-by: Danny Avila <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants