Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🚀 Feature: support emitting events for prompts in addition to current behavior #2456

Open
1 of 21 tasks
nirga opened this issue Jan 2, 2025 · 10 comments
Open
1 of 21 tasks
Labels
💎 Bounty enhancement New feature or request

Comments

@nirga
Copy link
Member

nirga commented Jan 2, 2025

Which component is this feature for?

All Packages

🔖 Feature description

Fix the following packages and their tests:

  • AlephAlpha
  • Anthropic
  • Bedrock
  • Cohere
  • Google Generative AI
  • Groq
  • Langchain
  • LlamaIndex
  • Mistral AI
  • Ollama
  • OpenAI
  • Replicate
  • SageMaker
  • Together
  • Transformers
  • VertexAI
  • WatsonX

🎤 Why is this feature needed ?

Full compliance with new semantic conventions

✌️ How do you aim to achieve this?

See new OpenAI instrumentation for inspiration.

  • Make sure to keep the current way of emitting events and the new (event-based) way with the official semantic conventions.
  • Add a config to each instrumentation called use_legacy_attributes which defaults to true, and if set to false emit events instead of the prompt / completion attributes.
  • Propagate a new initialization parameter of the SDK called use_legacy_attributes that sets this config in all instrumentations.

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

  • I checked and didn't find similar issue

Are you willing to submit PR?

None

@nirga
Copy link
Member Author

nirga commented Jan 2, 2025

/bounty $1200

Copy link

algora-pbc bot commented Jan 2, 2025

💎 $1,200 bounty • traceloop

Steps to solve:

  1. Start working: Comment /attempt #2456 with your implementation plan
  2. Submit work: Create a pull request including /claim #2456 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to traceloop/openllmetry!

Add a bountyShare on socials

Attempt Started (GMT+0) Solution
🔴 @akv2011 Jan 2, 2025, 4:06:44 PM WIP
🟢 @itsparser Jan 2, 2025, 6:10:34 PM WIP
🟢 @maliniv1530 Jan 2, 2025, 7:31:59 PM WIP
🟢 @gerred Jan 2, 2025, 11:35:19 PM #2476
🟢 @sanjay7178 Jan 3, 2025, 3:35:43 AM WIP
🟢 @SAIKIRANSURAPALLI Jan 3, 2025, 5:57:40 AM WIP

@akv2011
Copy link

akv2011 commented Jan 2, 2025

@nirga is there a hard deadline to generate pr?

@nirga
Copy link
Member Author

nirga commented Jan 2, 2025

@akv2011 ideally by Monday 6/1

@itsparser
Copy link

itsparser commented Jan 2, 2025

/attempt #2456

@akv2011
Copy link

akv2011 commented Jan 2, 2025

/attempt #2456

@maliniv1530
Copy link

maliniv1530 commented Jan 2, 2025

/attempt #2456

3 similar comments
@gerred
Copy link

gerred commented Jan 2, 2025

/attempt #2456

@sanjay7178
Copy link

sanjay7178 commented Jan 3, 2025

/attempt #2456

@SAIKIRANSURAPALLI
Copy link

SAIKIRANSURAPALLI commented Jan 3, 2025

/attempt #2456

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💎 Bounty enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

7 participants