You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When AWS returns an error to the bedrock runtime client when streaming, it raises
undefined method `event_type=' for #<struct Aws::BedrockRuntime::Types::ThrottlingException message="Too many requests, please wait before trying again. You have sent too many requests. Wait before trying again.">
Expected Behavior
To be able to handle it with handler.on_error_event
Current Behavior
it raises
undefined method `event_type=' for #<struct Aws::BedrockRuntime::Types::ThrottlingException message="Too many requests, please wait before trying again. You have sent too many requests. Wait before trying again.">
Reproduction Steps
body = {
"prompt" => "Instructions: This is a test. Respond confirming a successful response\n\nHuman: (Taps, mic...) Is this thing on?\n\nAssistant: ",
"temperature": 0.7,
"max_tokens_to_sample": 1000000
}
Aws::BedrockRuntime::Client.new().invobe_model_with_response_stream({body: body.to_json, model_id: "anthropic.claude-v2})
Possible Solution
Give all the Aws::BedrockRuntime::Types::<X>event_type= method
Additional Information/Context
No response
Gem name ('aws-sdk', 'aws-sdk-resources' or service gems like 'aws-sdk-s3') and its version
aws-sdk-bedrockruntime (1.1.0)
Environment details (Version of Ruby, OS environment)
Ruby 3.0, macOS
The text was updated successfully, but these errors were encountered:
I've put out a PR for the fix, it will probably be reviewed Monday morning and hopefully released Monday or Tuesday. In the mean time, you can probably monkey patch the event_type member to the structure.
Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.
Describe the bug
When AWS returns an error to the bedrock runtime client when streaming, it raises
Expected Behavior
To be able to handle it with
handler.on_error_event
Current Behavior
it raises
Reproduction Steps
Possible Solution
Give all the
Aws::BedrockRuntime::Types::<X>
event_type=
methodAdditional Information/Context
No response
Gem name ('aws-sdk', 'aws-sdk-resources' or service gems like 'aws-sdk-s3') and its version
aws-sdk-bedrockruntime (1.1.0)
Environment details (Version of Ruby, OS environment)
Ruby 3.0, macOS
The text was updated successfully, but these errors were encountered: