error when using litellm

[nima-hodhodi]

2024-12-25 12:08:55.296 | INFO | pr_agent.algo.utils:update_settings_from_args:621 - Updated setting IGNORE.GLOB to: "['.png', '.jpg', '.wav', '.dll', '.mp3', '.psd', '*.meta']"
2024-12-25 12:09:00.456 | INFO | pr_agent.tools.pr_reviewer:run:129 - Reviewing PR: http://185.86.181.211/nima/ai-merge/merge_requests/20 ...
2024-12-25 12:09:01.440 | INFO | pr_agent.algo.pr_processing:get_pr_diff:73 - PR main language: Other
2024-12-25 12:09:01.446 | INFO | pr_agent.algo.pr_processing:get_pr_diff:84 - Tokens: 1750, total tokens under limit: 8000, returning full diff.
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use litellm.set_verbose=True'. 2024-12-25 12:09:02.934 | WARNING | pr_agent.algo.ai_handlers.litellm_ai_handler:chat_completion:242 - Error during LLM inference: litellm.APIError: APIError: OpenAIException - Connection error. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new LiteLLM.Info: If you need to debug this error, use litellm.set_verbose=True'.

[krrishdholakia]

Connection error

looks like the openai / openai-compatible endpoint endpoint you're trying to call didn't respond.

I don't see a litellm-specific error here, let me know if i'm missing something (you can also try and debug this by setting litellm.set_verbose=True for more detailed debug logs)

closing for now - feel free to reopen/bump me if you can see it being litellm-related