AI Question answering Model

[rheophile10]

Janet, I'm not totally sure what to do on this one

[jlastwood]

The AI task is the same as this https://python.plainenglish.io/whatsapp-app-to-generate-a-4-page-business-plan-using-gpt-3-api-python-django-and-meta-api-c53f7ed2a86b. We will generate a Project Plan using AI. When project manager create a plan there are some concrete factor like start date, end date, and people assignments, but there is quite a bit of narrative, these are difficult for PM´s to complete and usually difficult to get out of the stakeholders. The implementation is in the plan file (button Ask me). Ask me generates the correctly formatted question and the context, then calls the model to provide the answer. In my code is working ChatGPT solution, you can turn it on and test if you generate an OpenAI key, the one I was using has expired. I prefer to replace chatGPT with a hugging face model open source because I do not want to be tied to a commercial solution but this articles explains the challenge https://analyticsindiamag.com/huggingchat-vs-chatgpt-the-chat-battle-has-now-begun. this article says that huggingface cannot do what chatgpt is doing.

[jlastwood]

I am not sure which model to try, https://huggingface.co/gpt2. The challenge of this task is probably the selection of a model that is trained to answer questions about the subject project management. https://huggingface.co/models?pipeline_tag=text-generation&p=2&sort=trending. Only need English at this time, other languages are not in scope for a while.

[rheophile10]

there are a bunch of models available through google cloud and we'll make this so that we can swap out models easily so you can try a bunch. I put up a basic chat interface for streamlit today and I'll plug an llm into it later. the docs have examples for openai specifically but I want to stay llm agnostic as much as possible.

I would really like to build a CICD flow for this in a google cloud project. There are going to be api secrets for using whatever LLM we are going to use and I like to encrypt the .env file they go in using google cloud keyring when I am launching a service. Can we move to google cloud?