feat: add reasoning engine + multimodal agent sample notebook

[Abhishekbhagwat]

No description provided.

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[kanchpat]

LGTM

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

RajeshThallam commented on 2024-10-16T21:24:24Z
----------------------------------------------------------------

1. Update links
2. Clear outputs

[review-notebook-app]

View / edit / reply to this conversation on ReviewNB

RajeshThallam commented on 2024-10-16T21:24:25Z
----------------------------------------------------------------

Add a cleanup step to delete datastore and deployed agent.

Check this notebook: https://github.com/GoogleCloudPlatform/applied-ai-engineering-samples/blob/main/research-operationalization/timesfm/operationalizing_timesfm_on_vertexai.ipynb

[RajeshThallam]

@code-review-assist review the notebook

[code-review-assist]

This pull request adds support for a reasoning engine and includes a sample notebook demonstrating a multimodal agent. This enhances the repository with valuable tools and examples. The documentation updates in mkdocs.yml and the reasoning engine README effectively guide users. A minor suggestion for the .gitignore file is to add a comment explaining the purpose of the added line. Overall, the changes are well-structured and contribute positively to the project.

[code-review-assist]

It's good practice to include a comment explaining what this line ignores. For instance, if it's intended to ignore a nix cache directory, a comment like # Ignore nix cache directory would improve clarity and maintainability.

Suggested change

	.idx/dev.nix
	.idx/dev.nix # Ignore nix cache directory

[code-review-assist]

The "Overview" entry for Vertex AI Extensions is duplicated. While this might be intentional, it could be confusing. Consider removing the duplicate entry or adding a comment to clarify its purpose.

Suggested change

	- Overview: genai-on-vertex-ai/vertex_ai_extensions/README.md
	- Vertex AI Extensions:

[code-review-assist]

Minor suggestion: Change "end to end" to "end-to-end" for better readability.

Suggested change

	In this set of notebooks, we will explore how to build an end to end agent with Langchain and deploy it on Vertex AI Reasoning Engine.
	In this set of notebooks, we will explore how to build an end-to-end agent with Langchain and deploy it on Vertex AI Reasoning Engine.

[RajeshThallam]

@code-review-assist Review jupyter notebook (.ipynb)

[code-review-assist]

This pull request adds support for a reasoning engine and includes a sample notebook demonstrating a multimodal agent. This enhances the repository with valuable features for building more complex and interactive AI applications. The documentation updates in mkdocs.yml and the README effectively reflect these additions. A minor suggestion for the .gitignore file is to add a comment explaining the purpose of the ignored files. Overall, the changes are well-structured and contribute positively to the project.

[code-review-assist]

Adding a comment explaining the purpose of ignoring .idx/dev.nix would improve the clarity of this entry. For example, is this related to a specific development environment or tool?

Suggested change

	.idx/dev.nix
	.idx/dev.nix # Ignore IDX development environment files

[code-review-assist]

The "Overview" link appears twice under Agents. One of these entries should be removed to avoid redundancy and maintain clarity in the navigation structure.

Suggested change

	- Overview: genai-on-vertex-ai/vertex_ai_extensions/README.md
	- Vertex AI Extensions:
	- Overview: genai-on-vertex-ai/vertex_ai_extensions/README.md

[code-review-assist]

Using a relative path or the full URL to the notebook on GitHub would make the link more robust and platform-independent. Currently, the path assumes a specific directory structure, which might not be applicable in all contexts.

Suggested change

	1. [Multimodal Google Nest Support / Concierge Agent](genai-on-vertex-ai/agents/reasoning_engine/langchain_on_reasoning_engine/multimodal_google_nest_support_agent_w_langchain_reasoning_engine.ipynb) - This agent takes a video of the user describing their issues about Google Nest products, uses a combination of Gemini multimodality as well as Vertex AI Search to solve customer issues.
	1. [Multimodal Google Nest Support / Concierge Agent](./multimodal_google_nest_support_agent_w_langchain_reasoning_engine.ipynb) - This agent takes a video of the user describing their issues about Google Nest products, uses a combination of Gemini multimodality as well as Vertex AI Search to solve customer issues.