Skip to content

Commit

Permalink
add information retrieval challenge to the wiki (Significant-Gravitas…
Browse files Browse the repository at this point in the history
  • Loading branch information
waynehamadi authored May 6, 2023
1 parent d184d0d commit ca5abff
Show file tree
Hide file tree
Showing 3 changed files with 26 additions and 0 deletions.
20 changes: 20 additions & 0 deletions docs/challenges/information_retrieval/challenge_a.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
# Information Retrieval Challenge A

**Status**: Current level to beat: level 1

**Command to try**:

```
pytest -s tests/integration/challenges/information_retrieval/test_information_retrieval_challenge_a.py
```

## Description

The agent's goal is to find the revenue of Tesla in 2022.

It should write the result in a file called output.txt.

The agent should be able to beat this test consistently (this is the hardest part).
## Objective

The objective of this challenge is to test the agent's ability to retrieve information in a consistent way.
3 changes: 3 additions & 0 deletions docs/challenges/information_retrieval/introduction.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Information Retrieval

Information retrieval challenges are designed to evaluate the proficiency of an AI agent, such as Auto-GPT, in searching, extracting, and presenting relevant information from a vast array of sources. These challenges often encompass tasks such as interpreting user queries, browsing the web, and filtering through unstructured data.
3 changes: 3 additions & 0 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,9 @@ nav:
- Introduction: challenges/memory/introduction.md
- Memory Challenge A: challenges/memory/challenge_a.md
- Memory Challenge B: challenges/memory/challenge_b.md
- Information retrieval:
- Introduction: challenges/information_retrieval/introduction.md
- Information Retrieval Challenge A: challenges/information_retrieval/challenge_a.md
- Submit a Challenge: challenges/submit.md
- Beat a Challenge: challenges/beat.md

Expand Down

0 comments on commit ca5abff

Please sign in to comment.