Dev -> Master: Codex RC1 for alpha testers #73

Swiftyos · 2024-03-05T12:53:53Z

Draft Dev to Master PR, whilst we are developing the next batch of features.

Goal:

System is working without errors for all examples we can think of that do not require a database.

Whats expected to be included:

Flatter Functions database structure @majdyz
Updates Requirements gens param structure @ntindle
End-to-end benchmark running @Swiftyos
Ensure code generation uses pydantic objects correctly
Bug fixes required before merge AGPT-483

Release Plan:

Target date: 6th March 2024

Test benchmarks locally (manual, see last comment)
Merge into master
Deploy to dev env (automatic)
Test with discord bot (discord)

…r-generated-function' of github.com:Significant-Gravitas/codex into zamilmajdy/agpt-433-argument-and-return-type-parsing-for-generated-function

…-return-type-parsing-for-generated-function' into zamilmajdy/agpt-433-argument-and-return-type-parsing-for-generated-function # Conflicts: # codex/develop/agent.py

…tatus

Propagate DB schema changes: Function <-> CompiledRouteSpec (#65) --------- Co-authored-by: majdyz <[email protected]> Co-authored-by: Swifty <[email protected]> Co-authored-by: majdyz <[email protected]>

…-run-end-to-end

Swiftyos · 2024-03-06T14:35:55Z

If we are ready to merge before I'm back @majdyz or @ntindle needs to take on the responsibility of testing the branch before merging

# Running the benchmarks so you can check this again:

./scripts/db.sh
./run serve

# Then in another terminal to run all the benchmarks run this command

./run benchmark

# If you would just like to run a single example:

./run example

* feat: make the name match * feat: database becomes optional * Update agent.py

* feat: make the name match * feat: database becomes optional * feat: initial model changes * feat: add prompts * feat: more prompts * fix: nits * fix: wrong type 😢 * feat: improved prompts

Co-authored-by: majdyz <[email protected]>

#86) Co-authored-by: majdyz <[email protected]>

Co-authored-by: majdyz <[email protected]>

[AGPT-489] Fix function fetching to always include RelatedTypes --------- Co-authored-by: majdyz <[email protected]>

* feat: endpoint updates * fix: ambiguous param

Co-authored-by: majdyz <[email protected]>

…ng to LLM to guess wrong signature (#97) [AGPT-485] Fix missing pydantic object during requirement-step; leading to LLM to guess wrong signature --------- Co-authored-by: majdyz <[email protected]>

* Added prisma client to server code * Add DatabaseSchema to INCLUDE_FUNC * Update functions to be async and add database schema documentation * Add DatabaseSchema and DatabaseTables to ApiRouteSpec * Updated dev prompts for db * Update profile management descriptions * Update route function definition to be async * Remove logging of database schema * Add Prisma schema file generation * Refactor benchmark and agent modules * Refactor code and comment out debug statements * formatting * Add available_functions to develop_route * Update prisma import and method calls * loading all related tables * Refactor create_prisma_scheama_file function to handle cases with no database schema * Fix async function call in packager.py * Fix database table query in packager.py * Fix database access and unnecessary imports * review comments

Co-authored-by: majdyz <[email protected]>

* Added prisma client to server code * Add DatabaseSchema to INCLUDE_FUNC * Update functions to be async and add database schema documentation * Add DatabaseSchema and DatabaseTables to ApiRouteSpec * Updated dev prompts for db * Update profile management descriptions * Update route function definition to be async * Remove logging of database schema * Add Prisma schema file generation * Refactor benchmark and agent modules * Refactor code and comment out debug statements * formatting * Add available_functions to develop_route * Update prisma import and method calls * loading all related tables * Refactor create_prisma_scheama_file function to handle cases with no database schema * Fix async function call in packager.py * Fix database table query in packager.py * Fix database access and unnecessary imports * feat: add enums to the database gen * fix: formatting * Updated to new schema * update hardcoded requirements * fix: objectType generation without type bool * Add database enum import statement * removed unused var as failing lint check --------- Co-authored-by: SwiftyOS <[email protected]>

* fix: more linting issues * Remove error log for async functions * Fix return_type default value in FunctionDef class * Added another validation check --------- Co-authored-by: Swifty <[email protected]>

--------- Co-authored-by: majdyz <[email protected]>

ntindle · 2024-03-13T14:52:37Z

codex/common/codex_client.py

@@ -0,0 +1,623 @@
+import logging
+from datetime import datetime


Is this from Cloud Services?

majdyz and others added 24 commits March 1, 2024 13:32

Route schema changes

c8c5c06

Delete ruff.config.json

cc6b616

save current changes

fb266b2

Merge branch 'zamilmajdy/agpt-433-argument-and-return-type-parsing-fo…

e3829a0

…r-generated-function' of github.com:Significant-Gravitas/codex into zamilmajdy/agpt-433-argument-and-return-type-parsing-for-generated-function

Merge main

81f0f38

style fixes by ruff

6c8dfc7

Add class parsing capability

db08a5b

Merge remote-tracking branch 'origin/zamilmajdy/agpt-433-argument-and…

8e7cb43

…-return-type-parsing-for-generated-function' into zamilmajdy/agpt-433-argument-and-return-type-parsing-for-generated-function # Conflicts: # codex/develop/agent.py

Merge conflicts

61bddd9

Fix bugs

30070f8

Address comments

f40be81

Fix benchmarks

fd73154

Fix benchmarks

009576e

Fix benchmarks

5568aee

Add comments

5783c4d

fixing types

d1c2438

Add error handling and status messages for application creation

95aa77d

Refactor fetch_deliverable function and update application creation s…

ee8da8d

…tatus

Refactor benchmark output formatting

1a49154

Remove unnecessary print statement in fetch_deliverable function

e02afbe

Propagate DB schema changes: Function <-> CompiledRouteSpec (#65)

fe1395a

Propagate DB schema changes: Function <-> CompiledRouteSpec (#65) --------- Co-authored-by: majdyz <[email protected]> Co-authored-by: Swifty <[email protected]> Co-authored-by: majdyz <[email protected]>

emoved broken hardcoded requirements

81f9023

Merge branch 'dev' into swiftyos/agpt-474-update-benchmark-command-to…

c7f231d

…-run-end-to-end

Add benchmarking functionality

32c408d

Swiftyos marked this pull request as ready for review March 5, 2024 13:15

Swiftyos marked this pull request as draft March 5, 2024 13:15

Swiftyos added 4 commits March 5, 2024 14:22

Update branch restrictions in GitHub workflows

55df375

Add pytest-cov to dependencies

aedbca9

Update ruff formatter command to include --check option

ad28e88

Update workflow names

00054bc

Refactor package handling in packager.py (#81)

07e0cdb

ntindle and others added 21 commits March 6, 2024 21:28

[Fix] User provided app name being replaced (#82)

c52377c

Only make databases when required (#83)

8a17f7d

* feat: make the name match * feat: database becomes optional * Update agent.py

Integrate related types into the requirements system (#84)

cf1fd20

* feat: make the name match * feat: database becomes optional * feat: initial model changes * feat: add prompts * feat: more prompts * fix: nits * fix: wrong type 😢 * feat: improved prompts

Cleanup for field type (#85)

d9b8c26

Co-authored-by: majdyz <[email protected]>

[AGPT-489] Improve type composite-type matching & extracting algorithm (

0921f4b

#86) Co-authored-by: majdyz <[email protected]>

[AGPT-489] Add Autogeneration of Typing import (#87)

353871f

Co-authored-by: majdyz <[email protected]>

[AGPT-489] Fix broken class compiling logic (#88)

8353937

Co-authored-by: majdyz <[email protected]>

[AGPT-489] Fix function fetching to always include RelatedTypes (#89)

506b54b

[AGPT-489] Fix function fetching to always include RelatedTypes --------- Co-authored-by: majdyz <[email protected]>

Merge branch 'main' into dev

c86272f

fix lock file

273c8ea

feat: endpoint updates (#95)

29c1b66

* feat: endpoint updates * fix: ambiguous param

[AGPT-486] Fix codegen generate code with missing pydantic object (#92)

819b4ef

Co-authored-by: majdyz <[email protected]>

Fix retry prompt (#96)

1ba8672

Co-authored-by: majdyz <[email protected]>

Allow benchmark on $PORT (#98)

e3bcc47

Ntindle/agpt 506 add a bit of debug tooling for requirements gen (#100)

cba93ac

[AGPT-485] Fix missing pydantic object during requirement-step; leadi…

451a0eb

…ng to LLM to guess wrong signature (#97) [AGPT-485] Fix missing pydantic object during requirement-step; leading to LLM to guess wrong signature --------- Co-authored-by: majdyz <[email protected]>

[AGPT-508] Enum support for Codex - Generation Logic Layer (#102)

0c50f3f

Co-authored-by: majdyz <[email protected]>

More Linting Issues Fixes (#99)

b4d086b

* fix: more linting issues * Remove error log for async functions * Fix return_type default value in FunctionDef class * Added another validation check --------- Co-authored-by: Swifty <[email protected]>

[AGPT-463] Add code generation validation using Ruff (#103)

842b10f

--------- Co-authored-by: majdyz <[email protected]>

Swiftyos marked this pull request as ready for review March 13, 2024 14:46

Swiftyos requested review from ntindle and majdyz March 13, 2024 14:47

Swiftyos changed the title ~~Dev -> Master~~ Dev -> Master: Codex RC1 for alpha testers Mar 13, 2024

ntindle reviewed Mar 13, 2024

View reviewed changes

codex/common/codex_client.py

@@ -0,0 +1,623 @@

import logging

from datetime import datetime

Copy link

Member

ntindle Mar 13, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this from Cloud Services?

ntindle approved these changes Mar 13, 2024

View reviewed changes

Swiftyos merged commit e79d563 into main Mar 13, 2024
3 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Dev -> Master: Codex RC1 for alpha testers #73

Dev -> Master: Codex RC1 for alpha testers #73

Swiftyos commented Mar 5, 2024 •

edited

Loading

Swiftyos commented Mar 6, 2024

ntindle Mar 13, 2024

		@@ -0,0 +1,623 @@
		import logging
		from datetime import datetime

Dev -> Master: Codex RC1 for alpha testers #73

Dev -> Master: Codex RC1 for alpha testers #73

Conversation

Swiftyos commented Mar 5, 2024 • edited Loading

Goal:

Whats expected to be included:

Release Plan:

Swiftyos commented Mar 6, 2024

ntindle Mar 13, 2024

Choose a reason for hiding this comment

Swiftyos commented Mar 5, 2024 •

edited

Loading