-
Notifications
You must be signed in to change notification settings - Fork 3
Mini Experience Report
I wanted to give a mini experience report on building a tool by pairing with AI (in this case mainly ChatGPT 4 + a little Copilot).
The tool is very niche and not very interesting for 99% of the world but I thought the experience report might be more interesting to people.
I paired with ChatGPT for the following:
- Write the code (first in Go, then later I rewrote it in bash - the Go never got checked in)
- The README (docs)
- The logo design.
I'd estimate I spent about 4-5 days over evenings and weekends, it was at the very least a 50% reduction in my work load but possible as high as 75% of the text was written by ChatGPT. (there were a lot of iterations didn't get committed)
Overall I'd estimate the project was about 2 weeks worth of work. COCOMO model thinks it's more like 2 month (see scc report below) or about $7k
I did write a LOT of prompts to get the result I wanted. (The chat transcript is 2700 lines long of request and response with code etc -see other page). Debugging with ChatGPT most of the time was excellent, even if 50% of the issues where created by ChatGPT in the first place, but then the speed of code output was close to 90% faster: think I'd write a sentence or two, past in some previous code and maybe an error message and then with a second or so I'd get back an answer. Then I'd normally iterate 2-3 to get the answer I really wanted (not introduction unnecessary complexity / dependencies etc)
$ cloc . --exclude-dir=.idea
6 text files.
6 unique files.
2 files ignored.
github.com/AlDanial/cloc v 1.90 T=0.00 s (1269.6 files/s, 94459.4 lines/s)
--------------------------------------------------------------------------------
Language files blank comment code
--------------------------------------------------------------------------------
Markdown 1 52 0 137
Bourne Again Shell 1 24 0 107
YAML 2 4 0 38
Dockerfile 1 3 0 7
--------------------------------------------------------------------------------
SUM: 5 83 0 289
--------------------------------------------------------------------------------
$ scc
───────────────────────────────────────────────────────────────────────────────
Language Files Lines Blanks Comments Code Complexity
───────────────────────────────────────────────────────────────────────────────
YAML 2 42 4 0 38 0
BASH 1 131 24 1 106 18
Dockerfile 1 10 3 0 7 2
Markdown 1 189 52 0 137 0
gitignore 1 2 1 0 1 0
───────────────────────────────────────────────────────────────────────────────
Total 6 374 84 1 289 20
───────────────────────────────────────────────────────────────────────────────
Estimated Cost to Develop (organic) $7,337
Estimated Schedule Effort (organic) 2.12 months
Estimated People Required (organic) 0.31
───────────────────────────────────────────────────────────────────────────────
Processed 12160 bytes, 0.012 megabytes (SI)
───────────────────────────────────────────────────────────────────────────────