Tom Ritchford
1 min readOct 27, 2023

--

But the code is bad. Your client code has no way to tell the difference between an error, and a JSON file containing only "null". And you have no idea where sys.stdout is going - that print statement might be thrown away or it might even be incorrectly put into your output file.

A competent human would detect this. I would never allow this beginner-level code in any codebase I had anything to do with.

It might seem like I'm nitpicking with these complaints, but the point is that LLMs operate at the level of a sloppy beginner.

I went through an LLM phase, and I realized it took me more time than doing it myself.

The tiny amounts of typing I saved were less than the time I had to spend proofreading and correcting the code; and for non-trivial things, it would simply make up bullshit some portion of the time.

--

--

No responses yet