When all you have is an LLM, then all you see are language problems. And while many things are language problems, there are many more things that look like language problems that are actually people problems, design problems, math problems, economics problems, or incentive problems, to name a few.
Even with the enormous help of AI, we must still follow the problem—solution chain and first be very clear about the problem we’re solving, and then work on an appropriate solution.