Thoughts on how to validate Data Insights while leveraging LLMs

I wrote up a blog post on a framework to think about that even though we can use LLMs to generate code to DO Data Science we need additional tools to verify that the inferences generated are valid. I'm sure a lot of other members of this subreddit are having similar thoughts and concerns so I am sharing in case it helps process how to work with LLMs. Maybe this is obvious but I'm trying to write more to help my own thinking. Let me know if you disagree!

Data Science is a multiplicative process, not an additive one

I’ve worked in Statistics, Data Science, and Machine Learning for 12 years and like most other Data Scientists I’ve been thinking about how LLMs impact my workflow and my career. The more my job becomes asking an AI to accomplish tasks, the more I worry about getting called in to see The Bobs. I’ve been struggling with how to leverage these tools, which are certainly increasing my capabilities and productivity, to produce more output while also verifying the result. And I think I’ve figured out a framework to think about it. Like a logical AND operation, Data Science is a multiplicative process; the output is only valid if all the input steps are also valid. I think this separates Data Science from other software-dependent tasks.