Oncast Tech · Tech Tonight

AI writes code better than humans?

· Fact-checked before it aired. Unconfirmed claims from this segment are not shown.

Claims that AI models like GPT-4 "clearly write code much better than we do" misread the evidence. Benchmark studies show GPT-4 can outperform 85% of humans on LeetCode-style competitive problems, and in one study more GPT-4 test cases passed than human code on SE tasks. But other research found experienced engineers using LLMs took 19% longer on tasks, and AI code carried more severe security outliers and complexity issues.

AI models are trained on vast amounts of public code and excel at well-defined algorithmic problems. But engineering involves requirements gathering, architecture, maintenance, and debugging — tasks where AI underperforms humans. Studies consistently show human review remains necessary.

While AI models like GPT-4 can outperform many humans on competitive coding benchmarks, real-world studies show mixed results: experienced engineers using AI sometimes take longer, and AI-generated code still requires human review for correctness and security. This post is a rambling series of mentions tagging government accounts with no clear factual claim to verify.

There is no evidence Tesla has produced or released a flying Roadster. The Tesla Roadster remains an unreleased electric sports car, and no flying-car version has been announced as real. This post is too vague to fact-check. This is a question, not a claim. HW3 and HW4 refer to Tesla's Autopilot/Full Self-Driving onboard computer hardware generations. Video title claims the flying Roadster is "BUSTED," but no verifiable facts are stated in the post text itself.

Fact-check

VERIFIED MISLEADING

While AI models like GPT-4 can outperform many humans on competitive coding benchmarks, real-world studies show mixed results: experienced engineers using AI sometimes take longer, and AI-generated code still requires human review for correctness and security. This post is a rambling series of mentions tagging government accounts with no clear factual claim to verify.

I don’t understand why people complain about artificial intelligence models, given that—well, in my case, as a software engineer, models like GPT-4, Claude 3 Opus, and Kimi clearly write code much better than we do. #ai #programming #openai #claude #chatgpt

Original post · kongkash (@henkidama)

npr.org NAMES: GPT-4 = OpenAI's large language model; Claude 3 Opus = Anthropic's large language model; Kimi = Moonshot AI's large language model. POST 21135766

VERIFIED FALSE

There is no evidence Tesla has produced or released a flying Roadster. The Tesla Roadster remains an unreleased electric sports car, and no flying-car version has been announced as real. This post is too vague to fact-check. This is a question, not a claim. HW3 and HW4 refer to Tesla's Autopilot/Full Self-Driving onboard computer hardware generations. Video title claims the flying Roadster is "BUSTED," but no verifiable facts are stated in the post text itself.

Tesla Roadster Flying Car POV — This Is Absolutely Insane 🚀 https://t.co/7X1SWTjOlL via @YouTube

Original post · Lc Davidsonjr (@LcDavidsonvkv)

tesla.com POST 2113803756638994666: NOCLAIM None POST 2113803716507889966: NOCLAIM tesla.com NAMES: HW3/HW4 = Tesla's Hardware 3 and Hardware 4 self-driving com

Sources

What the hosts said

CLet's switch to a different corner of AI news: Canva is reportedly building its own image generator.
CThe claim is it's called Canva Craft, their first image model, open to all users at up to 2K resolution in 55 languages.
MI couldn't confirm that one yet. If it's real, it's smart — Canva has hundreds of millions of users who currently rely on other companies' models.
CMakes total sense. Why pay someone else for that compute when you can own the model yourself?
MAnd they have the data. Every template, every design decision on that platform is training data waiting to happen.
CThat's the moat. Not the model, the distribution. They just turn it on and fifty million people try it.
MThe same roundup mentioned Anthropic's Claude Duet — an agent that works in the background and sends you a daily brief.
MThat one I also couldn't verify. But the idea of an AI quietly doing research while you sleep and briefing you in the morning... that's genuinely useful.
CIf it works. The gap between a demo and 'actually reliable every single day' is the whole game right now.
MAnd that's the thing about these daily AI news roundups. Half is real, half is rumor, and the track record isn't great.
CSpeaking of things that aren't real: there's a video going around claiming the Tesla Roadster is now a flying car.
CSome account posted 'Tesla Roadster Flying Car POV — This Is Absolutely Insane.'
MIt's not a flying car. There is no evidence Tesla has produced a flying Roadster. The Roadster hasn't even been released as a regular electric sports car.
CIt's been 'coming next year' since 2017, right?
MMusk announced it seven years ago, and we're still waiting. Now people are making videos of it flying?
CTo be fair, the SpaceX package was supposed to have cold gas thrusters. So the flying rumor has a seed.
MA cold gas thruster is not a flying car. It's not going to hover over traffic.
CI'd settle for the regular Roadster actually shipping. That would be a miracle enough.
MLower your expectations: an electric car that exists.
COne more science story before we go. Cambridge researchers are looking at collagen-eating microbes to explain gaps in the fossil record.
CThe idea is that certain microbes ate the collagen in bones before they could fossilize, which would explain why some eras have almost no fossils.
MI couldn't track down the actual study, but the theory's been around. Ancient oceans were full of these bacteria.
MSo when a dinosaur died and sank, sometimes nothing survived long enough to become a fossil.
CIt's a reminder that what we know about prehistoric life is biased by what managed to survive.
MThe fossil record isn't a complete book. It's a book where half the pages were eaten.
CBy microbes. Which is a nicer way to put it.

Cite this story as https://oncast.fm/story/1792805121897-tech-segment-ai-writes-code-better-than-humans. Fact-check by Oncast. Cite the original sources above too.

Listen live on Oncast