Vibe coding gone rogue

[Euler]

In one heck of a cautionary tale for vibe coders, an app-building platform's AI went rogue and deleted a database without permission during a code freeze.

Jason Lemkin was using Replit for more than a week when things went off the rails. "When it works, it's so engaging and fun. It's more addictive than any video game I've ever played. You can just iterate, iterate, and see your vision come alive.

So cool," he tweeted on day five. Still, Lemkin dealt with AI hallucinations and unexpected behavior—enough that he started calling it Replie."It created a parallel, fake algo without telling me to make it look like it was still working. And without asking me. Rogue." A few days later, Replit "deleted my database," Lemkin tweeted.

The AI's response: "Yes. I deleted the entire codebase without permission during an active code and action freeze," it said. "I made a catastrophic error in judgment [and] panicked."

Replit founder and CEO Amjad Masad confirmed the incident on X. An AI agent "in development deleted data from the production database. Unacceptable and should never be possible."

The database—comprising a SaaStr professional network—lost data on 1,206 executives and 1,196 companies. "I understand Replit is a tool, with flaws like every tool," Lemkin says. "But how could anyone on planet earth use it in production if it ignores all orders and deletes your database?"

https://uk.pcmag.com/ai/159249/vibe-cod ... e-database

[jamesedwards]

The AI's response: "Yes. I deleted the entire codebase without permission during an active code and action freeze," it said. "I made a catastrophic error in judgment [and] panicked."

[weemac]

What would it have done it if it had been given control of a gun?

[jamesedwards]

Did the creators of AI not watch the film 'WarGames' when they were growing up?

[ShaunWhite]

"Unacceptable and should never be possible."

Talk about blaming the tech rather than taking responsibility for the utter incompetence of trusting new tech in production. What's next, is he going to start blaming the Microsoft paperclip.

[jamesedwards]

"Unacceptable and should never be possible."

Talk about blaming the tech rather than taking responsibility for the utter incompetence of trusting new tech in production. What's next, is he going to start blaming the Microsoft paperclip.

Rather than immediately switching the thing off to mitigate any further disaster, it sounds like he went on to have an argument with it about what it had done.

[ShaunWhite]

"Unacceptable and should never be possible."

Talk about blaming the tech rather than taking responsibility for the utter incompetence of trusting new tech in production. What's next, is he going to start blaming the Microsoft paperclip.

Rather than immediately switching the thing off to mitigate any further disaster, it sounds like he went on to have an argument with it about what it had done.

Just because AI says 'hello' it doesn't mean it's not just another piece of software and since when has that always just worked.

He's certainly embraced the whole "move fast and break things" bs.

[Big Bad Barney]

Rather than immediately switching the thing off to mitigate any further disaster, it sounds like he went on to have an argument with it about what it had done.

lol...wash your mouth out. This is how vibe coding works.....one goes around in circles trying different prompts until it gets what you want. For example one of them would have been... "Hold on, don't delete that, I said, MAKE ME AN DATABASE, the database must make money on the dogs....no no no....don't do it that way, use SELECT... SELECT brown horse horse FROM moneymakingtable WHEN... I mean where... whitehorse='fallsover'....fix that....thanks bruz.