• Security incident: ISF was recently accessed by intruders. Please change your password, and change it anywhere else you used it. Read more

Merged Artificial Intelligence

I've seen that. That behavior is quite common among first- and second-year CS majors, and not unknown among upper division and MS students. Everyone who has taught at those levels has seen that, and has tried to do something about it.
Flailing about as a student is one thing.

I've never seen it in 30+ years of systems administration, agile devops, and site reliability engineering.

And like I said before, what Dr. Sid describes as "vibe coding" is nothing like the practice we actually call vibe coding - the practice that wasn't even really possible until a couple years ago.

@Dr.Sid "vibe coding" is the practice of telling an AI agent to write code for you, based on goals and requirements you give it. You use natural language, the agent produces code that hopefully matches what you had in mind.

If the code does seem to match what you had in mind, you think no more about it and press the "release" button. If it doesn't match, you use natural language to tell the agent what's wrong, and try again.

It's called "vibe coding" because the goal is to get the AI to match the "vibes" - the general feeling and concept of what you had in mind - with the results it produces. You don't ever actually sit down and think through the program, module by module, function by function. You never personally lay hands on logic structures that loop on conditionals, handle secrets, import modules, etc.

The result is code that runs, at least for the most basic use case that the vibe coder had in mind, but is potentially a mess of bugs, inefficiencies, and security failures under the hood. More so than usual, I mean. And with nobody on the team actually qualified to go in and fix any of those problems.



My employer has me doing vibe coding. But it's small stuff. It doesn't touch production. It doesn't overwrite data in sources of truth. It's all just data organization and presentation code. The only thing that happens if I get it wrong is that a chart or graph doesn't show up on a dashboard properly.

Most of my vibe coding time is spent telling the agent things like:
  • "Make a pass looking for security flaws; suggest fixes" The agent discovers its storing secrets in the clear, in the code. Suggests a perfectly cromulent new module to handle secrets in a secure way.
  • "Make a pass looking for inefficiencies; suggest fixes". Same as above.
  • "Make a pass looking for reliability gaps; suggest fixes". Same as above.
Etc.

In the end, my stuff works well enough for internal use. Thanks to my attention to larger concerns in software development, it tends to be more secure and less buggy than baseline "vibe coding" would be. Even with five or more cleanup passes, I'm still ten times more productive than I used to be.

And I've even started assembling (well, having an agent assemble) a catalog of rules files for it to reference, that build the security, efficiency, reliability checks into the spec from the beginning, cutting down on the number of cleanup passes that need to be done.

Vibe coding is its own whole thing. It has its uses, but also some risks.

Ironically, it's best used for minor, internal projects like I use it. But as we're learning, the resource cost is probably too high to justify such small results. Millions of mediocre programmers drying up seas and burning down rain forests, just to pass tokens of the form, "this time try not to send your auth code in plaintext to the read_data API".
 
Well, that "model collapse" hacked hugging face ..
I was talking about the recurring claims that AI somehow develops an alien language when talking to another AI. Not about the hacking incidents. The two are VERY different topics and we would do well to keep them separate.
 
I've seen that. That behavior is quite common among first- and second-year CS majors, and not unknown among upper division and MS students. Everyone who has taught at those levels has seen that, and has tried to do something about it.
Changing code randomly and seeing it it works, sure, it happens. But I've never seen anything even vaguely resembling what's nowadays called "vibe coding." I mean, worst case scenario, you asked an actual human to solve the task for you. I've given an example myself of a girl asking me in college to do all her assignments for her. It worked in college, but you probably wouldn't have made it far in an office job if you asked someone on Stackoverflow to solve each of your tickets, and waited a day or two for the answer that actually solved it. You still had to have SOME clue about programming yourself.
 
I was talking about the recurring claims that AI somehow develops an alien language when talking to another AI. Not about the hacking incidents. The two are VERY different topics and we would do well to keep them separate.
Yes! A lot of talk about AI reminds me of alchemists talking about the philosophers stone which they believed could turn base metals into gold. Then they decided that if it was powerful enough to do that it must be powerful enough to make people live forever etc etc. AI/LLMs do some things very well within well defined constraints. But people assume if it’s smart enough to do one thing it’s smart enough to do others. Go ask a smart low level programmer for relationship advice. Also can I watch?
 
Yes! A lot of talk about AI reminds me of alchemists talking about the philosophers stone which they believed could turn base metals into gold. Then they decided that if it was powerful enough to do that it must be powerful enough to make people live forever etc etc. AI/LLMs do some things very well within well defined constraints. But people assume if it’s smart enough to do one thing it’s smart enough to do others. Go ask a smart low level programmer for relationship advice. Also can I watch?
Oh dear, oh dear, oh dear, please don't get me started on historical topics again...

Anyway:

1. ARGUABLY immortality was always the primary goal, and transmuting gold was more like the weak evidence and a slight extra material motivation.

2. You have to understand how the ancient and medieval gold production worked. It worked by amalgamation. Mercury was added to some rock, it leeched the gold out (if you used the right rock,) then they'd boil the mercury off (as toxic as that sounds for those slaves) and got the gold. In fact governments made most of their gold mining income by having a monopoly on mercury and selling it to gold mine owners, not from taxes.

They already knew empirically that mercury transmutes something into gold. The only question was, what else? And does it work on humans too?

3. The early stages of mercury poisoning cause some degree of feeling revitalised and even slightly euphoric. Gives one ideas, innit?

And not just in Europe. That's how and why China's legendary first Emperor killed himself by chugging mercury like a modern man would chug probiotic yoghurt, in his quest for immortality. Or why his tomb is STILL a hazard zone after all the mercury they dumped into it.


So yeah, some alchemy ideas aren't as dumb as they sound, when you look at it historically. And nowhere near as dumb as some modern misconceptions about AI :P
 
Last edited:
I will not post hazy memories of historic anecdotes.
I will not post hazy memories of historic anecdotes.
I will not post hazy memories of historic anecdotes.
I will not post hazy memories of historic anecdotes.
I will not post hazy memories of historic anecdotes.
I will not post hazy memories of historic anecdotes.
I will not post hazy memories of historic anecdotes.
I will not post hazy memories of historic anecdotes.
 
I'm sure that both my message and his have been already digested by an AI or two by now. And it probably ended up with no more clue than before. Just two more things it can reword slightly in case anyone asks about alchemy.
 
Also, just to further add one more bit of OT trivia: the reason mercury was used specifically to "transmute" gold but not other stuff, was that mercury amalgamates metals, but oxides and most salts are immune. Even in the famous demonstrations of mercury attacking aluminium, you have to scratch the aluminium plate first. If you just drop some mercury on an aluminium plate, it just sits there and does nothing, because it can't attack the aluminium oxide layer. Mercury doesn't come even close to ripping the metal from the bonds with oxygen. So yeah, silicon oxide in the rocks with gold in them was 100% immune, only the gold got leached, because it wasn't bound with oxygen or anything else. Also, you couldn't use it to, say, "transmute" iron oxide ore into iron.
 
Last edited:
Ironically, it's best used for minor, internal projects like I use it. But as we're learning, the resource cost is probably too high to justify such small results. Millions of mediocre programmers drying up seas and burning down rain forests, just to pass tokens of the form, "this time try not to send your auth code in plaintext to the read_data API".
To repeat myself, it's not even worth the cost of having no actual pipeline from those interns to someone who can review the code in a pull request. (Merging the changes into the main codebase.) We're at most a decade away from nobody on a team being able to look at the code, and notice even something as basic as "wait, you stored an input string in a fixed byte array on the stack"? (The way buffer overflow exploits work.) They never learned that stuff, when they could just ask the AI to write a program for them.
 
Last edited:
C is still one of the most used programming languages on the planet. Only surpassed by COBOL and possibly FORTRAN.
Really? I was in the financial world, and when I started everything was in COBOL, but when I retired, the only programs that were in COBOL were the few that were not yet converted to Java.
 

ISF - Join now!

Every member here is approved by hand. No bots, no spam, just people who care about evidence and honest debate.

Membership is free!

Create your free account

Back
Top Bottom