The Eternal Sloptember
geohot.github.io
I’m calling it now, the adoption of AI agents into software development will be one of the most costly mistakes in the field’s history. Agents cannot program, and it’s taking longer and longer to realize that they can’t. They are a highly sophisticated statistical model designed to mimic the distribution of programming. The output is broken, but in a way that’s getting harder and harder to detect. Which is exactly what you’d expect from an increasingly accurate statistical model.

I’m calling it now, the adoption of AI agents into software development will be one of the most costly mistakes in the field’s history. Agents cannot program, and it’s taking longer and longer to realize that they can’t. They are a highly sophisticated statistical model designed to mimic the distribution of programming. The output is broken, but in a way that’s getting harder and harder to detect. Which is exactly what you’d expect from an increasingly accurate statistical model.

  • NaibofTabr@infosec.pubEnglish
    1·
    2 months ago

    One of the most widely commented things about DNNs is that we don’t really understand them completely. I don’t know how you would miss that if you knew anything about AI at all.

    No one who actually works on digital neural networks thinks this. We may not be able to predict the behavior of a particular neural network with certainty (because there are a lot, like millions, of variables), but that does not mean that we don’t understand how they work.

    Which part of the brain do you think is impossible to simulate with maths?

    simulation ≠ reality

    • FizzyOrange@programming.dev
      1·
      2 months ago

      simulation ≠ reality

      Yes it is, if your simulation is sufficiently accurate. Let me rephrase. Which part of the brain do you think has behaviour that is required for intelligence/consciousness and that behaviour cannot be replicated with sufficient accuracy on a computer (of arbitrary capacity)?