Discussion about this post

User's avatar
Carlos's avatar

Pretty good, I think it's the most lucid take on AI I've seen, much better than the AI 2027 extravaganza.

Anthony's avatar

I don't think the issue with AGI is its inability to agree with our expected behavior, but rather the structure it uses to generate that behavior. Of the requirements you described I think 'common sense' would be the toughest to fulfill and it would be due to structural reasons. The LLM structure is designed to non-linearly correlate virtually any input set to any output set. It can align any two endpoints it is fed, even ones we deem to be nonsensical. Going from an LLM-style AI to an AGI is a massive jump in logic/epistemology criteria. In order to generalize, the AGI would have to use abstract and general modes of behavior via induction. If we take the example of a baby, it is not the case that it must see a thousand triangles to understand its abstract nature. Instead the baby already possesses the abstract notion of a triangle, and is then able to project that onto all sorts of things in the physical world. In fact, nobody has ever seen a triangle at all - they dont exist physically. The properties we recognize, then label and give to the AI as training data, are not properties of the objects we recognize but rather are internal properties that we map onto anything we see. This is done through induction, and its a well known result in epistemology that induction cannot be derived without circularity - i.e. you need induction to justify the use of induction. This is why formal systems just take induction as an axiom, since no amount of examples can take a statistical approximation to a true absolute generalization. If AGI is in any sense possible it will be due to programming a generalizable form of induction directly into the model's structure as a prior, something that is unsolved in epistemology and biology, yet clearly done by humans. The ability to generalize is not derivable from a data set, no matter how large.

No posts

Ready for more?