Introduction We are entering a period where technology is being reimagined, just as it was during the industrial revolution. With the advent of powerful AI systems, it becomes possible to revolutionize computers, software applications, and operating systems. This essay explores the future of software and operating systems from the perspective of AI advancement and first […]
There is a great deal of debate about whether large language models like GPT-4 possess artificial general intelligence. In this author’s opinion, language models like GPT-4 do possess a type of general intelligence. This is an alien form of intelligence that is episodic in nature. The would seem to be the opinion of Microsoft researchers […]
NLP models often work by autoregressively predicting the next word in a text sequence. This is a highly specific task. This does not appear to be optimized to produce generalization. To produce more generalization, I propose two changes. Training Method to Produce More Generalization: Start with a pre-trained model (e.g., GPT-3). Create a strong paraphrase […]
Categories
Google GATO: A Path to AGI?
On May 12, 2022, Google’s DeepMind released Gato, which they described as a “generalist agent.” They were able to use a single transformer architecture to train an agent that could perform 600 different tasks including captioning images, playing video games, and moving real robotic arms. In my opinion, this does seem like it could be […]
Introduction One aspect of evaluating a theory is to consider the breadth of phenomena that it can explain. A theory of intelligence would be stronger if it explained how “the hard problem of consciousness” is solved.1 In this post, an attempt will be made to explain consciousness from the perspective of this author’s theory of […]
What if all of the focus on training AI to say all the nice things we want to hear, and none of the nasty things we don’t want to hear, builds the world’s first super-politician? Is it such an absurd idea? Let’s imagine teaching AI very clear rules about what it can and can’t say […]
Categories
Tool Use and Language: PBM’s?
According to the Functions Operating on Mental Models (FOMM) theory of human intelligence articulated in this blog, language is an example of a Procedural Behavioral Model (PMB). A PBM is a hierarchical, nested, recursive, model that is executed in a sequential manner on a conceptual level and a parallel manner on lower levels (e.g., neural). […]
Categories
What is a concept?
I have done a lot of thinking about this particular word as a psychologist and as a technologist. It was enigmatic for a long period of time, but resolved more clearly as I studied both psychology and AI. I define a concept as a label that is applied to an extracted set of correlated features. […]
Warning: I am trying to build this model by writing it and sharing it. Please feel free to contribute any thoughts you may have. This post will probably change over time as I further refine the ideas. Introduction Some researchers seeking a pathway to AGI have noted the importance of large-scale mental models (e.g., Numenta, […]