Categories
Language Theory

Improving NLP Generalization with Emotion and Paraphrase Detection

NLP models often work by autoregressively predicting the next word in a text sequence. This is a highly specific task. This does not appear to be optimized to produce generalization. To produce more generalization, I propose two changes. Training Method to Produce More Generalization: Start with a pre-trained model (e.g., GPT-3). Create a strong paraphrase […]

Categories
Uncategorized

Google GATO: A Path to AGI?

On May 12, 2022, Google’s DeepMind released Gato, which they described as a “generalist agent.” They were able to use a single transformer architecture to train an agent that could perform 600 different tasks including captioning images, playing video games, and moving real robotic arms. In my opinion, this does seem like it could be […]

Categories
Consciousness Theory

Experience and Action Model of Consciousness

Introduction One aspect of evaluating a theory is to consider the breadth of phenomena that it can explain.  A theory of intelligence would be stronger if it explained how “the hard problem of consciousness” is solved.1  In this post, an attempt will be made to explain consciousness from the perspective of this author’s theory of […]

Categories
AI Dangers

The Looming Danger of Artificial Super-Politicians

What if all of the focus on training AI to say all the nice things we want to hear, and none of the nasty things we don’t want to hear, builds the world’s first super-politician? Is it such an absurd idea? Let’s imagine teaching AI very clear rules about what it can and can’t say […]

Categories
Language

Tool Use and Language: PBM’s?

According to the Functions Operating on Mental Models (FOMM) theory of human intelligence articulated in this blog, language is an example of a Procedural Behavioral Model (PMB). A PBM is a hierarchical, nested, recursive, model that is executed in a sequential manner on a conceptual level and a parallel manner on lower levels (e.g., neural). […]

Categories
Theory

What is a concept?

I have done a lot of thinking about this particular word as a psychologist and as a technologist. It was enigmatic for a long period of time, but resolved more clearly as I studied both psychology and AI. I define a concept as a label that is applied to an extracted set of correlated features. […]

Categories
Theory

Defining Human Level Intelligence: Functions Operating on Mental Models (FOMM)

Warning: I am trying to build this model by writing it and sharing it. Please feel free to contribute any thoughts you may have. This post will probably change over time as I further refine the ideas. It does not currently cite sources. Introduction Some researchers seeking a pathway to AGI have noted the importance […]