Fade in: INT. COMPUTER LAB — DAY We see JEN and MIKE working at their computers in a bustling lab. They are discussing the progress of their latest project, a distillation model using transformers. Jen: I think we’re making great progress with the model. It’s able to fine-tune a smaller…

As a fan of John Vervaeke’s work on Recursive Relevance Realization (R3) and its role in human cognition, I am excited to share my own proposal for a similar framework for artificial intelligence: Incremental Inductive Inference (I3). While current AI systems have not yet achieved the level of sophistication necessary…

Are you ready to have your mind blown? The parallels between Transformer models (i.e., GPT-3) and Nick Chater’s “The Mind is Flat” are too intriguing to ignore. Chater’s thesis challenges the notion of cognitive depth, arguing that our minds are actually shallow and driven by a just-in-time fluency and improvisation…

For over four billion years, the global biosphere has been performing massive parallel computations that have ultimately led to the emergence of humans. This incredible feat of natural computation is a testament to the complexity and resilience of life on Earth. However, it also serves as a reminder of the…

In my humble and somewhat comedic opinion, human cognition is a strange and wondrous thing! We are all equipped with a “now or never” form of understanding that allows us to rapidly funnel information into an information bottleneck and make sense of it in the moment. …

Cancer cells are our own cells that have become ineffective at sustaining the life of the entire body and instead have opted to prioritize growth over anything else. They are paperclip maximizers of our bodies. Imagine a group of friends who are planning a trip together. Most of the friends…

Gary Marcus and Joscha Bach are both researchers in the field of artificial intelligence (AI), but they have different perspectives on the state and future of the field. Marcus is known for his more pessimistic views, often cautioning against overhyping the capabilities of current AI systems and advocating for a…

‘Rote Adaptiveness’, the capability of automatically being adaptive seems like an oxymoron and is also not as well investigated. But this capability is critical to General Intelligence. How can a skill that is performed without comprehension be one that is also adaptive? …

Richard Sutton (of “The Bitter Lesson” fame) has a five to ten year plan for AI research The Alberta Plan for AI Research. He proposes four principles: 1- Emphasis on ordinary observation (oberve, reward, action) 2- Temporal uniformity 3- Scales with compute power 4- An environment includes other agents. Here…