Open in app

Sign In

Write

Sign In

Carlos E. Perez
Carlos E. Perez

30K Followers

Home

About

Published in Intuition Machine

·Feb 16

Deep Learning Modularity and Language Models

Modularity is essential for any disruptive technology. For years deep learning lacked sufficient remix functionality to quickly customize solutions. Everything had to either be trained from scratch or fine-tuned. The latest innovations are tearing down these restrictions. Modularity allows a developer to combine an existing module with others to generate…

5 min read

Deep Learning Modularity and Language Models
Deep Learning Modularity and Language Models

5 min read


Published in Intuition Machine

·Dec 12, 2022

The False Equivalence of Categorization as Thought

The most glaring flaw of Deep Learning is masked because our entire society has been indoctrinated into an ontology based on substance metaphysics. We assume a feature about cognition that is simply non-existent but we think is real because of our metaphysics. Let me explain! The value of deep learning…

4 min read

The False Equivalence of Categorization as Thought
The False Equivalence of Categorization as Thought

4 min read


Published in Intuition Machine

·Dec 12, 2022

The AI Teacher Student Distillation Experiment

Fade in: INT. COMPUTER LAB — DAY We see JEN and MIKE working at their computers in a bustling lab. They are discussing the progress of their latest project, a distillation model using transformers. Jen: I think we’re making great progress with the model. It’s able to fine-tune a smaller…

4 min read

The AI Teacher Student Distillation Experiment
The AI Teacher Student Distillation Experiment

4 min read


Dec 11, 2022

Peirce’s Trichotomy of Inferences Informs the Curriculum of Deep Learning Training

As a fan of John Vervaeke’s work on Recursive Relevance Realization (R3) and its role in human cognition, I am excited to share my own proposal for a similar framework for artificial intelligence: Incremental Inductive Inference (I3). While current AI systems have not yet achieved the level of sophistication necessary…

8 min read

Peirce’s Trichotomy of Inferences Informs the Curriculum of Deep Learning Training
Peirce’s Trichotomy of Inferences Informs the Curriculum of Deep Learning Training

8 min read


Published in Intuition Machine

·Dec 11, 2022

The Origami Brain and Cognitive Depth

Are you ready to have your mind blown? The parallels between Transformer models (i.e., GPT-3) and Nick Chater’s “The Mind is Flat” are too intriguing to ignore. Chater’s thesis challenges the notion of cognitive depth, arguing that our minds are actually shallow and driven by a just-in-time fluency and improvisation…

8 min read

The Origami Brain and Cognitive Depth
The Origami Brain and Cognitive Depth

8 min read


Published in Intuition Machine

·Dec 11, 2022

How Time Travel Boostrapping Accelerates AGI Development

For over four billion years, the global biosphere has been performing massive parallel computations that have ultimately led to the emergence of humans. This incredible feat of natural computation is a testament to the complexity and resilience of life on Earth. However, it also serves as a reminder of the…

14 min read

How Time Travel Boostrapping Accelerates AGI Development
How Time Travel Boostrapping Accelerates AGI Development

14 min read


Published in Intuition Machine

·Dec 11, 2022

The Now or Never Nature of Human Thinking

In my humble and somewhat comedic opinion, human cognition is a strange and wondrous thing! We are all equipped with a “now or never” form of understanding that allows us to rapidly funnel information into an information bottleneck and make sense of it in the moment. …

5 min read

The Now or Never Nature of Human Thinking
The Now or Never Nature of Human Thinking

5 min read


Published in Intuition Machine

·Dec 11, 2022

Disinformation and Paper-Clip Maximizers

Cancer cells are our own cells that have become ineffective at sustaining the life of the entire body and instead have opted to prioritize growth over anything else. They are paperclip maximizers of our bodies. Imagine a group of friends who are planning a trip together. Most of the friends…

5 min read

Disinformation and Paper-Clip Maximizers
Disinformation and Paper-Clip Maximizers

5 min read


Published in Intuition Machine

·Dec 8, 2022

Balancing AGI Pessimistic and Radical Views

Gary Marcus and Joscha Bach are both researchers in the field of artificial intelligence (AI), but they have different perspectives on the state and future of the field. Marcus is known for his more pessimistic views, often cautioning against overhyping the capabilities of current AI systems and advocating for a…

10 min read

Balancing AGI Pessimistic and Radical Views
Balancing AGI Pessimistic and Radical Views

10 min read


Published in Intuition Machine

·Oct 17, 2022

The Origin of Creativity: Rote Adaptiveness

‘Rote Adaptiveness’, the capability of automatically being adaptive seems like an oxymoron and is also not as well investigated. But this capability is critical to General Intelligence. How can a skill that is performed without comprehension be one that is also adaptive? …

7 min read

The Origin of Creativity: Rote Adaptiveness
The Origin of Creativity: Rote Adaptiveness

7 min read

Carlos E. Perez

Carlos E. Perez

30K Followers

Author of Artificial Intuition and the Deep Learning Playbook — http://linkedin.com/in/ceperez https://twitter.com/IntuitMachine

Following
  • Oliver Ding

    Oliver Ding

  • umair haque

    umair haque

  • Jon Hawkins

    Jon Hawkins

  • Alex Mathers

    Alex Mathers

  • Michael Simmons

    Michael Simmons

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech