Part IV: Cycles of Innovation and Stagnation (1957-2011)

AI Summers, Winters, and the Rise of Expert Systems

Rob Johnson

by Rob Johnson

Jun 27th 2025

# ai # essay

Section 4.1: The Golden Years & Early Triumphs (1957-1974)

Following the 1956 Dartmouth Workshop, the field of AI entered a "golden age" of exploration and rapid discovery, fueled by government funding, particularly from the U.S. Department of Defense's Advanced Research Projects Agency (DARPA). Researchers were confident that machines with human-level intelligence were just around the corner. This era produced several foundational breakthroughs that demonstrated the potential of the symbolic AI paradigm.

  • LISP (1958): John McCarthy, a key figure from the Dartmouth conference, created the LISP (List Processing) programming language at MIT. LISP's ability to process symbolic information and its flexible structure made it the preferred language for AI research for decades, becoming the lingua franca of the field.
  • The Coining of "Machine Learning" (1959): While developing a checkers-playing program at IBM, Arthur Samuel designed it to learn from its mistakes and improve its strategy over time. The program eventually became skilled enough to defeat its own creator. In a 1959 speech about this work, Samuel coined the term "machine learning," introducing the concept of a machine that could learn independently of its initial programming.
  • ELIZA (1966): At the MIT AI Laboratory, Joseph Weizenbaum created ELIZA, the world's first "chatterbot". ELIZA simulated a Rogerian psychotherapist by using simple pattern-matching techniques to rephrase a user's statements as questions. For example, if a user typed "I am feeling sad," ELIZA might respond, "How long have you been feeling sad?" Despite its simple mechanism, ELIZA created a powerful illusion of understanding and was a landmark demonstration of natural language processing (NLP). Many users formed an emotional attachment to the program, a phenomenon that surprised even Weizenbaum and foreshadowed modern debates about human-AI relationships.

Section 4.2: The First AI Winter (c. 1974-1980)

The unbridled optimism of the golden years eventually collided with the harsh reality of computational limits and theoretical hurdles, leading to a period of severe funding cuts and diminished interest known as the first "AI winter". The promises made by researchers had far outpaced their results.
Several key events triggered this downturn:

  • The Failure of Machine Translation (1966): After years of investment, the U.S. government's Automatic Language Processing Advisory Committee (ALPAC) published a report in 1966 that was highly critical of machine translation research. It concluded that the technology was slower, less accurate, and more expensive than human translation and had no immediate prospects of success. The report led to a drastic reduction in government funding for the field.
  • Critique of Perceptrons (1969): The connectionist approach suffered a major blow with the publication of the book Perceptrons by MIT's Marvin Minsky and Seymour Papert. The book provided a rigorous mathematical proof that simple, single-layer neural networks (perceptrons) were fundamentally incapable of solving certain classes of problems, most famously the "XOR problem." While they acknowledged that multi-layer networks might be more powerful, they speculated that these would be computationally intractable. Their critique was so influential that it effectively halted most research into neural networks for more than a decade.
  • The Lighthill Report (1973): In the United Kingdom, the government commissioned mathematician Sir James Lighthill to evaluate the state of AI research. His 1973 report was scathing, criticizing the field's "grandiose objectives" and its utter failure to solve real-world problems. He highlighted the problem of "combinatorial explosion," where AI algorithms that worked on simple "toy" problems would grind to a halt when faced with the immense complexity of reality. The Lighthill report led to the almost complete dismantling of AI research in the UK.
  • DARPA Cutbacks: In the U.S., DARPA grew frustrated with the lack of progress in projects like the Speech Understanding Research program at Carnegie Mellon University and began redirecting its funding to more targeted, mission-oriented projects, cutting off the free-flowing grants that had sustained blue-sky AI research.

Section 4.3: The AI Boom & The Rise of Expert Systems (1980-1987)

AI re-emerged from its winter in the early 1980s, driven by a new, more pragmatic and commercially focused paradigm: Expert Systems. Instead of trying to create general, human-like intelligence, researchers focused on building systems that could capture the knowledge of a human expert in a very narrow domain and use it to solve specific problems. These systems were the first truly commercial application of AI.

This boom was characterized by several key developments:

  • XCON (1980): The first commercially successful expert system, XCON (for eXpert CONfigurer), was developed at Carnegie Mellon and used by Digital Equipment Corporation (DEC). It automatically selected the correct components for customer computer system orders based on their needs, saving the company millions of dollars annually.
  • Japan's Fifth Generation Computer Project (1981): The Japanese government launched an enormous, $850 million project to develop "fifth-generation" computers designed for AI, capable of conversation, translation, and human-like reasoning. This initiative sparked a wave of fear and competitive investment in the U.S. and Europe, further fueling the AI boom.
  • The LISP Machine Market: A new industry emerged to build and sell specialized, expensive hardware known as "LISP machines," which were optimized to run the LISP programming language and power expert systems.

Section 4.4: The Second AI Winter (c. 1987-1993)

The expert system boom was short-lived. By the late 1980s, the hype once again faded, and the field entered its second AI winter as the limitations of the technology became apparent.

The causes of this second collapse were twofold:

  • Expert Systems Were Brittle and Expensive: While useful, expert systems were difficult and costly to build and maintain. The knowledge had to be painstakingly extracted from human experts and manually coded into rules. The systems were inflexible and could not learn or adapt when new situations arose that were not covered by their rules.
  • Collapse of the LISP Machine Market (1987): The specialized hardware that had powered the boom became obsolete. Cheaper and increasingly powerful desktop computers, like those made by Apple and IBM, became capable of running LISP applications, collapsing the billion-dollar LISP machine industry and signaling the end of the expert system era.

These cycles of boom and bust reveal a fundamental pattern in AI's history. Progress was not a steady march but a series of punctuated equilibria, driven by a recurring cycle of ambitious promise, intense hype, technological under-delivery, and subsequent disillusionment. Early pioneers, buoyed by initial successes, often made bold predictions that the available computational power and theoretical understanding could not support, creating a credibility gap that led to funding collapses. The shift from the grand goal of general intelligence in the 1960s to the narrow focus of expert systems in the 1980s can be seen as a strategic retreat. Having failed at the larger goal, the field pivoted to a more achievable and commercially viable objective, which, while saving AI from complete obscurity, also delayed work on the harder, more fundamental problems of intelligence for another decade.

Works cited

[18] John McCarthy - CHM
[19] John McCarthy: Father of Artificial Intelligence - DataScientest
[20] The 1956 Dartmouth Workshop and its Immediate Consequences: The Origins of Artificial Intelligence - Computer History Museum
[21] Rule-Based System - Engati
[22] Rule-based system - Wikipedia
[23] AI winter - Wikipedia
[24] AI for Beginners - The Difference Between Symbolic & Connectionist AI
[45] A Historical Overview of AI Winter Cycles - Perplexity
[46] Marvin Minsky - Wikipedia
[47] Timeline of the AI winters | Download Scientific Diagram - ResearchGate