AI relied on manually coded rules (if-then logic).
Rigid, unable to adapt to new contexts.
Machine Learning AI
2. Machine Learning-Based AI (2010-2020)
Used statistical models and deep learning for text classification, sentiment analysis, etc.
Lacked nuanced contextual understanding.
Large Language Models (LLMs)
3. LLMs & Prompt Engineering (2020-Present)
Generative AI can produce responses dynamically rather than following pre-programmed scripts.
Techniques like zero-shot, few-shot, and chain-of-thought (CoT) prompting enhance reasoning.
API-driven AI (e.g., OpenAI API, Claude API) powers applications in automation, marketing, and research.
The Rise of Transformers (2017-Present)
Transformers History
The turning point came with the Transformer architecture (Vaswani et al., 2017), which introduced self-attention mechanisms that revolutionized natural language understanding. This led to models like:
BERT (2018) – Enabled deep contextual understanding.
GPT-3 (2020) – Brought generative AI into the mainstream.
Claude, Gemini, Llama (2023-2024) – Enhanced reasoning and memory capabilities.
Prompt engineering evolved in response, shifting from simple keyword-based prompts to structured inputs that guide AI through complex reasoning.