Recommended resources
The freely available resources this lesson will direct you to.
Introduction
In our last lesson, we created a clear distinction between non-agentic AI (like a chatbot) and agentic AI. We established that the core difference lies in proactivity and autonomy, using the OODA loop as our conceptual model and introducing a formal taxonomy for levels of autonomy. You now have a framework for classifying what an AI system is not.
Today, we will build on that foundation to model what an agent is. The learning outcome for this lesson is to model the core agentic cycle: perception, memory, planning/reasoning, and action. We are going to deconstruct the "Orient" and "Decide" phases of the OODA loop into a concrete architectural blueprint that you can use to design and analyze any agentic system. This is the engineering schematic behind the concept of autonomy.
The Core Agentic Cycle: A Blueprint for Autonomy
At its heart, an autonomous agent operates in a continuous loop. It observes the world, thinks about what to do, acts, and then observes the outcome of its action, starting the cycle anew. This fundamental process can be broken down into four key capabilities that form the pillars of any agentic system.
The article "Reasoning, Memory, and the Core Capabilities of Agentic AI" provides an excellent, enterprise-focused definition of these pillars.
Reasoning, Memory, and the Core Capabilities of Agentic AI
This article from Unstructured.io is written from an enterprise architect's perspective. It provides a pragmatic and clear definition of the four fundamental capabilities of an agent.
Please read the sections 'Defining the Enterprise Agent' and 'The Anatomy of an Agent: Core Capabilities'. Focus on the four capabilities listed: perception, cognitive abilities (reasoning/planning), system action (tool use), and memory. Notice the diagram that shows them as a synergistic, virtuous cycle.
As the article outlines, the four pillars are:
- Perception: The agent's ability to ingest information from its environment.
- Reasoning & Planning: The agent's cognitive ability to analyze information, decompose goals, and form a strategy. This is the "brain" of the operation.
- Action: The agent's ability to execute its strategy by using tools to interact with the external world.
- Memory: The ability to retain information from past perceptions, thoughts, and actions to inform future cycles.
This isn't a linear sequence but a dynamic loop, as illustrated in the diagram below. The outcome of an Action becomes the new Perception, which informs the next cycle of Reasoning.

To hear this described concisely, watch the following short clip.
RAG vs Agentic AI: How LLMs Connect Data for Smarter AI
This clip from IBM Technology provides a quick, verbal summary of the agentic loop, reinforcing the concepts from the reading.
Watch from 01:18 to 01:54. The speaker outlines the loop as: perceive, consult memory, reason, act, and observe.
Now, let's build this model from the ground up to understand how each component adds a new layer of capability.
Constructing the Agent: From Simple Reflex to Complex Reasoning
A powerful way to understand the agentic cycle is to see how it evolves from the simplest possible agent to a more sophisticated one. We'll use a video that classifies agents into five types, progressively adding the components of our model.
5 Types of AI Agents: Autonomous Functions & Real-World Applications
This IBM Technology video, '5 Types of AI Agents', is an excellent resource for understanding how adding components like memory and planning dramatically increases an agent's capability. We will watch it in segments.
I will guide you through sections of this video to build our model piece by piece.
1. Perception and Action: The Simple Reflex Agent
The most basic agent operates on a simple if-then logic. It perceives its environment and acts immediately based on a predefined rule. It has no memory and no planning.
Watch the first segment of the video (from 00:51 to 02:52), which describes the Simple Reflex Agent.
- Perception: The agent receives "precepts" from its environment via "sensors." In a software agent, this could be new data arriving in a queue, a user's prompt, or a stock price update.
- Action: It performs an action via "actuators." For a software agent, this is an API call, a database write, or sending an email.
- The connection is a simple, hard-coded
Condition-Action Rule. There is no reasoning or memory. A thermostat is a perfect non-AI example.
2. Adding Memory: The Model-Based Agent
A purely reactive agent is limited because it cannot account for anything it doesn't currently perceive. The next step is to add an internal state, or memory.
Now, watch the segment on the Model-Based Reflex Agent (from 02:52 to 04:21).
- Memory: This agent maintains an "internal model of the world." It remembers where it has been and how its own actions affect the environment. This allows it to operate effectively even with partial information. A robotic vacuum cleaner that maps a room is a good example.
- This directly corresponds to the Memory pillar of our model. It provides the context needed for more advanced cognition.
3. Adding Planning & Reasoning: Goal-Based and Utility-Based Agents
With perception and memory in place, we can introduce the core cognitive engine. Instead of just reacting based on rules, the agent can now plan ahead to achieve a specific goal.
Continue with the video, watching the sections on Goal-Based Agents (04:21 to 05:51) and Utility-Based Agents (05:51 to 07:04).
- Planning/Reasoning: The agent now asks, "What action will help me achieve my goal?" It simulates future outcomes of possible actions. This is a fundamental shift from reacting to planning.
- The Utility-Based Agent refines this by asking, "What action will lead to the best outcome?" It introduces a "happiness score" or utility function, allowing it to weigh trade-offs (e.g., speed vs. cost). This is a form of optimization within the planning process.
4. Closing the Loop: The Learning Agent
The final step is to create a feedback mechanism that allows the agent to improve over time.
Watch the final segment on the Learning Agent (07:04 to 08:29).
- The "critic" component evaluates the outcome of the agent's actions against a performance standard.
- The "learning element" uses this feedback to update the agent's internal knowledge and strategies.
- This creates a true learning loop, where the results of
ActionarePerceivedand used to refine futureReasoning.
This progressive model shows how each component of the agentic cycle—Perception, Memory, Planning/Reasoning, and Action—builds upon the last to create increasingly autonomous and capable systems.
An Architect's View of the Components
Now that we have the conceptual model, let's examine the key implementation details an AI architect must consider for each component. Lilian Weng's seminal blog post on autonomous agents provides the necessary technical depth.
Planning and Reasoning
This is the agent's "brain." The LLM is the core reasoning engine, but it requires structured prompting techniques to break down complex problems effectively.
LLM Powered Autonomous Agents | Lil'Log
The 'Planning' section of Lilian Weng's post details the techniques used to structure an agent's thought process. This is critical for moving from a simple prompt-response model to true task decomposition.
Read the section titled 'Component One: Planning'. Pay special attention to 'Task Decomposition' (Chain of Thought) and 'Self-Reflection' (ReAct). These are patterns you will frequently encounter.
- Task Decomposition: Techniques like Chain-of-Thought (CoT) instruct the model to "think step by step," breaking a large goal into smaller, manageable sub-tasks.
- Self-Reflection (ReAct): This framework creates an explicit
Thought -> Action -> Observationloop. The agent verbalizes its reasoning (Thought), decides on a tool to use (Action), and then incorporates the result of that tool use (Observation) into its context for the next thought. This iterative process grounds the agent's reasoning in real-world feedback, reducing errors. We will explore ReAct and other patterns in more detail in Module 3.
Memory
An agent's memory is what separates it from a stateless tool. As an architect, you'll manage two types of memory.
LLM Powered Autonomous Agents | Lil'Log
The 'Memory' section of the same post explains the different types of memory an agent uses and how they are technically implemented.
Read 'Component Two: Memory'. Focus on the distinction between Short-Term Memory and Long-Term Memory and the role of vector databases for retrieval.
- Short-Term Memory: This is the agent's "working memory," managed within the LLM's context window. It holds the immediate conversation history and observations. Managing this finite space is a key engineering challenge.
- Long-Term Memory: This is a durable, external storage layer. It's often implemented using a vector database, where information is stored as embeddings. When the agent needs to recall past information, it queries this database to retrieve the most relevant memories, a process you'll recognize as Retrieval-Augmented Generation (RAG) from our first module. The
Unstructured.ioarticle also provides a useful cognitive science-inspired categorization for an architect: Episodic (past conversations), Semantic (factual knowledge), and Procedural (learned skills).
Action (Tool Use)
Planning is useless if the agent cannot act on the world. Tools are the agent's "hands."
LLM Powered Autonomous Agents | Lil'Log
Finally, the 'Tool Use' section explains how an agent interacts with external systems.
Read 'Component Three: Tool Use'. Understand that 'tools' are essentially APIs that the LLM is trained or prompted to call in a structured way.
- Tool Use: This is the mechanism by which an agent executes its plan. A "tool" is any external function the agent can call, such as a weather API, a database query, a code interpreter, or another agent.
- The agent's reasoning process determines which tool to use and with what parameters. The output from the tool then becomes an "observation" that is fed back into the perception part of the cycle.
Conclusion
In this lesson, we have constructed a detailed architectural model of an autonomous agent. We've moved beyond abstract concepts to a concrete blueprint that you can use for design and analysis.
Key Takeaways:
- The core agentic cycle consists of four interconnected components: Perception, Memory, Planning/Reasoning, and Action.
- This is not a linear process but a continuous, iterative loop where the output of one stage feeds the next.
- We can understand agent sophistication by progressively adding these components: a simple agent just perceives and acts, while more advanced agents add memory for context, planning for goal-directed behavior, and learning for self-improvement.
- As an architect, you will translate these conceptual components into technical implementations: ReAct and Chain-of-Thought for reasoning, context windows and vector databases for memory, and API calls for action.
Preview of the Next Lesson:
Now that you have a robust mental model of how an agent works internally, the next logical question is why an enterprise should invest in building one. In our next lesson, we will address this by focusing on how to formulate the value proposition of agentic AI for enterprise workflow automation. We will connect the agentic cycle you learned today directly to tangible business outcomes like efficiency, accuracy, and scalability.