Agentic AI
15 min read

Banking AI Vocabulary — Part 2: Building the Agentic Bank

A comprehensive glossary of 30+ foundational terms defining agentic banking architecture, from semantic intelligence and ontologies to AI orchestration and governance frameworks.

The Big Idea

Traditional banks digitized processes. Agentic banks digitize reasoning, operational intelligence, institutional knowledge, decision-making, and workflow execution. This requires a completely new enterprise stack built around semantic intelligence, ontology, contextual memory, knowledge graphs, AI orchestration, and governed autonomy.

Agentic AI

AI systems capable of autonomous reasoning, planning, tool usage, workflow orchestration, memory utilization, contextual decision-making, and collaborative execution in pursuit of defined goals.

Simple Analogy

Traditional AI is like a receptionist: answers questions, retrieves information, follows scripts. Agentic AI is like an experienced banking operations manager: understands objectives, coordinates teams, follows policies, handles exceptions, escalates issues, and executes workflows autonomously.

Banking Example

When a customer says "investigate why my international transfer is delayed and resolve it," an agentic system checks payment status, inspects sanctions workflow, analyzes SWIFT repair queue, verifies FX settlement, coordinates compliance review, raises escalation tickets, and notifies the customer—all without explicit step-by-step instructions.

Banking Ontology

A structured semantic model defining banking entities, concepts, relationships, workflows, business meanings, operational dependencies, and policy semantics that allow AI systems to understand banking context.

Why Ontology Matters

Without ontology, AI sees isolated data points: "STATUS = 7" means nothing. With ontology, AI understands semantic meaning: "Payment pending sanctions screening review before SWIFT release." This distinction enables AI to reason about enterprise business logic, regulatory requirements, workflow dependencies, and customer context—not just answer questions about database fields.

Simple Analogy

A banking ontology is like a combination of: a banking dictionary (what terms mean), a relationship map (how entities connect), and an enterprise rulebook (how banking behaves). It teaches AI what banking entities mean, how they relate to each other, and how banking processes operate.

Example Ontology Relationships:

  • • Customer owns → Account
  • • Account initiated → Payment
  • • Payment blockedBy → SanctionsReview
  • • TradeFinanceCase requires → Document

Banking Domains Covered by Ontology

Banking ontologies span multiple business domains:

  • Retail Banking: CASA (Current/Savings Accounts), deposits, consumer loans, credit cards, mortgages, investment products
  • Corporate Banking: Trade finance, corporate lending, working capital, treasury services, liquidity management
  • Payments: Domestic transfers, international payments, SWIFT, same-day settlement, real-time gross settlement (RTGS)
  • Risk & Compliance: AML (Anti-Money Laundering), sanctions screening, KYC (Know Your Customer), fraud detection, regulatory limits
  • Banking Operations: Account servicing, reconciliation, exception handling, workflow approvals, case management, escalation procedures

Knowledge Graph

A connected representation of enterprise entities and relationships used for contextual intelligence and semantic reasoning. Where databases store isolated rows, knowledge graphs store connected meaning.

Why Knowledge Graphs Matter

Banks are relationship-heavy institutions. Understanding one customer requires knowing their accounts, transactions, approvals, risk assessments, compliance status, and payment history. Knowledge graphs enable AI to traverse enterprise relationships and reason contextually instead of treating each entity as isolated data.

Simple Analogy

Traditional Database: A spreadsheet of isolated customer records. Looking up customer #12345 gives you a row of attributes.

Knowledge Graph: A connected map showing: Customer #12345 → owns Account #ABC123 → initiated Payment #XYZ → blocked by SanctionsRule #7 → requires Review by Compliance Team. This connected path enables AI to understand workflow dependencies, relationships, and business logic.

MCP (Model Context Protocol)

A protocol enabling AI agents to securely access enterprise tools, workflows, permissions, memory, business context, and orchestration services in a standardized manner.

Why MCP Matters

Without MCP, integrating AI agents with enterprise systems requires custom integrations for each tool, leading to fragmented governance, inconsistent permissions, brittle orchestration, and security gaps. With MCP, AI agents access tools through standardized protocols, enabling centralized governance, reusable enterprise context, dynamic tool discovery, and consistent security policies.

Simple Analogy

MCP is like an API gateway designed for AI agents. Instead of each agent building custom connections to payment systems, AML tools, customer databases, and compliance checkers, MCP provides a standardized interface where tools register themselves, permissions flow through centralized governance, and agents discover available capabilities dynamically.

Banking Workflow Example

A customer service agent receives an escalation: "Investigate why customer's monthly transfer failed." Through MCP, the agent discovers available tools: Payment Investigation Tool, AML Checker Tool, SWIFT Status Tool, Compliance Rules Tool. The agent calls these tools in sequence with appropriate permissions, receives results, reasons about the outcome, and either resolves the issue or escalates to a human—all coordinated through MCP.

Retrieval-Augmented Generation (RAG)

A technique where AI systems retrieve relevant information from enterprise knowledge sources before generating responses, ensuring answers are grounded in current, verified business data.

Why Banking Needs RAG

Banking information changes constantly—policies update, rates adjust, regulations shift, procedures evolve. RAG ensures AI uses current enterprise knowledge (loan policies, interest rates, compliance rules, product terms) before answering customer questions or making operational decisions, preventing outdated or inaccurate responses.

Banking Example

Instead of LLM only: "Yes, we offer personal loans," RAG retrieves current product policies: "We offer personal loans up to $50,000 at 6.5% APR for creditworthy customers with minimum 2-year employment history, subject to AML clearance and current regulatory limits."

Vector Database & Embeddings

Vector databases store numerical representations (embeddings) of enterprise knowledge, enabling semantic search where similar meanings are mathematically nearby, unlike traditional keyword-based search.

Simple Analogy

Traditional Database: Stores exact matches only. Search for "payment stuck" finds only records with exact phrase "payment stuck."

Vector Database: Stores semantic meaning. Search for "why is my transfer delayed?" automatically finds similar concepts like "payment blocked," "settlement pending," "SWIFT queue," because they're semantically nearby in mathematical space.

Banking Example

Searching vector embeddings of banking regulations finds "sanctions screening" when querying "payment compliance," even without exact keyword match, because the concepts are semantically related.

Embeddings

Numerical vector representations of semantic meaning generated by AI models, where similar concepts appear closer together mathematically, enabling semantic reasoning.

Simple Analogy

Embeddings convert words and concepts into points in mathematical space. Similar words cluster together: "customer," "client," "account holder" are nearby points. Dissimilar words are far apart: "customer" and "transaction" are distant. AI uses these distances to understand semantic relationships.

Banking Example

Embeddings of banking terminology cluster payment-related terms: "SWIFT," "fund transfer," "remittance," "settlement" are nearby. Compliance terms "AML," "sanctions," "KYC" cluster separately. AI uses these clusters to understand domain semantics.

Large Language Models (LLMs)

Foundation models trained on vast amounts of text data capable of understanding language patterns, reasoning about context, and generating human-like responses.

Critical Banking Consideration

LLMs alone are NOT banking experts by default. They require: ontology (understanding banking concepts), grounding (access to current banking knowledge), workflows (integration with enterprise systems), governance (regulatory compliance), and memory (retention of customer context). Deploying LLMs directly in banking without these foundations creates hallucination risks and compliance violations.

Banking Example

A bare LLM answers: "We offer mortgages at 2% APR." A banking-grade agentic system using LLM + ontology + RAG + governance: "We currently offer mortgages at 6.2% APR for 30-year fixed rates, subject to credit approval, appraisal, and AML clearance."

Contextual Intelligence & Multi-Agent Architecture

Contextual Intelligence: AI systems that understand business context, customer history, relationship dynamics, operational constraints, policy implications, and enterprise consequences when making decisions or recommendations.

The Context Difference

Without context: AI behaves like someone joining a meeting halfway through—missing history, unaware of decisions already made, unable to reason about relationships.

With context: AI behaves like an experienced banker who understands customer relationships, operational history, regulatory constraints, and enterprise politics—enabling sophisticated decision-making and exception handling.

Multi-Agent Architecture: Specialized AI agents collaborating to execute complex workflows. Like banking departments (Payments Team, AML Team, Treasury Team) working together, multi-agent systems coordinate autonomous execution under orchestration and governance.

Enterprise Architecture Concepts

Semantic Layer: Enterprise infrastructure that translates raw banking data into machine-readable semantic meaning, enabling all downstream AI systems to reason at the business level rather than the technical level.

Explainable AI (XAI): AI systems that provide understandable reasoning behind decisions and recommendations. When AI declines a loan application, it explains risk factors, policy violations, contributing variables, and confidence levels—critical for regulated banking environments.

Human-in-the-Loop (HITL): Workflows where AI makes recommendations but humans make final decisions, especially for high-value or compliance-sensitive operations like loan approvals, exception handling, or fraud investigations.

Policy-Aware AI: AI systems that understand and enforce enterprise policies, regulatory rules, and business constraints during execution rather than as post-hoc validation.

Digital Workforce: Autonomous AI agents that function like banking employees—understanding workflows, following procedures, escalating exceptions, remembering history, and collaborating with human teams.

Straight-Through Processing (STP): Fully automated workflows where transactions complete end-to-end without manual intervention—settlements, reconciliations, customer onboarding—executed safely under AI governance.

Hallucination: When AI generates plausible-sounding but false or invented information. In banking, hallucinations create severe risks—inventing loan terms, fabricating compliance status, or making up regulatory requirements.

Prompt Engineering: The practice of designing specific instructions and context to guide AI systems toward desired behavior, accuracy, and compliance—critical for directing agentic banking systems.

Advanced Intelligence Concepts

Grounding: The process of constraining AI outputs using trusted enterprise data and knowledge sources. Grounding reduces hallucinations (false information), inaccuracies (incorrect facts), policy violations (breaking enterprise rules), and inconsistent responses (contradicting previous guidance). In regulated banking environments, grounding is essential—it ensures AI operates within compliance boundaries and uses verified information.

Long-Term Memory: Persistent contextual memory enabling AI to retain and reuse historical information across conversations and workflows. AI remembers customer preferences, unresolved servicing cases, prior escalations, communication history, relationship dynamics, and behavioral patterns. This enables continuity and avoids repeating issues.

Institutional Intelligence: Accumulated enterprise operational knowledge embedded across workflows, enterprise policies, organizational behavior, business rules, and customer relationships. Institutional intelligence consists of: standard operating procedures (how things get done), enterprise policies (what we allow), organizational knowledge (who knows what), customer relationships (history and preferences), and operational practices (what works). The true enterprise AI moat—models can be commoditized, but institutional intelligence remains proprietary.

Operational Intelligence: Real-time AI understanding of enterprise states including workflows, processing queues, dependencies between operations, exceptions requiring intervention, bottlenecks limiting throughput, and system health metrics. This enables dynamic optimization and intelligent exception handling rather than static rule-based processing.

AI Governance & Compliance

Banking AI requires fundamentally different governance than consumer AI. Banking AI must ensure traceability (audit trails of all decisions), explainability (understandable reasoning for human review), accountability (responsibility for outcomes), and regulatory compliance (adherence to banking regulations).

Why Banking Governance is Different

Consumer AI can be probabilistic and approximate. Banking AI must be deterministic and accountable. If a consumer AI recommends a wrong product, the user loses a purchase. If banking AI makes an incorrect decision, regulatory violations, customer harm, financial losses, and compliance breaches occur. Banking AI governance requires: decision traceability (knowing why AI decided), policy enforcement (ensuring compliance during execution), exception escalation (when AI confidence drops), and human oversight (final approval for high-risk decisions).

The Future Architecture

These architectural patterns represent the evolution from digital banking (automating existing processes) to intelligent banking (AI-driven reasoning and autonomous execution). Together, they define the vision of the Agentic Bank.

Semantic Banking: Banking architecture enhanced with semantic intelligence—ontologies, knowledge graphs, and contextual data layers—enabling AI systems to read and understand banking operations, workflows, entities, relationships, policies, and enterprise behavior at the business level rather than the technical level.

Semantic Core Banking: Future-generation core banking platform architected natively for AI by combining traditional transaction processing capabilities with integrated ontology, knowledge graphs, AI orchestration services, and contextual intelligence layers. Rather than bolting AI onto existing cores, semantic cores are AI-first from the database schema upward.

Autonomous Banking: Banking operations partially or fully executed autonomously by AI systems operating under explicit governance controls and human oversight. Examples: automated reconciliation, autonomous fraud investigation, payment repair workflows, servicing automation, customer onboarding, treasury operations, and exception handling—all executing independently within defined policy boundaries.

Federated Intelligence: Distributed AI intelligence architecture where specialized agents operate across multiple systems, business units, or even partner organizations while remaining coordinated through unified governance and shared enterprise context. Enables seamless enterprise-wide and inter-organizational AI collaboration without central control bottlenecks.

AI-Native Banking: Banking architecture fundamentally designed around AI-first operating models and intelligent automation as core business logic, not retrofitted additions. In AI-native banks, workflows, decision trees, customer experiences, and operational procedures are architected with AI automation as the primary execution mechanism, with human oversight reserved for governance and exception handling.

Bringing It All Together

The Agentic Bank is not built on a single technology. It emerges from the integration of multiple foundational concepts working in concert:

  • 1.Ontology provides semantic meaning—teaching AI what banking concepts mean
  • 2.Knowledge Graphs create connected enterprise intelligence—showing how entities relate
  • 3.RAG & Vector Databases ground AI in current, verified enterprise knowledge—preventing hallucination
  • 4.LLMs with Grounding provide reasoning capabilities—but only when constrained by policy
  • 5.Agentic AI enables autonomous reasoning and workflow execution—coordinating complex multi-step operations
  • 6.MCP & Multi-Agent Architecture standardize agent-to-enterprise integration—enabling orchestration at scale
  • 7.Governance & Explainability ensure regulatory compliance and operational safety—maintaining trust and accountability

Together, these concepts enable the transformation from traditional banking (recording transactions) to intelligent banking (reasoning about context) to autonomous banking (executing decisions independently). This is the foundation of the Agentic Bank.