Context Is King: Why the AI That Knows Your SOPs Will Beat the AI That Knows Everything

Generic AI intelligence is a commodity. The competitive advantage is institutional context — your SOPs, your examiner preferences, your member patterns. Why the AI that knows you beats the AI that knows everything.

By Sean Hsieh
Read 11 min
Published September 20, 2025
Context Is King: Why the AI That Knows Your SOPs Will Beat the AI That Knows Everything

You can go to ChatGPT right now and ask it anything about BSA compliance. It’ll give you a textbook answer — accurate, comprehensive, generic. Now ask it: “What’s Heartland Credit Union’s policy on CTR exemptions for the landscaping company on Main Street that deposits $4,000 in cash every Tuesday?” It has no idea.

That question — the one that matters to your BSA analyst at 8 AM on a Wednesday — is the gap between AI that knows everything and AI that knows you. Generic intelligence is a commodity. Institutional context is the competitive advantage.


The “Knows Everything, Knows Nothing” Problem

ChatGPT, Gemini, and generic copilots are trained on the entire internet. They can write code, draft essays, summarize research papers, and explain quantum mechanics. They know more than any single human ever will. And they know nothing about your credit union.

They don’t know your SOPs. They don’t know your member communication style — do you say “Dear Member” or “Hi Sarah”? They don’t know your risk tolerance. They don’t know your examiner’s areas of focus from last cycle. They don’t know that Maria’s Tuesday cash deposits are from her flower shop on Main Street, not money laundering.

This gap isn’t just an inconvenience. In regulated industries, it’s dangerous.

In legal proceedings, researchers have now documented over 480 cases of lawyers submitting AI-hallucinated citations to courts — fake case law that sounded authoritative but didn’t exist. Over 120 lawyers have been sanctioned. Generic AI didn’t say “I don’t know.” It generated plausible-sounding fiction with absolute confidence.

In credit union compliance, a plausible-sounding-but-wrong policy interpretation is worse than no answer at all. When your AI agent tells a BSA analyst that a transaction pattern is consistent with the credit union’s exemption policy — and it’s wrong because it doesn’t actually know your exemption policy — you don’t have a technology problem. You have a compliance violation.

Here’s the deeper issue. Generic AI is trained on what’s publicly available — the internet, published research, open documentation. But roughly 80% of credit union operational knowledge is undocumented. It lives in people’s heads. In institutional habits. In the way Linda in compliance has always handled wire transfer reviews. In the fact that your examiner flagged weak CTR documentation last cycle, so your team has been over-documenting ever since. The most valuable knowledge for AI to have is precisely the knowledge that generic AI cannot have.

a16z — the most prominent venture capital firm in technology — published an essay in August 2025 titled “Context Is King,” arguing that AI itself is not a moat but context is. Generic foundation models are commoditizing. What’s defensible is the proprietary context layer that makes AI useful for a specific organization. Runline arrived at this thesis independently, through months of embedding with credit union operations teams. When the leading voice in tech investing validates the same conclusion from a completely different starting point, that’s a signal worth paying attention to.


What “Context” Actually Means for a Credit Union

Context isn’t just data. It’s the meaning and relationships within data that only emerge from sustained operational presence. I think about it in five layers, each one deeper and harder to replicate than the last.

Layer 1: SOPs and Policies. Your written procedures — BSA policy, lending guidelines, HR handbook, member service protocols. Most credit unions have these, but they’re scattered: PDFs on a shared drive, Word docs on someone’s desktop, a binder in the compliance office that hasn’t been updated since 2019. At one CUSO I worked with, the SOPs were “sprinkled across people’s computers, tribal knowledge in people’s heads.” No centralized, searchable, AI-accessible library. This is the norm, not the exception.

Layer 2: Member Communication Style. How your credit union talks to its members is a competitive differentiator that no generic AI knows. Does your outbound communication use first names or formal titles? Is your tone warm and casual or professional and precise? Do you sign emails “Your CU Team” or with individual names? An AI agent drafting member communications needs to have absorbed your voice, not a generic financial services template.

Layer 3: Operational Patterns. Maria’s Tuesday cash deposits. The construction company’s seasonal revenue cycle. The university town’s student loan disbursement pattern every August and January. These patterns aren’t in any database. They’re observations that experienced staff know from years of working with the membership. They’re the reason a 20-year BSA analyst can glance at an alert and know in three seconds whether it’s suspicious or routine.

Layer 4: Regulatory Relationships. Every credit union has a relationship with its examiner. Examiners have preferences, areas of focus, and specific expectations shaped by prior examination findings. Your examiner flagged weak CTR documentation last cycle? Your AI should know that and prioritize documentation quality for CTRs going forward. This is context no generic AI vendor can deliver because it’s unique to your institution’s regulatory history.

Layer 5: Risk Tolerance and Institutional Values. How aggressively does your credit union pursue indirect lending? How conservative is your board on real estate concentration? What’s your appetite for small-dollar consumer loans? These values shape every operational decision. An AI agent making recommendations without understanding your institutional risk tolerance is like a financial advisor who’s never met the client.

Each layer gets harder to replicate. Anyone can index your written SOPs — that’s Layer 1. But understanding that your examiner cares more about SAR narrative quality than CTR timeliness because of a finding from three years ago? That’s Layer 4. And no amount of model intelligence can substitute for it.


Why Vertical Beats Horizontal

The market is validating this thesis in real time. Gartner projects that domain-specific generative AI models will grow from 1% of deployments in 2023 to over 50% by 2028. By 2027, enterprises will use three times more task-specific AI than general-purpose tools. The movement from horizontal to vertical is one of the clearest trends in enterprise technology.

The reason is counterintuitive: the best model doesn’t win. The best context wins.

Google has the most powerful AI models in the world and unlimited data. They still lose in vertical domains to companies with better contextual data. Google Health’s AI diagnostics couldn’t match specialist systems built with hospital-specific clinical data — because knowing medicine in general is fundamentally different from knowing how this hospital practices medicine.

Morgan Stanley proved the thesis at scale in financial services. They indexed 350,000 internal documents — research reports, product guides, regulatory filings, client communication templates — and gave their 16,000-plus financial advisors RAG-powered access to that institutional knowledge. Adoption hit 98% within months. Research that used to take 30 minutes took seconds.

The AI Morgan Stanley deployed wasn’t smarter than ChatGPT. It was contextualized with Morgan Stanley’s specific products, compliance requirements, and client communication standards. The same advisor, the same question — but the AI that had absorbed Morgan Stanley’s institutional knowledge gave answers the advisor could actually use. The generic model gave answers the advisor had to verify, contextualize, and often discard.

The technical mechanism is simpler than the jargon suggests. RAG — Retrieval-Augmented Generation — is how you make a powerful general model useful for your specific organization. Instead of retraining the entire AI — expensive, slow, fragile — you give it access to your documents, your data, your operational knowledge at query time.

Think of it like this: a brilliant new hire who’s read every finance textbook. That’s the foundation model. RAG is the equivalent of giving that new hire access to your filing cabinet, your institutional playbooks, and a mentor who’s been at the credit union for 20 years. Same person, radically different effectiveness.

The quality of what you retrieve matters more than the intelligence of the model. A mid-tier model with excellent credit union-specific context outperforms a frontier model with generic internet knowledge on credit union compliance tasks. Every time.


Context Accumulation: The Moat That Compounds

Here’s where this gets strategic. Context isn’t static. It accumulates.

An AI agent that has operated inside your credit union for six months has learned which alerts are consistently false positives for your membership patterns. How your examiners want documentation formatted. Which member communication styles get the best response rates from your membership. What your compliance team considers escalation-worthy versus routine. The seasonal patterns of your community’s economy.

At Runline, we documented this as a foundational architectural belief before reading any VC thesis on the subject: persistent agents that compound knowledge. An agent that has worked with a credit union for six months is genuinely more valuable than one starting from zero. Not because it’s smarter. Because it’s contextualized.

Month one, our agents do what you tell them. Month six, they start telling you what you should be doing differently.

The compounding effect creates a flywheel. Better context leads to smarter agents, which produce better outcomes, which build more trust, which means more context shared, which produces even smarter agents. This accelerates over time.

The switching cost this creates is real — but it’s earned, not manufactured. This isn’t vendor lock-in through proprietary formats or data hostage. It’s the accumulated intelligence of months of operational partnership. Switching to a competitor means starting the context accumulation from scratch. Not because we made it hard to leave — but because the institutional knowledge the agent has built is genuinely unique to your credit union.

This is the same reason you don’t let a 20-year employee go lightly. Not because of a contract, but because of everything they know that no replacement can replicate overnight.

a16z’s evolution on this point is telling. In 2019, they published “The Empty Promise of Data Moats” — arguing that generic data is not defensible. By 2025, their “Context Is King” essay revealed the evolution: domain-specific institutional context, accumulated through operational presence, is defensible. Generic data isn’t. That distinction is everything.


The Retirement Cliff Makes This Urgent

This isn’t just a philosophy. It’s a ticking clock.

Eleven thousand two hundred Americans turn 65 every day through 2027. Credit union compliance officers, loan officers, BSA analysts, and operations managers who’ve spent 20 to 30 years accumulating institutional knowledge are retiring. The retirement cliff I introduced in Article 6 isn’t only a staffing problem. It’s a context problem.

When Linda in compliance retires, she takes with her every pattern she recognizes, every examiner preference she’s internalized, every undocumented shortcut, every member relationship nuance. Eighty percent of that knowledge was never written down. It exists in her judgment, her instincts, her ability to glance at an alert and know in three seconds what a new hire would spend 30 minutes researching.

This is not an abstract problem. At one credit union partner, I watched a BSA analyst make judgment calls in seconds that would take a new hire weeks to research — because she’d been watching that membership’s patterns for 15 years. When she retires, that capability walks out the door.

The AI solution isn’t to replace her. It’s to capture her context now — her SOPs, her decision patterns, her institutional knowledge — in an AI agent that preserves and amplifies that expertise for the people who come after her. The next article in this series goes deep on this human dimension.

Your core processor is a time capsule of data — the subject of Article 5. Your experienced staff are time capsules of context. Both need to be unlocked before they’re lost. The data is trapped in legacy systems. The context is trapped in people’s heads. AI infrastructure solves both — but only if it’s built to absorb context, not just process transactions.

ChatGPT knows everything about compliance. Your best BSA analyst knows everything about your compliance. In a regulated industry, the second kind of knowledge is the only kind that matters. And the AI that captures it — before it retires — is the most strategic investment your credit union can make.


Sean Hsieh is the Founder & CEO of Runline, the secure agentic platform for credit unions. Previously, he co-founded Flowroute (acquired by Intrado, 2018) and Concreit, an SEC-regulated WealthTech platform managing real securities under dual federal regulatory frameworks.

Next in the series: “Human at the Helm: Why the Best AI Strategy Is a People Strategy” — the retirement cliff is real, decades of tribal knowledge are walking out the door, and AI isn’t the replacement — it’s the preservation mechanism.


Get Started

Ready to see what stateful AI agents can do for your credit union?

Runline builds purpose-built AI agents for regulated financial institutions. Every interaction compounds institutional intelligence.

Schedule a Demo