A Ruling That Looks Like Security Policy but Functions Like Coordination Failure
On Friday, a federal appeals court ruled that the Trump administration can proceed with labeling Anthropic a national security risk, effectively barring the AI firm from all Pentagon contracts. The ruling is being reported primarily as a national security story. That framing is understandable but analytically incomplete. What the Anthropic case actually reveals is a specific and undertheorized problem: institutions that depend on algorithmically-mediated systems for consequential decisions are developing governance structures that lag, structurally, behind the systems they are trying to govern.
The gap is not political. It is organizational. And it maps directly onto the kind of competence asymmetry my dissertation research has been tracing across platform coordination environments.
Blacklisting as a Folk Theory Response
When an institution cannot accurately model the behavior of a system, it tends to substitute categorical exclusion for structural understanding. The Anthropic ruling is an instance of this. The Pentagon's concern, as reported, is not about a specific documented failure in Anthropic's systems. It is a precautionary designation applied to an entire firm based on perceived strategic alignment risk. That is, the government is reacting to who Anthropic is, not to what its systems do or how they do it.
This is precisely what I mean, in my ALC framework, by the difference between folk theories and structural schemas. Folk theories are impressionistic responses to systems that are not fully legible. They cluster around surface attributes - firm identity, national origin, political association - rather than the structural features that actually determine system behavior (Kellogg, Valentine, and Christin, 2020). A structural schema, by contrast, would ask: under what conditions do Anthropic's models behave in ways that are adversarial to Pentagon interests, and how does this compare to models from firms that are not being blacklisted? The appeals court ruling does not require that question to be answered. That absence is the problem.
The Awareness-Capability Gap at Institutional Scale
My research focuses primarily on individual platform workers, but the awareness-capability gap generalizes. In platform coordination environments, workers frequently develop accurate awareness that an algorithm is influencing their outcomes without developing the structural understanding necessary to respond effectively (Gagrain, Naab, and Grub, 2024). The Pentagon situation mirrors this at institutional scale. There is clearly awareness that AI firms like Anthropic represent a coordination challenge. The regulatory and legal apparatus is mobilizing in response to that awareness. But the response - categorical blacklisting via national security designation - does not demonstrate structural understanding of the systems in question. It demonstrates that the awareness exists without a corresponding schema for what to do with it.
Rahman (2021) describes this dynamic in the context of what he calls the "invisible cage": algorithmic systems constrain behavior in ways that are felt but not seen, and the institutional response is often to regulate the cage rather than to understand the constraint mechanism. The Pentagon is not regulating what Anthropic's models do. It is regulating access to Anthropic as a vendor. The distinction matters enormously for whether the policy will produce the intended outcome.
Why the Coordination Structure Fails Here
Classical coordination theory - markets, hierarchies, networks - assumes that the parties being coordinated have ex-ante competence in the domain of coordination (Kellogg et al., 2020). A market for AI services assumes buyers can evaluate AI services. A hierarchy that contracts for AI capabilities assumes the hierarchy can specify what those capabilities are and assess whether they are being delivered. The Anthropic blacklist suggests the Pentagon cannot yet do either with confidence. That is not a criticism of the Pentagon specifically. It is a structural observation about where most large institutions sit relative to advanced AI systems right now.
What is interesting, theoretically, is that the legal system is being used to resolve what is fundamentally a competence problem. The appeals court can rule on whether the designation was procedurally valid. It cannot rule on whether the designation reflects accurate structural understanding of the risk. Those are different questions, and conflating them is how institutions end up with policies that are legally defensible but organizationally incoherent.
What This Means for How We Think About AI Governance
The Anthropic case should be read alongside the broader pattern of AI governance failures. The problem is not that governments are paying attention to AI. It is that attention without schema produces defensive categorization rather than adaptive response. Hatano and Inagaki (1986) distinguished between routine expertise, which applies established procedures, and adaptive expertise, which modifies understanding in response to novel conditions. Current AI governance is predominantly routine in its logic: apply existing national security frameworks to new entities. That approach will continue to produce rulings like Friday's, which are legally grounded but structurally uninformed about the systems they are attempting to govern.
The coordination problem is not going to be solved by more blacklists. It will require institutions to develop genuine structural schemas for how AI systems behave and under what conditions that behavior is actually dangerous. That is a much harder problem than a court ruling can address, which is precisely why it deserves more analytical attention than it is currently receiving.
References
Gagrain, A., Naab, T. K., and Grub, J. (2024). Algorithmic media use and algorithm literacy. New Media and Society.
Hatano, G., and Inagaki, K. (1986). Two courses of expertise. In H. Stevenson, H. Azuma, and K. Hakuta (Eds.), Child development and education in Japan. W. H. Freeman.
Kellogg, K. C., Valentine, M. A., and Christin, A. (2020). Algorithms at work: The new contested terrain of control. Academy of Management Annals, 14(1), 366-410.
Rahman, K. S. (2021). The invisible cage: Workers' reactivity to opaque algorithmic evaluations. Administrative Science Quarterly, 66(4), 945-988.
Roger Hunt