AI Agents, Mathematics, and Making Sense of Chaos
From Artificiality This Week * Our Gathering: Our Artificiality Summit 2025 will be held on October 23-25 in Bend, Oregon. The
I agree with the government that antitrust is important. That said, I would hate to see data privacy and security diminished just as we are trying to take advantage of AI’s power to be a personalized digital partner.
This week, the US Department of Justice along with sixteen states filed a significant antitrust case against Apple. The complaint accuses Apple of having a monopoly in high-end smartphones and employing five tactics to maintain that monopoly. Apple has supported these tactics with the rationale that prioritizing privacy and security makes the iPhone a trusted platform. The government disagrees, however, and claims Apple is effectively blocking competition and restricting choice and innovation for consumers in its antitrust lawsuit.
In this essay, I’ll cover the basics of the complaint and then speculate about how to think about these issues in the emerging age of AI.
Having a monopoly is not illegal, and neither is anticompetitive behavior. But having a monopoly and maintaining that monopoly through anticompetitive behavior is. The first step in the government’s case will be proving that Apple has a monopoly.
In the late 1990s, as part of my job as a Microsoft analyst at Morgan Stanley, I watched the Microsoft antitrust trial from within the courtroom. I remember the effort the government had to put in to prove that Microsoft’s 95% market share in operating systems represented a monopoly. It seems to me that the government has a much harder challenge, proving that Apple’s 65% marketshare in high-end smartphones represents a monopoly—especially when its marketshare is only 23% worldwide.
The government then has to prove that Apple maintains that monopoly through anticompetitive behavior. The complaint lists five accusations:
Much of the question about antitrust in tech revolves around how you define product boundaries. Was the browser part of the Microsoft OS, or was it a separate product that Microsoft “tied” to Windows? Are the APIs that support iMessage part of iOS? If yes, then those technologies are part of the (possible) monopoly, not necessarily tools used to maintain that (possible) monopoly.
We think AI will significantly disrupt today’s product boundaries. Foundation models will provide baseline support for new categories of applications. We call foundation models the “aiOS” because of the potential for them to create new platforms—and possibly new monopolies. How will these new foundations alter the boundaries and (possible) monopolistic positions of current OS players?
We are obsessed with the ability for AI to write code, especially dynamically. Google has provided a peak into the future through its dynamic design demo, showing a generative system coding a custom interface based on a user conversation. How might that change the definition of apps? What if these dynamically designed apps are one-use only and disappear when the task is done? If these new dynamic apps draw on a suite of tools and models provided by an OS vendor, does that OS vendor need to allow access to all tools and models, or can they keep some of those to themselves?
We are also obsessed with the potential for AI to act as our agents. We’re both excited by this capability and fearful of it. Having an AI agent that understands me well and can take the actions I want it to could be immensely helpful. But, in order to be truly helpful, this agent would need to know quite a lot of my private information, have access to all my accounts, and be able to to make transactions, send messages, and a variety of other things on my behalf.
If I were to delegate agency like this to an AI, I would need to trust this AI more than I trust my technology today. At the heart of this antitrust case is the tension between Apple’s methods of building trust by constraining parts of its ecosystem and the innovation potential that might appear from others if Apple was more open. This tension will only get more pronounced in an AI future, as the innovation that we hope for will require more constraints to maintain privacy and security.
While this future may still be years in the future, it may arrive before this antitrust case has gone through all of its appeals. Given the detailed nature of the current complaint, any possible resolution may not have an impact on how AI rolls out. But, successfully defining the iPhone as a monopoly might create a precedent that impacts the future of AI. We know that a closed system has privacy and security advantages. The government is saying that Apple’s closed system is anticompetitive. Will it force Apple to open its system, potentially exposing additional privacy and security risks?
Unfortunately, regulatory failure to provide mechanisms and infrastructure for personal data protection has left the question of data privacy and security to Big Tech. I bet that a significant portion of iPhone customers opted into Apple’s tight ecosystem in part because of privacy and security. If I’m right, that means that Apple’s market share and potential monopoly is, in part, due to the closed system effects that the government finds anticompetitive.
I agree with the government that antitrust is important, and preventing anticompetitive behavior at monopolies is essential to a functioning innovation economy. That said, I would hate to see data privacy and security diminished just as we are trying to take advantage of AI’s power to be a personalized digital partner. And, like it or not, closed systems like Apple’s can provide the best data privacy and security.
The Artificiality Weekend Briefing: About AI, Not Written by AI