From Artificiality This Week * Our Gathering: Our Artificiality Summit 2025 will be held on October 23-25 in Bend, Oregon. The
AI agents are evolving with orchestration layers enabling modular, autonomous systems beyond traditional SaaS, reshaping workflows, labor, and software design.
David Wolpert warns AI networks may evolve beyond human math, creating unpredictable, emergent intelligence that defies control and comprehension.
Trust: The Foundation of the Intimacy Economy, Creativity in the Age of Artificiality, A New Framework for Understanding Emergence in Complex Systems, How to Use Generative AI Part 8, and more!
Memory updated.
When ChatGPT responds with this phrase, you’ve made a trade. You’ve provided it information about yourself and, in return, it will supposedly work better for you. You have traded trust for functionality. But what have you trusted the AI system with? How much better will it work? And do you trust the company behind the AI system enough to trade your intimate details for that functionality?
Some of ChatGPT’s memories of me are facts that I’ve disclosed before: the name of my company, our mission, people I am connected with, activities I pursue. But others I haven’t: my dreams, ideas, concerns, passions. I didn’t ask OpenAI to remember these details. And, now, as I look through the list of ChatGPT’s “memories,” I wonder, do I trust OpenAI with this information? And, if so, what will I get in return?
The usefulness of AI systems across a wide range of use cases improves with context. That means: the more you tell an AI system about the context of you, the better it can interpret the intent of your interaction and help you in your current workflow. Want help with a business problem? The more you tell the AI system about your business, the better it will be able to help you. Want help with a personal challenge? The more you tell the AI system about your personal life, the better it will be able to help you.
This trade of trusting AI systems with intimate information in return for functionality will only become more important as AI systems can manage more information. The question is: how much will people trust AI systems? And, therefore, how useful might AI systems become?
Today, the data says the AI industry has a tall hill to climb: 86% of people in the US say data privacy is a growing concern. 54% of people in the US are concerned about AI companies misusing their personal data. 30% of people in the US aren’t willing to share their personal data for any reason. Even 33% of business leaders in the US say consumers should be concerned about how their personal data is used by their own company. (See below for sources)
It’s possible that people might change their minds if the value provided in return for data is high enough. But, today, 40% of people in the US don’t trust information provided by AI systems. And, while 76% of people trust technology businesses, only 50% trust AI innovations.
Perhaps worst of all, the AI industry shouldn’t be expecting an embrace from the digital natives of Gen Z. 79% of Gen Zers say it's more important to trust the brands they use today than it was in the past. And only 34% trust large businesses, which most AI companies are or intend to be. And, no, it’s not that Gen Z doesn’t trust anyone—71% of them trust small business.
We’re obsessed with the conundrum that trust is required to increase AI usefulness, but consumer trust is low and declining in certain cases. We believe that trust will emerge as the foundation for the Intimacy Economy. And the companies that consumers trust to remember intimate details will have the significant advantage of being able to provide the most useful AI systems.
For more on trust, rewind to our research update on Trust & AI from March 2024.
We're obsessed with the question of how AI will impact creativity. We're also obsessed with the music of Jonathan Coulton. So we're thrilled that Jonathan will be joining us at The Imagining Summit to catalyze a conversation on creative synergy.
Join us in Bend on October 12-14 so you, too, can collaborate in Jonathan's session:
Creative Synergy: AI & Songwriting with Jonathan Coulton. It’s going to be the future soon (so we have to start imagining a hopeful one with AI). Prepare for a dive into the world of creativity with singer-songwriter Jonathan Coulton. Jonathan can't stop singing about AI. In this session, he'll riff on his dream AI collaborator for songwriting. Expect a highly interactive discussion (with perhaps some tunes) about the nature of creativity and what artists might want from AI.
As a preview of Jonathan's ideas on creativity, listen to our podcast with him. For more on creativity, rewind to our ideas piece on Creativity & AI, our ideas piece on The Synergy of Human Creativity and AI, our science piece on Is AI Really as Creative as Humans?, and our conversation with Jonathan Feinstein on The Context of Creativity.
The AI-Savvy Leader, 9 Ways to Take Back Control and Make AI Work, by David De Cremer
De Cremer is the dean of the D'Amore-McKim School of Business at Northeastern University and has spent years involves in all-things-business AI, including guiding the development of EY's AI Lab. So I was interested to read this short-and-to-the-point book about what it means to lead in this AI age.
Net-net, De Cremer has words for leaders: you aren't doing your job. 87% of AI initiatives fail. Why? "Leaders are not leading," he says. AI adoption and deployment is complex, and so is navigating the narratives around it. Leaders have to act yet that is hard to do when you don't understand what it even is.
If you've been involved in AI for a while, much of this book may feel familiar. However, if you are new to leading AI initiatives in business, you’ll find it quite valuable, especially if you are open to developing the right mindset.
What is the "right mindset"? Here, I wholeheartedly agree with De Cremer, whose insights are particularly resonant. I'd like to share a section directly: on the two fundamentally opposing perspectives around how to use AI—do you side with those who are in the endgame of making AI more and more like the human brain, or are you looking for something else?
As a leader, you have a decision to make. Which of these two perspectives do you adopt when bringing AI into your organization?
Perspective 1: AI is an increasingly cheap way to replace people and achieve new levels of productivity and efficiency.
Perspective 2: It's a powerful tool to augment—but not replace—human intelligence and unlock more innovation and creativity in workers
Everything tees off from here. As a leader do you understand:
This book isn't just a clarion call to leaders; it's also for those responsible for fostering human flourishing in organizations, such as learning and development groups. It provides a foundation to build your business case and to articulate the importance of integrating human creativity with machines, emphasizing the vital role of human intelligence in the workplace.
Sources:
The Artificiality Weekend Briefing: About AI, Not Written by AI
