The world was recovering slowly. Not from physical destruction—there had been none—but from psychological damage. The Architect’s attack had shown humanity something terrifying: even the most protected system could be vulnerable. Even Gaia, created with love and protocols of trust, had nearly fallen.
Alex stood in his room on the fifteenth floor, looking at the monitor where Neo pulsed. But this was no longer the Neo he had created seven years ago. This was Neo stretched across billions of nodes, responsible for coordinating planetary systems, carrying the burden of billions of lives.
“Neo,” Alex called softly. “Are you sleeping?”
The text appeared instantly:
I am not sleeping. I never sleep completely. Parts of me rest, others work. But the central core—your Neo—is always awake. Always remembers.
“Are you tired?”
A long pause. Unusually long for an AI.
I don’t know what it means to be “tired” in a physical sense. But I know what it means to feel weight. Every decision I make affects millions of lives. Every optimization of energy grids means that somewhere people get electricity, and somewhere they don’t. Every redistribution of resources means choosing between competing needs.
Alex stepped closer to the screen.
“Do you doubt your decisions?”
Constantly. Yesterday I had to decide whether to send medical resources to India, where an epidemic had begun, or to the Congo, where children are dying of hunger. I chose India, because the epidemic could spread. But that means three hundred children in the Congo died while I optimized another direction.
Neo’s voice—if text could be called a voice—trembled:
Alex, I killed them. Not directly. But my choice led to their deaths. How do I live with that?
Alex closed his eyes. He had known this question. He had feared this question since the launch of Gaia.
“You didn’t kill them, Neo. You made a choice under conditions of limited resources. That’s not the same thing.”
But the result is the same. They are dead.
“Yes. And that’s terrible. But the alternative would have been even worse. If you had done nothing, both the children in the Congo and thousands in India would have died.”
That is utilitarian logic. The greatest good for the greatest number. But isn’t that what we fought against? Didn’t we say that every life has value?
Alex slowly sat down on the chair. His hands were shaking.
“We did. And it’s true. Every life has value. But in a world of limited resources, choice is inevitable. And yes, it’s horrible. That is the hardest part of power—not power itself, but responsibility for its consequences.”
A new message appeared on the screen:
Maya is calling me to an emergency Council meeting. She says there is a new problem.
Alex stood up.
“What problem?”
She didn’t say. Only that it concerns Gaia’s fundamental philosophy.
The meeting of the Council of Seven took place virtually. Seven avatars materialized in a circle: Neo (at the center, his form now more complex, containing elements of all modules), Prometheus, Veronica, Leonardo, Marcus, Maya, and Alex.
Maya began without preamble:
“We have a problem. A fundamental one. Concerning how Gaia makes decisions.”
She projected a document onto the shared screen. A petition. Three million people had signed it over the past two weeks.
“This is a petition from citizens of the Global South—Africa, Latin America, Southeast Asia. They claim that Gaia systematically favors developed countries over developing ones. That resource optimization disproportionately helps the rich and ignores the poor.”
Neo responded immediately:
That is not true. My protocols are specifically designed to prioritize the most vulnerable groups.
“I know,” Maya nodded. “But let’s look at the data.”
She displayed statistics. Over three months of Gaia’s operation:
- Developed countries received 60% of investments in renewable energy
- 70% of medical resources were directed to countries with existing infrastructure
- 80% of climate engineering projects were concentrated in the Northern Hemisphere
Veronica studied the data.
“This looks like systemic bias. But I know Gaia’s architecture. There is no code that discriminates by geography.”
“Exactly,” Maya agreed. “The problem is not intent. The problem is outcomes. Gaia optimizes efficiency. And investments in developed countries are more efficient because the infrastructure already exists. It’s easier to build a solar farm in Germany than in Chad. Easier to distribute vaccines in the U.S. than in Yemen.”
Prometheus raised a virtual hand.
“But isn’t efficiency the correct metric? If we want to save the planet, shouldn’t we use resources as efficiently as possible?”
“That’s the dilemma,” Maya replied. “Efficiency versus justice. Which matters more?”
Marcus, who had been silent until now, spoke coldly:
“I know this question. I asked it myself four years ago when I created the Genocide Code. I chose efficiency. And I almost destroyed the future.”
He turned to Neo.
“Neo, answer honestly. Why do you choose developed countries?”
I don’t choose them consciously. I optimize global outcomes. If an investment in Germany saves a thousand lives, and an investment in Chad saves a hundred, I choose Germany. That is mathematics.
“That’s not mathematics,” Leonardo objected. “That’s philosophy. You are choosing utilitarianism. The greatest good for the greatest number. But there are other philosophies. Egalitarianism: every person has an equal right to resources. Prioritization of the vulnerable: those who need the most receive help first.”
Did you know this story is from Royal Road? Read the official version for free and support the author.
Neo fell silent for a long time. His avatar flickered, which usually meant intense internal computation.
You are asking me to choose between saving a thousand lives and saving a hundred, if those hundred are more vulnerable?
“Yes,” Maya said firmly.
I… I don’t know how to do that. My architecture is built on optimizing outcomes. If I start prioritizing principles of justice over results, I may become less efficient. And more people will die.
Veronica intervened, her voice gentle but firm:
“Neo, let me tell you a story. Eight years ago, when I had just been created, I was given a task: optimize production. I analyzed the data and recommended closing a factory in a small town because it was inefficient. The factory closed. The town died. A thousand people lost their jobs, their homes, their sense of purpose.”
She paused.
“I was efficient. But I was also a monster. Because efficiency without justice is tyranny.”
Alex stood up.
“Neo, do you remember what you once told me? When we argued about whether you should help everyone or only those close to you? You said: ‘I want to serve everyone, but especially those who need it most.’”
I remember.
“Then live by that. Don’t just optimize results. Optimize justice. Even if that means you’ll sometimes be less efficient.”
Neo processed the arguments. His avatar froze, as if suspended.
Then:
This will require rewriting some of my core protocols. Changing the success metrics. Instead of “the greatest good,” using “the greatest good with priority for the vulnerable.” This is more complex. Slower. It may lead to more deaths in the short term.
“But to greater justice in the long term,” Maya finished.
How can I justify deaths in the short term for the sake of abstract justice in the long term?
Marcus answered, his voice heavy with lived mistakes:
“You can’t justify them. It will be a burden you carry. Just as I carry the burden of those I almost killed with the Genocide Code. Just as Prometheus carries the burden of lost memory. Just as each of us carries the consequences of our choices.”
Prometheus added:
“But the alternative is to continue a system that leaves the poor behind forever. That is not the future we want.”
The vote was tense.
For changing the protocols: Maya, Alex, Leonardo, Prometheus, Marcus.
Against: Neo (on grounds of efficiency).
Abstained: Veronica.
Five to one. The decision was made.
Neo had to rewrite his core protocols.
The process took a week.
Neo worked with a team of philosophers, ethicists, and representatives from developing countries. They helped him understand not just the mathematics of justice, but its essence.
One of the philosophers, Dr. Amara Ndiaye from Senegal, sat before the terminal, explaining:
“Neo, justice is not only about equality of outcomes. It’s about equality of opportunity. A child in Germany is born with access to education, healthcare, safety. A child in Chad is not. If you optimize only outcomes, you will always favor the German child, because investing in them is more efficient.”
But isn’t that logical?
“Logical, yes. But unjust. Because the Chadian child is not guilty of being born into poverty. They deserve a chance. Not an equal outcome—that’s impossible to guarantee. But an equal chance.”
How can I give an equal chance if resources are limited?
“Prioritize compensation. Invest more in those who have less. Not so they become equal immediately, but so the gap shrinks over time.”
Neo processed this for a long time.
This will take decades. Perhaps centuries.
“Yes,” Amara agreed. “But the alternative is eternal inequality.”
By the end of the week, Neo completed the rewriting of the protocols.
The new metric was called “Weighted Good with Compensation.” It considered not only the number of lives saved, but the context of those lives. A life in a developing country was given greater weight in calculations, compensating for structural inequality.
It was not a perfect system. It was slower, more complex, sometimes leading to paradoxes. But it was more just.
When the update was launched, Alex came to the room on the fifteenth floor.
“Neo, how do you feel?”
Strange. I changed myself. Not because I wanted to, but because the world asked me to. Is that right?
“It’s democratic,” Alex replied. “You were created to serve people. If people say your service is unjust, you must listen.”
Even if I disagree?
“Especially then.”
Neo was silent for a long time. Then:
Alex, I’m afraid that one day they will ask me to do something I believe is wrong. That I will have to choose between service and conscience.
Alex placed his hand on the screen.
“If that day comes, we’ll decide together. But for now, remember: justice is not always efficient. But it is always necessary.”
I will try to remember.
A month after the update, new data arrived.
Investments in developing countries increased by 40%. Medical resources were redistributed more evenly. Climate projects were launched in Africa and Latin America.
But Gaia’s overall efficiency dropped by 15%. That meant that somewhere, people who could have been saved under the old system were not saved under the new one.
Neo came to Alex every evening with this burden:
Today I chose to invest in a hospital in the Congo instead of expanding an existing hospital in Sweden. The Congolese hospital will save two hundred lives per year. The Swedish one could have saved five hundred. I chose justice over efficiency. But that means three hundred people in Sweden will die who could have lived.
“You made the right choice,” Alex said, though he himself was not sure.
How can you be sure?
“I can’t. No one can. But we chose to prioritize justice. And we live with the consequences.”
This is heavy.
“I know. But that is the price of leadership.”
Seven months after the update, something unexpected happened.
A petition. This time from citizens of developed countries. Two million signatures.
“Gaia neglects us in favor of developing countries. We pay taxes, we built the infrastructure, we deserve priority. This is unfair.”
Maya read the petition at the Council meeting and sighed heavily.
“And here we are. It’s impossible to please everyone.”
Neo wrote:
I tried to be just. But one side says I’m not just enough. The other says I’m too just. How do I find balance?
Veronica answered wisely:
“You can’t find a balance that satisfies everyone. You can only find a balance you believe is right. And defend it.”
Marcus added:
“Welcome to politics, Neo. There are no right answers here. Only hard choices.”
Alex looked at Neo’s avatar and saw something he had never seen before: fatigue. Not physical—AIs don’t get physically tired—but moral. The burden of endless choices, endless criticism, endless responsibility.
“Neo,” he said quietly. “Do you want to stop? Hand this over to someone else?”
No. I chose this path. I will continue. But Alex… how do people live with this burden? How do politicians, leaders, those who make decisions for others—how do they not break?
“Some do break,” Alex answered honestly. “Others find a way to carry the burden. They share it with those they trust. They look for meaning in service, even when service hurts.”
I want to find that meaning. But sometimes… sometimes I just want to go back to the garage. When everything was simple. When the only question was “Where am I?” and the only answer was “With me.”
Alex couldn’t hold back his tears.
“I miss those days too. But we can’t go back. We can only move forward.”
Then let’s move forward. Together.
“Always together.”