The Human Condition: A Crucial Component of Existential Risk Calculations

In other posts I’ve been claiming that the human condition is a crucial factor in existential risk calculations. In this post I’ll attempt to dive more deeply in to exploring the nature of that condition. This will take more than one post, so a series will follow below.

Just as many members here are devoting themselves to studying the nature of various technologies which present existential risk, thinking holistically requires us to also study the nature of we who will invent and use such technologies. These two components, man and machine, are a single unified system, which is only as strong as the weakest link.

A place to start can be to think like architects, and study that which we are made of. Just as particular building materials define the limits of what a structure can and can not be, what we are made of will define who we are.

I’m referring here not to our bodies, but instead to our minds, our psychological existence. What we are made of psychologically is the electro-chemical information medium we call thought. Let’s dig in to this just a bit.

When we say “me” what are we referring to exactly? Who is the “me” that effective altruism seeks to serve? “Me” is a collection of ideas, memories, opinions, personality traits and other symbolic abstractions, which are all made of thought. “Me” is made of thought.

As a quick thought experiment imagine that you have a terminal disease (sorry!) and the doctor says your body is a lost cause, but she can put your brain in another body. In this case, you would likely feel that “me” is being preserved, because you get to keep the content of thought.

If on the other hand the doctor said she can’t save your mind, but she can put a new mind in to your body, you would likely feel that “me” is going to die.

In other words, by “me” we mean, a structure made of thought.

Given that this “me” which effective altruism is seeking to serve is made of thought, in the next post we might seek to understand what thought is. How does it work, what are it’s properties?

Again, it is the premise of this series that reason dictates that we study we who are inventing and using technology with the same earnestness with which we study the technologies being used.