WillPearson

• WillPearsonMar 5, 2025, 8:05 PM

  1 point

  0 ∶ 0

  on: Frac­tal Gover­nance: A Tractable, Ne­glected Ap­proach to Ex­is­ten­tial Risk Reduction

  Here is a blog post also written with Claudes help that I hope to engage with home scale experimenters with

Frac­tal Gover­nance: A Tractable, Ne­glected Ap­proach to Ex­is­ten­tial Risk Reduction

• WillPearsonFeb 26, 2025, 11:15 PM

  2 points

  0 ∶ 0

  in reply to: ank’s comment on: Share AI Safety Ideas: Both Crazy and Not

  I appreciate your views on space and AI working with ML systems in that way might be useful.

  But I think that I am drawn to the base reality a lot because of threats to that from things like gamma ray bursts or aliens. These things can only be represented probabilistically in simulations because they are out of context. The branching tree explodes with possibilities.

  I agree that we aren’t ready for agents , but I would like to try to build time non-static intelligence augmentation as slowly as possible. Starting with building systems to control and shape them tested out with static ML systems. Then testing them with people. Then testing them inside simulations etc

• WillPearsonFeb 26, 2025, 7:11 PM

  2 points

  0 ∶ 0

  in reply to: ank’s comment on: Share AI Safety Ideas: Both Crazy and Not

  I find your view of things interesting. A few questions, how do you deal with democracy when people might be inhabiting worlds unlike the real one and have forgotten the real one exists?

  I think static AI models lack corrigibility, humans can’t give them instruction on how to change how to act, so they might be a dead end in terms of day to day usefulness. They might be good as scientists though as they can be detached from human needs. So worth exploring.

• WillPearsonFeb 26, 2025, 5:31 PM

  2 points

  1 ∶ 0

  in reply to: ank’s comment on: Share AI Safety Ideas: Both Crazy and Not

  There is a concept of utility, but I’m expecting these systems to mainly be user focussed so not agents in their own rights, so the utility is based on user feedback about the system. So ideally the system would be an extension of the feedback systems within humans.
  
  There is also karma which is separate from utility which is given by one ml system to another, if it is helped it out or hindered it in a non-economic fashion.

• WillPearsonFeb 26, 2025, 1:28 PM

  2 points

  0 ∶ 0

  on: Share AI Safety Ideas: Both Crazy and Not

  I’ve been thinking that AGI will require an freely evolving multi-agent approach. So I want to try out the multi-agent control patterns on ML models without the evolution. Which should prove them out in a less dangerous setting. The multi-agent control patterns I am thinking are things like karma and market based alignment patterns. More information on my blog

[Question] In­tel­lec­tual prop­erty of AI and ex­is­ten­tial risk in gen­eral?

• WillPearsonMay 23, 2024, 10:48 PM

  2 points

  0 ∶ 0

  on: Big Pic­ture AI Safety: Introduction

  Does anyone have recommendations for people I should be following for structural AI risk discussion and possible implications of post-current deep learning AGI systems.

[Question] What is the na­ture of hu­mans gen­eral in­tel­li­gence and it’s im­pli­ca­tions for AGI?

• WillPearsonMar 9, 2024, 4:50 PM

  1 point

  0 ∶ 0

  in reply to: David T’s comment on: Ex­is­ten­tial risk man­age­ment in cen­tral gov­ern­ment? Where is it?

  I suppose I’m interested in questions around what is an existential threat. How bad a nuclear winter would it have to be to cause the collapse of society (and how easily could society be rebuilt afterwards). Both require robust models of agriculture in extreme situations and models of energy flows in economies where strategic elements might have been destroyed (to know how easy rebuilding would be). Since pandemic/​climate change also have societal collapse as a threat the models needed would apply to them too (they might trigger nuclear exchange or at least loss of control over nuclear reactors, depending upon what societal collapse looks like).
  
  The national risk register is the closest I found, in the public domain. It doesn’t include things like large meteorites, that I found.

[Question] Ex­is­ten­tial risk man­age­ment in cen­tral gov­ern­ment? Where is it?

• WillPearsonFeb 18, 2024, 12:29 AM

  3 points

  0 ∶ 0

  in reply to: CAISID’s comment on: Is work­ing on AI to help democ­racy a good idea?

  It’s true that all data and algorithms are biased in some way. But I suppose the question is, is the bias from this less than what you get from human experts, who often have a pay cheque that might lead them to think in a certain way.

  I’d imagine that any system would not be trusted implicitly, to start with, but would have to build up a reputation of providing useful predictions.

  In terms of implementation, I’m imagining people building complex models of the world, like decision making under deep uncertainty with the AI mainly providing a user friendly interface to ask questions about the model.

[Question] Is work­ing on AI to help democ­racy a good idea?

• WillPearsonDec 14, 2023, 5:55 PM

  3 points

  0 ∶ 0

  in reply to: Geoffrey Miller’s comment on: Is any­one work­ing on safe se­lec­tion pres­sure for digi­tal minds?

  Thanks, I did a MSc in this area back in the early 2000s, my system was similar to Tierra, so I’m familiar with evolutionary computation history. Definitely useful context. Learning classifier systems are also interesting to check out for aligning multi-agent evolutionary systems. It definitely informs where I am coming from.

  Do you know anyone with this kind of background that might be interested in writing something long form on this? I’m happy to collaborate, but my mental health has not been the best. I might be able to fund this a small bit, if the right person needs it.

• WillPearsonDec 13, 2023, 12:33 PM

  1 point

  0 ∶ 0

  in reply to: Ryan Greenblatt’s comment on: Is any­one work­ing on safe se­lec­tion pres­sure for digi­tal minds?

  Thanks, I’ve had a quick skim of propositions, it does mention perhaps limiting rights of reproduction, but not the conditions under which it should be limited or how it should be controlled.

  Another way of framing my question is if natural selection favours ai over humans, what form of selection should we try to put in place for AI. Rights are just part of the the question. Evolutionary dynamics and what is needed by society from AI (and humans) to continue functioning is the major part of the question.

• WillPearsonDec 13, 2023, 12:38 AM

  1 point

  0 ∶ 0

  in reply to: Ryan Greenblatt’s comment on: Is any­one work­ing on safe se­lec­tion pres­sure for digi­tal minds?

  I’ve clarified the question, does it make more sense now?

• WillPearsonDec 12, 2023, 10:46 PM

  1 point

  0 ∶ 0

  on: Is any­one work­ing on safe se­lec­tion pres­sure for digi­tal minds?

  And if no one is working on it, is there an organisation that would be interested in starting working on it?

[Question] Is any­one work­ing on safe se­lec­tion pres­sure for digi­tal minds?

• WillPearsonOct 23, 2023, 10:37 AM

  −5 points

  0 ∶ 0

  on: WillPear­son’s Quick takes

  I’ve been thinking a bit around secret efforts in AI safety research.

  My current thoughts are around: if it is or does occur what non secret efforts might be needed? E.g. if it develops safe AI media that shows postive outcomes from AI might be needed so that people aren’t overly scared.
  
  Oh and AI policy might be needed too, perhaps limiting certain types of AI (agentic stuff).

• WillPearsonAug 27, 2023, 8:46 AM

  1 point

  0 ∶ 0

  on: WillPear­son’s Quick takes

  How should important ideas around topics like AI and biorisk be shared? Is there a best practice, or government departments that specialise in handling that?