#time

"I think it's somewhat of a happy coincidence so far that most breakthroughs have been good. To say, I see a breakthrough on the horizon. Is that good or bad? How can we prepare for it? That's another thing academia is really not set up to do. Academia is set up to get the breakthrough. That is a question I ask myself a lot is here's an intellectual activity. Why can't it be done in academia? These days, my answer is if it's really primarily of interest to a very cosmopolitan philanthropist trying to help the whole future, and there's no one client and it's not frontier advancing, then I think that does make it pretty plausible to me that there's no one doing it. We would love to change that, at least somewhat, by funding what we think is the most important work."

quotekg

React to this quote

More by Holden Karnofsky

See all

“I now believe that there simply is no mainstream academic or other field that can be considered to be "the locus of relevant expertise" regarding potential risks from advanced AI. These risks involve a combination of technical and social considerations that don't pertain directly to any recognizable near-term problems in the world, and aren't naturally relevant to any particular branch of computer science. This is a major update for me: I've been very surprised that an issue so potentially important has, to date, commanded so little attention – and that the attention it has received has been significantly due to people in the effective altruism community.”

“I model the world as having most of the impact from extreme cases, 'home-runs'. I think that's true in business, science and social impact. If you have good personal fit, your chances of being that extreme case are dramatically better – you climb the ladder, you get to see and do things that other can't, and you get to make unique contributions.”

“When I look at large foundations making multimillion-dollar decisions while keeping their data and reasoning "confidential" – all I see is a gigantic pile of the most unbelievably mind-blowing arrogance of all time. I'm serious.”

“So one crazy analogy to how my morality might turn out to work, and the big point here is I don't know how my morality works, is we have a painting and the painting is very beautiful. There is some crap on the painting. Would I like the crap cleaned up? Yes, very much. That's like the suffering that's in the world today. Then there is making more of the painting, that's just a strange function. My utility with the size of the painting, it's just like a strange and complicated function. It may go up in any kind of reasonable term that I can actually foresee, but flatten out, at some point. So to see the world as like a painting and my utility of it is that, I think that is somewhat of an analogy to how my morality may work, that it's not like there is this linear multiplier and the multiplier is one thing or another thing. It's: starting to talk about billions of future generations is just like going so far outside of where my morality has ever been stress-tested. I don't how it would respond. I actually suspect that it would flatten out the same way as with the painting.”

“I have more pet peeves than anyone else I know, and one of the very biggest ones is what I call flakes: people who say they'll do something, then back out without giving me the communication I need to adjust my plans. Anyone who's ever stood me up, or even been very late to something without a heads-up phone call, or just forgotten to do something they knew I was counting on them to do, has felt my wrath … thanks to cellphones and email, there is just no excuse.”

“I could tell you about my strengths and weaknesses. I'm creative and intelligent and able to rock the boat and do things that can create uncomfortable situations and then not be bothered about it. But I'm not the best diplomat, I don't have a lot of patience for being sunny and making people happy.”