Huge thanks to Alex Zhu, Anders Sandberg, Andrés Gómez Emilsson, Andrew Roberts, Anne-Lorraine Selke (who I've subbed in entire sentences from), Crichton Atkinson, Ellie Hain, George Walker, Jesper Östman, Joe Edelman, Liza Simonova, Kathryn Devaney, Milan Griffes, Morgan Sutherland, Nathan Young, Rafael Ruiz, Tasshin Fogelman, Valerie Zhang, and Xiq for reviewing or helping me develop my ideas here. Further thanks to Allison Duettmann, Anders Sandberg, Howie Lempel, Julia Wise, and Tildy Stokes, for inspiring me through their lived examples.
I did not believe that a Cause which stood for a beautiful ideal […] should demand the denial of life & joy.
– Emma Goldman, Living My Life
This essay is a reconciliation of moral commitment and the good life. Here is its essence in two paragraphs:
Totalized by an ought, I sought its source outside myself. I found nothing. The ought came from me, an internal whip toward a thing which, confusingly, I already wanted – to see others flourish. I dropped the whip. My want now rested, commensurate, amidst others of its kind – terminal wants for ends-in-themselves: loving, dancing, and the other spiritual requirements of my particular life. To say that these were lesser seemed to say, “It is more vital and urgent to eat well than to drink or sleep well.” No – I will eat, sleep, and drink well to feel alive; so too will I love and dance as well as help.
Once, the material requirements of life were in competition: If we spent time building shelter it might jeopardize daylight that could have been spent hunting. We built communities to take the material requirements of life out of competition. For many of us, the task remains to do the same for our spirits. Particularly so for those working outside of organized religion on huge, consuming causes. I suggest such a community might practice something like “fractal altruism,” taking the good life at the scale of its individuals out of competition with impact at the scale of the world.
If you’re a Blinkist or Sparknotes person, you can stop here.
If you read on, you might find that everything written has been said already in the history of philosophy.[1] This is a less rigorous experiential account that came from five years of personal reckoning. I thought my own story might be more relatable for friends with a history of devotion – unusual people who’ve found themselves dedicating their lives to a particular moral vision, whether it was (or is) Buddhism, Christianity, social justice, or climate activism. When these visions gobble up all other meaning in the life of their devotees, well, that sucks. I go through my own history of devotion to effective altruism. It’s the story of [wanting to help] turning into [needing to help] turning into [living to help] turning into [wanting to die] turning into [wanting to help again, because helping is part of a rich life].
There’s also an implicit critique of the Effective Altruist movement here. As far as I can tell, my dark night experience represents a common one for especially devoted, or “hardcore” EAs – the type who end up in mission-critical roles. If my experience is in fact representative, then I suspect it is productive (even on consequentialist grounds) for the movement to confront its dark night problem.
Of course, there has been much discussion about burnout and mental health in EA.[2] The movement has responded: there are support groups and more. But I doubt that ordinary mental health interventions – therapy, coaching, etc – are sufficient for hardcore EAs. Instead, I think that hardcore segments of the movement, who are bound by philosophy, might be helped by examining whether their philosophy is, in fact, in agreement, rather than in competition, with personal flourishing.[3]
Sidenote for the rigorous readers of this forum: I ask you to read this essay somewhat impressionistically. “The logic is incomplete, but let’s see if he’s still onto something,” is the attitude I'd suggest. Although I wrote this essay over six aching months, I admittedly rushed its completion and editing in order to make the deadline of the Red-Teaming contest.[4]
What is quest-relevant?
After days behind Berlin’s grey sky, the sun now peaks through, a thin beam between clouds, golden, lighting the cheek of my partner, as if I am in a role playing game that is telling me this cheek is quest relevant. Maybe it is: I touch it, lightly, and she stirs. “Love,” she murmers groggily, her eyes still closed; the word is both description and invocation. “Love love love.”
I wonder at my role in this game. It is clearly to love, but how?
The world turns and the sun lights much more: It streams through the windows of my parents’ bedroom in New York, where they lie, hoping to become grandparents someday soon. It streams through windows of friends in California, some who lie across mattresses in loneliness, reluctant to call me or anyone else because they are not sure if we care. The world turns and perhaps the sun touches a kid in western Kenya; he wakes with brain fog beyond mere grogginess; his stomach hurts – it is full of hookworms. It turns many times, and the light streams through windows in cities of thirty years into the future. Few of these future people, framed by their windows, know that tomorrow, the sun might shine on an earth empty of subjects, as someone at Google, OpenAI, or Tsinghua University hits go on an algorithmic process designed to maximize economic output. It will spiral out of control, consuming the atoms of friends, children, dogs, sidewalks, trees, necklaces, dirt, rocks, wild boars, the cheeks of lovers, consuming all possibility of letters from utopia,[5] all this for raw materials – unless we hit stop.
A lover’s cheek, mom and dad, lonely friends, a stranger in Kenya, and people of the future – these things are all quest relevant. If you’re like me, you know it to be so, even during the times we convinced ourselves otherwise. And so, if you’re like me, you become overwhelmed.
From childhood through college, I handled the overwhelm by narrowing in on those things which were “near and dear.” I became a New York City Enjoyer and lived vividly: composing songs for friends, dressing brightly, performing nonsense in leotards at art museums, dancing until morning to Balkan brass, meditating, lying in the grassy fields of parks, studying cognitive science for no reason other than fascination.
Ultimately, it wasn’t enough. As my sense of agency increased, it became impossible to ignore the fact that billions of others didn’t share my idyllic quality of life. In 2013, I was sitting in a zoo, pondering the sentience of animals, when I found myself Googling “how can I make a difference” or “practical moral philosophy” or “what should I do with my life?!?!” or some combination of these words. Eventually, I encountered Peter Singer, and started down the Effective Altruism (EA) rabbit hole.
The unstoppable logic
Previously, I had narrowed on the near and dear to avoid the overwhelm. From 2013-2019, I re-narrowed on the far and dear: the drowning children of other countries, the suffering animals of factory farms, the Schrödingarian citizens of the future who dangled between existence and annihilation. I moved to the Bay Area and I threw myself into the EA movement. With various amazing cofounders, I built EA Global, Reducetarianism, EA Ventures (the precursor to EA Funds), the Pareto Fellowship, Reserve, and a myriad of minor hunks of movement infrastructure.
What had finally tipped me into EA was an article.[6] It proposed dead children as a unit of currency. “Here me out,” it said: It costs roughly $800 to save a child’s life through charity [at least this was the assumption at the time the article was written]. “If you spend eight hundred dollars on a laptop, that’s one African kid who died because you didn’t give it to charity. Distasteful but true.”
Well, fuck. I tried to escape the conclusion. But the logic was unstoppable. Hm. I was still young and poor; I didn’t have money, but I did have time. And so, soon after, I started to work 12-to-14-hour weekdays and weekends on EA causes. No amount of hours seemed like enough. How many hours did it take to raise $800? In my case – since I am decent at “networking” – probably a couple of hours, the length of one movie. So if I watched a movie instead of fundraising, a child was now dead. Did that mean watching a movie made me a murderer? I concluded: yeah. It did.
I extrapolated the implications of this. And so began a personal hell realm. As I crossed its borders, and continued to its interior, I went from being the happiest person I knew to eventually wanting to end my life.
What one must become
How to not be complicit in mass suffering and death? The answer was clear: I needed more time, more energy, more focus. I needed to become superhuman, I needed to become like Elon Musk. Or better: I could become like the Terminator, a machine single-mindedly devoted to improving the world. A couple of fellow hardcore EAs gave me this idea: “Terminator-like focus.” Interestingly, they both work on AI safety.[7]
I became renunciate. I stopped making art, because my art was not worth a child’s life. I swore off emotions that might hamper me. I let go of girlfriends and live music and old friends and calling my mom because these things were now wastes of time in the face of The Big Problems. I stopped dressing in the crazy outfits and bright colors that I’d become famous for; I did not want to harm the respectability of the movement. I gave up my lifelong hope to become a dad. I gave up on love.
But it was not all about giving up. It was also about adding things. I added sprinting up hills every morning. I learned rationality techniques, hundreds of them, to the point where nearly all my thinking happened through rationality techniques (the stakes were too high for things like mind-wandering). I ordered the wakefulness drug modafinil from India. Although I had a policy against lying, I sometimes began to mislead, if I thought doing so might help with the greater good. I started networking with people who I cared about only insofar as their talents, money, connections, or prestige were instrumental for saving or improving the lives of others.
Indeed, this was now the only way I cared about myself. “I am an instrument that serves the world.” I would repeat variants of this phrase in my head to make it true, to eliminate any resistance from the parts of me that wanted things outside my infinite moral obligation.
All of this made me good at my new job as Director of Growth at the Centre for Effective Altruism’s USA branch.
I judged others for not following suit. I judged them for continuing to make art, play video games, and prepare elaborate dinners. I especially judged fellow effective altruists, the ones who I deemed “not really serious about this,” who continued to pursue “non-altruistic desires,” for failing to restructure their entire lives to be hardcore, like me. Did they not stay up at night, thinking about the suffering multitudes they might help by dedicating more time and money to the cause? I did, because I was a real EA.
I wrote the author of the “dead children as currency” article, asking him to write a follow-up article. I told him he should write one about the opportunity cost of not just dollars, but of time, to persuade others to become more dedicated. He declined. He wrote back “…There’s a point at which you run up against how nobody can do 100% effective things all the time without going crazy.” A wise person would have listened. I was a 24-year-old person.
A descent
After a couple of years of the Hardcore Way, I began to lose steam. Maybe it had something to do with inattention to my “non-altruistic desires?” A breaking point came around the time that I spoke with an actual real-life friend of Elon Musk. He told me that even Elon makes time for fun. (This was before Elon made his fun more obvious, for instance, by smoking weed on Joe Rogan or tweeting things like “69.420% of statistics are false.”) This surprised me. But the the more I researched, the more it turned out that many of the Great People of history were characterized by rich lives, full of romance and hobbies.
Aha, I thought. My mistake was failing to embrace my human frailty. I could still rescue my motivation. I could stay single-mindedly devoted to doing good. But I needed to adapt my motivation, to make it work with the meat-machine that I inescapably inhabited.
It was time to watch movies again. It was time to call my mom. To reunite with old friends. To write poems once more. Submitting to these lower cravings was necessary for endurance on The Cause.
So I watched movies and wrote poems while something in the back of my head urged, “Refresh me faster!” at these activities. Walking was no longer about just getting from A to B: it was also about soaking in beauty so I could alter my neurotransmitters in ways that would make me more generative. I went to bars in a way that was justified because these nights were spent with allies and comrades with whom I intended to coordinate – not just with any random person I enjoyed the company of. I found a girlfriend, but this was also OK because she was a fellow EA – while other couples might enjoy a candlelit evening, we spent the time strategizing about the long term future. And then by morning I danced in the sun to drums around Lake Merritt in Oakland while wondering, “How can I dance in a way that is useful? In a way that helps me overcome psychological barriers to being productive? Perhaps I can do interpretative dances of important ideas so I can internalize them better.” And I could. I internalized many important ideas through dance.
I wrote poems.[8] A metaphor kept recurring, working its way into my stanzas: it was of my organs fading from red to grey, becoming machine parts whose role was to sustain my output. Sometimes while writing I would break through to a heightened form of consciousness and my world would change, like I’d popped a bubble of numbness: colors became brighter, object-boundaries became sharper, ideas came more fluidly, the people around me felt rich and alive, like worlds onto themselves which my heart was bursting to explore. During these episodes, as I reflected on my state, two things would happen at once.
One part of me would say, “This is what life is about. You used to feel this way all the time. Remember? But these days you are doing something terrible to yourself. You are becoming a husk.”
Another part of me would say, “This heightened state is called ‘hypomanic.’ But if you can bring some rationality into this powerful state of mind to harness it, you might just stand a chance of making a difference. Keep writing poetry!”
These vivid moments became fewer and fewer and soon I felt worse than I had when I’d just ignored my “non-altruistic” impulses. I became confused: Why did none of my old joys rejuvenate me anymore?
I failed to answer this question before I lost the will to live.
The bottom
And yet I was morally obligated to live: I still needed to fulfill my duties after all. And yet…I could not get myself to fulfill them. Not only could I not work, but also it took me hours each day to get out of bed. There was no one to talk to about this: I thought my parents would freak out if I told them – they like to see me happy. Therapists? They dealt with my pursuit of effective altruism as a pathology, so I stopped seeing them. Friends? I’d been out of touch with my old friends for years. My new friends all doubled as colleagues who I dared not weigh down with my problems; they were working on saving lives. Disrupting their work would make me a murderer.
I quit my role at the earn-to-give startup I’d cofounded, Reserve, mostly by failing to show up. A controversial organization called Leverage Research, which was full of similarly hardcore EAs, rented me a relatively low-cost room. (Edit: Much more accurate to say this instead: I was receiving a salary from Paradigm, a Leverage affiliate that incubated my company, Reserve, and part of that salary went to renting a room.) I participated in a few of their experimental therapies, telling myself that I wasn’t burdening them, because at least they were learning something by helping me.
The techniques they used were actually impressive (I still use many of them). But the culture behind them made my problem worse: their aim was to help people remove psychological blocks to working on the world’s biggest problems. At this point, returning to working on the world’s biggest problems meant I’d just remold myself into a Terminator meat machine. I'd begun to associate the prospect of recovery with personal obliteration.
The very use of my will felt dangerous, because I would use it to become a numb instrument, a being whose only purpose was to work. But what was the alternative? What was my life worth if I could no longer work? What use were life’s joys? Of what value were sex, dancing, or strumming a ukulele if they did not help me fulfill my purpose?
I had no answer. From 2018-2021 I spent most of my time lying on mattresses. And eventually, I was accepting unemployment checks and not much else. I started playing video games again for the first time since high school and hated myself for becoming addicted to such uselessness. I stopped responding to emails and messages (“Hey Tyler, haven’t heard from you in a while. How have you been?”).
I didn’t have much experience with mental illness, and I remember feeling shocked at how bad it is possible to feel. I decided the best thing I could do was to not burden my network with my untimely death…unless I could figure out some way to make it look like an accident. But all the ways I thought of required more competence than I was capable of at the time, like amplifying a hilarious theory that several friends and family had for my absence: that maybe I’d been recruited for a secret and dangerous project. Thanks to EA’s connections to government officials and billionaires, and the still-living legend of my competence, it seemed plausible to them.
During brief and infrequent windows of lucid energy, I tried all the standard ideas for beating depression: therapy, SSRIs, NDRIs, exercise, diet, routines, nature walks, psychedelics, meditation, good sleep, journaling, seeing friends, etc etc etc. All these solutions shared the same problem: they had a chance of actually working. And if I got better, my purpose would require me to instrumentalize myself again. I wasn’t going to do that.
Finally, I even tried giving up on my purpose.
Guess what: I couldn’t! My sense of purpose wasn’t just a social identity. (This aspect I could drop, and – eventually, thankfully – I did.) It was a core part of me, as much as my love of music. Dropping my impulse to help in a big way would be as hard as dropping my love of music. Both of these things were sources of inherent meaning, ends-in-themselves – things I engaged with for their own sake.
It took me years to unpack the implications of these thoughts. But when I finally unpacked them, I found a reason to live.
Moral inquiry
I now believe the root of my suffering was in a philosophical mistake: I’d supposed there existed some external source of moral authority – in particular, one which imposed a totalizing obligation to help.
The word “obligation” probably means different things to different people. The way I’d been (unconsciously) using it was like this: An obligation is that which – if I don’t fulfill it – I become Bad.
When I took the EA logic of opportunity costs seriously, my moral obligation became rather extreme: Sure, my basic survival needed to be covered. But any resources I had beyond that, I was Obligated to spend on The Most Impactful Thing, because – if I failed to do so – people would suffer and die. That would make me Bad.
I didn’t want to be Bad. So I needed to spend all my time becoming Good. There was no time for other seemingly meaningful pursuits. Art, relationships, and so on – these apparent ends-in-themselves would need to be cast aside, or become means to serve my moral obligation, like coal that feeds a furnace. I could not bear the thought that someone might die because I mindlessly enjoyed a movie instead of working on the Effective Altruism movement. This subjugation of my “non-altruistic” ends to moral ends was what led to my depression.
I found the reason to live again through contemplating the question: Where does my moral obligation come from?
I didn’t believe it was mandated by a god. Nor did I believe it was somehow written into physics. Nor did I believe that it came from society: There were plenty of societal norms that I didn’t care about. Furthermore, effective altruism itself was often considered weird or repellant when I first got into it, in 2013.
Perhaps I could locate the source of my moral obligation by asking questions like, “Who or what would discipline me, or confer Bad Person status upon me, if I gave up my obligation?” Alternatively: “Who or what would compel me to return to the Moral Way if I strayed?” Imagine that I did give up on moral ends, and decided to live a nice normal life as – I don’t know – a sunglasses-wearing, Ferarri-driving management consultant who donates $0 per year and has 0 altruistic projects.
- Would God strike me down or send me to a hellish afterlife? Doubtful.
- Would a physical law force me back to altruism? No.
- Would an abstract, imaginary, perfectly rational being disapprove of me? Unclear. Rationality enables agents to pursue their ends. Where did the moral ends of a perfectly rational being come from? This was essentially the question I was trying to answer.
- Would society put me in jail or ostracize me? No. In fact, I might become higher status being a management consultant instead of a guy who illegibly moves between projects, betting on their potential impact. In particular, most of my friends and family would be happy because I’d have more time for them.
So where did my moral obligation come from?[9] Rereading Singer’s drowning child thought experiment was clarifying:
To challenge my students to think about the ethics of what we owe to people in need, I ask them to imagine that their route to the university takes them past a shallow pond. One morning, I say to them, you notice a child has fallen in and appears to be drowning. To wade in and pull the child out would be easy but it will mean that you get your clothes wet and muddy, and by the time you go home and change you will have missed your first class.
I then ask the students: do you have any obligation to rescue the child? Unanimously, the students say they do.[10]
I ran a different version of the thought experiment without language around obligation: “Imagine that – somehow – the universe has deemed me unalterably Good regardless of whether I help. Do I still want to rescue the child?”
My answer was “Yes” – and, incidentally, so was that of 96% of 697 people who took my Twitter poll with similar wording (disclaimer: sampling bias, imperfect wording, etc etc).
After rewording Singer’s thought experiment, it dawned on me that I’d been using the frame of an “obligation” as a psychological whip to get myself to do what I already wanted to do. Weird.
When I went looking for the force or deity outside of myself that held the whip, there was nothing there. I was the one holding the whip. This was a revelation. The thing underlying my moral “obligation” came from me, my own mind. This underlying thing was actually a type of desire. It turned out that I wanted to help suffering people. I wanted to be in service of a beautiful world. Hm.
Suddenly the words of my moral vocabulary took on new meanings. Was I obligated to save the drowning child? Did I have a responsibility or moral duty? Was it something that one should or ought do? This language seemed misleading. These words seemed to replace my natural impulse to help with an artificial demand imposed by…nothing and no one.
It made me angry. I felt like I’d drunk the kool-aid of some pervasive cult, one that had twisted a beautiful human desire into an internal coercion, like one for a child you’re trying to get to do chores while you’re away from home.
There’s this scene in the movie Everything Everywhere All at Once where a cop tells the villain, “Ma'am, you and your pig can't be here.” She replies, “See, I can physically be here. But what you meant to say is you're not allowing me to be here.” Similarly, I started translating moral terms: “One is obligated to help others,” now meant either “Someone wants me to help others,” or else, “I personally want to help others.”
What would happen if I put down the whip of obligation? What would happen if I stopped threatening myself with Bad Person Status? Would I stop pursuing my own desire to help? It seemed scary that I might.
On the other hand, it was clear that if I kept using the psychological whip of obligation, I would have little joy, burn out again, and thus fail to help anyone for more than one strenuous sprint. But I believed myself to be in a marathon. It was time for me to try a different way. I would reckon with my intrinsic desire to help.
The puzzle of having many ends
To quote a philosopher friend, Jesper Östman “…Morality is only relevant to us because we care deeply about it. But we care deeply about other things too. So we should try to make all these things go well, and not sacrifice some of them. At least if we are rational agents.”
And so the first thing to reckon with was this: Now my moral desires had become commensurable with other sources of meaning – those things I engaged as ends-in-themselves. These other ends were the ones I’d been ignoring or turning into means to feed my all-devouring obligation…an obligation I could no longer locate in external authority. Ends such as: Listening to music for sheer enjoyment. Hanging out with non-EA friends. Helping a random mom carry her stroller down the subway stairs, even if the time doing so would trade off with more effectively altruistic endeavors. An action done for the “warm fuzzies” alone. (Gasp!)
I’d already learned a hard lesson: My life goes poorly when revolves around one end only. What would happen if I failed to partake in a well-rounded life of ends, eudaemonia, in other words? The real punishment of giving up on making art or serving a flourishing world was not that a god strikes me down or that society punishes me. The punishment was that I would start to feel empty, depressed, weak, irritable, or brain-foggy, as if I was missing some vital spiritual nutrient. And the reward of pursuing my ends was simply that I would feel healthy, energetic, wholesome, content, alive.
But the prospect of pursuing all of my ends was overwhelming. How to balance a lover’s cheek, mom and dad, the writing of poems, and the aid of sufferers across oceans and time? Well, I had to ask: had I ever really reckoned with the problem, with the same dedication I’d applied to just one ends in the EA movement?[11] In truth, I hadn’t. I, like many EAs I know, had only decided it was an unsolvable problem.
These days, I think it’s just a practical problem. I have faith that the tradeoffs we presume are not what they seem – but I must admit that this is the part of the essay where I’m still figuring things out for myself. Below I outline some proposals for not simply balancing one’s various ends, but integrating them, like adopting a diet that not only gets you healthy proportions of nutrients, but also incorporates delicious combinations. In fact, similar principles seem to apply to food diets and what you might call “meaning diets.” For instance:
- Partial substitution is possible (multiple foods contribute Vitamin C; dancing and making art might both contribute some [ineffable spiritual nutrient]).
- Different portions are required for different nutrients; it’s helpful to understand your dietary requirements.
- Some nutrients have harmonies, they mutually enhance one another.
But whereas food nutrients are absorbed through largely involuntary processes, the absorption of spiritual nutrients seems to happen through quality of engagement, a special type of attention.
This returns me to the problem of turning ends into means. In practice, when I turn ends into things that are primarily instruments for other ends – rather than engaging them for their own sake – I engage them in lower-quality ways.
Back when my team was planning the first EA Global, I started hosting dance party breaks in between Pomodoros. These energized us during our days of processing applications, emailing speakers, contacting vendors, and so on. But if I danced only to feel alive enough to work on EA Global, it wouldn’t have properly nourished me in practice. What made this dancing nourishing was that we turned our room in the CFAR & MIRI office into a rave and went all in.
By analogy, imagine (a) reading your favorite book for its own sake vs (b) reading the same book only to get an A+ on a test. You can feel what’s different about these experiences. What is it?
It takes serious care to harmonize spiritual nutrients without subjugating one to the other. But one of the most simple ways to change one’s life is to ask: of all activities I currently engage as means, how can I find elements in them to engage as ends? Even doing the dishes can be miraculous when it’s not just about an empty sink, but regarded as an immersive activity where one enjoys the sensations of scrubbing and water over one’s hands, or more abstractly, enjoys the exercising of excellence in one’s own attention to detail, finding the marks and stains that few others would have noticed. Hell, even using Microsoft Excel can be marvelous if it’s not solely about getting the budget done – perhaps you’re someone who, like me, enjoys the practice of systematization. The key is to lean into these ways the activities are already meaningful for their own sake.
This doesn’t imply discarding the useful outcomes of activities. In fact, I find that when I engage something for its own sake, I’m far more likely to produce virtuosic work. At a meeting of the rationality community, Anna Salamon once argued that to use truth-seeking as solely a means to fight existential risk (x-risk) would compromise the activity of truth-seeking – for instance, by cutting corners while rushing for an answer. So she proposed an alternative: “Rationality for rationality’s sake…for x-risk’s sake.”
It seems that engaging activities as ends is important for not only the absorption of spiritual nutrients, but also – paradoxically – for their usefulness as means. This can be bewildering for a consequentialist to wrap their head around. It may take mental practice to make this shift if one has ported consequentialist patterns to other parts of one’s life, viewing life's activities as instruments, mostly good for other things rather than as containing good in themselves.
At this point, I’ll drop the diet metaphor, and stop speaking of individual nutrients, because the dissociation of nutrients leads to things like existential Soylent, an artificial lifestyle that theoretically gets you all the things you need, but which, in actuality, are unlikely as such to be healthy or enjoyable over the long-term, since it likely doesn't contain the same harmony of nutrients as a whole food or broader cuisine.
Fractal altruism
For supporting eudaemonia, a better metaphor than a diet is probably something like a regional cuisine, prepared by you and others who share many of your spiritual needs. A good cuisine is nutritionally complete and evolves amidst a local way of life, including nutritional harmonies that come together over time through a community developing dishes via trial and error. Community is the medium that affords harmony amidst ends, weaving disparate parts of the good life into a whole.
The ideal community is like a shared garden, growing all the ends for a regional cuisine, i.e., the particular composition of ends enjoyed by your people. In my ideal community, for instance, infrastructure for enjoyable parenthood would be grown alongside support for effective altruist projects. Tending to the growth of one another’s ends not only involves reciprocity (“I benefit you so that benefit me.”), but also mutuality, symbiosis, alignment (“I benefit both of us at once, by tending to shared ends.”).
This truly isn’t a new idea. Mutual dedication to one another’s ends seems like a thing commonly present in religious and ethnic communities. But it seems quite uncommon to the demographic of secular idealists, like me. Such idealists tend to form and join single-focus communities like effective altruism, which serve only a subset of our eudaemonic needs.[12]
If a mutualist community were to include EA-inclined people like myself, effective world-scale service needs to be supported in conjunction with other ends. A parsimonious idea can be applied to a community that supports flourishing at the level of the self, the neighbor, and the world. For this, I’ve been trying on the term “fractal altruism.” This is simply where similar principles of effectiveness and altruism are applied across scales.
In such a fractal altruistic community, tradeoffs between ends would, of course, be a matter of active research and debate. There is still an important sense in which a unit of effort that the community spends on a tango class could have been spent on a local conference for alternative meat entrepreneurs.
However, I expect fractal altruists to become experts in dissolving tradeoffs in the same way that effective altruists became experts in finding top interventions. For instance, perhaps the tango class may benefit from having fresh dance partners while the entrepreneurs are in town. Meanwhile, the conference may benefit by giving its participants a fun and memorable way of growing closer. Or perhaps – as the community grows and its members specialize – "units of effort" lose fungibility altogether. Older grandparents in the community might be well-placed as a team to run a daycare, but not to work on artificial intelligence policy. Synergy, specialization, and many other strategies can minimize tradeoffs. Strategies can be borrowed from religious communities that have already been attempting altruism across the scales of self, neighbor, and world for hundreds of years, regardless of whether you agree with their premises.
I doubt the template for such a community would be communes or isolated ideological enclaves. These typically fail to be self-correcting and demonstrably don’t last very long. I don’t know what the right template is. I suspect it would be something quite normal and informal, maybe even boringly traditional: a tight-knit neighborhood inside a broader municipality (see, for example, Chinatown in New York).
Such a tight-knit neighborhood might come about like so: A loose, nonideological network of people who already look out for one another – mostly friends and family – slowly move to the same part of a town or city. There probably needs to be some excuse to move there and root long-term. This excuse might be shared parenthood infrastructure to help the modern undersupported parent. Or it might be a new university that employs the majority of community members. Like many tight-knit neighborhoods, it might lack a centralized governing body, simply consisting of many overlapping close personal relationships and activity groups.
How then would this be different from a normal tight-knit neighborhood? The only added ingredient might be demographic: a substantial subset of people who are devoted to world-scale service (ideally the effective kind). Provided that this subset is supported, not everyone needs to identify with a fancy ideology like “fractal altruism.” Fractal altruism would simply describe the community’s emergent activity, one which springs from its members’ natural inclination to tend to one another’s ends, which happen to include – for some – intense moral ambition. Here are examples of friends building things close to what I’m suggesting: The Neighborhood SF, The Neighborhood NYC, and some parts of The Embassy Network.[13] (My own particular approach would focus more on young families, for reasons I discuss elsewhere.[14])
But hey, this whole fractal altruism thing is just one proposal for cultivating our ambitious moral projects inside a garden of our other ends. I wish to hear about others.
I’ll leave you now with three other wishes:
For young entrants to movements like EA, bursting with revelation and ready zealotry:
I wish that you pursue your newfound revelation with vigor, with the aliveness of one who holds firmly, and uncompromisingly, to all that is dear to one’s spirit. I wish that you hold to these things – whether they fit the movement or not – until some synthesis can occur. I wish that you never need a dark night at all, that there is tenderness rather than violence to the internal revolutions you are likely to endure. From where you are now, you might look at the old guard and think “They are smarter than I.” In many ways, they probably are, and yet they may have forgotten the wordless truths that you remember. Let not the fire which brought you here be quenched. I wish that you remember, remember, remember.
For those in the midst of their dark night:
If you find yourself lying on the floor for more than a month, I wish that you speak with someone who likes or loves you, to admit your pain to them (even if it seems they couldn’t possibly understand), and to ask their support (even if you couldn’t possibly know what that could look like). If you’re a consequentialist, I wish that you read chapter five of Mill’s autobiography, the part where he discusses his return from depression. (I've linked some excerpts below.[15])
Moreover: I wish you the death of the stance which destroys you. And when that worldview withers to the ground, I wish you the equivalent of bacteria and fungi, to metabolize and repurpose those raw ingredients which compelled you to the worldview to begin with. Here is a spell written by the ancient Egyptians. And here are some things I've written on depression, in case they help. (Edit: I’ve removed this link, since my suggestions are speculative and intended for my niche Twitter audience. If you have a good replacement resource, please comment with it below!)
For those beyond the dark night:
I wish you hard-earned cousinhood. I wish that you find each other, inspire each other, fight and refine each other. I wish that you grow and share the garden of ends, and from it, grow something new, a fruit we’ve never seen. I wish that you find shared pride in having been humbled, and faith that more humbling is sure to come, breaking us over and again, until fuller truths are found, ones to bring the world – and the aspect that is you – to flourish.
Edit: ps – if you're a moral antirealist, like most EAs I know, I strongly recommend this post that Spencer Greenberg sent me. I wish it had existed in 2013; it probably would have saved me a lot of the confusion and suffering I described in this essay!
- ^
E.g., Alasdair MacIntyre, Charles Taylor, Nietzsche, Aristotle, and forthcoming work on "valuism" by Joe Edelman and Ellie Hain for ideas around ends-in-themselves as being the valuable things. Buddhist ideas and the beautiful work of Simone Weil for the idea that quality of attention differentiates ends and means. Also…Confucius (?!) for ideas very similar to fractal altruism.
- ^
Here are 10 forum posts on burnout and self-care:
https://forum.effectivealtruism.org/posts/NDszJWMsdLCB4MNoy/burnout-what-is-it-and-how-to-treat-ithttps://forum.effectivealtruism.org/s/a2LBRPLhvwB83DSGq/p/J2tmgAn8ne6Yhk27o
https://forum.effectivealtruism.org/s/a2LBRPLhvwB83DSGq/p/hh7juwFBMftSRZKu4
https://forum.effectivealtruism.org/s/a2LBRPLhvwB83DSGq/p/vPceuASWY4Ea97vAg
https://forum.effectivealtruism.org/posts/4kqiHGrZh6Rj7EmEW/cheerfully
https://forum.effectivealtruism.org/posts/cvjABvEmyEiFZ5eAZ/give-sustainably
https://forum.effectivealtruism.org/posts/WuWDS4SmtLNd6sKtb/helen-toner-sustainable-motivation
- ^
This might only apply to EAs who believe that improving the world is a marathon rather than a sprint. Those with short x-risk timelines might still endorse burning out the most dedicated people until we've reached the long reflection or the like. You cold cold benevolent bastards. 😛
- ^
- ^
"Letter from Utopia" by Nick Bostrom
- ^
Said article on dead children as currency.
- ^
I still love you guys.
- ^
- ^
Spencer Greenberg has a great essay on this confusion if you're a moral anti-realist: Tensions between moral anti-realism and effective altruism
- ^
- ^
In reality, my pursuit of EA probably decomposed into multiple ends, including – separately – the alleviation of suffering, being of service to a beautiful world, engaging in systematic thought, and other.
- ^
This is changing, especially as coliving grows more popular. However, shared gardens take time and care, and our demographic is typically too mobile to make one prosper. I think the demand for parenthood infrastructure will cause the next revolution here, causing friends and colleagues to settle down together for the sake of their children.
- ^
- ^
Here’s a Twitter thread I wrote with a regrettably overbold tone and misuse of the term “village,” which made people think I wanted to build a rural commune rather than something more like a neighborhood.
- ^
From the winter of 1821, when I first read Bentham, and especially from the commencement of the Westminster Review, I had what might truly be called an object in life; to be a reformer of the world. My conception of my own happiness was entirely identified with this object. The personal sympathies I wished for were those of fellow labourers in this enterprise. I endeavoured to pick up as many flowers as I could by the way; but as a serious and permanent personal satisfaction to rest upon, my whole reliance was placed on this; and I was accustomed to felicitate myself on the certainty of a happy life which I enjoyed, through placing my happiness in something durable and distant, in which some progress might be always making, while it could never be exhausted by complete attainment. This did very well for several years, during which the general improvement going on in the world and the idea of myself as engaged with others in struggling to promote it, seemed enough to fill up an interesting and animated existence. But the time came when I awakened from this as from a dream.
...
In this frame of mind it occurred to me to put the question directly to myself: "Suppose that all your objects in life were realized; that all the changes in institutions and opinions which you are looking forward to, could be completely effected at this very instant: would this be a great joy and happiness to you?" And an irrepressible self-consciousness distinctly answered, "No!" At this my heart sank within me: the whole foundation on which my life was constructed fell down. All my happiness was to have been found in the continual pursuit of this end. The end had ceased to charm, and how could there ever again be any interest in the means? I seemed to have nothing left to live for.
...
I gradually found that the ordinary incidents of life could again give me some pleasure; that I could again find enjoyment, not intense, but sufficient for cheerfulness, in sunshine and sky, in books, in conversation, in public affairs; and that there was, once more, excitement, though of a moderate, kind, in exerting myself for my opinions, and for the public good. Thus the cloud gradually drew off, and I again enjoyed life; and though I had several relapses, some of which lasted many months, I never again was as miserable as I had been.
...
I, for the first time, gave its proper place, among the prime necessities of human well-being, to the internal culture of the individual. I ceased to attach almost exclusive importance to the ordering of outward circumstances, and the training of the human being for speculation and for action.
I had now learnt by experience that the passing susceptibilities needed to be cultivated as well as the active capacities, and required to be nourished and enriched as well as guided. I did not, for an instant, lose sight of, or undervalue, that part of the truth which I had seen before; I never turned recreant to intellectual culture, or ceased to consider the power and practice of analysis as an essential condition both of individual and of social improvement But 1 thought that it had consequences which required to be corrected, by joining other kinds of cultivation with it. The maintenance of a due balance among the faculties now seemed to be of primary importance. The cultivation of the feelings became one of the cardinal points in my ethical and philosophical creed. And my thoughts and inclinations turned in an increasing degree towards whatever seemed capable of being instrumental to that object.
I now began to find meaning in the things, which I had read or heard about the importance of poetry and art as instruments of human culture. But it was some time longer before I began to know this by personal experience. The only one of the imaginative arts in which I had from childhood taken great pleasure, was music; the best effect of which (and in this it surpasses perhaps every other art) consists in exciting enthusiasm; in winding up to a high pitch those feelings of an elevated kind which are already in the character, but to which this excitement gives a glow and a fervour, which, though transitory at its utmost height, is precious for sustaining them at other times.
...
In most other countries the paramount importance of the sympathies as a constituent of individual happiness is an axiom, taken for granted rather than needing any formal statement; but most English thinkers always seem to regard them as necessary evils, required for keeping men's actions benevolent and compassionate. [Boooooo! - Tyler's commentary.]
Root out maximizers within yourself. Even 'doing the most good.' Maximizer processes are cancer, trying to convert the universe into copies of themselves. But this destroys anything that the maximizing was for.
I agree. The motto is "doing good better" not doing good the best.
This post single-handedly changed my life. The first two thirds of my 2022 were mentally bleak and full of self-loathing, because of feelings you described above. This article has helped my tremendously in transforming my thinking about the issue and gave me clarity—and hope! Thank you for writing this!
I’m so happy to hear this!!
I felt like this is a deeply human approach to sharing “critique”, something that I wish to see so much more of, both in EA and everywhere else.
Your expression, for me, paints a possibility of “altruism” that is capable of escaping the seeming paradox that doing good for a world (which includes me) somehow must trade off against my wellbeing. When we model to the rest of the world that “Effective” “Altruism” looks like brilliant (and especially young) people burn themselves out in despair, we are also creating a second order effect where we broadcast the image of Altruism as one tiled with suffering for the greater good. This is not quite inviting or promising for long term engagement on the world's most pressing problems. I feel you painting something differently. The value of signaling altruism as itself a joyous practice to pursue is, in my opinion, a woefully undervalued cause area – one that you are now expressing through your embodiment.
Once again, I really appreciate your synthesis of an intensely rich journey so far.
Thank you, David! I also worry about this:
Of course, if one believes that AGI is coming within a few years, then you might not care about these potential second order effects. I do not believe AGI is coming within a few years. Though if I did, I might actually believe that a culture of mutual dedication to one another's full set of ends is also instrumentally useful for the level of trust & coordination that could be required to deal with short timelines. Big "might."
Loved reading about your journey...
I think a lot of EAs, including myself, struggle with how to integrate the psychological features that propel, enrich, stifle, or endanger our capacities as moral agents. Although, upon reflection, we are firmly committed to privileging net well-being of conscious entities across space-time, we are firmly aware that this commitment is imperiled by the beasts within us hungering for other ends.
Like many of us, you determined that acknowledging and feeding those beasts was correct and appropriate... One's health is indispensable to being able to do good. Yet what the beast most craved was to be regarded with dignity and respect. The delights and adventures were bereft of their magic to you if you just considered them extrinsically valuable.
The proper antidote seems self-deception... Allow yourself to be lost in the greatness of life as an intrinsic value in the moment while charting your broader path in moments of reflection...
I agree with you that the question of how to integrate our broader humanity into our personal moral calculuses is most critical. It is also immensely difficult: the differentiation between a rational sacrifice to our beasts in the name of psychological health and consequently, greater good, and an excuse to indulge ourselves and behave badly when such choices are not warranted is very hard. I personally participate in the torture of animals by eating meat without regard for its provenance. Given my current circumstance, I think this abomination rational sacrifice to my beasts, but I sincerely doubt many vegans would agree. (I think that with the work I'm currently doing, taxing myself psychologically by a lifestyle change to veganism would be net negative EV).
The broader question of how to ethically and responsibly integrate our own flaws into ethical decisionmaking is fascinating, necessary, and fraught with peril.
Hi Brad, I appreciate this reply. I wonder if we might have a fundamental disagreement!
I personally don't regard my non-EA ends as "beastly" – or, if I do, my valuing of EA ends is just as beastly as my valuing of other ends. I can adopt a moral or cultural framework that disagrees with my pre-existing "value function," and what it deems valuable. But something about this is a bit awkward: Wasn't it my pre-existing value function that deemed EA ends to be valuable?
Moreover:
It's not obvious to me that severe sacrifice and tradeoffs are necessary. I think their seeming necessary might be the byproduct of our lack of cultural infrastructure for minimizing tradeoffs. That's why I wrote this analogy:
I believe it's possible to find and build synergies that reduce tradeoffs. For instance, as a lone ancient human in the wilderness, time building shelter might jeopardize daylight that could have been spent foraging for food. However, if you joined a well-functioning tribe, you're no longer forced to choose between [shelter-building] and [foraging]. If you forage, the food you find will power the muscles of your tribesmate to build shelter. Similarly, your tribesmate's shelter will give you the good night's rest you need to go out and forage. Unless there's a pressing emergency, it would be a mistake for the tribe to allocate everyone only to foraging or only to shelf-building.
I think we're in a similar place with our EA ends. They seem like they demand the sacrifice of our other ends. But I think that's just because we haven't set up the right cultural infrastructure to create synergies and minimize tradeoffs. In the essay, I suggest one example piece of infrastructure that might help with this: a fractal altruist community. But I'm excited to see what other people come up with. Maybe you'll be one of them.
Yeah we probably do have a fundamental disagreement.
I think you were essentially correct when you were in the dark night. The weight you put to your own conscious experiences should not exceed the weight you put on that of other beings throughout space and time. Thus, the wonders and joys of your own conscious experience have intrinsic value, but it is not clear that satisfaction of these joys is the most effective use of the resources you as an agent have in an obvious sense (i.e. it seems like you can enable greater net experiences by privileging other entities).
I think there is a nonobvious reason to (seemingly) privilege yourself sometimes as an Effective Altruist in that concessions to your own psychological desires can facilitate your most effective operation and minimize likelihood that you will abandon or weaken your commitment to maximize well-being. This is what I mean by feeding the beast.
Your seeming reconciliation is value pluralism, which appears to, in this case, simply mean placing the value of some of your own conscious experiences in a superpriority above those of the conscious experiences of others. I would think your framing, an elevation of your own conscious experience, makes less sense than mine. Other beings' conscious experiences are no less important than my own. I would make concessions which seemingly prioritize me, but ultimately, if I am acting morally, this preference is only illusory.
Do you subscribe to moral realism? If not, I’m curious what you think of Spencer‘s post: https://www.spencergreenberg.com/2022/08/tensions-between-moral-anti-realism-and-effective-altruism/
I am a moral realist believing agents should act to create the greatest net well-being (utility).
Not all conscious experiences are created equal.
Pursuing those ends Tyler talks about helps cultivate higher quality conscious experiences.
If you, believe, as I do, that there aren't sturdy philosophical grounds for de-valuing my other ends, then life becomes a puzzle of how to fulfill all of your ends, including – for me – both my EA ends and making art for actually for its own sake (i.e., not primarily for the sake of instrumentally useful psychological health so I can do the greater good).
Thank you for writing about what pushed me away from the EA community. The force to make all else instrumental. Best of luck
Yes! yesyesyes. Hey. Wow. Thank you! This is the first time that a forum article has spoken to me as a whole, not just the optimiser part of my brain (which by now is so interwoven with my inner critic that, well, meh).
It felt eerie to see so much of my own journey here: from spritely, quirky, happy person, to eager optimiser, to dimmed and depressed. When I read your post, I am aching for the Ronja that should have read this years ago, and a sort of raging against this community that no one could see that this was a descent fed by their very own behaviours ("You're thinking of studying anthropology, purely out of interest? But... why?!", "See, self-care is important because it helps you be productive afterward." "Oh, no, but you're a great person! Look at all the impact you're having!").
When I finally realised the unhealthiness of my environment, my solution was to distance myself from the community, to stop trying for impact, and slowly building up from there. But I could only accept to stop trying once it was very clear that lying in bed feeling bad about myself was literally not conducive to any part of me. Alongside that grief and rage and regret, I also breathe a sigh of relief - I am not alone, it seems. There is nothing wrong with me, maybe I even was onto something in my journey, even though I never articulated it as you just did. Maybe these were not just things I learnt about myself, but pointers to something more deeply human. And maybe it's not the case that this is a community just for optimisers who single-mindedly pursue impact by working and networking and very calculatedly recharging.
For myself, I have already concluded that, if I am ever going to do anything with a whiff of greatness, it will come from the Ronja that is shiny-eyed, boundlessly excited, radiating love for the world - and not from the haunted-looking tortured soul that keeps telling herself "yeah, but I should". The open question, for me, is whether I can be this person in this community, or even find pockets of community that understand my altruistic goals and still see and cherish and support the whole person that I am. For now, my policy of cutting ties (with the community as a whole, not with individual friends that also happen to be into EA), focusing on finding communities that nurture a variety of spiritual needs (like for you, music is a big one here) and deepening ties with people who love me just as me has been a good starting point. I am now, very cautiously, re-engaging from here; even though I run in panic from EA events as often as not, or feel hollowed-out and drained afterwards. And that sucks because it now feels like there are some impact-focused things that I really want to do, that are now harder than they would ever have been had I not been burnt so badly before. I am glad that I re-engaged to the extent of finding this post here!
I am very excited about the idea of finding people like you, people who've been through this journey, or just people who feel similarly about pursuit of impact as one important goal, but who are also in touch with other ends in themselves, and are able to listen to their soul's needs.
As for the practical trade-offs: I think they are relevant, and I wish to think about them more. But I think I'm still learning to lean into the non-consequentialist parts of me, and figuring out what I cherish and, as you phrase it, what spiritual nutrients I require (although that does make me prone to go down the "spiritual Soylent" route. So more like: I need to figure out how to nourish my soul).
So I think I'll have to come back to that one later!
But, again, thank you. I don't know you, but I feel very moved by your post and grateful to you for writing and sharing it.
Yet another weary traveler has come to this post down the line and felt many of the same resonances. I'd love to talk to you as well, calendly in my bio if you are so inclined :)
I love this post, just one nitpick:
The writing wouldn't be as persuasive, but it might be worth mentioning that you also had a mysterious gut condition that may have contributed to your suffering?
I'm not sure the right way to address this. My burnout and disabling depression predated my gut condition by something like 9 months. My doctors have told me that inciting events for gut symptoms like mine very often include a period of severe stress/burnout. Given that I was quite fit and healthy, without any history of chronic illness, it seems likely the causality of what you're suggesting was reversed. However, it's true that once my gut symptoms started this made my subsequent suffering much worse. =(
That makes sense. Btw, I was suggesting that maximizing caused suffering and gut problems caused suffering, not that maximizing couldn't lead to gut problems.
Ah, got it. My current theory is that maximizing caused suffering (stress) which caused gut motility problems which caused bacterial overgrowth which caused suffering, or some other crazy feedback phenomenon like that.
Sometimes positive feedback loops are anything but. 😓
This is wonderful – thank you so much for writing it.
Agree about secular, single-purpose communities – but I'm not sure EA is quite the same.
I've found my relationships with other EAs tend to blossom to be about more than just EA; those principles provide a good set of shared values from which to build other things, like a sense of community, shared houses, group meals, playing music together and just supporting each other generally. Then again, I don't consider EA to be the core of my identity, so YMMV.
Thank you for telling your story.
I agree that 'obligation' is an optional, man-made concept. Altruism can be framed in different ways, for example as an opportunity.
It is also possible to separate the normative question of 'What is best from a universal perspective?' from the personal, psychological question of 'What am I going to do?' The individual can then put working for the general good in its place as only one amongst several personal goals.
This is beautiful and important Tyler, thank you for sharing.
I've seen a few people burn out (and come close myself), and I have made a point of gently socially making and reinforcing this sort of point (far less eloquently) myself, in various contexts.
I have a lot of thoughts about this subject.
One thing I embrace always is silliness and (often self-deprecating) humour, which are useful antidotes to stress for a lot of people. Incidentally, your tweet thread rendition of the Eqyptian spell includes
(emphasis mine) which I enjoyed. A case of bad keming reified?
A few friends and acquaintances have recently been working on something they're calling Shard Theory, which considers the various parts of a human's motivation system and their interactions. They're interested for other reasons, but I was reminded here. See also Kaj Sotala's Multiagent Models of Mind which is more explicitly about how to be a human.
As a firm descriptive (but undecidedly prescriptive) transhumanist, I think your piece here also touches on something we will likely one day (maybe soon?) have to grapple with, which is the fundamental relationship between (moral) agency and moral patienthood. As it happens, modern humans are quite conclusively both, by most lights, but it doesn't look like this is a law of nature. Indeed there are likely many deserving moral patients today who are not much by way of agents. And we may bring into being agents which are not especially moral-patienty. (Further, something sufficiently agenty might render humans
themselvesourselves to the status of 'not much by way of agents'.)Agree so much with the antidote of silliness! I’m happy to see that EA Twitter is embracing it.
Excited to read the links you shared, they sound very relevant.
Thank you, Oliver. May your fire bum into the distance.
Really deep and thoughtful. I lost some very treasured people to the Dark Night you describe
‘When we treat workaholics as heroes, we express a belief that labor rather than contemplation is the wellspring of great ideas and that the success of individuals and companies is a measure of their long hours.’ from the book ‘Rest: Why we get more done by doing less’
Thank you for writing this Tyler! I really enjoyed it.
I have had a similar journey recently. I've also heard a bunch of other examples from people in this community with similar stories.
There is an interesting tension I find when communicating about this:
If someone's motivational framework is fundamentally shackled to a dominant, altruistic part, then the benefits of losing the shackles need to put in terms that that part will value. But to really succeed at this you need to genuinely abandon the idea that the values of that part of you are above your other values.
For example I've found myself saying things like "now that I have this perspective, I feel better, and more intrinsically motivated, but am not being any less altruistic, I may even be more altruistic across my life".
You touch on this here:
This has the flavour of a trick to me. In order to be free to follow other ends intrinsically, you need to be vulnerable to the prospect of actually being less altruistic, of actually ending up doing less good. Maybe this is a necessary trick? Is there is a way of negotiating with the dominant part that allows it to let go in full knowledge of its vulnerability?
(an approach that has seemed to be working for me here has been comfort zone expansion with respect the feeling of being a bad person.)
Yes, I find trying to make that part less dominant most promising here. If it secretly is still dominant while you pretend engaging in other things for their own sake, you will get this "trick" flavour.
For me, this part only ended up less dominant once it could fully comprehend that it wasn't leading to good places even by its own light. (I would go: "See, optimiser-Ronja, we have followed your lead for a while now, and we've ended up absolutely depressed and unable to do anything at all. I know you don't want that either. So, please, let go of your grip for a while as we figure out other approaches.")
This dialogue with my optimizer-self, showing it evidence that it was undermining its own values by ignoring my other values, was very helpful for me too.
Tyler, thanks so much for writing this. I’ve been struggling to get more involved with EA precisely because I fear that accepting its premises would inexorably lead to the kind of dark night you’ve described. How could I possibly waste my time on leisure activities once I’ve seen the dark world? Even my work in the disability and autism communities would be profligate when measured against worthier causes.
This post goes some way to helping dispel these notions in me, but I’m still struggling with the implications. For example, I have a hard time seeing music, art, dancing, poetry and so forth as ends-in-themselves, rather than as a means to an end of generating utility in the form of quality of life. And it is hard for me to not see that quality of life as being fungible with that of other people; why should my own QALYs count for more than the drowning child’s, except on account of my own “beastly” self-interest?
Maybe the valuing of EA-ends are indeed just as beastly as valuing any other ends. Yet if this is so, one is not actually valuing the betterment of the world, but the neurological reward mechanism, the warm fuzzies, that it produces. Maybe these warm fuzzies perfectly align with doing the most good. But this proxy-alignment doesn’t seem like the basis of a robust system of ethics.
Where I had worried about falling on the slippery slope of EA-style utilitarianism, but I now fear a slope in the other direction; if I accept that “morality is relevant only because we care deeply about it”, then does it not follow that for those who care nought about it, there is consequently no moral obligation at all? Is our moral duty, if it exists, only commensurate with the degree of pleasure we derive from its practice?
There’s also a more practical aspect, best encapsulated by ThomasW’s reply to Eric Neyman’s bargain with the EA machine:
I don’t want to let impact guide my every decision. I want to believe that no trade-offs are required. But in building our moral framework, shouldn’t we assume the least convenient possible world? I'm not suggesting that there are yet certain answers here, but in the meantime I personally find it difficult to make moral decisions under such philosophical uncertainty. For now, I suppose the best heuristic remains:
Hi Braxton – I feel moved by what you wrote here and want to respond later in full.
For now, I just want to thank you for your phrase here: "How could I possibly waste my time on leisure activities once I’ve seen the dark world?" I think this might deserve its own essay. I think it poses a challenge even for anti-realists who aren't confused about their values, in the way Spencer Greenberg talks about here (worth a read).
Through the analogy I use in my essay, it might be nonsensical, in the conditions of a functional society, to say something like "It's more important to eat well than to sleep well," since you need both to be alive, and the society has minimized the tradeoffs between these two things. However, in situations of scarcity or emergency, that might change. If supply chains suddenly fail, I might find myself without food, and start sacrificing sleep to go forage.
A similar tradeoff might apply to value threatened by emergency or scarcity. For instance, let's say that a much-loved yet little-seen friend messages me: "Tyler! I missed my layover in Berlin, so now I'm here for the night!" Under this condition of scarcity, I might put off the art project I'd planned to work on this night. This is a low-stakes example, but seems to generalize to high stakes ones.
One might say: The emergency/scarcity conditions of the world bring our EA values under continuous threat. Does the same logic not apply?
I need to think about this more. My preliminary answer is kind of simple. Eventually I do need to sleep well to continue to forage for food, otherwise I'll undermine my foraging. Likewise, I can't raincheck my artmaking every night if my art project is a key source of fulfillment – doing so will undermine my quality of engagement when I spend time with friends. And similarly, allowing EA pursuits to crowd out the rest of the good life seems to undermine those EA pursuits long term (for roughly everyone that I know at least – my opinion). This seems to be true not only of EA pursuits, but any value that I allow to crowd out my other values. So the rational strategy seems to be to find ways for values to reduce conflict or even become symbiotic. An internal geopolitics of co-prosperity.
Just want to say that even though this is my endorsed position, it often goes out the window when I encounter tangible cases of extreme suffering. Here in Berlin, there was a woman I saw on the subway the other day who walked around dazedly with an open wound, seemingly not in touch with her surroundings, walking barefoot, and wearing an expression that looked like utter hopelessness. I don't speak German, so I wasn't able to interact with her well.
When I run into a case like this, what the "preliminary answer" I wrote above is hard to keep in mind, especially when I think of the millions who might be suffering in similar ways, yet invisibly.
Great post, and sorry to hear about your dark night Tyler. I think one thing that has given me pause in EA has been the explore-exploit tradeoff. Crucial Considerations, and the idea of working smarter rather than harder, means that it's unlikely to be optimal to go all out on exploiting any given opportunity. Related is the idea of giving now vs giving later, which should probably relate to time as well as money - i.e. it could be better to grow your skills before you spend them down in a sprint/burn-out, and perhaps better to not sprint/burn-out at all given new Crucial Considerations may always be forthcoming.
I think these are true, and mitigate some of the problem of "going all in". As I see it, though, they don't mitigate the potential (psychological) harms from treating most things as a means to impact.
I guess a failure mode of this is just going all out when exploring as well as exploiting! And optimising your pauses for reflection to maximise both. Perhaps ultimately there is no substitute for a well-cultivated garden of ends.
As mentioned in a footnote of the OP, an exception to this might be if your AGI timelines are short. Even then though (as is the case for me), there is still uncertainty over what is the right action. I guess there is always more reading to do to figure things out better, but that always requires time to digest and think. It's still better to work smarter rather than harder in this case. And Tyler makes a point here about more well-adjusted and happy people potentially being better at coordination.
(The image at the bottom of the post is broken, btw)
Fixed! Thank you.
Appreciating this. It's helping me see that part of how I didn't fall deeper into EA than I did is that I already had a worldview that viewed obligations as confused in much the sort of way you describe... and so I saw EA as sort of "to the extent that you're going to care about the world, do so effectively" and also "have you noticed these particular low-hanging fruit?" and also just "here's a bunch of people who care about doing good things and are interesting". These obligations are indeed a kind of confusion—I love how you put it here:
I did get infected with a bit of panic about x-risk stuff though, and this caused me to flail around a bunch and try to force reality to move faster than it could. I think Val describes the structure of my panic quite aptly in Here's the exit. It wasn't a sense of obligation, but it was a sense of "there is a danger; feeling safe is a lie" and this was keeping me from feeling safe in each moment even in the ways in which I WAS safe in those moments (even if a nuke were to drop moments later, or I were to have an aneurysm or whatever). It was an IS not an OUGHT but nonetheless generated an urgent sense of "the world's on fire and it's up to me to fix that". But no degree of shortness to AI timelines benefits from adrenaline—even if you needed to pull an all-nighter to stop something happening tomorrow, calm steady focus will beat neurotic energy.
It seems to me that the obligation structure and the panic structure form two pieces of this totalizing memeplex that causes people to have trouble creatively finding good win-wins between all the things that they want. Both of them have an avoidant quality, and awayness motivation is WAY worse at steering than towardsness motivation.
Are there other elements? That seems worth mapping out!
Ah I realized I actually wanted to quote this paragraph (though the one I quoted above is also spot on)
I felt similarly angry when I realized that my well-meaning friends had installed a shard of panic in my body that made "I'm safe" feel like it would always be false until we had a positive singularity. I had to reclaim that, in several phases. And on reflection I had to digest some sense of social obligation there, like fear of people judging me, whether EAs or other obligation-driven activists. And maybe they do or will! But I'm not compromising on catching my breath.
I wrote a thread with some reactions to this.
(Overall I agree with Tyler's outlook and many aspects of his story resonate with my own.)
Maybe it's that I'm 42. Maybe it's that I read lots and lots of SSC essays before discovering EA. But to me it always seemed like the EA community (as expressed on EA forum and 80000 Hours) wasn't as hardcore as Tyler describes. So I signed up for the GWWC pledge and never thought that I should give more than 10%. I understood pretty early that to seriously cut down on one's quality of life for the sake of effective giving would be bad for the movement as a whole (as I recall, there were essays specifically explaining this), because other potential EAs wouldn't want to go down that same path. Not only would your excessive self-sacrifice make the movement as a whole suffer due to people saying "I'm not hardcore enough to be an EA", but it would harm your own mental health which, in turn, could impair your ability to help others.
I do currently live modestly impoverished though; the 10% GWWC pledge can be a bit tough at low incomes, especially for someone like me. For one thing, I'm really insecure about the possibility of financial ruin, so I tend to save money aggressively (net worth now $200K CAD, which doesn't feel that high when I have a family to take care of). So each year I put 10-30% of after-tax income into retirement savings and then over 10% in GWWC.
But this year the inflation on food and fuel has been really high, I'm currently earning minimum wage (not bad, it's $15 CAD/hr here), I was scammed into buying a lemon car (albeit it was only $1550 CAD), and I was just sued for $100,000 because I rear-ended someone on an icy road at 3 km/h (2 mph, and maybe the insurance will take care of it, we'll see), I'm struggling to get work done while helping take care of our newborn baby, struggling to use Twitter less, I don't have any EA or rationalist friends IRL, and...
...and I just wish the GWWC pledge was a bit more flexible. Because while technically I'm doing fine, and technically I have lots of savings so I'm not forced to eat this much Ramen... still, I prefer not to deplete my savings (especially as it's so heavily invested in equities and bonds that are way down this year) and not to break my pledge, rather than to have nice food, have a car that isn't likely to die permanently in the next year, and occasionally have some fun activity to please my family... though they're not really happy having a belt this tight.
So it would've been nice if the GWWC pledge had a relief valve for low-income-earners, e.g. it could say "10% of my income after subtracting the cost of basic needs for myself and my dependents." No doubt it was designed to be as simple as possible, but that simplicity will be a bit burdensome for us in 2022-23.
(Also, kind of a stupid technicality... since long before signing the pledge, I have always preferred to give a percent from my post-retirement-savings income rather than before-tax or after-tax income. This way, I will still be able to give money during retirement by giving 10% of my retirement savings. I look forward to that. But the GWWC pledge says to give 10% of "income" which I guess may be pre-tax or post-tax but not post-retirement-savings, and there's no provision for delaying the giving, so... rather than reconfigure my spreadsheet, I normally just give 15% post-retirement-savings to make sure I'm above 10% post-tax (and usually above 10% pre-tax). Maybe I'll tweak the spreadsheet this year to cut my giving down to the minimum.)
Thanks for this. I'm somewhat reminded of this post on using a different motivational system than guilt.