Saturday, May 28, 2016

Of Donald Knuth and Lobsters: Stress as a Creative Force

“Lobsters are a soft mushy animal that lives inside of a rigid shell. That rigid shell does not expand. How can the lobster grow? Well, as the lobster grows, that shell becomes very confining. And the lobster feels itself under pressure and uncomfortable. It goes under a rock formation to protect itself from predatory fish, casts off the shell, and produces a new one. Eventually, that shell becomes uncomfortable as it grows again. Back under the rocks… the lobster repeats this numerous times. The stimulus for the lobster to be able to grow is that it feels uncomfortable. Now, if lobsters had doctors, they would never grow. Because as soon as the lobster feels uncomfortable, he goes to the doctor, gets a Valium, gets a Percocet, feels fine. Never casts off his shell. So, I think, what we have to realize is that times of stress are also times of growth. And if we use adversity properly, we can grow through adversity.”

“Pressure pushing down on me
Pressing down on you”
Queen & David Bowie. Under Pressure. Hot Space.

“No pains, no gains.
If little labour, little are our gains:
Man's fate is according to his pains.”
Robert Herrick. Hesperides [1650 edition].

At my last job, as CTO of a large software company, I had the privilege of hosting several industry legends in events we called “The Distinguished Speaker Series”. They usually gave a talk about a subject of their own choosing and answered questions from the audience.

I remember Ken Thompson talking about building the UNIX operating system at Bell Labs and how he was told by his supervisors not to waste time on it! I remember him also talking about his passion for cryptography as he displayed an original Enigma machine from World War II. I remember him talking about the Go programming language and its evolution.

I remember James Gosling talking similarly about the birth of Java. I also remember him talking passionately about his current work on autonomous watercraft used for forecasting weather patterns. I remember feeling jealous about the fact that he gets to swim in the waters off Hawaii to do his work while I get to sit in a dark conference room all day.

But the one speaker that has stayed with me the longest is Donald Knuth, Professor Emeritus at Stanford University, and author of the classic The Art of Computer Programming, a book that is still studied with awe almost fifty years after its publication. Let me repeat that. A computer science book still being studied fifty years after it was first published. Before the age of Internet, before the iPhone, broadband, Facebook, and Google. Before even Microsoft. Before UNIX. I have seen CEOs and CTOs who proudly display their autographed copy of the book in their offices. Fifty years in computer science is about the same, roughly speaking, as a thousand years in normal human years. How many other thousand-year-old books are still taught in colleges and referenced as an authoritative source on scientific concerns?

Professor Knuth is also the author of TEX, a typesetting program that is still used - forty years later - in scientific circles for publishing papers. We are talking about a piece of software that pre-dates PDF, Word, Apple, and WYSIWYG editors. Dr. Knuth will even still send you a check if you find a bug in his code from all those years ago. Every once in a blue moon, some lucky bastard finds himself in possession of a check for $2.56 (“the number of pennies in a hexadecimal dollar”) - an admission by the master that you found a bug in his code. Forty years after the fact. How many other programmers can say the same?

On this particular visit, Dr. Knuth gave a fascinating talk about what he calls "intentional programming" but what struck me most was his response to a question before the speech. I innocently asked when he had been most productive in his entire career. Here's what he had to say:

“If I think back about my own life and I ask what was the period when I did my most creative work, had the best ideas, and somehow things worked out to be wins… I have to say, it was the time when I was under the most stress. I had two babies… two years old, three years old… and I was having trouble with ulcers and I was on all kinds of committees and there were all kinds of things happening… I was supposed to give lectures for the ACM and I hardly had any time to research, but somehow, during those years, I had the most creative ideas I’ve ever come up with.

So, the answer is, of course, to torture you guys. [laughter]

When did Stravinsky write his best music? He was living in a garret in Paris and starving. Well, that’s not really sustainable but there is something about being under pressure that forces you to do the things you really have to do, that you’re called to do. That’s when you do your best work - when you’re responding to this calling.

I’ve met people from Eastern Europe and they did their best work before the fall of communism because they had something to rebel against. Unfortunately, that seems to be the answer but I have to leave it to you managers to figure out how to make it sustainable.”

The comments resonated with me partly because I was doing two jobs at the time. I had recently switched jobs from managing a large engineering team to being CTO but ended up performing both jobs for nine months while we searched for a replacement for my former role. I remember it as one of the most stressful, but also one of the most productive, periods of my career.

Stress is a great stimulator of productivity when applied in reasonable quantities. Of course, too much stress opens the door to destructive psychological and physical traumas but I do believe that a certain amount of tension, a certain amount of stress, a certain amount of pain is required for productivity. There is even a growing body of research out there that shows a historical basis for this thesis. Just compare the number of advanced civilizations that have thrived in the relatively harsh climates of Europe and America to the number that languished in the tropics. The harder you have to struggle, it seems, the more you thrive.

If necessity is the mother of invention, I guess I can argue that stress is the mother of productivity, if not creativity. You could say, a certain amount of stress is, well, healthy. Unfortunately, stress also has a severely debilitating effect on us physically. If you don't believe me, just take a few months off from work to see the difference with your own eyes.

I was lucky enough to take six months off from work last year. Absolutely nothing changed in my life - other than the fact that I didn't go to work every day. The time normally spent at work was replaced by many hours of biking up and down the local mountains and time spent with friends and family. The reduced stress - not having to worry about a thousand things at work - and increased physical activity were amazingly rejuvenating. I quickly lost thirty pounds in weight, shaved forty minutes off my best time on a favorite three hour bike route, and slept like a rock at night. Most importantly, I felt twenty years younger.

I've been back at work for six months now. My exercise is down to two days a week and has been replaced by the usual stress associated with a demanding high tech job. I've gained back almost fifteen pounds already, slowed way down on my bike route, and am happy if I get four hours of sleep a night. Pretty damning evidence, I would say. No, it's not a scientific experiment and it's only one data point but I'll stick with my conclusions.

Unfortunately, most of us don't have the luxury of taking six months off from work. In fact, the few days a year that we do take off for vacation are often spent checking work email, jumping on critical conference calls at odd hours, and getting even more stressed about the projects that are falling behind.

More work, more stress. More success, more work, more stress. It's a vicious cycle. Those who thrive in this world are the ones that can withstand the ever increasing levels of stress. These are also the same people who skimp on their own health and family, working ever longer hours and taking on ever more responsibilities. More success, more work. More work, more stress. More stress, less time. Less time, less rest. Less time, less exercise. Less time, less family, less friends. Less family, more work. It’s a vicious cycle.

Let's face it. Europeans have a much better system when it comes to vacations than we do. Everybody, go away for the month of August. No one in the office(s) means no urgent meetings and no urgent emails that need your attention. Of course, you need a skeleton crew to run operations and keep the place going but the idea of having everyone take vacation at the same time seems so much more efficient and, well, healthy.

No comments:

Post a Comment