April 3, 2020
Working in AI has changed how I view the world. In traditional software projects I think about solutions in terms of time, scope and resources: What do we want to build? How much time do we have? How big is the budget?
Now I think in terms of models, data, probability, and trends. Tripling the engineering budget won’t help us automate a business process if we don’t have sufficient data coverage. A great data scientist can develop a new mathematical approach which suddenly increases accuracy from 80% to 97% and improves profitability by 5x. It happens every day.
I’m also developing a keener intuition for identifying what I know—and don’t know. In traditional software projects “unknowns” are unacceptable risks to be mitigated through better planning. In AI “unknowns” are just part of the work.
Very few people are comfortable with this level of uncertainty. Fewer still can look at an exponentially-growing threat like the coronavirus and image a probabilistic range of outcomes. Most people are glued to their phones looking for reassurance or predictability. As usual, the scariest stories get the most eyeballs, advertising dollars, and political attention.
Here is the reality: nobody knows how this pandemic will evolve. The world’s smartest, most capable people are struggling to build models which even describe the current situation. We just don’t have the data. We can’t answer basic questions such as, “how many people died from the virus” because:
Other factors like R0, symptoms, or the impact of government policies are even more ambiguous. Experts like Michael Osterholm have spent decades modeling pandemics and can predict a return to normalcy this Summer or a total collapse of supply chains depending on assumptions. We. Just. Don’t. Know.
Fortunately the most unpredictable wildcard is a cause for optimism: the impact of human ingenuity. The world’s smartest, most capable people are collectively racing for a solution. Scientists are sharing data at an unprecedented scale.
In my own narrow circle of friends I’m watching:
We will begin adapting in a million unpredictable ways, all of which are impossible to model. Duke University found a way to clean N95 masks at scale. Our hospitals will begin optimizing for treating waves of infected people.
The virus exposed many fragilities with our globally-connected societies. In the coming months we will see the upside of this highly-connected, economically-optimized world as human innovation is unleashed at scale. It is unpredictable, but it is a cause for optimism.
April 3, 2020
Modeling anything about the pandemic is impossible—we just don't have the data. Fortunately the most unknowable factor is the one cause for optimism: the impact of human ingenuity
March 27, 2020
Having a hard time staying motivated? Finding yourself endlessly distracted by the news? Well, join the crowd—we all feel the same. Check out Stephen Pressfield's book, The War of Art. It gave me the motivation I need and may do the same for you.
March 13, 2020
Data science has been one of the fastest growing fields over the past five years. As we enter this economic downcycle managers will begin identifying their most valuable people—the ones they will fight to retain in the event of layoffs. What follows is advice for making yourself invaluable to any employer.