How Musk deals with complexity

Elon Musk has given a personal tour of SpaceX’s Starbase at Boca Chica in Texas to a Youtuber, Tim Dodd aka the Everyday Astronaut. You can see the first part of the interview here.

Musk’s interview is in his capacity as Chief Engineer at SpaceX. Musk is also the CEO of Tesla and a founder of Paypal, and currently the world’s third wealthiest person. The interview is fascinating throughout.

What I find most interesting is seeing how Musk handles massive complexity. As the Chief Engineer at SpaceX, part of his job is getting the left and right hands talking to each other across the processes that support the design and manufacturing of a rocket.

His interview reveals some elements of his strategy: a clear objective; a small number of metrics to guide decisions; awareness of how problems emerge in complex design and manufacturing; preserving the option to experiment (and fail) cheaply because some things are only discoverable through trial and error; solve the problems that need solving first.

I can’t help but think some of these strategies for dealing with complexity in scalable systems is relevant to public policy. Officials and ministers are not building rockets or cars. But they have to make sense of practically unlimited complexity. I don’t know what strategies officials use to manage the complexity they deal with. Whatever they are, few of those strategies seem to make it into public discourse.

Musk makes the interesting observation that because every Space Shuttle flight had people on board, failure was intolerable, experimentation was costly, and innovation essential stopped as a result. Keeping the doors open to experimentation which does not hurt anybody is important. That seems like a relevant idea for public policy.

Here are some of Musk’s insights from Part 1 of his interview with Dodd.

Objective

Become a multiplanetary species

Metrics

  • $/tonne of thrust: “What is hard is how do we make a Raptor [rocket engine] where the cost per tonne of thrust is under $1,000”
  • $/tonne to low Earth orbit: “The fundamental thing that needs to be fixed is the cost per tonne to orbit”
  • $/tonne delivered to Moon, Mars

Musk talks about thrust in tonnes, rather than the more correct measure Newtons, to make it easy to compare with the mass of the rocket the engines propel. He is happy to sacrifice correctness for clarity and simplicity.

On fuel mix, the bias is in favour of oxygen over methane because oxygen is cheaper and more dense, which reduces cost per tonne.

Process

Musk has a five step process for managing complex processes.

1. Make your requirements less dumb. “It is particularly dangerous if a smart person gave you the requirements. Because you might not question them enough.”

2. Try very hard to delete the part or process. If you are not adding things back in 10% of the time you are not deleting enough. The bias is to keep things just in case. You can make that argument for almost anything.

3. Simplify or optimise. This is the third step not the first because a common error of a smart engineer is to optimise a thing that should not exist.

4. Accelerate cycle time. But only after the first three steps. Otherwise you are just “digging your own grave faster.”

5. Automate.

“I have personally made the mistake of going backwards on all five steps. Multiple times.” Musk tells an interesting story of fibreglass mats in manufacturing Tesla cars.

“Any requirement or constraint must come with a name not a department.” Otherwise some person years ago could randomly come up with a requirement that today nobody supports. The requirement will persist if it is not owned.

Other points

“All designs are wrong, it’s just a matter of how wrong.”

“Everyone is wrong some of the time.”

If you look at the various reasons for Starship’s landing failures, none of those reasons were on prior risk lists.

Musk has more than one optimisation metric, but he treats them in a sequence. “Fundamentally, the optimisation is for cost per tonne to orbit, and ultimately cost per tonne to the surface of Mars.”

A common problem in production is too much testing. The production line will be tested at each stage to identify where problems are occurring. Once the problem is diagnosed, it is common for testing to not be removed.

Production processes (manufacturing rocket parts at scale) requires 10-100 times more effort than the technology. “Manufacturing is underrated. Design is overrated.” So rocket science is the easy bit. Mind blowing.

Boosters and ships (the drone ships boosters land on) are easier to build than the launch pad. The pad includes the mechanism for catching returning first stages. The pad is going to catch them from the air.

Says it all, really

The Gisborne Herald reports:

Mr Robertson described the report of the independent Climate Change Commission as “the most important document of my political lifetime”.

Robertson is talking about a report that says we should spend 5-10 times more than necessary to cut emissions, threatens our emissions targets, is filled with untruths and rhetorical tricks, and all based on a strategy that does not make sense when the government has already capped emissions.

That’s the most important document in his political lifetime?

Well, it’s only important if people believe it. If you think the Climate Change Commission is independent, I have a bridge to sell you.

Why so angry?

After a recent article in the Herald (ungated version here) I received the following email:

I realise that your objective is to advance a right wing agenda rather than provide factual information, but I was sufficiently annoyed by your article that I have provided media with the attached more informative article, to help people understand the real issues.

The article from my correspondent (I will not name him) was mostly about how EVs are good and will become great in the near future. I suspect he is right.

But that completely misses the point of my Herald piece.

My point is that having capped emissions with the Emissions Trading Scheme (ETS), to then tax or subsidise vehicles or anything else already covered by the cap will make no difference to total emissions.

This has nothing to do with the merits of EVs. Of course EVs can reduce emissions. But the emissions benefits of EV subsidies must be zero under a binding emissions cap.

The question I want to consider here is why an argument against ineffective emissions policies should lead somebody who is worried about climate change to feel angry.

I do not know my correspondent. I assume he was not the only person annoyed by my article. For the purposes of this post, I will assume people who feel angry reading my article:

  1. Are worried about the climate change.
  2. Believe greenhouse gas emissions cause climate change, and
  3. Support policies and actions which lower emissions.

What could lead someone who holds those views to object to an argument that we should oppose emissions policies which do not lower emissions?

Before I try to answer this question, let me first say I do not usually spend time thinking about peoples’ motivations on policy matters. My focus is on the merits of policy. Here I make an exception because I want to reach people who are concerned about climate and who see me as an opponent. If I can understand why people get mad, I have a better chance of communicating effectively and, ultimately, helping.

So let the speculation on where the anger is coming from begin.

First, the objective (lower emissions) is bundled with specific actions. Support for action on climate is support for more EVs, more renewables, less coal and petrol. These actions go with the goal of lower emissions like peas and carrots. EVs always mean lower emissions. Coal always means higher emissions. And more is always better when it comes to favoured technologies; for disfavoured technologies, less. No exceptions.

This view does not fit well with reality. It is probably not obvious, for example, that using coal and natural gas plausibly makes it easier to reduce emissions, or that further investment in renewables beyond some unseen limit in our electricity system will make it harder to achieve our emissions targets. See the ICCC final report on electricity.

For anyone who sees action on climate and getting more EVs on roads as the same thing, any argument against EV subsidies is going to look a lot like an argument against cutting emissions per se.

Second, the only alternative to taxes, subsidies and regulations to lower emissions is to do nothing. Here is James Shaw (at 43:00) saying exactly that to Parliament’s Environment Committee at a recent appearance, for example, after being challenged on the effectiveness of policies.

Such a conclusion is surely natural for anyone who has not heard of the ETS, or who does not know that it caps emissions, or who does not see the cap as credible, or who does not understand how a cap will generally neutralise other policies.

Shaw is in none of those categories, by the way – it is his cap! He introduced the legislation which gave the ETS its hard emissions cap. The bill passed last year.

I suspect another driver of this “alternative is doing nothing” view may have something to do with the idea that human agency is a necessary part of lowering emissions. Sure, the ETS will have some effect, the thinking might go. Profit-maximising corporates will always respond to the incentives of a carbon price. But we will not succeed, the thinking may go, unless somebody decides how and where emissions come down. Many seem to believe prices alone cannot bite hard enough to shift behaviours; we need more than incentives to overcome consumers’ myopia.

Third, I wonder if people are quick to suspect trickery lies behind any question of emissions policies? Sure, this person says he wants lower emissions, but perhaps there is a hidden agenda, either a political agenda or opposition to action on climate.

Another possibility is that the response to my article is a “rally behind the flag” effect. The classic example of rallying behind the flag is America’s response to the attack on Pearl Harbour by Japan in 1941. Political accountability for the catastrophe was put to one side. The focus was squarely on the forward-looking question of winning the war.

I do not think flag-rallying explains much in climate. Bad emissions policies are not in the past – they are not sunk, as it were. Policies are very much in the here and now, or in the future. They can be changed. Those policies will determine success or failure in the war on emissions.

If anything, rallying behind the flag should encourage not deter (constructive) skepticism of policies. Yet many people do not welcome questions about whether emissions policies work. If rallying behind the flag means overlooking past mistakes to focus on the mission at hand, climate policies are not a good fit.

Whatever explains the anger towards my article, it probably does not help that I am one of the only people saying emissions policies should work. It is striking how, out of all the people who demand action on climate, almost nobody has any apparent interest in the performance of the government’s emissions policies.

Anyway, these are my guesses about the psychology behind the interesting conundrum of why well-meaning, intelligent people who want action to reduce emissions feel genuinely angry when they see someone pointing out where emissions policies might not work.

This anger has consequences. It will, and almost certainly has, suppressed questions at the government on the performance of its policies.

We now stand at a precipice. In the next few months the government could commit to policies that will cost percentages of GDP but will not lower emissions, not by a single tonne. If the current track continues, we will end up materially poorer while doing nothing to help future generations on climate.

Surely, there no political constituency for that outcome? Yet that is the path we are on. Almost nobody is asking the government this most basic question: how does your emissions strategy cut emissions?

That question helps protect future generations. So don’t be angry at the person asking it. Be angry about the answer.

A solution searching for a problem

John Cochrane may be grumpy but he is possibly my favourite living economist.

In this article he makes a number of great points about climate financial risk. Here are two:

The idea that climate change poses a threat to the financial system is absurd, not least because everyone already knows that global warming is happening

Climate regulatory risk is slightly more plausible. Environmental regulators could turn out to be so incompetent that they damage the economy to the point of creating a systemic run.

One hopes that officials working on climate financial regulation in New Zealand understand the significance of knowing what has already been priced, and that regulation has costs and risk and if sufficiently-poorly designed could be a greater threat than the underlying problem. Officials seem to find market failure in a lot of places; regulatory failure less so.

Cochrane concludes:

Climate change and financial stability are pressing problems. They require coherent, intelligent, scientifically valid policy responses, and promptly. But climate financial regulation will not help the climate, will further politicize central banks, and will destroy their precious independence, while forcing financial companies to devise absurdly fictitious climate-risk assessments will ruin financial regulation. The next crisis will come from some other source. And our climate-obsessed regulators will once again fail utterly to anticipate it – just as a decade’s worth of stress testers never considered the possibility of a pandemic.

Read the whole thing.

HT Jim Rose.

Take the shorter path to success on climate

An emissions cap massively simplifies the problem of reducing greenhouse gases.

With an emissions cap, burning coal to keep the lights on in a dry year, for example, does not raise emissions. By definition, a cap means that for every tonne of emissions that leaves the generator’s smokestack, there must be one less tonne of emissions somewhere else in the economy. Getting to our emissions targets is a matter of reducing the emissions cap in line with those targets. James Shaw has aptly called this a “sinking lid”.

The Emissions Trading Scheme (ETS) caps emissions and the cap is falling over time in line with our emissions targets.

But good luck to any executive who says their company is fully meeting its responsibilities to reduce emissions thanks to the ETS cap. That line is simply not going to work.

That is because few people have heard of the ETS. Many who know about it don’t believe it really caps emissions. And although the ETS looks good on paper, right now we have little more than anecdote to show it is working in this country.

I expect the NZ ETS will prove to be highly effective, in line with findings from studies of cap-and-trade systems in other countries.

For the sake of argument, put to one side for now the important question of ETS effectiveness.

Consider two paths to net zero emissions in 2050:

  • Our current path, which has an ETS cap that is effective but not credible* combined with a welter of policies which give ministers and officials control over large parts of the economy, or
  • An alternative path, which has an ETS cap that is effective and credible. There are supporting policies but they stop well short of the sweeping controls in the current path.

What is the shorter path to success on climate? Is it to create a vast bureaucracy which has control over everything that produces emissions? Or is the shorter path to solve the ETS’s credibility problem?

I do not think improving the ETS’s credibility will be easy. But it is easier than the alternative.

I think the ETS’s credibility problem can be solved in four parts:

  • Strengthen the ETS to cover more emissions more robustly.
  • Introduce systems to test and demonstrate the ETS is working.
  • Credible protections for households and businesses against shocks in the carbon price, and
  • A carbon dividend to every household.

The key thing is to establish in the minds of enough voters that the government already has a system for reducing emissions, and that system makes other policies like a ute tax or a new bridge in Auckland not just unnecessary but worse than useless.

*It is important to note that I use the word ‘credible’ here in a particular way: I mean credible in the eyes of citizens. A $48 NZU price suggests the ETS is highly credible in the more usual sense that it has support in Parliament, that support is expected to endure, and the rights embedded in emissions units are regarded as secure.

De-commission the Climate Change Commission

Tim Hazeldine writes ($) in the Herald today on how the Climate Change Commission has gone so far off-target. It is hard to excerpt, the whole article is excellent.

Our climate change policy should be solely about climate change. “You can’t kill two birds with one stone” is a cliche but it is not trite. It is true and important in almost every policy context. Yet the Commission considers it should in future “consider broader well-being factors, like eradicating poverty, safeguarding food security and addressing other environmental outcomes”. Wrong, wrong, wrong and wrong.

Exactly. It is not that those other outcomes are undesirable. But insisting emissions policies also solve those other problems puts our emissions targets at risk. Allowing other objectives into the decision making carries a huge emissions penalty. Second-best emissions policies have roughly no effect on emissions.

It is farmers, other businesses, entrepreneurs, innovators, inventors, scientists, workers, and, not least, households – the whole team of five million – who will get the job done, and at the lowest cost, so long as the overall cap set by the Emissions Trading Scheme (or through a carbon tax) is secure.

Also mostly pointless, are the multitude of policy recommendations that pour forth from the report. If the real decision-makers in the economy (i.e. all those listed above) are getting the correct price signal from the ETS, then there is generally no justification for further government intervention. What should be done will be done… The main exception will be in the provision of what economists call “public goods” – in particular research results

A binding ETS cap does not mean doing nothing else. It means being smarter about where to point other policies, targeting then in places the ETS does not reach or might not reach adequately. Where possible, use cost-benefit analysis to check policies are cutting emissions at a high-enough rate to justify their cost, taking proper account of the effects of the ETS. I say “where possible” because research is something that cost-benefit analysis may not be much help. But fill your boots on feebate and harbour crossings.

Just one of the [Commission’s] 1000 technical references is a well-published economics article. This, by the way, rates subsidising electric vehicles as the highest-cost of all known climate policies.

An indictment of the Commission. Naturally, having shown EVs underperform other technologies with the one piece of economic evidence they cite, the Commission recommends accelerating the uptake of EVs.

So, what to do? The Climate Change Commission has, in just a few months, seriously outgrown its boots. The Government should step in, and with polite thanks for their efforts, de-commission the commission. It should then persuade a super-smart mid-career research-grade Kiwi economist – tough-minded but humble (they do exist) – to take the reins of a slimmed-down secretariat.

This is a pretty robust conclusion. However, the Climate Change Commission arguably exceeded its legislated mandate in its first report, and its emissions reduction plan threatens our emissions targets. Those two problems are serious enough to fully justify Hazeldine’s conclusion.