Working paper

The tension between exploding AI investment costs and slow productivity growth

This working paper explores the tension between rapidly increasing artificial intelligence investment costs and the slower pace of productivity growth

Publishing date
09 October 2024
Authors
Bertin Martens
e

This working paper explores the tension between rapidly increasing artificial intelligence investment costs and the slower pace of productivity growth, raising concerns about a potential ‘economic winter’ for AI. AI has shown significant technological progress, particularly with machine learning and generative AI models like ChatGPT. Investment in AI has surged. But there are concerns about whether these investments will yield proportional returns.

Training costs for a single frontier AI model are increasing exponentially, , from $1,000 in 2017 to nearly $200 million in 2024, driven by constant returns to scale in AI model training data, compute capacity and model complexity. Costs could reach billions of dollars by 2030, despite a rapid fall in unit costs per computing operation over the same period. Global AI infrastructure costs in hardware could exceed $1 trillion by the mid-2030s. Amortizing these huge fixed costs requires business models that can be rolled out across a very large user market.

Estimates about AI’s contribution to productivity growth vary, from a modest 0.5 percent per year to a very optimistic 10 percent per year. Research shows that productivity usually catches up slowly compared to costs. Without significant productivity gains, the current investment cost trajectory is unsustainable. We estimate that 3 percent annual productivity growth across advanced economies would be required to sustain AI model cost extrapolations to 2030. In an optimistic scenario, productivity increases would result in accelerated economic growth.
 

About the authors

  • Bertin Martens

    Bertin Martens is a Senior fellow at Bruegel. He has been working on digital economy issues, including e-commerce, geo-blocking, digital copyright and media, online platforms and data markets and regulation, as senior economist at the Joint Research Centre (Seville) of the European Commission, for more than a decade until April 2022.  Prior to that, he was deputy chief economist for trade policy at the European Commission, and held various other assignments in the international economic policy domain.  He is currently a non-resident research fellow at the Tilburg Law & Economics Centre (TILEC) at Tilburg University (Netherlands).  

    His current research interests focus on economic and regulatory issues in digital data markets and online platforms, the impact of digital technology on institutions in society and, more broadly, the long-term evolution of knowledge accumulation and transmission systems in human societies.  Institutions are tools to organise information flows.  When digital technologies change information costs and distribution channels, institutional and organisational borderlines will shift.  

    He holds a PhD in economics from the Free University of Brussels.

    Disclosure of external interests  

    Declaration of interests 2023

Related content