November 23, 2024

Rise To Thrive

Investing guide, latest news & videos!

Data centers powering artificial intelligence could use more electricity than entire cities

6 min read
Data centers powering artificial intelligence could use more electricity than entire cities

An Amazon Web Services data center in Ashburn, Virginia, US, on Sunday, July 28, 2024.

Nathan Howard | Bloomberg | Getty Images

The power needs of artificial intelligence and cloud computing are growing so large that individual data center campuses could soon use more electricity than some cities, and even entire U.S. states, according to companies developing the facilities.

The electricity consumption of data centers has exploded along with their increasingly critical role in the economy in the past 10 years, housing servers that power the applications businesses and consumers rely on for daily tasks.

Now, with the advent of artificial intelligence, data centers are growing so large that finding enough power to drive them and enough suitable land to house them will become increasingly difficult, the developers say. The facilities could increasingly demand a gigawatt or more of power — one billion watts — or about twice the residential electricity consumption of the Pittsburgh area last year.

Technology companies are in a “race of a lifetime to global dominance” in artificial intelligence, said Ali Fenn, president of Lancium, a company that secures land and power for data centers in Texas. “It’s frankly about national security and economic security,” she said. “They’re going to keep spending” because there’s no more profitable place to deploy capital.

Renewable energy alone won’t be sufficient to meet their power needs. Natural gas will have to play a role, developers say, which will slow progress toward meeting carbon dioxide emissions targets.

(See here for which stocks are helping to fix the nation’s power grid.)

Regardless of where the power comes from, data centers are now at a scale where they have started “tapping out against the existing utility infrastructure,” said Nat Sahlstrom, chief energy officer at Tract, a Denver-based company that secures land, infrastructure and power resources for such facilities.

And “the funnel of available of land in this country that’s industrial zone land that can fit the data center use case — it’s becoming more and more constrained,” said Sahlstrom, who previously led Amazon’s energy, water and sustainability teams.

Beyond Virginia

As land and power grow more limited, data centers are expanding into new markets outside the long-established global hub in northern Virginia, Sahlstrom said. The electric grid that serves Virginia is facing looming reliability problems. Power demand is expected to surge, while supply is falling due to the retirement of coal- and some natural gas-powered plants.

Tract, for example, has assembled more than 23,000 acres of land for data center development across the U.S., with large holdings in Maricopa County, Arizona — home to Phoenix — and Storey County, Nevada, near Reno.

Tract recently bought almost 2,100 acres in Buckeye, Arizona with plans to develop the land into one of the largest data center campuses in the country. The privately-held company is working with utilities to secure up to 1.8 gigawatts of power for the site to support as many as 40 individual data centers.

For context, a data center campus with peak demand of one gigawatt is roughly equivalent to the average annual consumption of about 700,000 homes, or a city of around 1.8 million people, according to a CNBC analysis using data from the Department of Energy and Census Bureau.

A data center campus that size would use more power in one year than retail electric sales in Alaska, Rhode Island or Vermont, according to Department of Energy data.

A gigawatt-size data center campus running at even the lower end of peak demand is still roughly comparable to about 330,000 households, or a city of more than 800,000 people — about the population of San Francisco.

The average size of individual data centers operated by the major tech companies is currently around 40 megawatts, but a growing pipeline of campuses of 250 megawatts or more is coming, according to data from the Boston Consulting Group.

The U.S. is expected see a growing number of data center campuses of 500 megawatts or more, equivalent to half a gigawatt, in the 2030s through mid-2040s, according to the BCG data. Facilities of that size are comparable to about 350,000 homes, according to CNBC’s analysis.

“Certainly the average size of the data centers is increasing at a rapid pace from now to 2030,” said Vivian Lee, managing director and partner at BCG.

Community impact

Today, Lancium has five data center campuses in various stages of development. A 1,000-acre campus in Abilene is expected to open in the first quarter of 2025 with 250 megawatts of power that will ramp up to 1.2 gigawatts in 2026.

The minimum power requirement for Lancium’s data center customers is now a gigawatt, and future plans involve scaling them up to between three and five gigawatts, Fenn said.

For data centers that size, developers have to ensure that electricity costs in neighboring communities don’t rise as a consequence and that grid reliability is maintained, Fenn said. Pairing such facilities with new power generation is crucial, she said.

“The data centers have to partner with utilities, the system operators, the communities, to really establish that these things are assets to the grid and not liabilities to the grid,” Fenn said. “Nobody’s going to keep approving” such developments if they push up residential and commercial electric rates.

Renewables not enough

Data center campuses run by publicly-traded Equinix are rising to several hundred megawatts from 100- to 200 megawatts, said Jon Lin, general manager for data center services at the company. Equinix is one of the largest data center operators in the world with 260 facilities spread across 72 metropolitan areas in the U.S. and abroad.

Developers prefer carbon-free renewable energy, but they also see solar and wind alone as unable to meet current demand due to their reliance on changing weather conditions.

Some of the most critical workloads for the world’s economy, such as financial exchanges, run at data centers operated by Equinix, Lin said. Equinix’s data centers are online more than 99% of the time and outages are out of the question, the executive said.

“The firmness of the power is still incredibly important for these data centers, and so doing that solely off of local renewables is candidly just not an option,” Lin said.

The major technology companies are some of the largest purchasers of renewable power in the U.S., but they are increasingly turning to nuclear in search of more reliable sources of electricity. Microsoft is supporting the restart of the Three Mile Island nuclear plant outside Harrisburg, Pennsylvania through a power purchase agreement. Amazon and Alphabet’s Google are investing in small nuclear reactors.

AWS CEO on Amazon's $500 million small modular reactors investment

But building new nuclear reactors is expensive and fraught with delays. Two new reactors in Georgia recently came online years behind schedule and billions of dollars over budget.

In the short run, natural gas will fuel much of the power demanded by data centers, Lancium’s Fenn said. Gas is the main, short-term power source providing the reliability these facilities require, Boston Consulting Group’s Lee said.

Investments could be made in new gas generation that adds carbon capture and battery storage technology over time to mitigate the environmental impact, Lee said.

The industry hopes that gas demand will taper off as renewables expand, battery storage costs come down and AI helps data centers operate more efficiently, Fenn said. But in the near term, there’s no question that data center expansion is disrupting technology companies’ emissions targets, she said.

“Hopefully, it’s a short term side step,” Fenn said of stepped-up natural gas usage. “What I’m seeing amongst our data center partners, our hyperscale conversations, is we cannot let this have an adverse effect on the environmental goals.”

Note: CNBC analysis assumes a data center campus is continuously utilizing 85% of its peak demand of a gigawatt throughout the year, for a total consumption of 7.4 billion kilowatt-hours. Analysis uses national averages for household electricity consumption from EIA and household size from Census Bureau.