Renewable Energy Transition: Opportunities, Challenges, and Costs
Flexibility in Renewable Energy Systems: A Crucial Challenge for the Energy Transition
Flexibility in power systems based on renewable energy has become a critical issue in the energy transition. As wind and solar power generation increase, so does the uncertainty in production. During periods of high output, overproduction can lead to negative power prices in the market and necessitate the curtailment of renewable energy, resulting in wasted resources. Conversely, during times of insufficient sunlight and wind, other production capacities—often reliant on fossil fuels—are required to meet demand. To eventually phase out fossil-based production, both electricity consumption and CO2-free energy generation must become significantly more flexible.
There are various approaches to enhancing flexibility on the demand side and improving energy storage solutions to address these challenges. However, current technologies are not yet sufficiently mature and remain costly. Additionally, regulatory hurdles and the technical limitations of local network operators hinder the effective utilization of demand-side flexibility. The result of this immaturity can be illustrated by the case of California.
The Case of California: Progress and Challenges
California provides a striking example of these issues. The development of Battery Energy Storage Systems (BESS) in the U.S. is advancing rapidly, with California leading the way. According to the International Energy Agency (IEA), California’s installed BESS capacity reached 7,3 GW in 2023, outpacing Texas at 3.1 MW, with other states being even further behind. Simultaneously, California is a top producer of renewable energy, excelling not only in solar and wind but also in geothermal power, a source of flexible generation. The state’s commitment to renewable energy is underscored by legislation mandating that at least 60% of its electricity come from renewables by 2030.
However, a recent article in Newsweek (California is paying other states to take its solar energy – Newsweek) highlights significant challenges of these advancements. California’s solar farms often produce a surplus that exceeds the storage capacity of existing batteries. To prevent grid overload, the state exports this excess energy, selling it below market rates and effectively subsidizing other states at the expense of California’s energy consumers. When asked about the cost of these transactions, CAISO official Guillermo Bautista-Alderete stated: “We don’t track that number specifically.”
One reason for this surplus is that solar farms are incentivized by federal tax credits and renewable energy credits to continue production, even when market prices drop to zero or turn negative.
Batteries are essential for capturing excess energy produced during peak generation hours—typically sunny afternoons and windy days—and storing it for later use during high-demand periods, such as evenings. However, California’s existing infrastructure can only store a fraction of the surplus, leaving much of it unused.
Additionally, Californians face the highest electricity rates in the continental United States at 34.31 cents per kilowatt-hour, according to Statista. In comparison, residents of neighboring states such as Oregon, Nevada, and Arizona pay only 15 cents, 13 cents, and 12 cents per kilowatt-hour, respectively. While California has increased its storage capacity by 30% over the past year, demand continues to outstrip available infrastructure.
Current battery technologies, primarily lithium-ion systems, face limitations in efficiency, lifespan, and scalability. Expanding battery capacity will require significant investment and innovation, as well as streamlined permitting processes to accelerate deployment.
Lessons from California and Europe
California is not alone in grappling with these issues. In many European countries, for example in Austria – my country of residence – power networks are similarly ill-equipped to manage the challenges posed by renewable energy and require substantial investments. These costs will ultimately be carried by power consumers, including households. Moreover, insufficient flexibility—leading to both under- and overproduction—will likely add to the higher prices for consumers.
The energy transition today differs from historical technological shifts, where new innovations matured and became more efficient before replacing older systems. In contrast, the current energy transition is politically driven, advancing without waiting for new technologies to reach optimal efficiency.
Addressing the flexibility gap in both energy production and consumption will be critical to creating a more sustainable and economically viable energy future. However, it will take time for emerging technologies to achieve the efficiency necessary to surpass traditional energy systems. Until these solutions are fully realized, the inefficiencies in the system will continue to place a heavy financial strain on consumers.
Keep in touch and sign up to our Newsletter
