Friday, December 16, 2016


It was reported this week (FT, 12th December) that Andrew Wright, a senior partner at OFGEM, had argued that Britain could be moving towards a two-tier power market in which some households pay for reliability while their neighbours “sit in the dark”. Ignoring for the moment the selective reporting of a complex discussion, and a mildly hysterical media reaction to this proposition, we need to recognise that the world is changing. Different tiers of reliability, in which customers can choose their own combinations of price and quality/availability, are now both technically feasible and advantageous to consumers. There are deficiencies in current retail markets, so new formats for the “consumer offering” are both necessary and desirable. They will give us better control over our power systems and can even help with thorny problems such as those of fuel poverty.

Possible supply failures in which households “sit in the dark” are a source of nightmares for government ministers and are seen, often correctly, as a sign of political failure. The last national “black-outs” in the UK occurred in the 1970s with the miners’ strike and the 3-day week, resulting in political turmoil and the fall of a government. But, historically and internationally the more common cause has been either inability to plan for, or inability to finance, sufficient generation capacity. The UK safety margin in generation is currently at a historic low, so risk of failure is increasingly seen as real. Responsibility for maintaining adequate supplies, within the current institutional architecture, is largely left to the “market”, with a degree of oversight from OFGEM.  Some of these issues, and instances of market failure, are spelled out in the page[1] dealing with low carbon power.

But Andrew Wright has raised different questions that deserve some very serious consideration, and go well beyond the simple question of whether we currently have enough capacity in our power system. They go to the heart of the ways in which consumers in future will and should be able to purchase electricity. Reliability is an expensive commodity and the idea of consumer choice over the standard of reliability required is one that can only benefit consumers and the overall efficiency of power systems. In most sectors of the economy the ability to choose combinations of quality and price that suit a consumer’s needs is well established, and indeed a normal characteristic of a vibrant market economy. An incidental benefit in the power sector is provision of an additional instrument to improve overall system reliability and, along with storage and interconnection, to assist in managing future low carbon power systems with operational features that include intermittency or inflexibility.

The changes that are coming stem from technological developments in control and metering systems that were considered futuristic in the 1970s, and were to a large extent inhibited by deficiencies in the structures of the UK retail market, including the adoption of load profiling. With load profiling, all consumers of a particular type are assumed to have the same time profile in their consumption pattern, implying a homogenous mix of peak/ non-peak, day/night and winter/summer loads. The supply business is then essentially commoditised.  All suppliers provide the same product, with differentiation only on price. This undermines, or rather excludes from the market, any competitive benefit from offering consumers a truly differentiated service. Profiling inhibited UK development of sophisticated metering and control systems and tariffs, arguably for a generation[2].

The conventional utility model has consumers able to treat electrical energy supply as “on tap”, with limited or no differentiation between applications (e.g. as between lighting, heating or mechanical power). Tariffs and prices for the most part approximate to an averaging of the costs of supplying electricity, with very limited ability to differentiate on grounds of differing incremental costs. 

Technology change is now forcing re-examination of this model and offers an opportunity to transform the market.  Just as new low carbon generation and storage technologies, with very different operating characteristics and cost structures, will force us to re-examine system operation and wholesale markets, so should developments in metering, telecoms and control technologies lead to re-examination of the way consumers use electricity and control their own usage, changing the whole nature of the supply business. These developments have created an explosion of possibilities in metering and service provision, including sophisticated metering or even real time pricing, and sophisticated remote control of individual appliances. Given the interactive nature of these possibilities, utilities need to consider how end use should be incorporated into processes for the secure and efficient operation of the system. Consumer behaviour, and consumer choice, will be incorporated as a much more active element in the system. 

What is needed is to redefine the “consumer offering”, defining electricity as a set of services, rather than a homogeneous commodity. This requires starting with a clean sheet in defining the nature of the services that consumers will want, and the basis on which they pay.  So, for example, a consumer wanting to charge electric vehicle (EV) batteries might request 75 kWh to be delivered in a specified period, over (say) 60 minutes for “instant” service, over several hours, overnight or over several days, and the consumer will pay for his 75 kWh requirement to be met within the agreed time but with the supplier choosing exactly when the charging takes place.  Corresponding arrangements could apply to the purchase of power for heat, for refrigeration, and some other uses, designed in each case to reflect the nature of the load.  Such services might even be packaged with the provision of appropriate equipment (eg storage heaters). Commitments to individual consumers would be made by energy service companies who would be able to aggregate consumer requests and in turn contract with network operators, for whom the flexibility would be an additional instrument in maintaining a reliable and efficient system.

Implicit in all this is the option to take electricity supply at varying levels of “reliability”.  Most consumers will want 100% reliability for lighting or the ability to watch “Strictly” live, and to continue to pay a higher kWh price to get it. But many will be relatively indifferent to the exact mode of operation of their storage heaters (as they are now), water heaters, or EV battery charging. But in each case they will have a choice between a higher price premium service with guaranteed instantaneous delivery, and a lower price with delivery still guaranteed but with timing subject to some external influence.

For all households, but perhaps particularly those struggling to meet their energy bills, this choice can have a real value if, for major parts of their kWh consumption, they are no longer forced to pay the full price for a “gold plated” concept of reliability that they neither need nor want.
The development of such schemes still requires a great deal of research and product design work and public consultation, but Andrew Wright is to be congratulated on bringing to our attention an idea which will be of increasing importance for 21st century power systems.


A fuller development of the above ideas can be found in the author's paper published by the Energy Technologies Institute: MARKETS, POLICY AND REGULATION IN A LOW CARBON FUTURE

[1] (See panel of page headings above).
[2] The CALMU credit and load management unit was pioneered by Fielden and Peddie (then an Area Board Chairman) in the 1980s, and has enjoyed worldwide success. It died in the UK with privatisation and the adoption of profiling.

Monday, December 12, 2016


Battery technology is becoming a hot topic for larger commercial consumers, and may soon become a viable option for domestic consumers too. And National Grid is contracting for battery storage as a back-up resource. But how batteries are best deployed in today’s power networks is a complicated question. Today’s wholesale markets and tariff structures are very imperfect and may be quite dysfunctional in the world of fast moving technical change that includes communications and control in power networks. Consumers investing in batteries to make or save money are therefore advised to look carefully at the options, and the small print in tariffs and contracts. There are opportunities, particularly in exploiting anomalies, but wholesale markets and utility tariffs can change very quickly, and maintaining flexible options is likely to be the wisest strategy for business consumers.

What led to this comment was a request to talk on the subject of commercial opportunities at a recent energy management exhibition (EMEX) held in partnership with the Energy Managers Association. There is strong current interest among commercial consumers, such as supermarket chains, in the installation of banks of batteries. These can help to enhance security of supply, but this is not a primary motive for a significant investment outlay.

Batteries are now proving to be a valuable option for power systems, with several potentially useful functions. These can include spreading national or aggregate system loads over the day, providing emergency back-up and other ancillary services, and managing thermal and voltage constraints in local distribution networks. A two year trial of the largest grid-scale battery in Britain has proved it can potentially transform the energy grid and play a major role in the transition towards a low-carbon economy. The latest auction round for back-up capacity is reported to involve procurement of 500 megawatts of new storage projects.

The fact that batteries also have significant value at the lower voltage levels of local distribution networks, as well as in contributing to the management of aggregate demand and supply, is very relevant since it means that the battery owner may want or need to have a commercial relationship with both the National Grid and the local network operator. It also suggests that, in relation to local networks, there may be a premium on mobile batteries since load constraints on the network may occur in different locations at different times.

Some new loads, such as electric vehicles, are likely to further increase the need for batteries within the control of the system operators, again both at national or system wide levels and at key nodes within local networks. A good example is described in the Norwegian experience described in an earlier comment.

Will commercial scale batteries operate in front of or behind the meter?

From a commercial consumer perspective, the investment case for battery purchase and installation rests on three possible sources of revenue or cost saving, arbitrage in the wholesale market where there is regular opportunity to “buy cheap and sell dear”, responding to use of network tariffs that are strongly differentiated by time of day, and contracting directly with the network system operators.

Arbitraging wholesale markets.  The risk in relying on trading in wholesale markets is the volatility in prices from year to year. Wholesale prices are expected to be high this winter, in early 2017, but this expectation is critically dependent on capacity margins. Additional capacity or less than expected demand growth can dramatically reduce prices and the opportunities for arbitrage. In the medium term, it is increasingly likely that conventional wholesale market structures and assumptions will be overturned in progress to a low carbon economy, possibly reducing the importance of wholesale “spot” prices. Basing an investment on the ability to exploit arbitrage opportunities needs to take account not just of immediate market risk but also future structural change.

Exploiting distribution use of system (DUoS) tariffs. Some published network tariffs are highly differentiated by time of day, enabling consumers on these tariffs to make very large savings if they are able to move their usage away from peak loading on the local network, for example by using their own battery storage. In the case of supermarkets this may also be possible by using a store of “cold” to reduce their refrigeration load.

But the key factor here is that these structures are often extremely imperfect economic signals and are very crude devices to influence the shape of consumer loads. Exploiting anomalies in the tariff structure is ultimately a zero sum game. Ultimately the network operator is a utility that will be allowed to earn a regulated rate of return. Its costs are composed mainly of the fixed costs of the network, so the network utility will be forced either to recover more revenue from other customers, (highly unpopular and subject to regulatory intervention), or to rebalance the tariff to remove what may actually be a distorting incentive. Again this is a commercial risk if this is the prime motive for investment in batteries.

Contracting directly with the network operator. This is a novel development for network operators but, as shown in the recent auctions, it is a trend that is now under way. It raises the more general question of whether it is more effective to have the system operator managing batteries as facilities contracted from the battery owner, or to try to manage the system through complex tariff structures which try to second guess consumer behaviour. In the first case we might describe the battery as “in front of the meter”, and in the second case “behind the meter”.

A wise decision for the commercial consumer considering battery purchase, which of course can also provide a small amount of extra security, would be to make this investment as flexible as possible, to allow for direct contracting as well as managing its own demand. In dealing with local networks, there might also be a case for making the batteries trailer mounted, to allow further geographic mobility and to meet changing local network needs.  

Thursday, December 8, 2016


The institutional framework against which investment decisions have to be made is critical to capital intensive sectors such as power, and in consequence to promoting low carbon economies, which in relative terms will often tend to be even more capital-intensive than conventional thermal generation. Sound regulatory and market frameworks are therefore a central concern for energy and GHG reduction policies. In the UK, for example, one of the biggest single issues is getting infrastructure investment against a background of policy uncertainty, one of the themes I have explored previously in discussing low carbon power[1].

But worldwide there are also some prior and even more pressing set of problems that can impact on the viability and sustainability of the power sector. These relate to fundamentals of law and good governance, and go to the heart of national political structures. The corrosive nature of corruption and clientelism (sometimes defined in terms of widespread patronage and the exchange of favours for votes) is a major challenge for all political systems, but is perhaps particularly important when there are serious resource constraints, and in the context of successful economic development. This is therefore a big issue for many less developed economies, which are of equal or greater importance to the achievement of a global low carbon future.

Vinayak Chatterjee describes the problem in an Indian context. How to revive India's corrupt and debt-ridden power sector. (October 26, 2015)

India's electricity distribution sector is a national embarrassment, brought about by decades of turning a blind eye to the misdemeanours of this sector. The unholy trinity of the conniving State Electricity Board (SEB) employee, the unethical and self-enriching domestic and industrial consumer and the politician patronising theft, corruption, sloth and freebies has brought the power sector to its knees.

Students of past performance of many SEBs, with honourable exceptions, will be familiar with this harsh judgement, with many of these criticisms confirmed in numerous World Bank studies. High levels of illegal abstraction from distribution networks, tariffs inadequate to allow SEBs to finance new capacity, and political patronage that can view SEB management as a vehicle for distributing favours and jobs, are all rife and in many instances both well documented and publicised. Unsurprisingly many SEBs are in dire financial straits and are ill-equipped to support the high levels of investment required to improve and increase access and supply, let alone make the transformation to a low carbon economy.

The Indian power sector is an important illustration, partly because a low carbon future for India is so important to the world, partly because the power sector is intrinsically crucial to this objective, and partly because the problems of India’s state electricity boards (SEBs) have been widely acknowledged and openly discussed. India is by no means unique in its lack of effective governance. Indeed the open nature of Indian democracy means that the problems are at least recognised, a first step to a possible resolution.

A recent article by Jacquelyn Pless and Harrison Fell, “Bribes, bureaucracies, and blackouts: Towards understanding how corruption at the firm level impacts electricity reliability” offers an interesting empirical example and theoretical perspective for this discussion, pointing out that these shortcomings in governance can also lead us to comparison with some familiar problems of a common pooled resource such as fisheries.[2] The study addressed a particular form of corruption, using data from many countries, and found empirically that firms with a propensity to bribe for electricity connections experienced 14 more power outages per month and incur 22% greater losses as a percentage of annual sales due to power outages.

Propensity to bribe is closely linked both to a perceived necessity for bribery (in order to get any power at all), ie a resource constrained system, and to weak governance where bribery is an effective, low risk and penalty-free option. Inevitably these include many systems in developing countries with limited power generation resources combined with weak governance and regulation. A simple example of the process by which the reliability of the network is degraded is given below.

Imagine you are an investor in a manufacturing plant invited to wait six months to connect a factory to the electricity grid. The temptation is to bribe an employee of the local power supplier to connect you next week. The bribe is a rational act and will benefit your company, but we can assume that many other people will be doing the same thing. Typically there is an actual or potential shortage of capacity in the system, due to a lack of investment, itself a result of failure to collect revenues that cover costs and of poor governance. This has frequently been true of State Electricity Boards (SEBs) in India, power being a competence of individual states rather than the federal government. Restricting new connections is one of the means that the SEB is obliged to use to try to restrict demand to a level that can be met with a reasonable degree of reliability. Unauthorised connections will overburden the electrical grid, leading to a more vulnerable system and less reliable power supplies for everyone.

In terms of impact, bribery to get a connection is akin to theft, equivalent in its effect to the smaller scale illegal “hook-ups” that are also commonplace. The company may subsequently pay for actual kWh consumed (by no means certain) but this does not reduce its immediate adverse impact. The fact that the SEB management is unable to control connections, obtained by bribery or other illegal methods, means that it loses control of system reliability. In other words a system that is open to corrupt practices, or indeed to simple theft, will inevitably suffer either financially or in terms of its ability to provide a reliable supply, or most likely both. It has become a common pool resource for which no-one is prepared to pay to maintain reliability.

There is an interesting and broader question of how to get to more socially efficient outcomes. Administrative rationing, giving preference to incumbent consumers, is often the starting point for electricity providers, given that they start from a position where potential demand is greatly in excess of available supply, but may also be economically inefficient. It also breaks down when subject to bribery and corrupt practices. It has sometimes been argued that corruption is a form of market pressure and can under some conditions improve social efficiency, by allocating scarce supplies (of import licences or network connections for example) to those who value them most highly.

Quite apart from any moral or ethical objections to condoning rent seeking by corrupt officials, however, bribery and corruption are by their very nature clandestine and non-transparent, and are unlikely to be organised in a technically efficient manner, eg with transparent markets or openly conducted competitive auctions. Our examples, and general experience, suggest that corruption quickly gets out of control.  World Bank economists have therefore preferred to recommend solutions that focus on improving governance and enhancing the financial capability of the sector, eg through cost reflective tariffs that permit investment in increased supply.

The so-called Washington consensus on economic reforms recognised the underlying problems but assumed that the answer was markets and privatisation. In practice this approach has not lived up to expectations, in no small measure because successful privatisation is only possible when the basic elements of reform, including adequate tariff levels and structures, and the depoliticisation of power sector management, have already been achieved. Private sector management is in any case not immune from corrupt practices in environments of weak governance.

I believe these will be continuing and increasingly important issues within a global perspective on both economic development and low carbon futures. Transparency, oversight, and enforcement of high standards of sector governance will continue to be important objectives everywhere, and they are closely tied to wider questions of political economy.[3]


[1] Recent papers published by the Energy Technologies Institute addressed these themes, and also related and additional elements of market failure, for the UK, and form a foundation for looking at future energy systems architecture.
[2] A recent Oxford Martin School blog by Jacquelyn Pless and Johanna Schiele  also aims to develop and extend this analysis to other aspects of electricity networks.
 [3] Francis Fukuyama provides a thought provoking discussion of the general issue of clientelism in Political Order and Political Decay: From the Industrial Revolution to the Globalisation of Democracy,  Farrar, Straus and Giroux. He also makes useful distinctions between the closely related concepts of corruption, patronage and clientelism. The book is also particularly interesting in its criticisms of the USA, and reminds us that political systems are capable of decay as well as improvement, with the ever present risk of reversion to clientelism in both democratic and authoritarian societies

Thursday, December 1, 2016


UK grid loses half the power from link to France.

National Grid powers up for a renewables future.

National Grid to be spared from break-up.

(all from FT, November 2016)

 The UK currently faces a tight supply situation through this winter, which may be exacerbated by downtime on French nuclear plant and partial loss of capacity on the submarine interconnector. National Grid as the system operator plays a key role in keeping the lights on, by finding ways to manage these and other unforeseen events, and balancing supply and demand in real time. It will also face new challenges in managing generation supply that contains an increasing proportion of renewable energy, with significant intermittency of supply. These challenges increasingly emphasise the difficulties in separating the roles of a transmission operator, managing and maintaining the high voltage network, and a system operator, directing many aspects of the day to day business of power generation. As I observed in an earlier comment, Low carbon network infrastructure. Not sufficient arguments for breaking up National Grid. the House of Commons Select Committee was ill advised to recommend the break-up of National Grid on the grounds of an interpretation of regulatory theory that addresses yesterday’s problems. Keeping these functions together implies that the government has to address the problems of a difficult low carbon future, not the outdated paradigms of the 1990s.

Three stories for the UK power sector came together in this week’s FT, all focused on National Grid, who maintain the UK’s high voltage long distance transmission network and also act as the system operator, essentially controlling the operation of the UK’s generating plant in order to maintain supply/demand balance and stability of power flows within the system. The first story, National Grid Powers up for a Renewables Future, describes how National Grid is refocusing its business to cope with the challenges of renewables.

Some analysts believe we are on the verge of a fragmentation of the power sector that will eventually lead to much more emphasis on local power generation and battery storage, making the high voltage grid redundant. I believe this extreme position is highly improbable, for two main reasons. First, a very high proportion, at least of new low carbon sources of power currently anticipated in most projections, is in sources of generation that are intrinsically either large scale or remote from population centres. This includes nuclear (excluding for the moment small modular reactors), carbon capture (CCS) and large scale renewables such as offshore wind. These and probably other options such as tidal lagoons, depend on access to long distance transmission to make them viable.

Second, smaller local systems face much bigger balancing problems, primarily because they lack diversity. Interconnection is therefore a necessity. There may be some specific issues of network charging, if local facilities believe local generation and lower “imports” allow them to escape paying for the back-up services the local system needs, but it is not clear why these issues should undermine the fundamentals of the National Grid business model.

It is true that the essentially intermittent nature of many sources of renewable power will make the Grid’s job, as system operator, more challenging. Viewed from this perspective even a system as large as the UK can benefit from additional diversity and from the back-up potentially provided by interconnection with other networks. This takes us to the second FT story, on 29 November, UK Grid loses half the power from link to France.

Damage to the cable, possibly from a marine anchor, has temporarily reduced the capacity of the link. Coinciding with some unanticipated downtime on French nuclear plants, this increases the risk of a tight supply situation this winter and a spike in short term market prices (one independent supplier has already gone to the wall). The impact of this loss of capacity, on France as well as the UK, emphasises the importance of interconnection for security of supply, and also the role of the Grid.

This leads us to the third story, National Grid to be spared from break-up, also on 27 November. The government has sensibly rejected the recommendations of the Select Committee chaired by the SNP’s Angus McNeil. As I argued in an earlier comment, the drive to a low carbon economy is going to bring profound changes to the power sector. These start with questions of technology and scale but they have huge ramifications, and conventional assumptions about markets, regulation and governance are coming under increasing pressure. Given that governments lack any technical competence in the power sector, the role of organisations like the National Grid is becoming more and more important. Now is not the time to take the risks of disruptive organisational change for its own sake.

To embark on a re-organisation of National Grid, in the absence of a clearer vision of where we need to get to, and focusing on issues which in a sense are problems of the old paradigm, may be a mistake. To do so without a clear direction of travel will simply add to the policy uncertainties already identified as a major problem for new investment.

For a fuller discussion of the National Grid break-up question, refer to the earlier article: Low carbon network infrastructure. Not sufficient arguments for breaking up national grid.  Some of these challenges sit at the heart of the Oxford Martin Programme on Integrating Renewable Energy.