Beyond averages and aggregates

By Shonali Pachauri, Senior Researcher in the IIASA Energy Program

Shonali Pachauri explains why data, indicators, and monitoring at finer scales are important to ensure that everyone benefits from policies and efforts aimed at achieving national and global development goals.

A world where no one is left behind by 2030, is the promise nations have made by adopting the United Nations’ Agenda for Sustainable Development. But how does one ensure that no one is left behind? It requires designing inclusive policies and programs that target the most vulnerable and marginalized regions and populations. Sound data and indicators underpin our current understanding of the status of development and are an important part of periodic reviews to determine the direction and pace of progress towards achieving agreed goals. These form the basis of informed decisions and evidence-based policymaking. While an exhaustive list of indicators has been prescribed to monitor progress towards the globally agreed goals, these have been largely defined at a national scale. These goals rely overwhelmingly on simple averages and aggregates that mask underlying variations and distributions.

Indian woman walking home with fire wood © Devy | Dreamstime.com

Recent work I’ve been involved in makes the pitfalls of working with averages and aggregates alone abundantly clear. They can obscure uneven patterns of changes and impacts across regions and groups within the same nation. The overall conclusion of this work is that, even if the globally agreed goals are met by 2030, this is no guarantee that everyone will benefit from their achievement.

A recent Nature Energy – News & Views piece I was invited to write reports on a study that assessed the impacts of China’s recent coal to electricity program across villages in the Beijing municipal region. The program subsidizes electricity and electric heat pumps and has been rolling out a ban on coal use for household heating. The study found that the benefits of the program to home comfort, air quality, and wellbeing varied significantly across rich and poor districts. In poor districts, the study found that the ban was not effective as poor households were still unable to afford the more expensive electric heating and were continuing to rely on coal. Studies such as this one that help us understand how and why benefits of a program may vary across regions or population groups can aid policy- and decision makers in formulating more fair and inclusive policies.

In other recent research carried out with colleagues in the IIASA Energy Program, the Future Energy Program at the Fondazione Eni Enrico Mattei (FEEM) in Italy, and the Institute for Integrated Energy Systems at the University of Victoria, Canada, we developed a detailed satellite nightlights derived dataset to track progress with providing electricity access at a sub-national level in Africa. We found that while progress with electrification between 2014 and 2018 varied across nations, at a sub-national provincial level, disparities were even more pronounced. Even more surprising, while electricity access is generally higher and easier to extend in urban areas, we found urban pockets where access has stagnated or even worsened. This correlated with areas where in-migration of populations had been high. These areas likely include urban slums or peri-urban regions where expanding electricity access continues to be challenging. Furthermore, our analysis shows that even where access has been extended, there are regions where electricity use remains extremely low, which means that people are not really benefitting from the services electricity can provide.

In a final example, of research carried out with collaborators from the University of British Columbia and the Stockholm Environment Institute, we evaluated a large nationwide program to promote cooking with liquefied petroleum gas (LPG) in Indian households to induce a shift away from the use of polluting solid fuels. While this program specifically targets poor and deprived, largely rural households, our assessment found that although there has been an unprecedented increase in enrollments of new LPG customers under the program, this has not been matched by an equal increase in LPG sales. In fact, we found consumption of LPG by program beneficiaries was about half that of the average rural consumer. Moreover, when we examined how purchases were distributed across all new consumers, we found that about 35% of program beneficiaries purchased no refills during the first year and only 7% bought enough to substitute half or more of their total cooking energy needs with LPG. Clearly, the health and welfare benefits of a transition to cleaner cooking are still to be realized for most people covered by this program.

Analyses, such as the examples I’ve discussed here, clearly highlight that we need data, indicators, and monitoring at much finer scales to really assess if all regions and populations are benefitting from policies and efforts to achieve national and globally agreed development goals. Relying on aggregates and averages alone may paint a picture that hides more than it reveals. Thus, without such finer-scale analysis and an understanding of the distributional impacts of policies and programs, we may end up worsening inequalities and leaving many behind.

 References:

[1] Pachauri S (2019). Varying impacts of China’s coal ban. Nature Energy 4: 356-357. [pure.iiasa.ac.at/15905]

[2] Falchetta G, Pachauri S, Parkinson S, & Byers E (2019). A high-resolution gridded dataset to assess electrification in sub-Saharan Africa. Scientific Data 6 (1): art. 110. [pure.iiasa.ac.at/15982]

[3] Kar A, Pachauri S, Bailis R, & Zerriffi H (2019). Using sales data to assess cooking gas adoption and the impact of India’s Ujjwala program in rural Karnataka. Nature Energy [pure.iiasa.ac.at/15994]

Note: This article gives the views of the author, and not the position of the Nexus blog, nor of the International Institute for Applied Systems Analysis.