Periodic Table of Open Data’s Impact Factors
Based on the existing literature and case studies, we have developed a Periodic Table of Open Data Elements detailing the enabling conditions and disabling factors that often determine the impact of open data initiatives. Although the importance of local variation and context is, of course, paramount, current research and practice shows that the elements included in five central issue categories — Problem and Demand Definition, Capacity and Culture, Partnerships, Risks, Governance — are likely to either enable or disrupt the success of open data projects when replicated across countries.
Problem and Demand Definition
U
User Research
U
User Research
Open data initiatives tend to be more successful and avoid the notion of, “if you build it, will they come,” when they are clearly optimized for an intended audience or user base from the start. The upfront identification, mapping and understanding of relevant constituencies, and a similar examination of their needs can enable more targeted open data-driven interventions.
C
Causes and Context
C
Causes and Context
In many open data initiatives, and in governance innovation efforts more generally, practitioners can find themselves addressing symptoms rather than the root causes of problems. Open data projects, such as the effort to predict dengue outbreaks in Paraguay, tend to be more successful when they seek to address underlying problems (mosquito breeding and transmission) rather than the symptoms of those problems (high levels of dengue fever).
Rf
Refinement
Rf
Refinement
To move from a well-understood problem area, to a granular, actionable, and quantifiable path forward, successful practitioners often look to refine their understanding of the problem to be addressed by seeking to understand, for instance, why the problem exists in its current form, what contributing factors could be at play, what potential knock-on effects of addressing the problem might be, and why the problem has not yet been solved by some other interested party.
Bg
Benefit and Goals
Bg
Benefit and Goals
Open data projects often fail to build an audience or continue to evolve and expand successfully over time if they do not successfully define the intended benefits of the open data use and set clear target goals. These deficiencies often can create difficulty in the development of metrics and indicators—important drivers of iteration and impact. Many of the projects studied, including notably Kenya’s GotToVote! project did not have a clear baseline against which to measure the success of the project. Without an understanding of the current baseline, measuring progress toward identified goals and demonstrating whether and how open data efforts actually benefited the public remains a challenge.
Da
Data Audit and Inventory
Da
Data Audit and Inventory
Once the problem and value proposition are in place, practitioners are able to explore the availability of datasets, both in the form of open government data, and from other potentially useful and relevant data sources, like NGOs, the private sector, or crowdsourcing efforts. A clear problem definition can help to uncover which data sources could add value and inform strategies for collecting or accessing that data. Colombia’s Aclímate Colombia, for instance, identified the types of data it needed for its agriculture algorithms and engaged the semi-public industry groups that had it. The Prayas Energy Group in India, on the other hand, found that no one collected or stored the type of energy usage information it needed for its power quality monitoring efforts, so it launched its own (open) data collection effort across 18 Indian states.
Capacity and Culture
Di
Data Infrastructure
Di
Data Infrastructure
On the supply side of open data the lack of a strong data infrastructure—that is, hardware and software platforms to make data consistently accessible and machine-readable in a timely manner—often creates major challenges to positive impact. Burundi’s OpenRBF platform is an example of working around issues related to data infrastructure. Burundi provided access to data on its results-based financing efforts around healthcare through the OpenRBF platform, a digital infrastructure for collecting and publishing such data. The existence of an “out-of-the-box” tool for making results-based funding (RBF) data public in reusable formats catalyzed the widespread opening of RBF data across many developing countries in Africa.
Open Data Ecosystem ElementsPu
Public Infrastructure
Pu
Public Infrastructure
Similar to the ICT4D environment, much of the literature and practice48 of open data in developing economies points to the importance of a strong public infrastructure—human capital (including data science and statistical knowledge), public services (including education and libraries), and civil society—to ensure that data is collected, cleaned, and released in a usable manner and that updates and feedback are seamlessly incorporated into open datasets. Supply side efforts to leverage these public infrastructures can increase the demand for open data and establish touchpoints with users. An active ecosystem of data users and international open mapping platforms and individuals helped to ensure that Nepal’s open data-driven crisis response efforts could be quickly developed and put into practice. The challenges experienced by Ghana’s Esoko platform as a result of unreliable electricity access in the country, on the other hand, shows the many ways that public infrastructure can affect the success of open data projects.
Open Data Ecosystem ElementsLp
Tech Literacy & Internet Penetration
Lp
Tech Literacy & Internet Penetration
Even as access to the Internet continues to expand across the developing world, especially through smartphones and other portable devices, many open data projects are being launched into communities that suffer from low Internet penetration and a persistent digital divide. Several of the initiatives studied struggled to achieve their transformative potential, particularly when practitioners failed to engage intermediaries or civil society groups capable of reaching unconnected audiences. Stakeholders involved in South Africa’s Medicine Price Registry Application (MPRApp) and Tanzania’s open education dashboards pointed to low Internet penetration rates, and the related challenge of low tech literacy, as major barriers they confronted to achieving greater positive impacts.
Open Data Ecosystem ElementsRb
Cultural/ Institutional Roadblocks
Rb
Cultural/ Institutional Roadblocks
As is often the case in developed countries, too, cultural and institutional roadblocks can limit the impact of open data. These roadblocks can manifest in the form of an institutional culture that remains skeptical of openness, or the absence of well-trained individuals capable of recognizing and acting on the potential of open data (readiness)—beyond the prevalence of engaging volunteers in the development of open data initiatives. In all cases, a more concerted culture- and capacity-building effort is often necessary to create an impact. In Burundi efforts to create transparency and accountability around its results-based financing efforts were slowed and complicated by a lack of readiness for technology-enabled openness. Jamaica’s open data tourism efforts relied on the readiness of outside volunteers to supplement open data through crowdsourcing—with the impact of the project dependent on their capacity to collect data and information in a strategic, usable manner.
Open Data Ecosystem ElementsSe
Skills & Expertise
Se
Skills & Expertise
Especially for more technical uses of open data—such as sophisticated data analytics—actors on the demand side of open data need to possess certain skills and expertise. Employees at CIAT, the organization behind Aclímate Colombia, for instance, possess high-level data science capabilities that enabled them to leverage open data to create sophisticated algorithmic tools to inform agricultural decision making. Other projects, like crowdsourcing efforts from Jamaica and Nepal, relied on the skills of a few important institutional actors on the demand side and the less-technical efforts of volunteer data collectors.
Open Data User/Donor ElementsFl
Feedback Loops
Fl
Feedback Loops
Open data initiatives tend to be less successful when they do not create mechanisms for users and beneficiaries to provide input to demand-side practitioners. Tanzania’s open education dashboards are a notable example. The platforms were launched into an environment with low Internet penetration and digital literacy, with seemingly little opportunity for the intended users and beneficiaries of the tools, like parents or education advocates, to suggest ways to make the platforms more usable (and useful) for the community.
Open Data User/Donor ElementsRs
Resource Availability and Sustainability
Rs
Resource Availability and Sustainability
The availability of funding and resources are a key variable of success on both the supply and demand sides of open data. Focusing on the demand side, although many open data projects can be stood up quickly on a tight budget (such as Kenya’s GotToVote! an initial prototype of which was created for only $500), sometimes with a very small team (Paraguay’s dengue prediction efforts were championed by researcher Juan Pane and a small team under his direction), establishing sustainability and scaling use often requires more sustained funding and/or well-defined business models. This was the dynamic at work for example in South Africa, where the MPRApp relied almost entirely on the time and effort of a single person. Likewise, in Uganda, CIPESA, the developers of the iParticipate open health data and citizen engagement effort, struggled to proactively elevate health service delivery concerns to relevant government officials because of funding issues affecting both data collection and outreach efforts. The agriculture information tool Esoko, on the other hand, has managed to take hold in Ghana in large part due to its for-profit, largely business to business (B2B) model, as well as significant investments from foundations and international organizations.
Open Data User/Donor ElementsGovernance
M
Performance Metrics
M
Performance Metrics
Open data projects are better positioned for success when practitioners develop and monitor metrics of impact to inform management and iteration. The vast majority of the open data initiatives studied in this series lacked clearly defined performance metrics. Not only does this create major challenges for iterating upon early efforts, it calls the sustainability of these interventions into question, with a demonstration of success and impact a likely requirement for continued funding and investment.
Open Data User/Open Agency ElementsRm
Risk Mitigation
Rm
Risk Mitigation
In some cases, open data projects can be advanced despite some level of risk. In such cases, practitioners must ensure that projects that deal in information that is potentially personally identifiable (including anonymized data) have outlined and implemented a clear, upfront strategy for addressing risks created by open data use. Many of the projects studied in this series dealt in potentially sensitive information—e.g., health, energy consumption, political, and education data. Although each project took steps to ensure that no personally identifiable information was released to the public, all would benefit from a clearly defined—and, preferably, openly available—risk mitigation strategy to ensure that no harms inadvertently fall on data subjects.
Open Data User/Open Agency ElementsOd
Open by Default (and other principles)
Od
Open by Default (and other principles)
Given the level of government resource allocation and time investment required to implement strong open data initiatives, high-level political buy-in and codified open data policies (reflecting the International Open Data Charter principles) are needed to provide the incentives and flexibility to government officials to meaningfully advance open data goals. The ESMI effort in India, for example, is an industry- and NGO-driven effort to create and open useful data on power quality in the country. This effort, which has had relatively little discernible impact to date, is only necessary because of the lack of energy data being opened by government—an issue that could be resolved with a commitment to openness by default and other internationally accepted principles.
Open Data Ecosystem ElementsFi
Freedom of Information and other Policies
Fi
Freedom of Information and other Policies
Clear policies pushing forward access to information and data can act as important drivers for open data initiatives. Without explicit policy backing, the sustainability of open data efforts can be called into question, and access to necessary data can dry up at any time. The existence of Freedom of Information policies can also provide means for accessing relevant information, though often at a much slower pace than open data. A key enabler for the MPRApp open data initiative, for example, was South Africa’s legislative framework that promotes and enacts transparency in medicine pricing. Such a framework compels the Department of Health to collect and publish data on medicine prices in South Africa, ensuring that the supply side of the MPRApp will continue to be made accessible, allowing Code for South Africa to focus on improving the tool and getting it into the hands of its intended users.
Open Data Ecosystem ElementsDq
Data Quality
Dq
Data Quality
A widely prevalent challenge to positive impact arises from poor data quality. Data quality is an issue in developed countries, but often presents even greater barriers to success in developing countries. Quality issues can manifest in a number of ways, like inaccurate information, a lack of completeness in official datasets, out-of-date data, or otherwise corrupted datasets. Aclímate Colombia, for example, experienced challenges gaining access to the most complete and up-to-date information sets for its agriculture tools, slowing their development. Open Development Cambodia’s efforts are consistently challenged by not only strong restrictions in terms redistribution, reproduction, and reuse on some datasets, but also by the inconsistency and unpredictability of when updates to important official datasets occur. In South Africa, the MPRApp was hurt by a lack of interoperability; that is, open data was not made available in standards that allowed for aggregation and manipulation. Likewise, Kenya’s GotToVote! experienced major challenges when one of its central data sources crashed unexpectedly, rendering the platform temporarily unusable.
Open Data Ecosystem ElementsR
Responsiveness
R
Responsiveness
Just as open data is unlikely to create a major impact without demand-side actors to act upon released data, a lack of responsiveness, often characterized by a lack of commitment to take up data-driven insights within governing institutions, can limit the impact of open data. Often, governments succumb to the temptation to open wash data, nominally opening it up but failing to create feedback loops to ensure that users are actually using the data or that data is being released to meet a genuine demand. In Jamaica, for example, an interactive community mapping project is supplementing open datasets with a crowdsourced effort to improve tourism in the country; the project’s clear potential has not yielded major impacts yet in part because tourism authorities have not yet acted on the generated insights. The researchers who used open data to predict dengue fever transmission in Paraguay also experienced ongoing challenges wresting the most useful data for their algorithms from government data holders; there has been little indication that their insights will be meaningfully taken up by institutional authorities.
Open Data Ecosystem ElementsPartnerships
Dh
Data Holders
Dh
Data Holders
Although open data is meant to provide value to data users without any direct engagement with data holders necessary, partnering with entities on the supply side (including government) can help to fill data gaps and enable higher impact data use. Aclímate Colombia is a strong example of the potential of such partnerships. The initiative, aimed at providing farmers with a better ability to plant crops in a way that is resilient to the effects of climate change, would not be possible without collaboration between the driver of the initiative (a civil society organization), key data holders (government ministries and agencies), and a second group of key data holders (private and semi-private crop growers’ associations). GotToVote! in Kenya, on the other hand, did not establish such cross-sector partnerships, and its long-term sustainability is now in question.
I
Intermediaries
I
Intermediaries
In many developing economies, as mentioned above, Internet penetration and, especially, data literacy are low among the citizenry. The presence of intermediaries—including journalists and others with relevant skills—can help to determine whether or not the available open data-driven outputs reach a community of users, and the intended impact is achieved49. The continued advancement of open data intermediaries can be seen as a key area of capacity building in developing economies. To encourage the use of Code for South Africa’s MPRApp, doctors and pharmacists played an important intermediation role with citizens. These trusted advisors—with nothing to gain from helping patients spend less money on their prescriptions—helped to alert citizens to the database and the potential for identifying much cheaper generic drugs to treat their ailments. In addition, the open data-driven offerings of Open Development Cambodia are often presented on the initiative’s website in a comprehensible manner (similar to data-driven Wikipedia articles on topics of public concern, like forest cover or development aid spending), but reach a much wider audience when taken up by journalists in the country and abroad in reporting on conditions in the country. Both of Tanzania’s open education dashboards, on the other hand, failed to attract a regular user base, likely as a result of a failure to engage consistently with intermediaries that could make the sites’ offerings useful to an intended audience with low digital literacy and access.
De
Domain Experts
De
Domain Experts
In many cases, demand-side open data actors’ expertise lies in technology or data science rather than the problem areas they seek to address through the use of open data. Tapping into the knowledge of stakeholders with relevant sector-specific expertise can improve efforts to optimize and target open data efforts based on a true understanding of needs, opportunities, and barriers. Nepali NGOs and businesses using open government data and crowdsourced data during the response to a major earthquake in the country, for instance, engaged with on-the-ground experts in crisis response who came to Nepal from around the world to help target its offerings.
Co
Collaborators
Co
Collaborators
Open data practitioners can extend their capacity by collaborating with like-minded organizations, institutions, or individuals, including foreign actors. Ghana’s Esoko agricultural information service, for example, is part of the Global Open Data for Agriculture and Nutrition (GODAN) network, enabling the company to tap into the knowledge of similar organizations from around the world seeking to leverage open agriculture data for business development and/or public benefit.
Risks
Pr
Privacy Concerns
Pr
Privacy Concerns
Privacy concerns probably rank among the most commonly cited worries over opening up data. Especially in conflict-stricken regions, individuals’ anonymity can be of life-or-death importance. Potential privacy harms can arise even from the release of ostensibly anonymized personally identifiable information (PII)50. Although the vast majority of open data efforts seek to anonymize or otherwise limit the release of PII, it is important to recognize that a lack of sophistication in anonymization or aggregation efforts can result in the inadvertent release of sensitive information51. In addition, in some instances information that itself poses no privacy concerns can be combined with other openly available datasets; the aggregated and linked information can lead to unexpected disclosure of personal data, such as bringing together open data on political activities with separately accessible information on a person’s location or place of work, for example52.
Ds
Data Security
Ds
Data Security
Because much government data contains sensitive information regarding individuals, industries, and national security, opening that data often leads to quite reasonable questions about data security. Cybersecurity remains a challenge across the world, and perhaps especially so in developing countries, which may lack the technical expertise to adequately protect information from sophisticated hackers and other intrusions53. At the same time, though security concerns are very real and important, they must be balanced against the opportunity cost or risk of not sharing data; often, government decision makers can lean on tenuous security concerns to justify keeping data closed and restricting access, potentially limiting the solution space.
Dm
Poor decision-making due to faulty information
Dm
Poor decision-making due to faulty information
Whether related to humanitarian efforts, crisis relief, or the livelihoods of vulnerable populations, data-driven efforts in developing economies can be literally life-or-death affairs. Given the many challenges and obstacles involved in open data projects, it is important to recognize the risks inherent in basing such life-and-death decisions on information that could be incomplete, out-of-date or otherwise faulty. The broader point is this: insights generated from data are only as good—and their impacts only as positive—as the quality of the underlying data54.
Pa
Entrenching power asymmetries
Pa
Entrenching power asymmetries
Although data can be empowering, it can also consolidate or reinforce existing privileges and authority inherent in societies. This problem is closely linked (though not restricted) to digital divide challenges; when only the elite of a society have access to data and/or data science capabilities, releasing data is likely to disproportionally benefit that elite55. We found numerous examples56, and they are important reminders that open data projects need to work hard to ensure that their social and economic benefits are widely, and evenly, distributed.
Ow
Open washing
Ow
Open washing
The term “open washing” has taken hold in practitioner circles over recent years describing the risk that governments may seek to leverage the enthusiasm for open data to avoid more difficult and potentially transformative openness and transparency efforts57. The Extractives Industries Transparency Initiative, for instance, is a laudable effort to push for more energy-related openness around the world, which has had demonstrable impacts on accountability. There is a growing belief, however, that a subset of still largely closed governments is joining the initiative only “in order to increase their international reputation and bolster their access to foreign aid.”
Problem and Demand Definition
Particularly in developing economies, where resources to put toward data release or data use can be in short supply, a clear, detailed understanding of the problem to be addressed by open data can help to ensure that efforts are targeted and optimized. Some of the most effective open data projects examined here are laser-focused on a specific user group (e.g., smallholder farmers in Colombia or Ghana), or identified gap (e.g., the lack of power quality in the Indian energy sector). Clearly defining the problem can also aid in the development of metrics of success and a strategy for monitoring progress against a well-defined baseline. Many of the initiatives studied as part of this project lacked such a monitoring strategy, making assessments of impact, evidence-driven iteration, and the demonstration of return on investment more challenging.
U
User Research
Open data initiatives tend to be more successful and avoid the notion of, “if you build it, will they come,” when they are clearly optimized for an intended audience or user base from the start. The upfront identification, mapping and understanding of relevant constituencies, and a similar examination of their needs can enable more targeted open data-driven interventions.
C
Causes and Context
In many open data initiatives, and in governance innovation efforts more generally, practitioners can find themselves addressing symptoms rather than the root causes of problems. Open data projects, such as the effort to predict dengue outbreaks in Paraguay, tend to be more successful when they seek to address underlying problems (mosquito breeding and transmission) rather than the symptoms of those problems (high levels of dengue fever).
Rf
Refinement
To move from a well-understood problem area, to a granular, actionable, and quantifiable path forward, successful practitioners often look to refine their understanding of the problem to be addressed by seeking to understand, for instance, why the problem exists in its current form, what contributing factors could be at play, what potential knock-on effects of addressing the problem might be, and why the problem has not yet been solved by some other interested party.
Bg
Benefit and Goals
Open data projects often fail to build an audience or continue to evolve and expand successfully over time if they do not successfully define the intended benefits of the open data use and set clear target goals. These deficiencies often can create difficulty in the development of metrics and indicators—important drivers of iteration and impact. Many of the projects studied, including notably Kenya’s GotToVote! project did not have a clear baseline against which to measure the success of the project. Without an understanding of the current baseline, measuring progress toward identified goals and demonstrating whether and how open data efforts actually benefited the public remains a challenge.
Da
Data Audit and Inventory
Once the problem and value proposition are in place, practitioners are able to explore the availability of datasets, both in the form of open government data, and from other potentially useful and relevant data sources, like NGOs, the private sector, or crowdsourcing efforts. A clear problem definition can help to uncover which data sources could add value and inform strategies for collecting or accessing that data. Colombia’s Aclímate Colombia, for instance, identified the types of data it needed for its agriculture algorithms and engaged the semi-public industry groups that had it. The Prayas Energy Group in India, on the other hand, found that no one collected or stored the type of energy usage information it needed for its power quality monitoring efforts, so it launched its own (open) data collection effort across 18 Indian states.
Capacity and Culture
The lack of available resources, insufficient human capital and immature technological capabilities can create major challenges to achieving meaningful impact with open data projects. These challenges can exist both within a country’s open data ecosystem—that is, the capacity of government, civil society, tech community, and the general public—as well as within the actors on the demand side using open data toward certain objectives and the donor organizations funding them.
Open Data Ecosystem Elements
Di
Data Infrastructure
On the supply side of open data the lack of a strong data infrastructure—that is, hardware and software platforms to make data consistently accessible and machine-readable in a timely manner—often creates major challenges to positive impact. Burundi’s OpenRBF platform is an example of working around issues related to data infrastructure. Burundi provided access to data on its results-based financing efforts around healthcare through the OpenRBF platform, a digital infrastructure for collecting and publishing such data. The existence of an “out-of-the-box” tool for making results-based funding (RBF) data public in reusable formats catalyzed the widespread opening of RBF data across many developing countries in Africa.
Pu
Public Infrastructure
Similar to the ICT4D environment, much of the literature and practice48 of open data in developing economies points to the importance of a strong public infrastructure—human capital (including data science and statistical knowledge), public services (including education and libraries), and civil society—to ensure that data is collected, cleaned, and released in a usable manner and that updates and feedback are seamlessly incorporated into open datasets. Supply side efforts to leverage these public infrastructures can increase the demand for open data and establish touchpoints with users. An active ecosystem of data users and international open mapping platforms and individuals helped to ensure that Nepal’s open data-driven crisis response efforts could be quickly developed and put into practice. The challenges experienced by Ghana’s Esoko platform as a result of unreliable electricity access in the country, on the other hand, shows the many ways that public infrastructure can affect the success of open data projects.
Lp
Tech Literacy & Internet Penetration
Even as access to the Internet continues to expand across the developing world, especially through smartphones and other portable devices, many open data projects are being launched into communities that suffer from low Internet penetration and a persistent digital divide. Several of the initiatives studied struggled to achieve their transformative potential, particularly when practitioners failed to engage intermediaries or civil society groups capable of reaching unconnected audiences. Stakeholders involved in South Africa’s Medicine Price Registry Application (MPRApp) and Tanzania’s open education dashboards pointed to low Internet penetration rates, and the related challenge of low tech literacy, as major barriers they confronted to achieving greater positive impacts.
Rb
Cultural/ Institutional Roadblocks
As is often the case in developed countries, too, cultural and institutional roadblocks can limit the impact of open data. These roadblocks can manifest in the form of an institutional culture that remains skeptical of openness, or the absence of well-trained individuals capable of recognizing and acting on the potential of open data (readiness)—beyond the prevalence of engaging volunteers in the development of open data initiatives. In all cases, a more concerted culture- and capacity-building effort is often necessary to create an impact. In Burundi efforts to create transparency and accountability around its results-based financing efforts were slowed and complicated by a lack of readiness for technology-enabled openness. Jamaica’s open data tourism efforts relied on the readiness of outside volunteers to supplement open data through crowdsourcing—with the impact of the project dependent on their capacity to collect data and information in a strategic, usable manner.
Open Data User/Donor Elements
Se
Skills & Expertise
Especially for more technical uses of open data—such as sophisticated data analytics—actors on the demand side of open data need to possess certain skills and expertise. Employees at CIAT, the organization behind Aclímate Colombia, for instance, possess high-level data science capabilities that enabled them to leverage open data to create sophisticated algorithmic tools to inform agricultural decision making. Other projects, like crowdsourcing efforts from Jamaica and Nepal, relied on the skills of a few important institutional actors on the demand side and the less-technical efforts of volunteer data collectors.
Fl
Feedback Loops
Open data initiatives tend to be less successful when they do not create mechanisms for users and beneficiaries to provide input to demand-side practitioners. Tanzania’s open education dashboards are a notable example. The platforms were launched into an environment with low Internet penetration and digital literacy, with seemingly little opportunity for the intended users and beneficiaries of the tools, like parents or education advocates, to suggest ways to make the platforms more usable (and useful) for the community.
Rs
Resource Availability and Sustainability
The availability of funding and resources are a key variable of success on both the supply and demand sides of open data. Focusing on the demand side, although many open data projects can be stood up quickly on a tight budget (such as Kenya’s GotToVote! an initial prototype of which was created for only $500), sometimes with a very small team (Paraguay’s dengue prediction efforts were championed by researcher Juan Pane and a small team under his direction), establishing sustainability and scaling use often requires more sustained funding and/or well-defined business models. This was the dynamic at work for example in South Africa, where the MPRApp relied almost entirely on the time and effort of a single person. Likewise, in Uganda, CIPESA, the developers of the iParticipate open health data and citizen engagement effort, struggled to proactively elevate health service delivery concerns to relevant government officials because of funding issues affecting both data collection and outreach efforts. The agriculture information tool Esoko, on the other hand, has managed to take hold in Ghana in large part due to its for-profit, largely business to business (B2B) model, as well as significant investments from foundations and international organizations.
Governance
A diversity of governing decisions affect the use and impact of open data efforts. Issues of governance exist at both the ecosystem level—especially related to standards and policies of data release—and on the demand side, with questions of risk mitigation and impact assessment leading the way.
Open Data User/Open Agency Elements
M
Performance Metrics
Open data projects are better positioned for success when practitioners develop and monitor metrics of impact to inform management and iteration. The vast majority of the open data initiatives studied in this series lacked clearly defined performance metrics. Not only does this create major challenges for iterating upon early efforts, it calls the sustainability of these interventions into question, with a demonstration of success and impact a likely requirement for continued funding and investment.
Rm
Risk Mitigation
In some cases, open data projects can be advanced despite some level of risk. In such cases, practitioners must ensure that projects that deal in information that is potentially personally identifiable (including anonymized data) have outlined and implemented a clear, upfront strategy for addressing risks created by open data use. Many of the projects studied in this series dealt in potentially sensitive information—e.g., health, energy consumption, political, and education data. Although each project took steps to ensure that no personally identifiable information was released to the public, all would benefit from a clearly defined—and, preferably, openly available—risk mitigation strategy to ensure that no harms inadvertently fall on data subjects.
Open Data Ecosystem Elements
Od
Open by Default (and other principles)
Given the level of government resource allocation and time investment required to implement strong open data initiatives, high-level political buy-in and codified open data policies (reflecting the International Open Data Charter principles) are needed to provide the incentives and flexibility to government officials to meaningfully advance open data goals. The ESMI effort in India, for example, is an industry- and NGO-driven effort to create and open useful data on power quality in the country. This effort, which has had relatively little discernible impact to date, is only necessary because of the lack of energy data being opened by government—an issue that could be resolved with a commitment to openness by default and other internationally accepted principles.
Fi
Freedom of Information and other Policies
Clear policies pushing forward access to information and data can act as important drivers for open data initiatives. Without explicit policy backing, the sustainability of open data efforts can be called into question, and access to necessary data can dry up at any time. The existence of Freedom of Information policies can also provide means for accessing relevant information, though often at a much slower pace than open data. A key enabler for the MPRApp open data initiative, for example, was South Africa’s legislative framework that promotes and enacts transparency in medicine pricing. Such a framework compels the Department of Health to collect and publish data on medicine prices in South Africa, ensuring that the supply side of the MPRApp will continue to be made accessible, allowing Code for South Africa to focus on improving the tool and getting it into the hands of its intended users.
Dq
Data Quality
A widely prevalent challenge to positive impact arises from poor data quality. Data quality is an issue in developed countries, but often presents even greater barriers to success in developing countries. Quality issues can manifest in a number of ways, like inaccurate information, a lack of completeness in official datasets, out-of-date data, or otherwise corrupted datasets. Aclímate Colombia, for example, experienced challenges gaining access to the most complete and up-to-date information sets for its agriculture tools, slowing their development. Open Development Cambodia’s efforts are consistently challenged by not only strong restrictions in terms redistribution, reproduction, and reuse on some datasets, but also by the inconsistency and unpredictability of when updates to important official datasets occur. In South Africa, the MPRApp was hurt by a lack of interoperability; that is, open data was not made available in standards that allowed for aggregation and manipulation. Likewise, Kenya’s GotToVote! experienced major challenges when one of its central data sources crashed unexpectedly, rendering the platform temporarily unusable.
R
Responsiveness
Just as open data is unlikely to create a major impact without demand-side actors to act upon released data, a lack of responsiveness, often characterized by a lack of commitment to take up data-driven insights within governing institutions, can limit the impact of open data. Often, governments succumb to the temptation to open wash data, nominally opening it up but failing to create feedback loops to ensure that users are actually using the data or that data is being released to meet a genuine demand. In Jamaica, for example, an interactive community mapping project is supplementing open datasets with a crowdsourced effort to improve tourism in the country; the project’s clear potential has not yielded major impacts yet in part because tourism authorities have not yet acted on the generated insights. The researchers who used open data to predict dengue fever transmission in Paraguay also experienced ongoing challenges wresting the most useful data for their algorithms from government data holders; there has been little indication that their insights will be meaningfully taken up by institutional authorities.
Partnerships
In many high-impact open data projects, partnerships within and especially across sectors play a key role in enabling success. Whether creating touchpoints with citizens through partnerships with civil society, informing the public through media partnerships, or filling important data gaps through partnerships with private sector entities, open data suppliers and users often improve outcomes through collaboration.
Dh
Data Holders
Although open data is meant to provide value to data users without any direct engagement with data holders necessary, partnering with entities on the supply side (including government) can help to fill data gaps and enable higher impact data use. Aclímate Colombia is a strong example of the potential of such partnerships. The initiative, aimed at providing farmers with a better ability to plant crops in a way that is resilient to the effects of climate change, would not be possible without collaboration between the driver of the initiative (a civil society organization), key data holders (government ministries and agencies), and a second group of key data holders (private and semi-private crop growers’ associations). GotToVote! in Kenya, on the other hand, did not establish such cross-sector partnerships, and its long-term sustainability is now in question.
I
Intermediaries
In many developing economies, as mentioned above, Internet penetration and, especially, data literacy are low among the citizenry. The presence of intermediaries—including journalists and others with relevant skills—can help to determine whether or not the available open data-driven outputs reach a community of users, and the intended impact is achieved49. The continued advancement of open data intermediaries can be seen as a key area of capacity building in developing economies. To encourage the use of Code for South Africa’s MPRApp, doctors and pharmacists played an important intermediation role with citizens. These trusted advisors—with nothing to gain from helping patients spend less money on their prescriptions—helped to alert citizens to the database and the potential for identifying much cheaper generic drugs to treat their ailments. In addition, the open data-driven offerings of Open Development Cambodia are often presented on the initiative’s website in a comprehensible manner (similar to data-driven Wikipedia articles on topics of public concern, like forest cover or development aid spending), but reach a much wider audience when taken up by journalists in the country and abroad in reporting on conditions in the country. Both of Tanzania’s open education dashboards, on the other hand, failed to attract a regular user base, likely as a result of a failure to engage consistently with intermediaries that could make the sites’ offerings useful to an intended audience with low digital literacy and access.
De
Domain Experts
In many cases, demand-side open data actors’ expertise lies in technology or data science rather than the problem areas they seek to address through the use of open data. Tapping into the knowledge of stakeholders with relevant sector-specific expertise can improve efforts to optimize and target open data efforts based on a true understanding of needs, opportunities, and barriers. Nepali NGOs and businesses using open government data and crowdsourced data during the response to a major earthquake in the country, for instance, engaged with on-the-ground experts in crisis response who came to Nepal from around the world to help target its offerings.
Co
Collaborators
Open data practitioners can extend their capacity by collaborating with like-minded organizations, institutions, or individuals, including foreign actors. Ghana’s Esoko agricultural information service, for example, is part of the Global Open Data for Agriculture and Nutrition (GODAN) network, enabling the company to tap into the knowledge of similar organizations from around the world seeking to leverage open agriculture data for business development and/or public benefit.
Risks
The release and use of open data in developing economies are not without risks. An upfront mapping and consideration of risks associated with intended uses of open data can allow practitioners to design programs from the outset in a way that is well-positioned to overcome or mitigate those risks. The risks listed here, however, should not be considered arguments against using open data in development. Rather, they are reasons for taking a more fine-grained approach that pays close attention to the empirical evidence, sifting out what works and what does not, and identifying conditions for scaling and replication.
Pr
Privacy Concerns
Privacy concerns probably rank among the most commonly cited worries over opening up data. Especially in conflict-stricken regions, individuals’ anonymity can be of life-or-death importance. Potential privacy harms can arise even from the release of ostensibly anonymized personally identifiable information (PII)50. Although the vast majority of open data efforts seek to anonymize or otherwise limit the release of PII, it is important to recognize that a lack of sophistication in anonymization or aggregation efforts can result in the inadvertent release of sensitive information51. In addition, in some instances information that itself poses no privacy concerns can be combined with other openly available datasets; the aggregated and linked information can lead to unexpected disclosure of personal data, such as bringing together open data on political activities with separately accessible information on a person’s location or place of work, for example52.
Ds
Data Security
Because much government data contains sensitive information regarding individuals, industries, and national security, opening that data often leads to quite reasonable questions about data security. Cybersecurity remains a challenge across the world, and perhaps especially so in developing countries, which may lack the technical expertise to adequately protect information from sophisticated hackers and other intrusions53. At the same time, though security concerns are very real and important, they must be balanced against the opportunity cost or risk of not sharing data; often, government decision makers can lean on tenuous security concerns to justify keeping data closed and restricting access, potentially limiting the solution space.
Dm
Poor decision-making due to faulty information
Whether related to humanitarian efforts, crisis relief, or the livelihoods of vulnerable populations, data-driven efforts in developing economies can be literally life-or-death affairs. Given the many challenges and obstacles involved in open data projects, it is important to recognize the risks inherent in basing such life-and-death decisions on information that could be incomplete, out-of-date or otherwise faulty. The broader point is this: insights generated from data are only as good—and their impacts only as positive—as the quality of the underlying data54.
Pa
Entrenching power asymmetries
Although data can be empowering, it can also consolidate or reinforce existing privileges and authority inherent in societies. This problem is closely linked (though not restricted) to digital divide challenges; when only the elite of a society have access to data and/or data science capabilities, releasing data is likely to disproportionally benefit that elite55. We found numerous examples56, and they are important reminders that open data projects need to work hard to ensure that their social and economic benefits are widely, and evenly, distributed.
Ow
Open washing
The term “open washing” has taken hold in practitioner circles over recent years describing the risk that governments may seek to leverage the enthusiasm for open data to avoid more difficult and potentially transformative openness and transparency efforts57. The Extractives Industries Transparency Initiative, for instance, is a laudable effort to push for more energy-related openness around the world, which has had demonstrable impacts on accountability. There is a growing belief, however, that a subset of still largely closed governments is joining the initiative only “in order to increase their international reputation and bolster their access to foreign aid.”
Reference
1World Wide Web Foundation, Open Data Barometer, Fourth Edition, 2016, http://opendatabarometer.org/.
2See Open Government Partnership website, http://www.opengovpartnership.org/, accessed November 30, 2016.
3Andrew Young, Stefaan Verhulst, and Juliet McMurren, “The GovLab Selected Readings on Open Data for Developing Economies,” August 1, 2016, http://thegovlab.org/open-data-for-developing-economies/.
4See Appendix D for an annotated selection of the key Readings.
5GovLab, “Open Data: What’s in a Name,” January 16, 2014, GovLab Blog, http://thegovlab.org/open-data-whats-in-a-name/.
6Open by Default; Timely and Comprehensive; Accessible and Usable; Comparable and Interoperable; For Improved Governance and Citizen Engagement; For Inclusive Development and Innovation. http://opendatacharter.net.
7Open Data for Development Network, Open Data for Development: Building an inclusive data revolution, Annual Report, 2015, 11, http://od4d.com/wp-content/uploads/2016/06/OD4D_annual_report_2015.pdf.
8See United Nations Independent Expert Advisory Group on a Data Revolution for Sustainable Development, “A World That Counts, Mobilizing the Data Revolution,” 2014, http://bit.ly/2am5K28.
9At the same time, there is a growing recognition of open data’s potential to meet the Sustainable Development Goals (SDGs). The World Bank, for instance, has explored the various ways in which open data could help to make progress toward the SDGs. Similarly, a recent White Paper by the Open Data Institute (ODI) concludes: “Open data can make an impact across the globe. Its role in combating development challenges of the next 15 years, both as a tool for measuring progress and in finding solutions, is becoming more clear.” See The World Bank, “Open Data for Sustainable Development,” Policy Note, August 2015, http://bit.ly/2aGjaJ4; and Open Data Institute, Supporting Sustainable Development with Open Data, 2015, 3, http://theodi.org/supporting-sustainable-development-with-open-data.
10Tim Davies, for instance, notes that, “researchers and other users outside of government may highlight inaccuracies and inconsistencies between datasets” as a result of access to open data, and thereby improving data quality and usefulness. Tim Davies, “Open Data in Developing Countries: Emerging insights from Phase I,” Open Data Research, July 15, 2014, http://opendataresearch.org/sites/default/files/publications/Phase 1 - Synthesis - Full Report-print.pdf.
11Aspasia Papaloi and Dimitris Gouscos, “Parliamentary Information Visualization as a Means for Legislative Transparency and Citizen Empowerment,” Journal of Democracy and Open Government, 2013, http://www.jedem.org/index.php/jedem/article/view/222/183.
12“By using common open repositories, public administrations can save time and money from the automisation of internal data exchange,” Raimondo Lemma, Federico Morando and Michele Osella, “Breaking Public Administrations’ Data Silos: The case of Open-DAI, and a comparison between open data platforms,” Journal of Democracy & Open Government, 2014, http://www.jedem.org/index.php/jedem/article/view/304.
13Jae-Nam Lee, Juyeon Ham and Byounggu Choi, “Effect of Government Data Openness on a Knowledge-based Economy,” Procedia Computer Science, 91, 2016. http://www.sciencedirect.com/science/article/pii/S1877050916312364.
14Ali Clare, David Sangokoya, Stefaan Verhulst and Andrew Young, “Open Contracting and Procurement In Slovakia,” GovLab, Accessed October 25, 2016, http://odimpact.org/case-open-contracting-and-procurement-in-slovakia.html.
15World Bank, World Development Report 2016: Digital Dividends, World Bank, 2016, 4, http://documents.worldbank.org/curated/en/896971468194972881/pdf/102725-PUB-Replacement-PUBLIC.pdf.
16Laura Dabbish, et al., “Social Coding in GitHub: Transparency and collaboration in an open software repository,” Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, February 11, 2012, http://dl.acm.org/citation.cfm?id=2145396.
17Dietmar Harhoff and Karim R. Lakhani (eds.), Revolutionizing Innovation: Users, communities, and open innovation, Boston: MIT Press, 2016.
18See GovLab, “Open Data: What’s in a Name,” January 16, 2014, GovLab Blog, http://thegovlab.org/open-data-whats-in-a-name/.
19See also (in Spanish), Silvana Fumega, “Algunas Ideas para ‘Debates Conceptuales sobre el Gobierno Abierto,’” September 25, 2016, http://silvanafumega.blogspot.fr/2016/09/algunas-ideas-para-debates-conceptuales.html.
20George Washington Law Review 26, no. 1 (October 1957), http://heinonline.org/HOL/Page?handle=hein.journals/gwlr26&div=10&id=&page=&collection=journals.
22Open Government Partnership, “Open Government Declaration,” http://www.opengovpartnership.org/about/open-government-declaration.
23See Matthew L. Smith and Katherine M.A. Reilly, eds., Open Development: Networked innovations in international development, MIT Press, 2013, http://idl-bnc.idrc.ca/dspace/bitstream/10625/52348/1/IDL-52348.pdf.
25Ibid.
26Jonathan Gray, “Five Ways Open Data Can Boost Democracy Around the World,” The Guardian, February 20, 2015, https://www.theguardian.com/public-leaders-network/2015/feb/20/open-data-day-fairer-taxes.
27Duncan Edwards and Rosie McGee, eds., “Opening Governance,” IDS Bulletin 47, no. 1 (January 2016), https://opendocs.ids.ac.uk/opendocs/bitstream/handle/123456789/7686/IDSB_47_1_10.190881968-2016.103.pdf?sequence=1.
28José M. Alonso, “Measuring Impact of Open Government Data — Open Data Research (South) Meeting Report,” May 24, 2012, http://webfoundation.org/2012/05/odrs-meeting1-report-available/.
29Martin Hilbert, “Big Data for Development: A review of promises and challenges,” Development Policy Review 34, no. 1 (January 2016), http://onlinelibrary.wiley.com/doi/10.1111/dpr.12142/full.
30See also Andrew Young, Stefaan Verhulst, and Juliet McMurren, “The GovLab Selected Readings on Open Data for Developing Economies,” August 1, 2016, http://thegovlab.org/open-data-for-developing-economies/.
31The author of a case study from the participating Open Data Institute, which disseminated the results of the effort, notes that, “Whether or not the improved information flow and accessibility to results — enabled by the application of open data — led to increased trust in the election process, or even an improved process, is not something that we can or indeed set out to prove or show empirically, although the outcome of this case study is certainly supportive of that conclusion.” Anna Scott, “Case Study: Burkina Faso’s open elections,” Open Data Institute, October 2016, https://theodi.org/case-study-burkina-fasos-open-elections#1.
32Auralice Graft, Stefaan Verhulst and Andrew Young , “Indonesia’s Kawal Pemilu — Elections: Free fair and open data,” The Governance Lab, http://odimpact.org/case-indonesias-kawal-pemilu.html.
33Third International Open Data Conference (IODC), “Enabling the Data Revolution: An International Open Data Roadmap,” http://1a9vrva76sx19qtvg1ddvt6f.wpengine.netdna-cdn.com/wp-content/uploads/2015/09/IODC2015-Final-Report-web.pdf.
34Jonathan Gray, “Open Budget Data: Mapping the Landscape,” https://github.com/okfn/research/blob/master/research/OpenBudgetData.pdf.
35“Credit Happy Brazilian Minister Admits Mistake and Resigns,” Merco Press, February 3, 2008, http://en.mercopress.com/2008/02/03/credit-happy-brazilian-minister-admits-mistake-and-resigns.
36Alan Freihof Tygel, Maria Luiza Machado Campos and Celso Alexandre Souza de Alvear, “Teaching Open Data for Social Movements: A research strategy, Journal of Community Informatics, 11, no. 3 (2015), http://ci-journal.net/index.php/ciej/article/view/1220/1165.
37See, for example, James Manyika, et al., “Open Data: Unlocking innovation and performance with liquid information,” McKinsey & Company, October 2013, http://www.mckinsey.com/business-functions/business-technology/our-insights/open-data-unlocking-innovation-and-performance-with-liquid-information.
38Open Data Fact Sheet, “Business, Research and Consulting,” Fall 2016, http://opendataimpactmap.org/Bus_Factsheet.pdf.
39Open Data Fact Sheet, “IT and Geospacial,” http://opendataimpactmap.org/IT_Factsheet.pdf.
41Empowering Local Communities with Open Data and Interactive Community Mapping,” Caribbean Open Institute, http://caribbeanopeninstitute.org/node/133.
42Evangelia Berdou, “Mediating Voices and Communicating Realities: Using information crowdsourcing tools, open data initiatives and digital media to support and protect the vulnerable and marginalised,” Institute of Development Studies, 2011, http://bit.ly/2aqbycg.
43Open Data Watch, “Real-time Data for Mapping Forest Change Worldwide,” Data Impacts Case Studies, http://dataimpacts.org/project/forest-watch/.
44Victor Montoro, “Satellite-based Forest Mapping PlatformHhits Its Stride,” Mongabay, June 26, 2015, https://news.mongabay.com/2015/06/satellite-based-forest-mapping-platform-hits-its-stride/.
45Andrew Young and Stefaan Verhulst, “Battling Ebola in Sierra Leone: Data sharing to improve crisis response,” GovLab, http://odimpact.org/case-battling-ebola-in-sierra-leone.html.
46Michael P. Canares, “Opening the Gates: Will open data initiatives make local government in the Philippines more transparent?” Open Data Research Network Report, 2014, http://www.opendataresearch.org/content/2014/672/opening-gates-will-open-data-initiatives-make-local-governments-philippines-more.
47“UN Reviews Security after Pakistani Taliban ‘Threat,’” BBC News, August 26, 2010, http://www.bbc.com/news/world-south-asia-11095267.
48See Andrew Young and Stefaan Verhulst, “Kenya’s Open Duka: Open data for transactional transparency,” GovLab, http://odimpact.org/case-kenyas-open-duka.html.
49See Francois Van Schalkwyk, et al., “Open Data Intermediaries in Developing Countries,” Journal of Community Informatics 12, no. 2 (2016), http://ci-journal.net/index.php/ciej/article/view/1146.
50See, for example, Alexandra Wood, David O’Brien, and Urs Gasser, “Privacy and Open Data Research Briefing,” 2016, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2842816.
51See, for example, Ira Rubinstein and Woodrow Hartzog, “Anonymization and Risk,” 2015, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2646185.
52Stefan Kulk and Bastiaan van Loenen, “Brave New Open Data World?” International Journal of Spatial Data Infrastructures Research, 7, 2012, https://www.researchgate.net/profile/S_Kulk/publication/254811532_Brave_New_Open_Data_World/links/0c96053a43af7ceb94000000.pdf.
53David Burt, et al., “The Cybersecurity Risk Paradox: Impact of social, economic, and technological factors on rates of malware,” Microsoft Security Intelligence Report Special Edition, January 2014, http://download.microsoft.com/download/E/1/8/E18A8FBB-7BA6-48BD-97D2-9CD32A71B434/Cybersecurity-Risk-Paradox.pdf.
54See, Michael Canares and Satyarupa Shekhar, “Open Data and Sub-national Governments: Lessons from developing countries,” Open Data for Development, 2016, http://od4d.com/wp-content/uploads/2016/01/ODDC-2-Open-Data-and-Sub-national-Governments.pdf.
55Michael Gurstein, “Open Data: Empowering the empowered or effective data use for everyone?” First Monday, February 2011, http://firstmonday.org/article/view/3316/2764.
56See odimpact.org.
57See, for example, Christian Villum, “Open-Washing”—The Difference between Opening Your Data and Simply Making Them Available,” Open Data International Blog, March 10, 2014, https://blog.okfn.org/2014/03/10/open-washing-the-difference-between-opening-your-data-and-simply-making-them-available/; and “#openwashing…anyone?” Web Foundation Blog, October 31, 2016, http://webfoundation.org/2016/10/openwashing-anyone/.
58Benjamin Sovacool and Nathan Andrews, “Does Transparency Matter? Evaluating the governance impacts of the Extractive Industries Transparency Initiative in Azerbaijan and Liberia,” Resources Policy 45 (2015), https://eiti.org/sites/default/files/documents/Sovacool%20%26%20Andrews%20%5B2015%5D%20-%20Does%20transparency%20matter%20-%20%20Evaluating%20the%20governance%20impacts%20of%20the%20Extractive%20Industries%20Transparency%20Initiative%20%28EITI%29%20in%20Azerbaijan%20and%20Liberia.pdf.
59See the Open Data Charter website, http://opendatacharter.net/.
60François van Schalkwyk, et al., Open Data Intermediaries in Developing Countries,” ODDC, 2015, http://bit.ly/2aJztWi.
61Organization for Economic Cooperation and Development, “Aid at a Glance Charts,” http://www.oecd.org/dac/stats/aid-at-a-glance.htm.
62Tawnya Bosko and Matthew Briskin, "Transparency in Healthcare: Where does it stand?" Management in Healthcare 1, no.1 (2016): 83-96.
63Like similar efforts in Paraguay and Singapore, researchers in India demonstrated how open data can be analyzed using statistical modeling and machine learning to determine how transmission of dengue (or other mosquito-borne illnesses like Zika) could be minimized through increased citizen awareness and/or more strategic allocation of resources. Vandana Srivastava and Biplave Srivastava, “Towards Timely Public Health Decisions to Tackle Seasonal Diseases with Open Government Data,” World Wide Web and Public Health Intelligence: Papers from the AAAI-14 Workshop, June 18, 2015, http://www.aaai.org/ocs/index.php/WS/AAAIW14/paper/view/8728/8221.
64Open Data Watch, “Data Impacts Case Studies: Using satellite and cell phone data to eliminate malaria in Namibia,” http://dataimpacts.org/project/malaria/.
65Seember Nyager, “Can Data Help Us Attain Healthier Lives?” Budeshi, May 15, 2016, http://www.budeshi.org/2016/05/can-data-help-us-attain-healthier-lives/.
66In regard to the discursive attributes related to the terms “participation,” “empowerment” and “citizenship” in aid, see Andrea Cornwall, Beneficiary, Consumer, Citizen: Perspectives on participation for poverty reduction, Stockholm: Sida, 2000, http://www.alnap.org/resource/10271.
67Vanessa Humphries, “Improving Humanitarian Coordination: Common challenges and lessons learned from the cluster approach,” The Journal of Humanitarian Assistance 30 (2013).
68Eleanor Goldbert, “Open Data Platform Lets Aid Groups Respond More Efficiently to Crises,” Huffington Post, May 31, 2016, http://www.huffingtonpost.com/entry/open-data-platform-enables-aid-groups-to-respond-more-efficiently-to-crises_us_574876fee4b03ede4414a6a4.
69The Humanitarian Data Exchange, https://data.humdata.org/.
70“Diplomacy and Aid in Africa,” The Economist, April 14, 2016, http://www.economist.com/blogs/graphicdetail/2016/04/daily-chart-10.
71Mzwandile Jacks, “China Emerges as Tanzania’s Major Investor,” Ventures Africa, January 29, 2014, http://venturesafrica.com/china-emerges-as-tanzanias-major-investor/.
72“Open Data’s Role in Nepal’s Earthquake,” ICT.govt.nz, 2015, https://www.ict.govt.nz/assets/Uploads/Case-Study-Nepal-Earthquake2.pdf.
73Nirab Pudasaini, “Open Source and Open Data’s Role in Nepal Earthquake Relief,” OpenSource.com, June 8, 2016, https://opensource.com/life/16/6/open-source-open-data-nepal-earthquake.
74Krishna Sapkota, “Exploring the Impacts of Open Aid and Budget Data in Nepal,” Freedom Forum, August 2014, http://www.opendataresearch.org/sites/default/files/publications/Open%20Aid%20and%20Budget%20Data%20in%20Nepal%20-%2015th%20Sept-print.pdf.
75Jane Battersby and Jonathan Crush, “Africa’s Urban Food Deserts,” Urban Forum 25, no. 2, Springer Netherlands, 2014.
76See also the Agriculture Open Data Package developed by GODAN, http://AgPack.info.
77“Big Data, Big Prospects: Crunching data for farmers’ climate adaptation,” CCAFS Annual Report 2015, https://ccafs.cgiar.org/blog/big-data-big-prospects-crunching-data-farmers-climate-adaptation#.WFBRtKOZORu.
78CABI, “Plantwise Knowledge Bank Wins Open Data Award for Social Impact,” Plantwise Blog, November 5, 2014, https://blog.plantwise.org/2014/11/05/plantwise-knowledge-bank-wins-open-data-award-for-social-impact/.
79Business Call to Action, “Empowering Farmers Through Mobile Communication in West Africa,” The Guardian, October 15, 2014, https://www.theguardian.com/sustainable-business/2014/oct/22/empowering-farmers-through-mobile-communication-in-west-africa.
80“Fellowship Programme,” School of Data, http://schoolofdata.org/fellowship-programme/.
81http://wmmd.codeforafrica.org.
82Michael Gurstein, “Open Data: Empowering the empowered or effective data use for everyone,” First Monday, February 2011, http://journals.uic.edu/ojs/index.php/fm/article/view/3316/2764; Kevin Donovan, “Seeing Like a Slum: Towards open, deliberative development,” Georgetown Journal of International Affairs 13, no. 1, April 26, 2012, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2045556.
83http://www.greenbuttondata.org.
84Benjamin Sovacool and Nathan Andrews, “Does Transparency Matter? Evaluating the governance impacts of the Extractive Industries Transparency Initiative in Azerbaijan and Liberia,” Resources Policy 45 (2015), https://eiti.org/sites/default/files/documents/Sovacool%20%26%20Andrews%20%5B2015%5D%20-%20Does%20transparency%20matter%20-%20%20Evaluating%20the%20governance%20impacts%20of%20the%20Extractive%20Industries%20Transparency%20Initiative%20%28EITI%29%20in%20Azerbaijan%20and%20Liberia.pdf.
85“Azerbaijan Suspended from the EITI – a Bankwatch and Counter Balance statement,” Bankwatch, March 9, 2017, http://bankwatch.org/news-media/for-journalists/press-releases/azerbaijan-suspended-eiti-%E2%80%93-bankwatch-and-counter-balance-.
86Andrew Young and Stefaan Verhulst, “Mexico’s Mejora Tu Escuela: Empowering citizens to make data-driven decisions about education,” GovLab, http://odimpact.org/case-mexicos-mejora-tu-escuela.html.
87http://www.qedu.org.br.
88Stefaan Verhulst, “Research Consortium on the Impact of Open Government Processes,” The GovLab Blog, February 11, 2016, http://thegovlab.org/research-consortium-on-the-impact-of-open-government-processes/.
89The GovLab Academy Canvas, http://canvas.govlabacademy.org.