GTF Most Significant Results  

In a two-part process grant holders identified a total of 160 results for deeper analysis. Within the timeframe available, grant holders were able to document and analyse a total of 113 of these results. Each result was analysed using the following parameters: theory of change, approaches, methods and tools, strength of evidence, impact, and value for money. We present below the aim and content of each section. It is important to be aware that these case studies were prepared by 38 organisations many of whom collaborated with partners in doing so: the actual presentation of the information does vary.

 

All of these represent outcomes in which an actor – government agency, private sector organisation, CSO or citizen - has changed behaviour in response to GTF supported activities. Six categories of results have been developed based on the types of change in behaviour:

 

1. Service Delivery
2. Changes in policy, legislation and budgets
3. Changes in practice
4. Citizen action
5. Application of sanctions and penalties
6. Transparency and access to information.

 

More information about parameters and categories can be found below.

Result

Category

Country

Produced By

Community mediation approaches resolve 80% of land conflicts

3. Changes in practice

Uganda

Conciliation Resources

Dialogue leads to more transparent adminstration of Social Development Fund

2. Changes in policy, legislation and budgets

Liberia

Conciliation Resources

Civil Society participates in forging national constitution

4. Citizen action

Fiji

Conciliation Resources

Public expenditure tracking improves water and sanitation services

2. Changes in policy, legislation and budgets

Ghana

WaterAid

Mapping process brings water to local community

1. Service Delivery
 

Uganda

WaterAid

Radio programme results in better water services for 11,850 people

1. Service Delivery
 

Uganda

WaterAid

Right to Information law used to improve water and sanitation services in nearly 500 villages

1. Service Delivery
 

India

WaterAid

Changes in eligibility criteria improves water and sanitation for over 3,500 families

2. Changes in policy, legislation and budgets

India

WaterAid

New law and training improves water and sanitation services in 42 communities

2. Changes in policy, legislation and budgets

Nicaragua

WaterAid

Media coverage improves service at Bong County Hospital

1. Service Delivery
 

Liberia

JHR

Government keeps promises due to media tracking project

3. Changes in practice

Liberia

JHR

Minister removed as corruption exposed in Education Ministry

5. Civil Society Strategies to Fight Corruption

Liberia

JHR

Media coverage delivers justice in Kakata

5. Civil Society Strategies to Fight Corruption

Liberia

JHR

New procurement processes reduce corruption and save $2.7 million in first year 3. Changes in practice Nigeria Partnership for Transparency Fund
Public monitoring of health sector procurement saves up to £400,000 6. Transparency and access to information Phillipines Partnership for Transparency Fund

Communities band together to reduce corruption in forest sector

4. Citizen action
 

Nepal

Partnership for Transparency Fund

Corruption in heath sector challenged by local committees

5. Civil Society Strategies to Fight Corruption

Nepal

Partnership for Transparency Fund

Missing $10.4 million returned to state budget after investigation reveals irregularities

5. Civil Society Strategies to Fight Corruption

 

Azerbaijan
 

Partnership for Transparency Fund

University of Buea adopt new anti-corruption rules

5. Civil Society Strategies to Fight Corruption
 

Cameroon

Partnership for Transparency Fund

Training improves impartial coverage of national elections

6. Transparency and access to information

Tanzania

BBC Media Action

Radio programme brings officials and protestors together

6. Transparency and access to information

Angola

BBC Media Action

Radio programme stimulate discussions in rural areas

6. Transparency and access to information

Sierra Leone

BBC Media Action

Civil society coalition changes Party and Campaign Finance Law

2. Changes in policy, legislation and budgets

Georgia

Transparency International

Government and civil society collaborate on 2011 Ethics and Anti-Corruption Act.

2. Changes in policy, legislation and budgets

Kenya

Transparency International

Citizen budget paints clearer picture of government finances

3. Changes in practice
 

Palestine

Transparency International

Over 3,000 cases pusued by TI's Advocacy and Legal Advice Centres.

4. Citizen action
 

Multi-country
 

Transparency International

Procurement contract cancelled after TI investigation in Tblisi

5. Civil Society Strategies to Fight Corruption
 

Georgia

Transparency International

Electoral processes more open to persons with disabilities

1. Service Delivery
 

Zimbabwe

NASCOH

Persons with disabilities gain access to services and appointed to positions of authority

4. Citizen action
 

Zimbabwe

NASCOH
 

Marsabit Diocese lobbies for 18km water pipeline

1. Service Delivery

Kenya

CAFOD
 

Water system constructed in Ndosha after residents mobilised by Justice and Peace Commission

1. Service Delivery

DRC

CAFOD
 

Changes to government budget cycle improves consistency of services

2. Changes in policy, legislation and budgets

Zambia

CAFOD
 

Cabinet ministers resign due to oil sector scandal

5. Civil Society Strategies to Fight Corruption

Uganda

CAFOD
 

Media reports bring end to discriminatory law on honour killings

2. Changes in policy, legislation and budgets

Palestine

Ma’an Network

Partnership wins Supreme Court decision obliging government to hold elections

5. Civil Society Strategies to Fight Corruption

Palestine

Ma’an Network

Noncustodial sentencing saves money and reduces recidivism

3. Changes in practice

South Africa

Nicro
 

Noncustodial sentencing gaining traction as viable alternative

3. Changes in practice

South Africa

Nicro

Extra $30 million for services due to advocacy campaign

2. Changes in policy, legislation and budgets

Palestine

Tiri
 

Community groups monitor delivery of 65 infrastructure projects worth $19 million

3. Changes in practice

Afghanistan

Tiri

Batken Coordination Council increases share of regional government budget

6. Transparency and access to information

Kyrgyzstan

Tiri

Police and motor-cycle taxi operators reach agreement to reduce corruption

4. Citizen action

Sierra Leone

ODI

Strengthening capacity of Farmers' Cooperative Unions increases exports

5. Civil Society Strategies to Fight Corruption

Ethiopia

ODI

Coordination between Bataka and formal court systems speeds justice

1. Service Delivery

Uganda

 

ODI

116,000 women registered for ID cards

1. Service Delivery

Pakistan

Oxfam GB

Civil society influences passage of 2013 law to prevent violence against women and girls.

2. Changes in policy, legislation and budgets
 

Nigeria

Oxfam GB

Particpation improves women's access to health, education and water services

4. Citizen action
 

Nepal

Oxfam GB

Changes in higher education funding policy benefit poorer students

2. Changes in policy, legislation and budgets

Armenia

GDN
 

Evidence supports policy for conditional cash transfers to the poor 2. Changes in policy, legislation and budgets Guatemala GDN

20% increase in women elected to local governments

2. Changes in policy, legislation and budgets

Mauritius

Gender Links

12 Governments ratify the SADC Protocol on Gender and Development 2. Changes in policy, legislation and budgets Multi-country Gender Links
Nine national action plans and 167 local action plans to end gender violence developed 3. Changes in practice
 
Multi-country Gender Links

Gender mainstreaming in seven training institutions

3. Changes in practice

Multi-country

Gender Links

Southern African Gender Protocol Alliance documents over 1000 case studies

4. Citizen action
 

Multi-country

Gender Links

Media literacy training provided to 1500 citizens in ten countries

4. Citizen action
 

Multi-country

Gender Links

Gender aware leadership score card applied to 300 local councils in ten countries

4. Citizen action

South Africa
 

Gender Links

11 community organisations supported to manage local natural resources

2. Changes in policy, legislation and budgets
 

Liberia

 

Global Witness
 

Social agreements help communities assert rights and oversee funds

4. Citizen action
 

DRC

Global Witness

Indigenous people gain greater voice and control over forest resources

2. Changes in policy, legislation and budgets

Cameroon

Global Witness

New regulations reduce illegal logging

2. Changes in policy, legislation and budgets

DRC

Global Witness

Local community asserts environmental rights

4. Citizen action
 

Ghana

Global Witness

Freedom of information law causes Ministry of Environment to be more transparent

6. Transparency and access to information
 

Ecuador

Global Witness

Additional £20 million allocated to Social Housing

2. Changes in policy, legislation and budgets
 

Philippines

PHILSSA
 

Capacity building of federations strengthens voice of urban poor

3. Changes in practice
 

Philippines

PHILSSA

Constituency Monitoring Committees improve local service delivery

3. Changes in practice
 

Kenya

Centre for Governance and Development
 

Call centre registers public complaints on government service delivery

3. Changes in practice

Kenya

Centre for Governance and Development

Documenting customary laws improves natural resource governance

2. Changes in policy, legislation and budgets

Kenya

IUCN
 

Community maps natural resources to influence local development plans

6. Transparency and access to information

Kenya

IUCN

Improved access to health and education services

1. Service Delivery

Ghana

Christian Aid

Anambra State government in Nigeria adopts community budget monitoring to improve service delivery

6. Transparency and access to information
 

Nigeria

Christian Aid

Community monitoring and advocacy improves access to government services 1. Service Delivery
 
Iraq
 
Christian Aid
 

Community monitoring and benchmarking reduces distance to water sources

1. Service Delivery

 

Kenya

Christian Aid

New law bars politicians with criminal record from holding public office 2. Changes in policy, legislation and budgets Brazil
 
Christian Aid

Law Against Domestic Violence addresses FGM in Kurdistan

2. Changes in policy, legislation and budgets

Iraq

Christian Aid

Speedier citizenship process in Northern Kenya

2. Changes in policy, legislation and budgets

Kenya

Christian Aid

Legislation reduces costs and supports rights of refugees

2. Changes in policy, legislation and budgets

Uganda

Christian Aid

Dominicans of Haitian descent gain support for citizenship

3. Changes in practice
 

Dominican Republic

Christian Aid

Campaign results in more women elected to public office

4. Citizen action
 

Sierra Leone

Christian Aid

Large spike in public participation at community meetings

4. Citizen action
 

Tanzania

Christian Aid

Accountability Corps improves access to water, education, and road infrastructure

1. Service Delivery

Nigeria

Living Earth

Torture victims appeal for justice in 450 cases of human rights abuse

4. Citizen action
 

Zimbabwe

Zim HR NGO Forum
 

Victims of domestic violence benefit from reduction in court fees

4. Citizen action
 

Zimbabwe

Zim HR NGO Forum
 

Women gain equitable share of property in dissolution of customary marriages

3. Changes in practice
 

Zimbabwe

Zim HR NGO Forum

123,000 hectares of misappropriated land recovered in Maya Biosphere

5. Civil Society Strategies to Fight Corruption
 

Guatemala

WCS

Education, health and water services improved in five communites

1. Service Delivery
 

Guatemala

WCS

Additional £20 million to protect the Maya Bisophere

3. Changes in practice
 

Guatemala

WCS

Fires and deforestation significantly reduced in the Maya Biosphere

3. Changes in practice

Guatemala

WCS

Plight of child domestic workers addressed in 2011 ILO Convention

2. Changes in policy, legislation and budgets

Multi-country
 

ASI
 

Child domestic workers protected by new bylaw in Bugogwa district

2. Changes in policy, legislation and budgets

Tanzania

ASI

$15m annual funding for National Programm for Sexual and Reprodctive Health for Youth

2. Changes in policy, legislation and budgets
 

Mexico

IPPF
 

Ministry of Health approves Models of Comprehensive Sexuality Education (MCSE)

2. Changes in policy, legislation and budgets
 

Albania

IPPF
 

National legislation includes sexual and reproductive rights of adolescents

2. Changes in policy, legislation and budgets
 

Bolivia

IPPF

Government approves 4-year roadmap for Strengthening Reproductive Health

2. Changes in policy, legislation and budgets
 

Kazakhstan

IPPF

Government allocates $3m for prevention of teenage pregnancy

2. Changes in policy, legislation and budgets

Peru

IPPF

Afghan government improves Open Budget Index ranking by publishing key budget reports

2. Changes in policy, legislation and budgets
 

Afghanistan

International Budget Partnership
 

UN resolution to enhance fiscal transparency in Member States

2. Changes in policy, legislation and budgets

Multi-country
 

International Budget Partnership

EU issues revised guidelines for budget support operations in development assistance

2. Changes in policy, legislation and budgets
 

Multi-country

International Budget Partnership

Honduras improves Open Budget Index ranking by publishing key budget reports

2. Changes in policy, legislation and budgets
 

Honduras
 

International Budget Partnership

São Tomé e Príncipe improves Open Budget Index ranking by publishing key budget reports

2. Changes in policy, legislation and budgets
 

Sao Tome

International Budget Partnership

International Budget Project creates vibrant global network 4. Citizen action
 
Multi-country International Budget Partnership

Research guides design of 10 National AIDS Action Plans

4. Citizen action
 

Multi-country

GNP+

Documentary addresses societal issues of gender-based violence in South Africa

3. Changes in practice
 

South Africa

GNP+

Government approves improved drugs for treatment of 450,000 people living with HIV 4. Citizen action
 
Malawi
 
GNP+

New services to benefit persons with disabilities

1. Service Delivery

Afghanistan

Relief
 

Community savings boxes support livelihoods in 60 villages

4. Citizen action
 

Afghanistan

Relief

FGM banned by local authorities in Kambia District

3. Changes in practice
 

Sierra Leone

Amnesty International

Rights of widows strengthened in Chansa

3. Changes in practice

Ghana

Amnesty International

Mogho Naaba bans accusations of witchcraft and protects rights of elderly women

3. Changes in practice
 

Burkino Faso

Amnesty International

National parliament establishes Human Rights Committee

2. Changes in policy, legislation and budgets

Uganda

WFD

Arab Institute for Parliamentary Training and Legislative Studies established

3. Changes in practice

Lebanon

WFD

Parliamentary Study Centre improves quality and timing of legislation

3. Changes in practice

Mozambique

WFD

Institute for Parliamentary Studies provides training to Members and Parliamentary staff

3. Changes in practice

Uganda

WFD

Parliamentary Journalism Network improves reporting on government procedures

6. Transparency and access to information

Mozambique

WFD

Millions of children receive national identity cards 1. Service Delivery Peru PRISMA

 

Parameters


Context and Theory of Change

 

  • When the projects were developed “theory of change" (ToC) was not a term in common use. But all the projects were designed with a thesis of how change would come about. Based on that understanding, an explicit ToC is presented for each result covering the following brief overview of the context for the initiative, including social, political and environmental conditions;
  • the long-term problem to be addressed or change that the initiative seeks to make;
  • who will ultimately benefit;
  • the process, or sequence of changes anticipated to lead to the desired long-term outcome;
  • assumptions underlying the anticipated process of change;
  • the other actors who have aided or sought to block change.

 

Approaches, methods and tools

 

This section summarises the approaches used; these might include increased access to information, monitoring policy commitments, evidence-based advocacy, and mass-mobilisation. In many examples an assessment is given of how successful each was in achieving the desired change analysing the factors that contributed to success or failure.

Methods and tools are presented separately from ToC: the Theory of Change describes what was intended; this section describes how that was achieved.

 

The experience of implementation

 

This section presents what actually happened – how the results were achieved. It also describes the elements of the ToC that have worked as anticipated and which ones have not. In doing so it should address how well the original assumptions have held true describing how this has helped or hindered implementation.

 

Long-Term Impact

 

Some MSRs describe a direct impact on people’s lives, in which case this section is less relevant – the immediate result is described in the initial statement and expanded on above. Others, however, describe outcomes that are intermediate steps in achieving a high level impact. This does not diminish their importance. This section describes how the intermediate outcomes will eventually make such an impact. Where possible as estimate of the scale of the longer-tem impact is presented in terms of number of beneficiaries disaggregating by gender and highlighting impact on socially excluded groups.

 

Value for Money

 

The GTF aims to make a real difference to the lives of the poorest and to deliver value for money. DFID’s framework for assessing value for money combines the concepts of economy, efficiency and effectiveness. In this framework: economy relates to efficient procurement; efficiency to the efficient delivery of outputs; and effectiveness to the achievement of intended outcomes.

 

The value for money assessment of the MSRs cannot provide the basis for a judgement about the value for money achieved from the programme as a whole. Nevertheless, it does broaden understanding of the way individual interventions offer value for money.

 

It has not been possible to do a full VFM assessment for all results. At the time the GTF grants were made a rigorous assessment was not envisaged - as a result the necessary data is often not available. Most results describe how economy was achieved. A number describe and quantify cost-efficiency by presenting cost data alongside the number of beneficiaries.

 

Where possible a cost effectiveness assessment is presented. This required grant holders to define outcomes (the benefits that are being weighed) in ways that clearly capture change and its effect on lives (i.e. not just process. Notwithstanding the difficulties, a number of results do present outcomes in quantitative terms, in some case with monetised values. However this element of VFM has proven to be the most difficult parameter to assess with sufficient rigour.

 

Strength of evidence

 

Each MSR presents a self-assessment by the grant-holder of the strength of evidence that a result was achieved. The aim of including this section is to be transparent so that those who might use a result and the surrounding analysis as evidence can do so in full knowledge of how strong that evidence is.

 

The assessment is based a framework developed by NGOs. BOND has introduced its NGO Evidence Principles to address the emerging need to strengthen the use of evidence in decision-making. The framework was adapted to enable it to be used retrospectively and to simplify the process of assessment.

 

The five principles against which evidence was assessed are:

 

1) Voice and Inclusion: the perspectives of people living in poverty, including the most marginalised, are included in the evidence, and a clear picture is provided of who is affected and how
2) Appropriateness: the evidence is generated through methods that are justifiable given the nature of the purpose of the enquiry
3) Triangulation: the evidence has been generated using a mix of methods, data sources, and perspectives
4) Contribution: the evidence explores how change happens, the contribution of the intervention and factors outside the intervention in explaining change
5) Transparency: the evidence discloses the details of the data sources and methods used, the results achieved, and any limitations in the data or conclusions.

Categories

 

To make it easier for users to find a result relevant to their need we have divided them into categories. The categorisation is based on the type of result achieved, rather than the sector in which it was achieved or the kind of strategy or organisation that achieved it. Some categories are self-explanatory; for others we provide a short explanation of the types of results covered.

Category 1. Service delivery. Improvements in the quality or quantity of services delivered by an agent of the state.

Category 2. Changes in policy, legislation and budgets.

Category 3. Changes in practice. A result in this category represents a change in the actual behaviour of duty-bearers so that they act in accordance with rules, guidelines and norms that promote equity. The category is included in recognition of the fact that formal changes to formal policy or budgets may not necessarily lead changes in the rules of the game, leaving actual practice largely unchanged

Category 4. Citizen Action. A result in this category represents a sustained action by citizens. The action might have been initiated by an outside agency but citizens continued with the activities with some degree of independence. The action may not have met with a substantive response from duty-bearers, but the fact that citizens took action to for instance, demand better services, represented significant change in attitude and behaviour.

Category 5. Civil society strategies to fight corruption.

Category 6. Transparency and Access to Information. A result in this category represents more transparent behaviour by duty-holders (as opposed to grant-holders themselves making information available). Improvements to the quantity and quality of information available are included in this category.
 

Learning and Impact