The Evaluation of the Better Approaches to Service Provision through Increased Capacities in Sulawesi Project (BASICS)

CIRCLE Indonesia TEAM

Quantitative/Basic Survey:
North Sulawesi Team:

• Main Evaluator: Yohanes da Masenus
• Enumerator: Arthur Andries Noch Rogi, S.PI, Atanasius Diyan Setiawan, Debby A.M. Mamesah, Decky Tiwow, Jean Fanny Junita Timban, SP., MSi, Nofri Yohan Raco, Paultje Erij Sangian and Richard Andreas Palilingan, SKM, MErg
• Data Entry: Yohanna and Reina A

Southeast Sulawesi Team:

• Main Evaluator: Henri Sitorus, PhD
• Enumerator: Agnes Melinda, I Gusti Made Devi Yani, S.KM, La Ode Yusman Muriman, SKM, M.Sc, Lisa Iha, Lulu Luciana, Muhamad Syarifuddin, S.KM, Sarianawati, AMG and Usman
• Data Entry: Yohanna and Reina A

Qualitative Evaluation:
North Sulawesi Team:

• Main Evaluator: Yohanes da Masenus
• Liaison Person-Local Assistant: Paultje Erij Sangian,

Southeast Sulawesi Team:

• Main Evaluator: Henri Sitorus, PhD
• Liaison Person-Local Assistant: Lisa Iha and Musram Abadi, S.Pt, M.Si

 
Senior Consultants from SALASAN Consulting, Inc., Canada:

• Colin Rankin
• Lenore Rogers

 
BACKGROUND
The Project “Better Approaches to Service Provision through Increased Capacities in Sulawesi (BASICS) was implemented with the aim of assisting Indonesia to improve the quality of decentralized social services (focused on services in Health and Education) in an equitable and gender-sensitive manner. The purpose of the Project is to strengthen and link planning and budgeting processes in a participatory, pro-poor, gender equal and environmentally sustainable manner leading to improved social service provision in selected districts/cities in Sulawesi.

The ultimate goal of the project was “Improved capacity of government and civil society to develop and implement policies, processes and systems for effective, decentralized services”.

The immediate outcomes of the BASICS Project were:

1. District/city governments developed and implemented plans and budgets leading to more responsive, gender-equitable, environmentally sustainable MDG/MSS-based social service provisioning.
2. Provincial and national governments provided improved support and supervision to district/city governments in the planning and budgeting processes for gender-equitable, environmentally-sustainable MDG/MSS-based social service provisioning.
3. Civil societies provided improved input to government planning and budgeting processes for MDG/MSS-based social service provisioning, and provided technical services to district/city governments.

 
OBJECTIVE
The evaluation aimed to evaluate the achievement of the BASICS projects implemented since 2013 – 2015.
The specific objectives of the evaluation were:

• To identify successes and good practices as well as constraints and challenges in program implementation (Effectiveness/Impact potential/Sustainability);To make recommendations as to how the action could be done better as appropriate and suggest modifications or adjustment of activities, strategies and targets among other actions that could enhance the relevance, effectiveness, efficiency, impact and sustainability of the project.
• Assess the effectiveness and efficiency of the project;
• Assess the relevance and sustainability of project results;
• Assess the effectiveness of the approach used to mainstream Gender Equality (GE) into regulations and tools at all levels of government (district, provincial, and national) – and if this approach was effective in mainstreaming GE – make recommendations on how it could be replicated in future initiatives.

 
 
METHODOLOGY
The evaluation covered two stages; quantitative and qualitative methods.

Quantitative/Basic Survey
The first stage was a quantitative survey. The survey aimed to identify:

1. Changes that have been in place in terms of delivery of services in the health and education sectors as a result of the project
2. Improvement of decision making in the delivery of education and health services in Sulawesi.Primary data collected from stakeholders of the project in 2 provinces and 4 districts representing teachers, parents, medical professionals and health, and education policy makers (local parliament and senior official).
3. Overall, there were 600 respondents selected from the four districts in quota-basis.

The survey was implemented in:
North Sulawesi

• Minahasa District
• North Minahasa District.

Southeast Sulawesi

• Wakatobi District
• Kanowe District

Enumerator and evaluator of Southeast Sulawesi Team

Enumerator met with Local Representative of Minahasa District, North Sulawesi

Qualitative Evaluation
The second stage of the evaluation was conducted with qualitative methods which was an in-depth interview with key informants from national, provincial and district officials on (1) Health Services; (2) Education Services; (3) Local Parliament; (4) Private Hospital; (5) Private Schools; (6) Parents; (7) Pos Yandu, (8) Ikatan Dokter Indonesia (IDI); (9) Local NGOs; (10) Community Leaders. In this stage, two senior consultants form SALASAN Consulting Inc., Canada, Colin Rankin and Lenore Rogers, worked with CIRCLE Indonesia team as the evaluator.

Interview were conducted in 2 Provinces:
North Sulawesi:

• Manado, North Sulawesi Province
• Minahasa District
• North Minahasa District
• South East Minahasa District

Southeast Sulawesi:

• Kendari, Southeast Sulawesi Province
• Norht Konawe District
• South Konawe District
• Wakatobi Distrcit

Evaluator, Colin Rankin and Yohanes, met with Local Representative of South East Minahasa District, North Sulawesi

Focus Group Discussion in Minahasa District, North Sulawesi

The evaluator team: Yohanes da Masenus Arus, Colin Rankin, Lenore Rogers and Henri Sitorus

SALASAN Consulting Inc., Canada, has been appointed by the Canadian Government (Global Affairs Canada) to conduct the evaluation of BASICS Project. To conduct the evaluation in Indonesia, SALASAN Consulting Inc. appointed CIRCLE Indonesia as its local counterpart.

For more information about SALASAN Consulting Inc., Canada please visit: http://www.salasan.com//