Evaluation of Research Quality of the Environment and Climate Change (ECC) Research Grants
Dala Institute is conducting an independent evaluation of KONEKSI's Environment and Climate Change (ECC) pilot research grants, assessing the quality of 38 funded projects using the Research Quality Plus (RQ+) framework. The evaluation identifies strengths and improvement areas in KONEKSI's research quality assurance mechanisms while exploring early outcomes and pathways to impact across climate change, circular economy, livelihoods, disaster management, and agroforestry themes. Our findings will inform the design and implementation of future KONEKSI grant cycles, strengthening Indonesia-Australia research collaboration that addresses real-world environmental and climate challenges.
Background
The DFAT-funded Knowledge Partnership Program (KONEKSI) is Australia’s flagship program in the Indonesia knowledge and innovation sector. The goal of KONEKSI is to achieve an enduring relationship between Indonesia and Australia that advances mutual interest and supports Indonesia’s inclusive and sustainable development.
Commissioned by the KONEKSI Secretariat based in Jakarta, this activity will evaluate the portfolio of Environment and Climate Change (ECC) research projects. The ECC portfolio comprises 38 collaborative research projects, carried out by 110 organisations working in partnerships, including Indonesian and Australian universities, think tanks, as well as private sector and civil society organisations (CSOs).
The evaluation will serve multiple purposes:
- To assess the quality of research produced under the ECC pilot grants, with reference to the dimensions of the Research Quality Plus (RQ+) framework. To identify strengths and areas for improvement in KONEKSI’s mechanisms for assuring research quality throughout the funding cycle.
- To generate evidence and lessons to inform the design and implementation of future KONEKSI grants, including upcoming calls.
- To contribute to a broader understanding among stakeholders of how KONEKSI-supported research can move beyond knowledge generation to address real-world problems, support commercialisation opportunities, and inform policy and practice in Indonesia.
Approach
Our evaluation of the KONEKSI Environment and Climate Change (ECC) research grants combines project-level Research Quality Plus (RQ+) assessments with portfolio-level synthesis to generate actionable insights for future programming. We apply the IDRC RQ+ framework—assessing scientific rigour, research legitimacy, research importance, and positioning for use—while contextualizing findings within Indonesia's unique research landscape.
Through semi-structured interviews with principal investigators, research partners, and knowledge users across 38 projects, complemented by systematic document review and field visits to up to five purposively selected sites, we gather rich qualitative data on research processes and outcomes. Our innovative approach integrates secure AI-assisted analysis of research outputs stored in the Informa system, enabling us to analyze 100% of eligible materials while maintaining data security.
This multi-method strategy not only evaluates the quality of individual research projects but also identifies programmatic strengths, recurring challenges, and opportunities for KONEKSI to more effectively support research quality across future grant cycles. By examining early outcomes and pathways to impact—including knowledge generation, policy influence, partnership development, and capacity strengthening—we provide evidence-based recommendations that bridge academic rigour with practical program improvement, ensuring KONEKSI's investments maximize their contribution to addressing Indonesia's pressing environment and climate challenges.
Expert Support
This project is supported by:
- Elle Wibisono, serving as Subject Matter Expert.
- Cynthia Maharani, serving as GEDSI Specialist.