Terms of Reference: End Evaluation for RHRN2 and Masarouna

Mountains

Evaluation Purpose

RNW Media is initiating a joint evaluation of two strategic partnerships, Masarouna and RHRN2. This evaluation addresses the lack of a cohesive understanding of the direct and indirect outcomes arising from the programs' digital media and learning interventions affecting partnering organizations and young people. This collaborative effort between Masarouna and RHRN2 aims to contribute to the final evaluations of both Strategic Partnerships (SPs), drawing on insights from gaps observed during the Mid-Term Review (MTR). The evaluation aims to demonstrate how digital media interventions and learning capacity strengthening trajectories and stand-alone interventions have 1) enhanced the capacities of partner organisations and 2) accelerated the digital transformation, digital performance and digital engagement of partner organizations; 3) how these increased capacities, digital transformation efforts, digital performance, visibility and engagement have translated into improved results  and impact on Young People by the partner organisations.  

Background

RNW Media is an international digital media accelerator, working for impact. Our mission is to accelerate the impact of locally rooted civil society organizations' and media outlets in their use of digital media to reach, engage and mobilize young people aged 15 to 35 on issues that matter to them like government accountability, gender equality or climate justice. We work with those who, like us, want to unleash the potential of next generations (millennials, Gen Z) in countries where freedom of expression and digital inclusion are under pressure. It is our goal to ensure that by 2030, through digital media, one billion young people can make informed decisions, advance their rights and positively affect society. We reach this mission by co-creating digital and learning solutions to accelerate change in behaviour, attitudes, social norms and policies. We work with partnering organizations using the Sustainable Development Goals (SDGs) relevant to young people as our compass in countries where the human rights of young people are under threat.

Methodology and Scope

The evaluation will be executed by an external consultancy team. The detailed methodology and research tools are expected to be developed by consultants in collaboration with RNW Media’s team and partner organizations involved in the evaluation.

We propose a mixed methodological approach. It involves the following:  

1) Mapping and analysing of all the available learning and digital media solutions data collected throughout the implementation of both programs from 2021 to mid 2024. This includes surveys, emails, internal documentation from teams, interviews, and other sources.  

2) Analysing the data from partners’ online platforms and determining digital performance and engagement of partner's channels, and the quality of the engagement that is produced through these channels. This includes idenitfying possible knowledge and information sharing opportunities between partners.

2) Employing the Contribution Analysis technique or other relevant methodologies to establish the contributions of capacity strengthening trajectories, i.e., partner organisations’ change in knowledge, perception/intention and social behaviour change related to digitalisation and their impact as well to young people.  

RNW Media and its partner organisations, has multiple years of track record and accumulated expertise in developing digital media solutions to address social issues. Two of our programmes to bring social change through digital media is Masarouna and Right Here Right Now 2.  

lessons learned that can enhance the design and execution of subsequent programs, ensuring continuous improvement and greater impact.

Proposed Learning questions

1) What is the contribution of RNW Media towards partnering organizations?

2) What is the contribution of RNW Media towards partners’ impact on young people?

3) How does RNW Media accelerate the digital transformation, digital performance and digital engagement of partnering organizations;

4) How does RNW Media ensure that 1) the partnering organizations' increase in the capacity building process is sustained through the digital media and learning trajectories and 2) digital media solutions have a wider and continuous impact on young people?  

5) What are the recommendations to sustain and strengthen the impact of digital media and learning solutions on partnering organizations and young people?  

6) How can partnering organizations leverage Artificial Intelligence (AI) to strengthen impact and what role can RNW Media play to help facilitate this?

7) How can the learnings be tied back to the Theory of Change of both programmes, as well as RNW Media’s?

Deliverables  

The selected evaluators(s) are expected to produce the following deliverables:

Deliverable 1: Inception Report - containing proposed detailed methodology, including analytical framework to be applied for analysis, and detailed work-plan specifying activities and timelines agreed with RNW Media (2 weeks after contract is signed)

Deliverable 2: Primary data collection tools including data collection plan and ethical consideration of data collection and use  

Deliverable 3: Summary of primary and secondary data findings with reference materials/links, annexure, photos, etc. and presentation of key findings session

Deliverable 4: First draft evaluation report  

Deliverable 5: Finalised evaluation report, including a set of concrete recommendations  

The consultant shall submit all data collected through the assessment in digitalised format, including possible databases, recordings, transcripts, or summaries, which remains property of RNW Media and the partners once the research is conducted.

Required expertise and experience 

  • At least five years of experience in conducting mixed-methods evaluations.
  • Profound knowledge of SRHR-related challenges being faced in parts of East/West/Central Africa, South Asia and MENA region
  • Experience and understanding of different aspects digital media, including digital analytic tools. 
  • Regional experience working in East/West/Central Africa, South Asia and MENA region
  • Strong analytical, reporting, and communication skills.
  • Fluent in English, with extensive report writing experience.
  • Knowledge of Arabic and French language is desirable.

APPLICATION PROCEDURE  

Interested consultants are invited to submit proposals before July 12, 2024 to sana.naqvi@rnw.org. This includes:

  • Contact details, brief description of the research team, including CVs highlighting relevant experience.
  • Motivation letter detailing methodological approach, including proposed methods and conceptual frameworks for digital media interventions. (max 3 pages).
  • Two references and one non-academic writing sample in English.

REQUIRED EXPERTISE AND EXPERIENCE  

  • At least five years of experience in conducting mixed-methods evaluations.
  • Profound knowledge of SRHR-related challenges being faced in parts of East/West/Central Africa, South Asia and MENA region
  • Experience and understanding of different aspects digital media, including digital analytic tools. 
  • Regional experience working in East/West/Central Africa, South Asia and MENA region
  • Strong analytical, reporting, and communication skills.
  • Fluent in English, with extensive report writing experience.
  • Knowledge of Arabic and French language is desirable.

Selection Process

  • Proposals will be evaluated based on an established assessment grid focusing on relevant experience, methodological robustness, and organizational fit.

RNW Media is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, indigenous groups and persons with disabilities are especially encouraged to apply. All applications will be treated with the strictest confidence.