These indicators have been chosen and agree during the Phase 2 proposal made to the European Commission.
UNITA impact observatory
Missing Sections & Actions:Indicators Confirmation.
Task number | 5.4 |
---|---|
Name | UNITA impact observatory |
Strategic Axes | Quality, Impact and Sustainability |
Workpackage | Impact and dissemination |
Objectives
- Supporting UNITA's strategies in its effect of transforming our universities will be generating impact for local andregional ecosystems as well as in the European Higher Education and Research Area.
- Contributing to the design of a shared model with the other alliances (ForEu2 Impact Group and other relevant groups),to deploy an impact-oriented approach in UNITA and to promote its measurement and evaluation and its use for pilotingstrategic, management and operational actions.
- Measuring the impact achieved through the alliance, on our international outreach and recognition, at the Europeanlevel and beyond, as well as on the contribution to the Sustainable Development Goals (SDG).Task 5.4 will work on the data from the other Tasks of WP5 (Impact and Dissemination) as well as of WP2 (Developing UNITA communities), WP3 (Lifelong Education), WP4 (Societal and territories needs driven research & innovation) andwill provide inputs to WP1 (Governance and Coordination).
Inputs & Resources
Source documentation:
Resources
- Human Resources: List of staff on the task, roles and position:
- Financial: Budget allocated to the task:
- Materials: Type of materials required (computers, software, scientific tools):
- Intangible: Type of intangible materials (communication tools, data bases,…):
Activities & Actions
Source documentation: In each WP folder, document entitled “WPx_full_description)
List of Activities | Activity Title | Actions | Deadline |
---|---|---|---|
1 | Identify the methods for impact measurement. | Chart and examine with experts what methods are best suited to measure the impact of Task outputs on internal and external target groups (e.g for impact on students: the European Graduate Tracking Initiative) and stakeholders and notably the specific indicators we defined under each Task. | (M1-M6) |
2 | Design methodology, data collection and interfaces dashboard principles. | Discuss methods of impact measurement (e.g., surveys) with Task teams and end users such as students, academic and administrative staff and other stakeholders. Agree on a process owners and calendar to conduct measurements data collection. Design an impact monitoring dashboard supporting and leading UNITA strategies decision bodies. | (M6-M12) |
3 | Implement and test first series of impact measurements. | Involving one-third of long-term vision strategies. Expand the test to two-thirds of long-term vision strategies and use the results to participate to an external impact monitoring system. | (M12-M24) |
4 | Collect and assess feedback from target groups and stakeholders. | On the impact measurement methodology and their results. Accommodate the impact measurement methodology to the feedback received | (M18-M30) |
5 | Intensify and widen the impact measurement methodology to all strategies. | And use the results toparticipate to an external impact monitoring system and share with other alliances and networks in Europe and beyond,including the European Higher Education Observatory. | (M24-M48) |
Indicators
These indicators have been gathered from the different source (list below) and have been gathered from interviews driven by Task 5.4 UNITA impact observatory.
Source documentation: In each WP folder, document entitled “WPx_full_description)
These indicators have been chosen and agree during the Phase 2 proposal made to the European Commission.
These indicators have been chosen and agree during the Phase 2 proposal made to the European Commission.
Data collection
Primary indicators
Indicators gathered from the proposal
- IND 5.4.a – Percentage of long-term vision strategies monitored by impact indicators available on the dashboard.
Baseline 2022: n.a.
Target 2027: 100%
Secondary indicators
To be defined by T5.4 members previously to interviews and to be proposed to task co leader
Subtask Outputs
Sub Task Outputs Indicate concerned sub task |
Outputs indicator Expected results at the sub-task level / To be verified in interview with task co-leaders |
Source of data To be verified in interview with task co-leaders |
---|---|---|
Outcomes
Source documentation:
Task Outcomes
Task Outcomes Identify the outcomes |
Outcomes indicator Expected results at the task level / To be verified in interview with task co-leaders |
Source of data To be verified in interview with task co-leaders |
---|---|---|
Impacts
Source documentation:
- Task and WP long-term objectives Task Description – T5.4 description - WP5 Objectives
- UNITA Mission Statement (from Grant Agreement)
Users / Beneficiaries Intern to UNITA | End-Users / Beneficiaries extern to UNITA | |
---|---|---|
1) Who are the stakeholders benefiting of the task’s actions? | ||
2) To what extent has the local/international society changed as a result of outcomes compared to before UNITA? What are the long term results for them? |
Indicators' data sheet
Description | Unit of measurement | Source of data | Frequency | Baseline (2022) | Target 2027 | Possible sub indicators |
---|---|---|---|---|---|---|
Task Progress Overview
As part of our ongoing Open Project tracking, we’re surfacing here every activity, action, deliverable, milestone and risk grouped under the task UNITA impact observatory.
Subject | Start Date | Due Date | Type | Priority | Status | Assignee | Description |
---|---|---|---|---|---|---|---|
5.4.3.2. Set up of the monitoring system | 1 January 2025 | 17 July 2025 | Action | Normal | In Progress | Clement Combier | Set up of the Monitoring system |
A.5.4.1.4 - Collection of task indicators | Action | Normal | Done | TL5.4 | Collection and review of each task indicators through two successive series of interviews led to each task co-leaders + UNITA offices. Thus, 21 interviews sheets have been completed in order to get the final definition of primary (contractual) and secondary indicators of each task. These results have been agreegated in the indicators matrix and reported in the Datawarehouse | ||
Datawarehouse Design and Development | Action | Normal | New | Antonio De Jesus Menchaca Martinez | |||
A.5.4.1.5 - Design of a mind map | 30 June 2025 | 30 June 2025 | Action | Normal | Done | TL5.4 | Final review and reporting on all elements collected and design of a mind map (indicators matrix and data collection process) |
5.4.3.3. Expand the test to all tasks and strategies | Action | Normal | New | TL5.4 | Tests may be extended and carried out over all tasks indicators and long term strategies | ||
Indicators computation | 10 March 2025 | 28 March 2025 | Action | Normal | In Progress | Antonio De Jesus Menchaca Martinez | |
A.5.4.2.1 - Discussion on methods of impact measurements | Action | Normal | Done | TL5.4 | Discussion on methods of relevant impact measurement with:
\- Task team members T5.4 - Done during the WP5 week in Pamplona in February 2024 \- Task teams, particularly T1.2 et T1.3 as transversal and coordination tasks - Done consecutively to the WP5 meeting during the Management Committees (T1.2) | ||
A.5.4.1.1 - Application to the 2024 THE (Times Higher Education) Impact Ranking | Action | Normal | In Progress | TL5.4 | Each partner may apply to 4 out of the 17 United Nations Sustainable Development Goals on the international Times Higher Education platform: [1](https://www.timeshighereducation.com/impactrankings) The application may be done each year in November through an individual commitment of each institution. | ||
5.4.3.1. Evaluation tests on selected indicators and long term strategy | Action | Normal | New | TL5.4 | Implementation of a first series of test involving, at least one-third of tasks. These actions will be led also in link with the long term strategies carried out by the T1.1 | ||
Data collection | 31 March 2025 | 25 April 2025 | Action | Normal | In Progress | Antonio De Jesus Menchaca Martinez | |
A.5.4.2.2 - Design of a provisional common methodology | Action | Normal | Done | TL5.4 | Finalisation of the methodology to be used in the framework of the UNITA alliance. The selected methodology is widely described in the Deliverable D5.4 "UNITA impact observatory plan" submitted in October 2024. | ||
A.5.4.1.2 - Internal Analysis of methodology | Action | Normal | Done | TL5.4 | Internal analysis of each partner’s methodology for impact assessments: data collection process , indicators selection, results analysis and impact measurement targeted | ||
A.5.4.2.3 - Definition of a process owners and design of a calendar to conduct measurements data collection | 31 July 2025 | 31 July 2025 | Action | Normal | In Progress | TL5.4 | Finalisation and dissemination of the data collection process for each indicator. The collaboration of the different tasks and the UNITA Offices is requested to implement and follow up the data collection. |
A.5.4.2.4 - Design an impact monitoring dashboard supporting and leading UNITA strategies decision bodies | Action | Normal | In Progress | TL5.4 | Selection of the long-term strategy on which the first serie of impact measurement tests will be conducted (A.5.4.3). To note: this activity is strongly dependent of the T1.1 as strategical task defining the different long term strategies of the alliance. | ||
A.5.4.1.3 - Identification of targeted stakeholder groups | Action | Normal | Done | TL5.4 |
| ||
5.4.2. Design methodology, data collection and interfaces dashboard principles | 1 February 2024 | 30 September 2025 | Activity | Normal | In Progress | TL5.4 | Objective: Discuss methods of impact measurement (e.g., surveys) with Task teams and end users such as students, academic and administrative staff and other stakeholders. Agree on a process owners and calendar to conduct measurements data collection. Design an impact monitoring dashboard supporting and leading UNITA strategies decision bodies. |
5.4.4. Collect and assess feedback from target group and stakeholders | 30 October 2026 | 30 October 2026 | Activity | Normal | To Do | TL5.4 | Implementation of the impact measurement methodology on specific target groups and stakeholders through indicators data collection, questionnaries, etc... |
5.4.5. Intensify and widen the impact measurement methodology to all strategies | Activity | Normal | To Do | TL5.4 | The impact measurement methodology may be extended to all the long term strategies of the alliance | ||
5.4.3. Implement and test first series of impact measurement | 1 January 2025 | 31 December 2025 | Activity | Normal | In Progress | TL5.4 | |
5.4.1. Identify the methods for impact measurement | 1 November 2023 | 1 November 2027 | Activity | Normal | Done | TL5.4 | Objective: Chart and examine with experts what methods are best suited to measure the impact of Task outputs on internal and external target groups and stakeholders and notably the specific indicators we defined under each Task. |
D5.4 UNITA impact observatory plan | Deliverable | Normal | Done | TL5.4 | Electronic format. In English with summary in each partmer's national language. ± 60 pages.
The report on the impact observatory plan will describe the observatory methodology and its analysis. UPPA, UPNA PU | ||
IMS03 - Analysis | Milestone | Normal | To Do | TL5.4 | 1. Primer reporte de análisis de indicadores: desviaciones, resultados básicos, problemas básicos (30/09/2025)
2. Correlación indicadores con estrategias y con stakeholders y análisis correspondiente 3. Impact análisis y feedback a tareas, WP, boards y acciones de corrección | ||
MS11 Impact measurement | Milestone | Normal | To Do | TL5.4 | Application of the impact measurement methodology to all the long-term vision strategies.
The impact report is published on the UNITA website UPPA, UPNA | ||
IMS04 - Conference on Impact | Milestone | Normal | To Do | TL5.4 | |||
MS10 Creation of the impact dashboard | Milestone | Normal | Done | TL5.4 | The impact dashboard is available as a service on the Interuniversity digital campus | ||
R5.4.1 UNITA-induced transformation cannot be fully measured and reflected in the impact observatory | Risk | Normal | In Progress | TL5.4 | Resolution or mitigation action based on the risk response strategy: Ensure a common semantic of indicators and an efficient collection strategy, which can be continuously adapted, based on periodic reviews including members from the operational, quality, management, and strategic levels of the alliance. |