UNITA impact observatory

    From UNITApedia
     Missing Sections & Actions:Indicators Confirmation.
    
    Task number 5.4
    Name UNITA impact observatory
    Strategic Axes Quality, Impact and Sustainability
    Workpackage Impact and dissemination



    Objectives

    • Supporting UNITA's strategies in its effect of transforming our universities will be generating impact for local andregional ecosystems as well as in the European Higher Education and Research Area.
    • Contributing to the design of a shared model with the other alliances (ForEu2 Impact Group and other relevant groups),to deploy an impact-oriented approach in UNITA and to promote its measurement and evaluation and its use for pilotingstrategic, management and operational actions.
    • Measuring the impact achieved through the alliance, on our international outreach and recognition, at the Europeanlevel and beyond, as well as on the contribution to the Sustainable Development Goals (SDG).Task 5.4 will work on the data from the other Tasks of WP5 (Impact and Dissemination) as well as of WP2 (Developing UNITA communities), WP3 (Lifelong Education), WP4 (Societal and territories needs driven research & innovation) andwill provide inputs to WP1 (Governance and Coordination).

    Inputs & Resources

    Source documentation:

    Resources

    • Human Resources: List of staff on the task, roles and position:
    • Financial: Budget allocated to the task:
    • Materials: Type of materials required (computers, software, scientific tools):
    • Intangible: Type of intangible materials (communication tools, data bases,…):

    Activities & Actions

    Source documentation: In each WP folder, document entitled “WPx_full_description)

    List of ActivitiesActivity TitleActionsDeadline
    1Identify the methods for impact measurement.Chart and examine with experts what methods are best suited to measure the impact of Task outputs on internal and external target groups (e.g for impact on students: the European Graduate Tracking Initiative) and stakeholders and notably the specific indicators we defined under each Task.(M1-M6)
    2Design methodology, data collection and interfaces dashboard principles.Discuss methods of impact measurement (e.g., surveys) with Task teams and end users such as students, academic and administrative staff and other stakeholders. Agree on a process owners and calendar to conduct measurements data collection. Design an impact monitoring dashboard supporting and leading UNITA strategies decision bodies.(M6-M12)
    3Implement and test first series of impact measurements.Involving one-third of long-term vision strategies. Expand the test to two-thirds of long-term vision strategies and use the results to participate to an external impact monitoring system.(M12-M24)
    4Collect and assess feedback from target groups and stakeholders.On the impact measurement methodology and their results. Accommodate the impact measurement methodology to the feedback received(M18-M30)
    5Intensify and widen the impact measurement methodology to all strategies.And use the results toparticipate to an external impact monitoring system and share with other alliances and networks in Europe and beyond,including the European Higher Education Observatory.(M24-M48)

    Indicators

    These indicators have been gathered from the different source (list below) and have been gathered from interviews driven by Task 5.4 UNITA impact observatory.

    Source documentation: In each WP folder, document entitled “WPx_full_description)



    These indicators have been chosen and agree during the Phase 2 proposal made to the European Commission.

    These indicators have been chosen and agree during the Phase 2 proposal made to the European Commission.

    These indicators have been chosen and agree during the Phase 2 proposal made to the European Commission.

    Data collection

    Primary indicators

    Indicators gathered from the proposal

    • IND 5.4.aPercentage of long-term vision strategies monitored by impact indicators available on the dashboard.
      Baseline 2022: n.a.
      Target 2027: 100%

    Secondary indicators

    To be defined by T5.4 members previously to interviews and to be proposed to task co leader

    Subtask Outputs

    Sub Task Outputs
    Indicate concerned sub task
    Outputs indicator
    Expected results at the sub-task level / To be verified in interview with task co-leaders
    Source of data
    To be verified in interview with task co-leaders

    Outcomes

    Source documentation:

    Task Outcomes

    Task Outcomes
    Identify the outcomes
    Outcomes indicator
    Expected results at the task level / To be verified in interview with task co-leaders
    Source of data
    To be verified in interview with task co-leaders

    Impacts

    Source documentation:

    Users / Beneficiaries Intern to UNITA End-Users / Beneficiaries extern to UNITA
    1) Who are the stakeholders benefiting of the task’s actions?
    2) To what extent has the local/international society changed as a result of outcomes compared to before UNITA? What are the long term results for them?

    Indicators' data sheet

    Description Unit of measurement Source of data Frequency Baseline (2022) Target 2027 Possible sub indicators

    Task Progress Overview

    As part of our ongoing Open Project tracking, we’re surfacing here every activity, action, deliverable, milestone and risk grouped under the task UNITA impact observatory.


    SubjectStart DateDue DateTypePriorityStatusAssigneeDescription
    5.4.1. Identify the methods for impact measurement1 November 20231 November 2027ActivityNormalDoneTL5.4Objective: Chart and examine with experts what methods are best suited to measure the impact of Task outputs on internal and external target groups and stakeholders and notably the specific indicators we defined under each Task.
    5.4.2. Design methodology, data collection and interfaces dashboard principles1 February 202430 September 2025ActivityNormalIn ProgressTL5.4Objective: Discuss methods of impact measurement (e.g., surveys) with Task teams and end users such as students, academic and administrative staff and other stakeholders. Agree on a process owners and calendar to conduct measurements data collection. Design an impact monitoring dashboard supporting and leading UNITA strategies decision bodies.
    5.4.3. Implement and test first series of impact measurement1 January 202531 December 2025ActivityNormalIn ProgressTL5.4
    5.4.3.1. Evaluation tests on selected indicators and long term strategyActionNormalNewTL5.4Implementation of a first series of test involving, at least one-third of tasks. These actions will be led also in link with the long term strategies carried out by the T1.1
    5.4.3.2. Set up of the monitoring system1 January 202517 July 2025ActionNormalIn ProgressClement CombierSet up of the Monitoring system
    5.4.3.3. Expand the test to all tasks and strategiesActionNormalNewTL5.4Tests may be extended and carried out over all tasks indicators and long term strategies
    5.4.4. Collect and assess feedback from target group and stakeholders30 October 202630 October 2026ActivityNormalTo DoTL5.4Implementation of the impact measurement methodology on specific target groups and stakeholders through indicators data collection, questionnaries, etc...
    5.4.5. Intensify and widen the impact measurement methodology to all strategiesActivityNormalTo DoTL5.4The impact measurement methodology may be extended to all the long term strategies of the alliance
    A.5.4.1.1 - Application to the 2024 THE (Times Higher Education) Impact RankingActionNormalIn ProgressTL5.4Each partner may apply to 4 out of the 17 United Nations Sustainable Development Goals on the international Times Higher Education platform: [1](https://www.timeshighereducation.com/impactrankings)   The application may be done each year in November through an individual commitment of each institution.
    A.5.4.1.2 - Internal Analysis of methodologyActionNormalDoneTL5.4Internal analysis of each partner’s methodology for impact assessments: data collection process , indicators selection, results analysis and impact measurement targeted
    A.5.4.1.3 - Identification of targeted stakeholder groupsActionNormalDoneTL5.4
    • Definition and identification of target stakeholder groups (students, doctoral students, staff, external partners (local, international), …)
    • Selection of representatives/working group within each stakeholder group- Identification and assessment of their needs and expectations
    A.5.4.1.4 - Collection of task indicatorsActionNormalDoneTL5.4Collection and review of each task indicators through two successive series of interviews led to each task co-leaders + UNITA offices. Thus, 21 interviews sheets have been completed in order to get the final definition of primary (contractual) and secondary indicators of each task. These results have been agreegated in the indicators matrix and reported in the Datawarehouse
    A.5.4.1.5 - Design of a mind map30 June 202530 June 2025ActionNormalDoneTL5.4Final review and reporting on all elements collected and design of a mind map (indicators matrix and data collection process)
    A.5.4.2.1 - Discussion on methods of impact measurementsActionNormalDoneTL5.4Discussion on methods of relevant impact measurement with:

    \- Task team members T5.4 - Done during the WP5 week in Pamplona in February 2024 \- Task teams, particularly T1.2 et T1.3 as transversal and coordination tasks - Done consecutively to the WP5 meeting during the Management Committees (T1.2) 


    A.5.4.2.2 - Design of a provisional common methodologyActionNormalDoneTL5.4Finalisation of the methodology to be used in the framework of the UNITA alliance. The selected methodology is widely described in the Deliverable D5.4 "UNITA impact observatory plan" submitted in October 2024.
    A.5.4.2.3 - Definition of a process owners and design of a calendar to conduct measurements data collection31 July 202531 July 2025ActionNormalIn ProgressTL5.4Finalisation and dissemination of the data collection process for each indicator. The collaboration of the different tasks and the UNITA Offices is requested to implement and follow up the data collection.
    A.5.4.2.4 - Design an impact monitoring dashboard supporting and leading UNITA strategies decision bodiesActionNormalIn ProgressTL5.4Selection of the long-term strategy on which the first serie of impact measurement tests will be conducted (A.5.4.3).  To note: this activity is strongly dependent of the T1.1 as strategical task defining the different long term strategies of the alliance.
    D5.4 UNITA impact observatory planDeliverableNormalDoneTL5.4Electronic format. In English with summary in each partmer's national language. ± 60 pages.

    The report on the impact observatory plan will describe the observatory methodology and its analysis.

    UPPA, UPNA

    PU
    Data collection31 March 202525 April 2025ActionNormalIn ProgressAntonio De Jesus Menchaca Martinez
    Datawarehouse Design and DevelopmentActionNormalNewAntonio De Jesus Menchaca Martinez
    IMS03 - AnalysisMilestoneNormalTo DoTL5.41. Primer reporte de análisis de indicadores: desviaciones, resultados básicos, problemas básicos (30/09/2025)

    2. Correlación indicadores con estrategias y con stakeholders y análisis correspondiente

    3. Impact análisis y feedback a tareas, WP, boards y acciones de corrección
    IMS04 - Conference on ImpactMilestoneNormalTo DoTL5.4
    Indicators computation10 March 202528 March 2025ActionNormalIn ProgressAntonio De Jesus Menchaca Martinez
    MS10 Creation of the impact dashboardMilestoneNormalDoneTL5.4The impact dashboard is available as a service on the Interuniversity digital campus
    MS11 Impact measurementMilestoneNormalTo DoTL5.4Application of the impact measurement methodology to all the long-term vision strategies.

    The impact report is published on the UNITA website

    UPPA, UPNA
    R5.4.1 UNITA-induced transformation cannot be fully measured and reflected in the impact observatoryRiskNormalIn ProgressTL5.4Resolution or mitigation action based on the risk response strategy: Ensure a common semantic of indicators and an efficient collection strategy, which can be continuously adapted, based on periodic reviews including members from the operational, quality, management, and strategic levels of the alliance.