Documentation: Difference between revisions

    From UNITApedia
    Line 10: Line 10:


    == Key Features ==
    == Key Features ==
    * '''Near real-time integrated data pipeline process'''
    * '''Near real-time integrated data pipeline processus:''' Utilizes robust APIs to fetch and display updated information from the [https://unitapedia.univ-unita.eu/pga/ PostgreSQL] database. Near-instantaneous process from data extraction to final result display on UNITApedia.   
    * '''Data Retrieval:''' Utilizes robust APIs to fetch and display updated information from the [https://unitapedia.univ-unita.eu/pga/ PostgreSQL] database. Near-instantaneous process from data extraction to final result display on UNITApedia.   
    * '''User-Friendly Interface:''' Built on MediaWiki, ensuring an intuitive experience for users of varying technical backgrounds. Extensions like Page Forms and Semantic MediaWiki simplify data input, annotation, and querying.   
    * '''User-Friendly Interface:''' Built on MediaWiki, ensuring an intuitive experience for users of varying technical backgrounds. Extensions like Page Forms and Semantic MediaWiki simplify data input, annotation, and querying.   
    * '''Open Source:''' Designed with modularity and scalability in mind, allowing deployment across other UNITA members or similar institutions. Supports customization to meet unique institutional needs while adhering to UNITA’s vision.   
    * '''Open Source:''' Designed with modularity and scalability in mind, allowing deployment across other UNITA members or similar institutions. Supports customization to meet unique institutional needs while adhering to UNITA’s vision.   

    Revision as of 08:31, 11 June 2025

    SYSTEM OVERVIEW

    The UNITApedia system is composed of two integrated main components designed to enhance data accessibility, transparency, and collaboration among UNITA members. It connects a shared data warehouse with a MediaWiki-based front-end, creating a dynamic and scalable ecosystem for data visualization, management, and analysis.

    Shared Data Warehouse

    Acts as the central repository for structured data such as deliverables, indicators, and progress metrics. Utilizes metadata, ontology, and semantic web technologies to provide a comprehensive, interconnected view of data collected across all UNITA members. Supports efficient data centralization, organization, and analysis, ensuring a unified understanding of the data ecosystem. Backed by PostgreSQL, enabling complex queries, scalability, and robust data storage. Alongside Apache HOP as an ETL to develop powerful data pipelines.

    MediaWiki-Based Front-End Interface

    Provides a user-friendly system for monitoring project progress, visualizing metrics, and assessing impact. Acts as the primary user interface, powered by extensions like External Data, Scribunto, and Semantic MediaWiki. Dynamically retrieves data through its API layer, integrating seamlessly with the data warehouse. Enhances decision-making and collaboration by providing stakeholders with real-time, actionable insights. Share and collaborate with other users to extend the UNITA knowledge-base.

    Key Features

    • Near real-time integrated data pipeline processus: Utilizes robust APIs to fetch and display updated information from the PostgreSQL database. Near-instantaneous process from data extraction to final result display on UNITApedia.
    • User-Friendly Interface: Built on MediaWiki, ensuring an intuitive experience for users of varying technical backgrounds. Extensions like Page Forms and Semantic MediaWiki simplify data input, annotation, and querying.
    • Open Source: Designed with modularity and scalability in mind, allowing deployment across other UNITA members or similar institutions. Supports customization to meet unique institutional needs while adhering to UNITA’s vision.
    • Dynamic Queries: Uses optimized prepared PostgreSQL statements and Lua scripting via MediaWiki extensions to deliver efficient and dynamic data visualization. Allows advanced customization of data presentation formats based on user needs.
    • Scalable Architecture: Employs a Dockerized infrastructure for each subsystem (MediaWiki, Strapi, PostgreSQL, Apache HOP, etc.), ensuring modularity and scalability. Supports efficient deployment, updates, and resource allocation.
    • Enhanced Collaboration and Transparency: Enables cross-institutional collaboration by centralizing data in the shared warehouse. Provides stakeholders with real-time visualizations, ensuring informed decision-making and alignment with organizational goals.