Documentation: Difference between revisions
| Line 1: | Line 1: | ||
=Data Collection for Impact Observatory= | =Data Collection for Impact Observatory= | ||
Two ways for collecting the data were implemented for the '''Impact Observatory'''. In the automatic path, users simply upload CSV files to our [https://unitapedia.univ-unita.eu/minio/buckets MinIO] object-storage service; from there, a suite of '''Pentaho''' jobs automatically ingests, transforms, and loads the data into our Datalake, ensuring updated metrics with zero manual intervention. In the manual path, UINTA offices log into our [https://unitapedia.univ-unita.eu/strapi/ Strapi] CMS and complete pre‐built indicator forms (e.g., entering dates, numeric values, and descriptions). Once submitted, each entry is stored in our PostgreSQL database, tracked with metadata (timestamps, author, version), and immediately available for reporting. This dual approach guarantees both high volume automation and flexible, data entry, so all the indicators stay accurate and updated. | Two ways for collecting the data were implemented for the '''Impact Observatory'''. In the automatic path, users simply upload CSV files to our [https://unitapedia.univ-unita.eu/minio/buckets MinIO] object-storage service; from there, a suite of '''Pentaho''' jobs automatically ingests, transforms, and loads the data into our Datalake, ensuring updated metrics with zero manual intervention. In the manual path, UINTA offices log into our [https://unitapedia.univ-unita.eu/strapi/ Strapi] CMS and complete pre‐built indicator forms (e.g., entering dates, numeric values, and descriptions). Once submitted, each entry is stored in our '''PostgreSQL''' database, tracked with metadata (timestamps, author, version), and immediately available for reporting. This dual approach guarantees both high volume automation and flexible, data entry, so all the indicators stay accurate and updated. | ||
[[File:Data_Collection.png|frameless|996px|center|Data Injection]] | [[File:Data_Collection.png|frameless|996px|center|Data Injection]] | ||
===Strapi & Minio Video Tutorial=== | ===Strapi & Minio Video Tutorial=== | ||
Bellow a short video tutorial explaining how to use Strapi and MinIO tools for the data collection of indicators. | Bellow a short video tutorial explaining how to use [https://unitapedia.univ-unita.eu/strapi/ Strapi] and [https://unitapedia.univ-unita.eu/minio/buckets MinIO] tools for the data collection of indicators. | ||
<html> | <html> | ||
<div style="position: relative; overflow: hidden; padding-top: 56.25%;"><iframe src="https://share.synthesia.io/embeds/videos/6b74f097-50d8-4557-af6e-b09d2be95862" loading="lazy" title="Synthesia video player - v2" allowfullscreen allow="encrypted-media; fullscreen;" style="position: absolute; width: 100%; height: 100%; top: 0; left: 0; border: none; padding: 0; margin: 0; overflow:hidden;"></iframe></div> | <div style="position: relative; overflow: hidden; padding-top: 56.25%;"><iframe src="https://share.synthesia.io/embeds/videos/6b74f097-50d8-4557-af6e-b09d2be95862" loading="lazy" title="Synthesia video player - v2" allowfullscreen allow="encrypted-media; fullscreen;" style="position: absolute; width: 100%; height: 100%; top: 0; left: 0; border: none; padding: 0; margin: 0; overflow:hidden;"></iframe></div> | ||
</html> | </html> | ||
Revision as of 12:02, 23 April 2025
Data Collection for Impact Observatory
Two ways for collecting the data were implemented for the Impact Observatory. In the automatic path, users simply upload CSV files to our MinIO object-storage service; from there, a suite of Pentaho jobs automatically ingests, transforms, and loads the data into our Datalake, ensuring updated metrics with zero manual intervention. In the manual path, UINTA offices log into our Strapi CMS and complete pre‐built indicator forms (e.g., entering dates, numeric values, and descriptions). Once submitted, each entry is stored in our PostgreSQL database, tracked with metadata (timestamps, author, version), and immediately available for reporting. This dual approach guarantees both high volume automation and flexible, data entry, so all the indicators stay accurate and updated.
Strapi & Minio Video Tutorial
Bellow a short video tutorial explaining how to use Strapi and MinIO tools for the data collection of indicators.