Editing User Guide (section)

= ETL Pipeline Tutorials =

This three-part tutorial series walks you through the complete '''ETL (Extract, Transform, Load)''' process used to feed structured data into the UNITApedia platform. Using [https://unitapedia.univ-unita.eu/strapi Strapi], [https://unitapedia.univ-unita.eu/hop Apache HOP], and [https://unitapedia.univ-unita.eu/pga PostgreSQL], we show how to create and manage data flows from form input to dynamic visualization.

=== Part I – Strapi: Data Collection Form ===
In this first part, we show how to use [https://unitapedia.univ-unita.eu/strapi Strapi] to create a structured form for data collection. You'll learn how to configure content types, add validation rules, and publish entries that will later be extracted and processed in our pipeline.

<html>
<div style="position: relative; overflow: hidden; padding-top: 56.25%;">
  <iframe src="https://share.synthesia.io/embeds/videos/b32a5947-b6e1-4ba5-b030-5cb5eaa315fc" loading="lazy" title="Strapi Tutorial - ETL Pipeline Part I" allowfullscreen allow="encrypted-media; fullscreen;" style="position: absolute; width: 100%; height: 100%; top: 0; left: 0; border: none; padding: 0; margin: 0; overflow:hidden;"></iframe>
</div>
</html>

=== Part II – Apache HOP: Transformation Pipeline ===
This part focuses on [https://unitapedia.univ-unita.eu/hop Apache HOP], where we create a basic transformation pipeline to extract data from [https://unitapedia.univ-unita.eu/strapi Strapi], process and filter it, and then store it in a [https://unitapedia.univ-unita.eu/pga PostgreSQL] datamart. This transformation prepares the data for use in reporting and analysis tools.

<html>
<div style="position: relative; overflow: hidden; padding-top: 56.25%;">
  <iframe src="https://share.synthesia.io/embeds/videos/7b430445-c85f-4c28-b1f0-a2c6318d305b" loading="lazy" title="Apache HOP Tutorial - ETL Pipeline Part II" allowfullscreen allow="encrypted-media; fullscreen;" style="position: absolute; width: 100%; height: 100%; top: 0; left: 0; border: none; padding: 0; margin: 0; overflow:hidden;"></iframe>
</div>
</html>

=== Part III – MediaWiki: Data Integration ===
In the final part, we use the External Data extension in MediaWiki to fetch and display the transformed data on our UNITApedia site. You'll learn how to configure database queries, create pages dynamically, and format the output for semantic use. The data displayed here originates from the [https://unitapedia.univ-unita.eu/pga PostgreSQL] datamart populated by [https://unitapedia.univ-unita.eu/hop Apache HOP] from [https://unitapedia.univ-unita.eu/strapi Strapi] entries.

<html>
<div style="position: relative; overflow: hidden; padding-top: 56.25%;">
  <iframe src="https://share.synthesia.io/embeds/videos/99bed61a-fabc-4682-88ff-a29e687abfe4" loading="lazy" title="MediaWiki Integration - ETL Pipeline Part III" allowfullscreen allow="encrypted-media; fullscreen;" style="position: absolute; width: 100%; height: 100%; top: 0; left: 0; border: none; padding: 0; margin: 0; overflow:hidden;"></iframe>
</div>
</html>