DATA ENGINEERING & ANALYTICS

Ireland Work Permit Statistics
Pipeline & Dashboard

An interactive data project exploring Ireland's employment permit statistics and company information through data collection, processing, database management, and visualisation.

End-to-end prototype

LIVE APPLICATION

Explore the Dashboard.

Interactive application powered by Streamlit.

TECHNOLOGIES USED

PythonMongoDBPyMongoDockerGitMongoDB AtlasPlotlyStreamlit

THE IDEA

Making public data easier to explore.

This project explores how data processing and visualisation can turn raw public statistics into information that is easier to understand and use.

DEVELOPMENT PROCESS

From Raw Data to Insights.

01

Data Collection

Collected employment permit statistics and company information from public sources.

02

Data Processing

Used Python to clean, transform, and organise raw data.

03

Database Design

Used MongoDB and PyMongo to store and retrieve structured data.

04

Data Visualisation

Created an interactive dashboard using Streamlit and Plotly.

05

Development Environment

Explored Docker, Git, and MongoDB Atlas during development.

CURRENT STATUS

A Working Prototype

The project brings together data collection, processing, database storage, and dashboard visualisation. It is currently a prototype with room for further testing and improvement.

WHAT I LEARNED

Learning by Building.

Building this project helped me understand how programming, databases, and visualisation work together in a practical data workflow.

BASED IN IRELAND01 / IRELAND WORK PERMIT