Data Mart As A Service

A R extension to Retrieve EPA Air Quality System Data via the AQS Data Mart API

A python 3 package to retrieve ambient air monitoring data from the United States Environmental Protection Agency’s (US EPA) Air Quality System (AQS) Data Mart API v2 interface

Huemul BigDataGovernance, es una framework que trabaja sobre Spark, Hive y HDFS. Permite la implementación de una estrategia corporativa de dato único, basada en buenas prácticas de Gobierno de Datos. Permite implementar tablas con control de Primary Key y Foreing Key al insertar y actualizar datos utilizando la librería, Validación de nulos, la…

ETL process using Pentaho Data Integration (Kettle), for Sales and Purchases Datamarts from Adventureworks, as the final project from the Data Management course from the Big Data & Analytics Masters @ EAE class of 2021

A simple and extensible UI widget creation library for faster UI development.

This is the final project I had to do to finish my Big Data Expert Program in U-TAD in September 2017. It uses the following technologies: Apache Spark v2.2.0, Python v2.7.3, Jupyter Notebook (PySpark), HDFS, Hive, Cloudera Impala, Cloudera HUE and Tableau.

Transaction data analysis using Python.

Source code for the IDI Population Explorer, including SQL Server datamart and R Shiny front end

Getting Data from the SFPD dataset, integrating this data into a Datamart, and then proceed with the analysis through a dashboard

Example Project for DataVault and DataMart MSSQL

My solution to the iFood Data Architect Test using PySpark, Jupyter and Docker in order to create a local prototype data lake.

The National Information Management Facility (NIMF) is a centralised datamart design that is used to consolidate fisheries data from various operational systems.

Repository for tutorials, information and notes on technology in general.

This repository presents a data pipeline from a fictitious company with two endpoints: a Data Warehouse and a Data Mart. The focus of the project is to use Pentaho and Dimensional Modeling.

Project for building a ETL pipeline

Automated data extraction using APIs, AWS functions to build ETL pipelines, and data modeling in SSIS. Performed data manipulation, profiling, cleansing, integration, and price history tracking.

Building a Data Warehouse for Fudgemart Inc. by Integrating Data from two Subsidiaries to support Business Intelligent