November 11, 2024
Data Warehouse management and Reporting
Construction focused dashboards, with in house infrastructure and data tools
Key Features
- Developed out back end infrastructure for pulling data, maintaining data warehouse scehma and deployments
- Managed data sanitization using in house built tools
- Created over 20 reports which used complicated data mappings and provided value to construction management
- Managed performance of API's from > 10 sources with > 100 endpoints.
Key learnings
- Heavy focus dev ops to allow for rapid development and testing
- Collaborating with mutliple different roles eg. report writers, consumers and data engineers.
- Used AWS web api's to spin up new hardware when required
- Built web tools to securely allow new customer setup without knowledge of the back end requirements.
- Network security, layered infrastrucutre and whitelisting only select IP's for access and validating
- Multitennanted data security and access using Microsoft Entra API's
- Improved my design and UX of PowerBI reports
