This white paper proposes a comprehensive Data Protection Impact Assessment (DPIA) framework for the Data Warehouse, detailing the potential commercial and personal data risks across individual data marts—including Projects, Employee, and Customer—and introducing a “Defence by Design” methodology to mitigate these risks effectively. Objectives Data Marts Overview and Risk Assessment 1. Projects Data Mart 2. … Read more
This draft framework provides a robust SLA for DataMart availability, balancing business needs, technical feasibility, and stakeholder communication. 1. Availability Target Set a clear uptime percentage that aligns with the criticality of the DataMart to your business processes. 2. Operational Hours Define the expected operational hours of the DataMart. Specify if it needs to be … Read more
What good looks like Background: By September 2025, all IFS data currently residing in the Apps 10 solution will transition to the IFS Cloud environment. Commitment: Data Engineering commits to ensuring uninterrupted delivery of DataMarts sourced exclusively from IFS Cloud, enabling the continuity of reporting assets. Prerequisites for a Successful Transition 1. Reduction of Views … Read more
Requirements & Design This document is used to outline details related to reporting requirements of the project. Specifically, this document captures the technical specifications that are required for the successful design and development of business reports. Report Technical Specifications This section is used to describe the detailed specification related to how NUIT will develop a … Read more
Accuracy is the degree of closeness to true value. Precision is the degree to which an instrument or process will repeat the same value. In other words, accuracy is the degree of veracity while precision is the degree of reproducibility. What does accuracy mean? If a measurement is accurate, it means that it agrees closely … Read more
Step 1: Download SQL Files from Azure Storage Step 2: Flatten Directory Structure and Compare Files Using Python Notebook Step 3: Analyse Differences Using Visual Studio Code
Quality standards that apply to the development. Software Lifecycle used Software Quality tool(s) and methods used. The overarching goal of Data Warehouse Development Quality Plan is proactive problem-solving, where any anomalies or discrepancies are swiftly identified and rectified before they escalate into issues. Through continuous monitoring, analysis, and data observability, the reliability, accuracy, and accessibility … Read more
Purpose of Software Quality Plan The purpose of a Data Warehouse Development Quality Plan is to ensure that the development, deployment, and maintenance of the data warehouse, along with its associated components such as third-party data sources, Azure Data Factory (ADF) pipelines, and Data Marts, meet established quality standards. This plan serves as a comprehensive … Read more
Project Plan or other project management document. Data Discovery Stage: Objective: Identify data sources, understand data requirements, and define the scope of the DataMart project. Key Activities: Deliverables: Design Stage: Objective: Design the architecture, schema, and data models for the DataMart. Key Activities: Deliverables: MVP (Minimum Viable Product) Stage: Objective: Develop and deploy a minimum … Read more