🎯 Objective To proactively expire or flag metadata rows that are no longer present in the source data even if their values haven’t changed, avoiding persistence of stale or misleading data. 1. 🏗 Recommended Table Extension Add these optional columns to any table using patch_upsert or put_update: 2. 📥 Staging Input Table – stage.project_values_current Your … Read more
🎯 Core Issue: 🔍 Risks of the Current Approach Scenario Problem Value disappears entirely You keep the last-seen value forever unless a new version overwrites Value moves to another key The old one is retained, and the new one appears as duplicate context Periodic reporting gaps Reporting shows a “stale” value that’s no longer present … Read more
SFIA Reference: RLMT Level 4 Data Architect (Grade 3) Competency Description Participates in Agile planning and stakeholder forums to align architecture with business and platform roadmaps. Learning Outcomes Evidence Requirements Level 4: Suggested Learning Activities Recommended Resources
SFIA Reference: TECH Level 4 Data Architect (Grade 3) Competency Description Contributes to solution review processes and maintains architecture documentation in line with standards. Learning Outcomes Evidence Requirements Level 4: Suggested Learning Activities Recommended Resources
SFIA Reference: METL Level 4/5 Data Architect (Grade 3) Competency Description Collaborates with engineers to embed automation and version control within architectural assets and processes. Learning Outcomes Evidence Requirements Level 4: Suggested Learning Activities Recommended Resources
SFIA Reference: INAN Level 4 Competency Description Designs semantic models and curated datasets to support analytics, dashboards, and self-service BI. Learning Outcomes Evidence Requirements Level 4: Suggested Learning Activities Recommended Resources
SFIA Reference: GOVN Level 4/5 Data Architect (Grade 3) Competency Description Ensures that data architecture aligns with data governance policies, regulatory standards, and organisational controls. Learning Outcomes Evidence Requirements Level 4: Suggested Learning Activities Recommended Resources
SFIA Reference: IRMG Level 4/5 Data Architect (Grade 3) Competency Description Develops and applies metadata standards to improve discoverability, auditability, and consistency across data assets. Learning Outcomes Evidence Requirements Level 4: Suggested Learning Activities Recommended Resources
SFIA Reference: ARCH Level 4/5 Data Architect (Grade 3) Competency Description Designs data platform architectures that support scalable storage, processing, and integration using cloud-native tools. Learning Outcomes Evidence Requirements Level 4: Suggested Learning Activities Recommended Resources
SFIA Reference: DATM Level 4/5 Data Architect (Grade 3) Competency Description Designs enterprise data architecture and modelling patterns that support business agility, reporting, and data governance. Learning Outcomes Evidence Requirements Level 4: Suggested Learning Activities Recommended Resources