When importing rich text data into a Data Warehouse (DWH), it’s often necessary to remove unwanted HTML tags while preserving essential formatting. This guide outlines a method using Python’s BeautifulSoup library to clean and structure the data efficiently. Why Strip HTML Tags? Rich text from sources like web applications, CMS platforms, and APIs often includes … Read more
The following Power Query (M) script demonstrates how to extract a list of dates from a table, convert them into a formatted string, and use them dynamically in an API request: Step-by-Step Guide Explanation: Application in get.myhistory This approach can be used within get.myhistory to dynamically retrieve historical records by supplying a list of relevant … Read more
Additions Customer Details USD ✅ New Addition customer_details_USD – Part of the CAD/USD series of changes.⚠️ Contains Created (Hash) Customer IDs – This will be corrected in the next release. Considerations & Next Steps 🔹 Customer ID Fix Pending – Plan for a smooth transition when correcting the Customer ID field.🔹 UNION-based “mega” list for … Read more
Overview The Splash View is a flexible data exploration tool in myBMT, providing interactive access to various structured data formats, including: This tool allows users to explore data visually and programmatically, ensuring seamless interaction across multiple file formats. 1️⃣ Availability Where can I find the Splash View? 🚿 Wherever you see the shower icon in … Read more
Alterations 15 Files Modified Key Fixes & Enhancements Notes 1. ⚠️ DIFFERENT: employee_absencelimit.sql2. ⚠️ DIFFERENT: infrastructure_changerequest.sql3. ⚠️ DIFFERENT: infrastructure_oshrecords.sql4. ⚠️ DIFFERENT: marketing_Advertising.sql5. ⚠️ DIFFERENT: marketing_campaignTraffic.sql6. ⚠️ DIFFERENT: marketing_campaignTrafficFormSubmissions.sql7. ⚠️ DIFFERENT: marketing_EmailCampaigns.sql8. ⚠️ DIFFERENT: marketing_Events.sql9. ⚠️ DIFFERENT: marketing_Forms.sql10. ⚠️ DIFFERENT: marketing_HubSpotLandingPages.sql11. ⚠️ DIFFERENT: marketing_Meltwater.sql12. ⚠️ DIFFERENT: marketing_pagePerformance.sql13. ⚠️ DIFFERENT: marketing_pagePerformanceFormSubmissions.sql14. ⚠️ DIFFERENT: marketing_SocialMedia.sql15. ⚠️ DIFFERENT: marketing_ThoughtLeadership.sql … Read more
Ensuring Structured, Reusable, and Scalable Data Architecture 1️⃣ Purpose of the Common Data Standard The Common Data Standard (CDS) establishes a structured framework for defining DataMart views in a consistent and scalable manner. This standard: ✅ Promotes reusability across different datasets.✅ Ensures alignment between business logic and reporting needs.✅ Enables efficient data joins and minimises … Read more
Bridging Structured Data with Usability 1️⃣ Understanding the Layers: CDS vs. Utility Views The Common Data Standard (CDS) defines a structured, specialist-oriented view of data, ensuring consistency and modularity in reporting. However, for non-specialists, the Utility (Commodity) View simplifies data consumption by cross-combining relevant details into a single, user-friendly dataset. View Type Purpose Audience Example … Read more