Data Analysis Workflow
How raw Canadian health survey data was acquired, audited, cleaned, and transformed into actionable population intelligence and decision-support tools.
- 01Phase 1Inspecting
Data Understanding & Ingestion
Profile raw Canadian health survey tables, examine multi-year survey cycles, and establish suppression rules.
- 02Phase 2
Data Cleaning & Standardization
Standardize StatCan long format, clean metadata columns, and unpivot CIHI chart definitions into tidy rows.
- 03Phase 3
Exploratory Data Analysis (EDA)
Analyze provincial variance, sex disparities (gender paradox), age gradients, and COVID-19 cycle breaks.
- 04Phase 4
SQL Analytics & KPI Development
Execute SQL analytical queries to compute high-level national and provincial KPIs for executive decision support.
- 05Phase 5
Machine Learning Synthetic Sandbox
Experiment with ML predictive algorithms in a strict sandbox environment with zero individual-level prediction.
- 06Phase 6
Live StatCan API & Trend Forecasting
Deploy a real-time FastAPI microservice fetching live Statistics Canada vectors and predicting indicator trajectories.
- 07Phase 7
Native Power BI Rebuild & Web Dashboard
Reconstruct the 4-page Power BI report natively into Next.js/Recharts with interactive choropleths and slide decks.
Data Understanding & Ingestion
F (too unreliable) or x (confidential) are retained as null to prevent synthetic distortion.Analytical Objective
Audit public Statistics Canada (CCHS) and CIHI tables to document data grain, cycles, missingness, and data quality flags prior to processing.
Key Analytical Steps & Methods
- โAudited StatCan CCHS tables (13-10-0972, 13-10-0465, 13-10-0802) across 2-year survey cycles (2015โ2022).
- โCatalogued data quality flags: A (excellent), B (very good), C (good), E (use with caution), and F / x (suppressed for confidentiality).
- โVerified geographic coverage across 10 provinces and 3 territories, identifying territory sampling exclusions.
- โEstablished strict data governance: zero imputation for suppressed cells (F/x) to avoid artificial variance.