CE Data Observatory (Dashboard)

National Interdisciplinary Circular Economy Research (NICER) Programme

Project aims

  1. Bring together a systemic data and modelling framework for the NICER programme and future UKRI CE research investments
  1. Develop a national CE-Observatory dashboard to visualise up-to-date, detailed baseline data and explore alternative future CE states across a range of resource-product-industry categories

Building off outputs including

  1. Data and modelling architecture developed by the CE-Hub
  2. Agnostic systems dynamics model
  3. Review of indicators
  4. Catalogue and review of public data assets
  5. Data collated for products and cases incl. signficiant collection across NICER programme

Dashboard design

Core chart components

  • Sidebar navigation
  • Sankey diagram
  • Area chart - inflow, stock and outflow over time
  • Bubble chart - ‘CE score’, lifespan and mass/value
  • KPI value boxes - set of consistent KPI boxes
  • Scenario builder - customisable ‘what ifs’ & pre-programmed scenarios
  • Metadata popout - Data quality, methodological process, indicator definition

More info shelf

Additional related data presented in tiles. For example:

  • Compositional data

  • Intensity ratios

  • Extra business-level data e.g. employment

Barriers/enablers shelf

Charts tracking dynamics identified as relevant to outcomes/impacts of interest through theory of change analysis.

  • Product design
  • Business models
  • Price differentials
  • Policy indicators e.g. enforcement actions

Data population

Data input and retrieval

‘Contribute’ pipeline

File (e.g. CSV) uploads of structured data following specified format and schema:

  1. Pre-written PostgreSQL chunks e.g. to append
  2. Metadata covering provenance, methods used

Extract pipeline

Using public data from official, academic and emerging sources:

  1. Signature resource-product combinations selected. Assigned to a top-level navigation tab
  2. Raw data extracted via API, web-scraping, download requests and manual retrieval. RAPs (to extent possible) hosted on GitHub to support version control & Open by default

Data transformation

  • Data validated and cleaned (e.g. outlier replacement)
  • Prioritised using decision rules or other methods
  • Unknown values estimated (interpolation, backcasting and forecasting)
  • Reformatted and restructured to populate required end-points (e.g. derived aggregations)

Data storage and loading

  • Data stored in supabase (Backend as a Service (BaaS) solution covering database, storage, authentication, API service)
    • PostgreSQL access policies & row-level security based on user attributes
  • API calls from gatsby to contenful and supabase at time of build

Data visualisation

  • The ce-observatory front-end

Mapping sources to components (electronics example)

Opportunity for feedback

  • Find here a link to the prototype dashboard (and here to the Github page for processing scripts).
  • Treat all data at the site as dummy as we build out and verify inputting data pipelines and model outputs. Please also do not share further for the moment.

Questions we would appreciate feedback on in particular:

  1. Is the most critical information currently captured in the proposed components (charts, KPIs, shelves)?
  2. What functionality would you like to see altered/added?

Answers to these questions as well as general feedback can be given at this google forms survey link

Observatory Dashboard