Updated

CKW_smart_meter_data

77
API Access

Access dataset files directly from scripts, code, or AI agents.

Browse dataset files
Dataset Files

Each file has a stable URL (r-link) that you can use directly in scripts, apps, or AI agents. These URLs are permanent and safe to hardcode.

/brauliobarahona/CKW_smart_meter_data/
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/README.md
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/data/ts/table_batch_0424.md
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/datapackage.json
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/pyproject.toml
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/src/ckw-smartmeter-data/parse.py
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/src/ckw-smartmeter-data/pre_process.py
Key Files

Start with these files — they give you everything you need to understand and access the dataset.

datapackage.jsonmetadata & schema
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/datapackage.json
README.mddocumentation
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/README.md
Typical Usage
  1. 1. Fetch datapackage.json to inspect schema and resources
  2. 2. Download data resources listed in datapackage.json
  3. 3. Read README.md for full context

Data Views

Data Previews

sample Dataset A

Loading data...

Schema

nametypeformatdescription
idstringAnonymized smart meter counter ID (MD5 hash)
timestampdatetimedefaultUTC timestamp at the beginning of the 15-minute measurement window (ISO-8601 format)
value_kwhnumberElectricity consumption in kilowatt-hours (kWh) during the 15-minute time window

smart-meter-timeseries

Unsupported data preview format `parquet`

Schema

nametypeformatdescription
idstringAnonymized smart meter counter ID (MD5 hash)
timestampdatetimedefaultUTC timestamp at the beginning of the 15-minute measurement window (ISO-8601 format)
value_kwhnumberElectricity consumption in kilowatt-hours (kWh) during the 15-minute time window

Data Files

FileDescriptionSizeLast modifiedDownload
sample Dataset A
Sample of 43.9 MB
sample Dataset A
smart-meter-timeseries
Individual smart meter electricity consumption time series data. Each parquet file is named with the anonymized smart meter ID (e.g., 027ceb7b8fd77a4b11b3b497e9f0b174.parquet) and contains all consumption measurements for that specific meter across the covered time period.43.9 MB
smart-meter-timeseries
FilesSizeFormatCreatedUpdatedLicenseSource
287.9 MBcsv, parquetover 1 year ago2 months agoCreative Commons Attribution 4.0 InternationalCKW Smart Meter Data Sample Dataset sample on Zenodo

badge

This data set contains a small sample of the CKW data set A sorted per smart meter ID, stored as parquet files named with the id field of the corresponding smart meter anonymised data. Example: 027ceb7b8fd77a4b11b3b497e9f0b174.parquet

Data

**!**Clean up and complete datapackage.json **!**Create a sample dataset in csv format for visualization

Description

Sources

Quick start

**!**TODO: simple clone and run a scrip or use the cli

Setup remote environment

These are the steps applied to setup the working environment and then parse the CKW in a virtual machine (VM) hosted in Switch engines for the AISOP project. First, setup workflow to work remotely from VM.

In order to authenticate to git and be able to clone the repository, first make sure you have

  • a github account
  • a personal access token
  • a ssh key pair
  • a ssh key pair added to your github account
  • a ssh key pair added to your ssh-agent
  1. Create a new ssh key pair
ssh-keygen -t rsa -b 4096 -C "hintisberg"
ssh-keygen -t ecdsa -C "hintisberg in braulio's github account"
  1. Copy the public key to your clipboard
pbcopy < ~/.ssh/id_rsa.pub

# or with cat and pipe to pbcopy
cat ~/.ssh/id_rsa.pub | pbcopy

# or copy to cliboard without pbcopy
cat ~/.ssh/id_rsa.pub
  1. Add SSH key to your github account

  2. Set SSH agent to remembner your key

# Start the ssh-agent in the background
eval "$(ssh-agent -s)"

# Add your specific key (adjust the filename if you used ecdsa)
ssh-add ~/.ssh/id_rsa

TODOs

**!**TODO: rename to ckw_data_parser **!**TODO: debug/test : scripts/ckw_download.py –list-only :: prints file tables for both datasets **!**TODO: debug/test : scripts/ckw_download.py –dataset a :: shows dataset A files and prompts for selection **!**TODO: test download + decompress cycle