CKW_smart_meter_data

142
0
Updated:
Files:2
Size:87.9 MB
Formats:csvparquet
License:CC-BY-4.0

API Access

Access dataset files directly from scripts, code, or AI agents.

Browse dataset files
Dataset Files

Each file has a stable URL (r-link) that you can use directly in scripts, apps, or AI agents. These URLs are permanent and safe to hardcode.

/brauliobarahona/CKW_smart_meter_data/
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/README.md
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/data/ts/table_batch_0424.md
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/datapackage.json
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/pyproject.toml
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/src/ckw-smartmeter-data/parse.py
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/src/ckw-smartmeter-data/pre_process.py
Key Files

Start with these files — they give you everything you need to understand and access the dataset.

datapackage.jsonmetadata & schema
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/datapackage.json
README.mddocumentation
https://datahub.io/brauliobarahona/CKW_smart_meter_data/_r/-/README.md
Typical Usage
  1. 1. Fetch datapackage.json to inspect schema and resources
  2. 2. Download data resources listed in datapackage.json
  3. 3. Read README.md for full context

Data Views

Electricity Consumption Time Series

Data Files

Explore with AI

sample Dataset A

smart-meter-timeseries

Unsupported data preview format `parquet`

About

Individual smart meter electricity consumption time series data. Each parquet file is named with the anonymized smart meter ID (e.g., 027ceb7b8fd77a4b11b3b497e9f0b174.parquet) and contains all consumption measurements for that specific meter across the covered time period.
Format
PARQUET
File size
43.9 MB

About this dataset

badge

This data set contains a small sample of the CKW data set A sorted per smart meter ID, stored as parquet files named with the id field of the corresponding smart meter anonymised data. Example: 027ceb7b8fd77a4b11b3b497e9f0b174.parquet

Data

**!**Clean up and complete datapackage.json **!**Create a sample dataset in csv format for visualization

Description

Sources

Quick start

**!**TODO: simple clone and run a scrip or use the cli

Setup remote environment

These are the steps applied to setup the working environment and then parse the CKW in a virtual machine (VM) hosted in Switch engines for the AISOP project. First, setup workflow to work remotely from VM.

In order to authenticate to git and be able to clone the repository, first make sure you have

  • a github account
  • a personal access token
  • a ssh key pair
  • a ssh key pair added to your github account
  • a ssh key pair added to your ssh-agent
  1. Create a new ssh key pair
ssh-keygen -t rsa -b 4096 -C "hintisberg"
ssh-keygen -t ecdsa -C "hintisberg in braulio's github account"
  1. Copy the public key to your clipboard
pbcopy < ~/.ssh/id_rsa.pub

# or with cat and pipe to pbcopy
cat ~/.ssh/id_rsa.pub | pbcopy

# or copy to cliboard without pbcopy
cat ~/.ssh/id_rsa.pub
  1. Add SSH key to your github account

  2. Set SSH agent to remembner your key

# Start the ssh-agent in the background
eval "$(ssh-agent -s)"

# Add your specific key (adjust the filename if you used ecdsa)
ssh-add ~/.ssh/id_rsa

TODOs

**!**TODO: rename to ckw_data_parser **!**TODO: debug/test : scripts/ckw_download.py –list-only :: prints file tables for both datasets **!**TODO: debug/test : scripts/ckw_download.py –dataset a :: shows dataset A files and prompts for selection **!**TODO: test download + decompress cycle