Sidebar
vd-pge
This is an old revision of the document!
Table of Contents
Analyzing PG&E data with VisiData
PG&E CSVs come with 5 rows of metadata followed by Type, Date, Start Time, End Time, Usage, Units, Cost, Notes columns. Delete the five rows of metadata in a text editor, or use tail to remove them like so:
tail +6 pge_electric_interval_data.csv | vd -f csv -
Then prepare your PG&E data like so:
Set Column Types, Widths, Names, Importance
| Key | Meaning |
|---|---|
| - | Hide columns TYPE, END TIME, UNITS and NOTES |
| = | Create a new column for weekday. Enter “DATE.weekday()” |
| = | Create a new column for weekday name. Enter “DATE.strftime('%A')” |
| ^ | Rename “START TIME” to “START_TIME” because column names should be one word for Python expressions. |
| C | Go to column mode and… |
| t | Select the DATE and START TIME columns |
| & | Make a new column that merges them |
| q, - | Quit the Column mode, hide DATE and START TIME columns |
| O | Go to options mode and… |
| e | Set disp_date_fmt to %Y-%m-%d %H:%M |
| q | Quit options mode. |
| @!, %, $ | Set DATE_START_TIME to date format and important, USAGE to float, COST to currency |
| = | Add a column, enter COST/USAGE, (Make it float with %) |
| ^ | Rename COST/USAGE to kWh rate |
| H,V and _ | Move and resize the columns. |
Select Rows to Analyze
| Key | Meaning |
|---|---|
| | | On DATE_START_TIME column, select by regex, like “-11-” for November |
| “ | To open a new sheet with just those selected rows. |
| q | Quit the new sheet mode. |
| Key | Meaning |
|---|---|
| z| | select rows matching Python expr “DATE_START_TIME [-3:] == '-07'” |
| ” | To open a new sheet with just those selected rows. |
| q | Quit the new sheet mode. |
Visualize Data
| Key | Meaning |
|---|---|
| . or g. | Select columns to graph them. Notice rate changes. Notice times of high use. |
| +, - | Navigate with hjkl, zoom in and out (more) |
vd-pge.1628578113.txt.gz · Last modified: 2021/08/09 23:48 by dblume
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
