vd
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
vd [2021/06/17 00:18] dblume |
vd [2023/04/10 10:27] (current) dblume |
||
|---|---|---|---|
| Line 3: | Line 3: | ||
| **[[https:// | **[[https:// | ||
| - | ====== Tips ====== | + | ====== Source Table Recommendations |
| - | + | ||
| - | ===== Source Table Recommendations ===== | + | |
| Gather data with more granularity than you think you need. You often need three tables: | Gather data with more granularity than you think you need. You often need three tables: | ||
| Line 13: | Line 11: | ||
| - **Mappings from product ID to product name**: (Maybe from platform ID or from product ID.) | - **Mappings from product ID to product name**: (Maybe from platform ID or from product ID.) | ||
| - | ===== Open VisiData and Set Data Types ===== | + | ====== Open VisiData and Set Data Types ====== |
| $ vd logs.csv active_devices.csv id_name.csv | $ vd logs.csv active_devices.csv id_name.csv | ||
| - | ==== Set Column Types, Widths, Names, Importance ==== | + | ===== Set Column Types, Widths, Names, Importance |
| ^ Key ^ Meaning ^ | ^ Key ^ Meaning ^ | ||
| Line 27: | Line 25: | ||
| | ; | Extract regex to new column. Ex, '' | | ; | Extract regex to new column. Ex, '' | ||
| | %%^%% | rename the column. Might have to be " | | %%^%% | rename the column. Might have to be " | ||
| + | | = | Use Python function to create new column. Ex, hex to dec: '' | ||
| + | | : | Split column by regex | | ||
| | - | Hide column | | | - | Hide column | | ||
| | S | Go to " | | S | Go to " | ||
| Line 36: | Line 36: | ||
| | " | Open duplicate sheet with only selected rows | | | " | Open duplicate sheet with only selected rows | | ||
| - | === Protip: Use column view to set multiple columns at once === | + | ===== Inspecting Columnar Data ===== |
| + | |||
| + | ^ Key ^ Meaning ^ | ||
| + | | I | Describe all columns, errors, distinct, mode, mean, median, stdev, etc. | | ||
| + | | i | Add a column of incrementing numbers (useful for ' | ||
| + | | . | Requires an " | ||
| + | | O | Options to enable " | ||
| + | | F | Frequency table of row counts, or histogram if numeric_binning is true | | ||
| + | |||
| + | ====== Case Study Link: Exported CSV from PG&E ====== | ||
| + | |||
| + | Visit [[vd-pge]]. | ||
| + | |||
| + | ====== Cast Study: Merging Two Tables, logs and metadata ====== | ||
| + | |||
| + | ==== Protip: Use column view to set multiple columns at once ==== | ||
| ^ Key ^ Meaning ^ | ^ Key ^ Meaning ^ | ||
| Line 53: | Line 68: | ||
| {{: | {{: | ||
| - | ===== Join Sheets ===== | + | ====== Join Sheets |
| Use '' | Use '' | ||
| Line 64: | Line 79: | ||
| | gu | Next time you're in Sheets, " | | gu | Next time you're in Sheets, " | ||
| - | === Protip: Remove insignificant noisy rows === | + | ==== Protip: Remove insignificant noisy rows ==== |
| ^ Key ^ Meaning ^ | ^ Key ^ Meaning ^ | ||
| Line 76: | Line 91: | ||
| Do a similar thing to join the Joined Sheet with the product Name sheet. | Do a similar thing to join the Joined Sheet with the product Name sheet. | ||
| - | ===== Process Data ===== | + | ====== Process Data ====== |
| In your final Joined sheet, add rows that are calculations of other rows. | In your final Joined sheet, add rows that are calculations of other rows. | ||
vd.1623914294.txt.gz · Last modified: 2021/06/17 00:18 by dblume
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
