Generation Aggregation

note

This panel requires the Electron desktop application. In the web build, folder selection is unavailable and aggregation cannot be run.

What It Does

The Generation Aggregation panel reads already-downloaded RTD CSV files from your local RTD/ subfolder, filters to generation unit rows, and produces a single wide-format hourly CSV where each column represents one generating station. This file contains the mean scheduled MW (SCHED_MW) per station per hour.

Aggregation is a local-only operation. No internet connection is required.

Inputs

Setting	Options
Date Range (start/end)	Min 2024-08-13, max today
Source Folder	The base folder that contains the RTD/ subfolder (the same folder used when downloading).

Hint text shown in the folder field: "Select the same base folder used when downloading. The tool will look inside the RTD/ subfolder."

Run Button

State	Label
Idle	"Process and Generate Output CSV"
Busy	"Processing..." (disabled)

Output File

One file is produced per aggregation run:

• Path: <baseFolder>/RTD/GenH_W_YYYYMMDD_YYYYMMDD.csv
• Header: DateTimeEnding,<station1>,<station2>,... (stations sorted alphabetically)
• Values: 6 decimal places per station (e.g., 425.000000)
• Line endings: \r\n
• Stations not present in a given hour are written as 0.000000
• Uses hour-ending convention (e.g., intervals up to and including 1:00 AM → DateTimeEnding 1:00:00 AM)

note

A 30-day aggregation may require 200–400 MB of memory at peak. If the process is slow, reduce the date range.

note

If the output file for the requested date range already exists, a dialog asks whether to overwrite or cancel.

Aggregation Method

• Reads RTD_YYYYMMDDHHNN.csv files from the RTD/ subfolder.
• Filters to rows where RESOURCE_TYPE = 'G' (generation units only).
• Uses SCHED_MW (column index 6) as the value and RESOURCE_NAME (column index 4) as the station identifier.
• Groups SCHED_MW by station and 5-minute interval; buckets into clock-hours.
• Computes the arithmetic mean per station per hour.

Activity Dock

Progress appears in the Activity Dock via the dl:generation-aggregation-progress channel.

• On success: the log shows the count of hourly rows and the count of unique stations found.
• On error: the error message is shown in the Activity Dock.

Error States

Error	Where shown
End date before start date	Inline text below date fields
No files found for date range	Activity Dock: "No files found for the specified date range."
Source folder not found	Activity Dock: error from aggregator
Output file already exists	Native dialog: "File Already Exists — Overwrite?"