Files Downloader

Overview

The Files Downloader tab is a download and data-processing utility for Philippine WESM (Wholesale Electricity Spot Market) market data published by IEMOP (Independent Electricity Market Operator of the Philippines). It connects directly to the IEMOP public website — no login is required — and lets you download, schedule, and process WESM market data files for use in iPool simulations.

What It Is Used For

Use the Files Downloader tab to:

• Download IEMOP market files manually — select the file types and date range you need and start a download in one click.
• Schedule automatic downloads — configure the tab to check for and download new files on an hourly or daily basis while Suite is running.
• Aggregate price data — process downloaded AP or iemap price files into regional mean-price CSVs formatted for iPool ingestion.
• Aggregate generation data — process downloaded RTD generation files into a wide-format hourly CSV for analysis.

A fifth operation, Weather, may be visible in the operation rail depending on your license tier.

When to Use It

Use the Files Downloader tab before running iPool simulations that require WESM market data inputs, or when preparing historical price or generation data for analysis. An active internet connection is required — all downloads come directly from the IEMOP website.

Data is available from 2024-08-13 onwards. Both date pickers enforce this minimum date.

Basic Steps

Manual download

1. Click the Files Downloader tab in the top bar. The Manual Download panel is shown by default.
2. Select the file types you want by clicking the pill buttons in the File types grid. RTD (Prices and Schedules) is pre-selected. Click Select All to select all types, or Clear to deselect all.
3. Set the From date.
4. Set the To date. The To date must be on or after the From date.
5. Click Browse to choose a destination folder where files will be saved.
6. Click Start Download. The button becomes active only when file types, both dates, and a destination folder are all set.
7. Watch the Activity Dock at the bottom of the screen. It shows timestamped progress messages for each file as it is downloaded.
8. When the download is complete, check the Total Files and Failed stat tiles for a summary.

note

Existing files in the destination folder are not overwritten. If a file already exists at the target path, the download for that file is skipped. Failed downloads are retried automatically up to twice before being recorded in a failure report saved to the destination folder.

Scheduled downloads

Click Scheduled Downloads in the left rail to configure automatic downloads. Set the interval (hourly or daily), how many recent days of data to retrieve, the data types to download, and an output folder. Click Save Settings, then enable the toggle switch to start the scheduler.

The scheduler runs while Suite is open. It stops when you close the application.

The scheduler is only available in the Electron desktop application.

Price aggregation

Click Price Aggregation in the left rail to aggregate downloaded AP or iemap price files into regional mean-price CSVs for iPool. Select the file type (AP or iemap), set the date range, choose the base output folder (the same folder you used when downloading), and click Process and Generate Output CSVs. If output files for that date range already exist, you are asked whether to overwrite them.

Generation aggregation

Click Generation Aggregation in the left rail to aggregate downloaded RTD generation files into a wide-format hourly CSV. Set the date range, choose the base output folder containing the RTD/ subfolder, and click Process and Generate Output CSV.

Important Fields, Buttons, and Options

Control	Description
Left rail	Switches between the available operations: Manual Download, Scheduled Downloads, Price Aggregation, and Generation Aggregation. A fifth item, Weather, may appear depending on your license tier.
File type pills	Toggle buttons for each IEMOP file type. RTD is pre-selected. Click a pill to select or deselect it.
Select All / Clear	Selects or deselects all file types at once.
From / To date fields	Set the date range for the download. Both fields enforce a minimum date of 2024-08-13 and a maximum of today.
Browse	Opens a folder picker to choose the destination for downloaded files. The chosen path is remembered for your next session.
Start Download	Begins the download. Disabled until at least one file type, both dates, and a destination folder are all set.
Activity Dock	A log panel at the bottom of the screen showing timestamped progress for every file: downloaded (✓), skipped (⊙), or failed (✗).
Total Files stat tile	Shows the total number of files downloaded when the run completes.
Failed stat tile	Shows the number of files that could not be downloaded after retries.

note

The Settings button in the bottom of the left rail is not yet implemented and is currently disabled.

Expected Result

After a manual download completes, files are organised into subfolders by type within your chosen destination folder. For example, RTD files go into an RTD/ subfolder, DAP files into a DAP/ subfolder, and so on.

If any files could not be downloaded after two retry attempts, a failure report (a plain text file listing each failure by type) is saved to the destination folder alongside the downloaded files.

The Activity Dock shows a completion summary line and the stat tiles update with the final counts.