Updating the Database
This section will cover three ways to update the database:
- Automatic update command in a batch file
- Manual update of the database in Apollo
An up-to-date system database is crucial for accurate Short-Term Forecasting, as the WESM market constantly changes (e.g., new units, upgrades).
Ways to Update the System Input Database
- Automatic
- Manual
- Direct
Automatic Update
iPool can analyze market data and automatically update the database using command-line flags, typically when running a historical load (-hist). The flags you combine with -hist determine the action taken.
-
-updatedb -hist (Analyze and Correct) This combination automatically corrects errors for existing units in the database, such as updating an incorrect MW capacity to match the historical data.
-
-genlist -updatedb -hist (Analyze, Correct, and Add) This combination performs both of the above actions and reads IEMOP input files (like MNM_Genlist.csv). This allows iPool to automatically add new units and sites to the database that were not previously listed.
iPoolx.exe -new BASE -t "7/14/2025" -ndays 7 -rep 3 -spin 1 -pmin 0 -elim 0 -ramp 1 -5mnDisp 1 -stor ALL -GenList mnm_genlist.csv -s -x iPoolx.exe -o BASE -s HISTORICAL -hist -rb -x -updatedb
Run a historical load first when using this method, as it ensures that the necessary data is prepared and available before proceeding with the database update.
Manual Update
The Historical Database Error file (HistDBErr.csv) is generated in the scenario folder whenever you run a historical load. It provides a summary of system errors such as missing units in the database, out‑of‑merit no bid, out‑of‑merit outage, and link outage. You can view this file in Apollo either by right‑clicking a scenario or by navigating directly to the historical scenario folder ("C:\IENERGY\WESMXXXX\Scenarios\Scenario_Name\HistDBErr.csv").
Add the details of new units, sites, and/or storages to their respective CSV files located in the Database directory folder ("C:\IENERGY\WESMXXXX\Databases"). Then, either run a batch file or do it using Apollo's command sequence.
Batch Files
Run a batch file containing the following command line:
iPool.exe -o BASE -UnitsFile Units.csv -SitesFile Sites.csv -StorsFile Storages.csv -updatedb -s -x
Apollo
Alternatively, using the Apollo Command Module, drag any scenario template, set the "Type" to Base, check Update Database, and under Inputs, add the respective files in Load Unit File, Load Site File, and Load Storage File. Click "Done editing" and "Run Sequence".
Direct Update
The system database can be directly updated by following these steps:
-
Navigate to the Directory: Go to the folder path "C:\IENERGY\WESMXXXX\Databases".
-
Open the Database: Open the specific database file that requires updating,
SysWESMxxx.mdb. -
Select the Table: In the left-hand navigation pane, click on Sites, Units, or Storages, depending on which entity needs to be updated.
-
Copy an Existing Entry: Locate an entry (site, unit, or storage) that is similar to the new object you intend to add (e.g., matching fuel type or site location).
-
Create the New Record: Copy the selected entry and paste it at the bottom of the table.
-
Save: Enter the new details into the pasted row and save the file.
Primary CSV Files
See each tab to learn more about the primary CSV files.
- Storages
- Sites
- Units
Storages.csv
The Storages.csv file defines the physical limits of the energy reservoir. It sets the maximum and minimum energy capacity (MWh) and the PcBeg (Beginning %), which determines the initial state of charge at the start of the simulation.
For Battery Energy Storage Systems (BESS), PcBeg is typically set to 50% to provide balanced charging and discharging flexibility.
The table below describes the parameters for storage assets (e.g., STO_CLUZ) as defined in the Storages.csv data structure.
| Item | Description | Example Value |
|---|---|---|
| StorageID | Unique identifier of the storage. | STO_CLUZ (user-defined) |
| Region | Region associated with the storage. | CLUZ, CVIS, or CMIN |
| StorageType | Classification of the storage. | BAT, HYDRO, GAS |
| InFlow | Rate of inflow into the storage (for hydro or similar technologies). | 0 (for BESS) |
| Max Cap (MWh) | Maximum energy capacity of the storage (MWh). | 4000 (user-defined) |
| Min Cap (MWh) | Minimum allowable energy level (MWh). | 1 (user-defined) |
| Begin Level (%) | Initial state of charge at the start of the simulation. | 50 (user-defined) |
| MoF0 – MoF12 | Monthly inflow values (if applicable). | 0 (for BESS) |
| Upstream StorageID | Upstream storage ID (if applicable). | (No input required for BESS) |
| Upstream Factor | Upstream factor. | 1 |
| Inflow Time Hrs | Inflow time (hours). | 0 (for BESS) |