Config for v7.8 of IASR worksheet by dylanjmcconnell · Pull Request #86 · Open-ISP/isp-workbook-parser

dylanjmcconnell · 2026-07-14T04:54:39Z

This PR adds in version 7.8 of the IASR worksheet and associated updated configs yamls, and CSV's .

The details below are largely related to the 'mechanical' (i.e. changes to configs, table names etc), relative to last public version of the workbook (7.5). More details on workbook content changes are reflected in a separate markdown file, in the project planning repo).

There is a lot of file additions (i.e new yaml config files, example output CSV's).

Main changes:

New sheets: 1 ("Hybrid site limits" )
New tables: 7 ( details in table below)
Deleted table: 1 (inconsequential table)
Schema changes: 6 (column additions, in separate table below).
Un-hidden tables : 2 (more details below)

There were 287 tables defined in version 7.5 (though two of them were actually "hidden" by a name clash - more details below). Of these, 133 were not changed, 151 were updated, 7 added. and one deleted, leaving 293 in version 7.8.

One table has (build_cost.yaml) has the newly implement skip_check optional value (see PR #85 ) due to data issues (see issue #82 )

Table changes

New tables (7)

Table	Sheet
`energy_efficiency_residential_higher_energy_efficiency`	Energy Efficiency
`energy_efficiency_business_higher_energy_efficiency`	Energy Efficiency
`nsw_roadmap_tender_7_firming_target`	Energy Policy Targets
`sa_firm_energy_reliability_mechanism_target`	Energy Policy Targets
`non_rez_connections_pipeline_build_limits`	Build limits - REZs
`rez_technology_specific_access_rights_limits`	Build limits - REZs
`hybrid_site_limits`	Hybrid site limits (new sheet)

Deleted:

Table gas_and_liquid_fuel_prices_consultant_scenario_mapping deleted from Gas, Liquid fuel, H2 price sheet.

Schema changes (6)

Table	Change
`energy_efficiency_consultant_mapping`	B:F to B:G (new "Higher Energy Efficiency" column)
`other_distributed_resources_build_limits`	B:E to B:G (new "Connections pipeline to 2029-30" group - though all zeros)
`initial_resource_limits` (Build limits - REZs)	B:O to B:Q (new "Connections pipeline to 2029-30" group - with data in this table)
`nsw_roadmap_min_vre_generation_target`	D:E to D:N (single value to 10-yr trajectory + new IIO row)
`nsw_roadmap_storage_energy_capacity_trajectory`	D:F to D:J (2 target years to 6-yr trajectory + new IIO row)
`nsw_roadmap_rez_max_connection_limit`	D:G to D:I (single limit to BESS/solar/wind columns)

Table name changes

*_reduced_energy_efficiency to *_lower_energy_efficiency (×2, workbook renamed the sensitivity)
Flow path naming normalised:
- ..._cost_... changed to ..._costs_... - think (?) this might address Typo in v7.5 table name: missing "s" in flow_path_augmentation_cost_slower_growth_CNSW-NNSW #80
- Underscore to hyphen in a handful of tables: e.g. MEL_WNV to MEL-WNV, SEV_MEL to SEV-MEL

Clashing table names

Discovered there were a couple of clashing table names in the yamls (i.e. same table name but in a different yaml file), that were silently failing (.. basically one of the tables was being ignored, randomly).

water_for_hydrogen appear in water_for_hydrogen.yaml (an actual water usage number) and `desalination_demand_for_h2.yaml (an energy consumption value)
embedded_storage_consultant_scenario_mapping in embedded_energy_storages.yaml and aggregated_energy_storages.yaml (inconsequential table).

Changes (Applied to 7.3/7.5/7.8):

water_for_hydrogen to desalination_electricity_demand_for_h2 in desalination_demand_for_h2.yaml;
embedded_storage_consultant_scenario_mapping to in aggregated_storage_consultant_scenario_mapping in aggregated_energy_storages.yaml

Note: as highlighted, made these changes to older workbooks as well - worth noting.

Drivers of config changes

These are the largest drivers of the change row/position changes (as above - more detail on content changes can be found here).

Updated rows / data

85 new generation/storage projects (58 of them batteries) , grew every generator attribute table (from 642 to 726 rows).
N9 REZ (Hunter-Central Coast) split into N9a/N9b (impacts ~15 sheets).

Granularity restructures

8 × energy efficiency forecast tables: state to ISP sub-region (5 to 15 rows each,
new Region column, first year 2024-25 dropped; business EE also delayed one year)
gas_prices_new_entrants: state to ISP sub-region (30 to 90 rows)

Other

Notes added directly beneath many tables (e.g. on table needed the end_row + skip_rows attributes to be changed).

- gas_prices_existing_generators: Dubbo GT x 3 scenarios - gas_prices_new_entrants: state-level entrants replaced by sub-region-level (10 to 30 entrants, per scenario) - gpg_secondary_fuel_prices: Dubbo GT x 3 (remainder unchanged)

- all forecast tables: state replaced by sub-region granularity (5 to 15 rows per table), new Region column, 2024-25 first year dropped - *_reduced_energy_efficiency renamed to *_lower_energy_efficiency (renamed in workbook) - new *_higher_energy_efficiency sensitivity tables (residential + business) - consultant_mapping: new Higher Energy Efficiency column (9 tables in 7.5, 11 in 7.8)

- generator summary: 85 projects added, 2 removed (Ravenswood BESS, Riverina Solar Farm), 2 renamed (QEJP - Borumba -> Borumba Pumped Hydro; Goyder North Wind Farm split into 1 & 2); new note row below table handled with end_row + skip_rows - new_entrants: N9 REZ split into N9a/N9b, some candidate options replaced (+26/-19) - electrolysers: duplicate rows removed in workbook (151 to 60 rows); N9 split, S-to-NSA piped options replaced by S-to-S - CER summary: unchanged (position shift only)

…nges 28 tables across 19 config files; row/position changes only - existing/committed/anticipated generator tables (auxiliary, emissions intensity, fixed/variable OPEX, heat rates, max capacity, closure years, seasonal ratings): 642 to 726 rows (85 new projects; 2 cancelled: Ravenswood BESS, Riverina Solar Farm; 2 renamed: QEJP - Borumba -> Borumba Pumped Hydro, Goyder North Wind Farm -> split into 1 & 2) - ramp rates, GPG min stable level, affine heat rates: Dubbo GT and Mugga Lane Renewable Hybrid added - N9 REZ (Hunter-Central Coast) split into N9a/N9b: generation options duplicated to both halves (capacity factors, wind & solar connection costs/forecasts, MLF new entrants +7 rows); electrolyser options assigned to a single half each (net zero) - REZ locations renamed, IDs unchanged: Q2 North Qld Clean Energy Hub -> Hughenden Hub; V3 Wimmera Grampians -> Western Victoria; V4 Wimmera Southern Mallee -> Western Victoria (V3/V4 now share one location label) - SA electrolysers piped for Green Commodities: S1/S3/S5/S7 repiped from NSA to own REZ, S2 option dropped entirely (MLF electrolysers and hydrogen pipeline build cost: 151 to 149 rows); the S5/S7 to NSA Piped-for-Domestic options are unchanged - known workbook inconsistency: MLF electrolysers "Power Station" column still uses the old "to NSA" names against the new "S_ to S_" IASR IDs - remainder: position shifts only Not covered: other_distributed_resources_build_limits (new columns), build_costs (stray artifact data in adjacent column AJ)

- new "Connections pipeline to 2029-30" column group (Solar PV MW, Battery storage MW): column range B:E -> B:G; parsed table gets 2 columns (all values currently zero) - table shifted down 2 rows (note rows added above): header rows [16, 17] -> [18, 19], end row 36 -> 38 - 19 sub-region rows unchanged

- locational cost factors and technology-specific LCFs: N9 split into N9a/N9b (both have identical N9 factor values) - (Other tables shift +1 row)

- pipelines: +1 row (end 48 to 49) - Kurri Kurri lateral added - reserves and resources 2: +1 row (end 143 to 144) - Gunnedah basn added - pipeline tariffs: 26 to 19 rows (Victorian DTS entries merged; end 175 to 168) - gas production costs: +1 row and table moved up 7 rows (header 181 to 174) - Gunnedah basn added - processing facilities, storage facilities, reserves and resources 1: unchanged

- CQ-NQ: 4 to 2 options (Options 1 and 2 removed) - SQ-CQ: +1 row (Option 7 added) - CNSW-NNSW: 5 to 3 options (Options 1 and 2 removed) - TAS-SEV: Option 1 replaced by Option 2A - all other flow paths: position shifts only (0 to -9 rows) - config names normalised in slower growth block: cost -> costs (CNSW-NNSW), MEL_WNV -> MEL-WNV, SEV_MEL -> SEV-MEL (changes identical across all 3 scenarios; 42 tables in one config file)

- NSW: +1 row (N9 options reassigned to N9a/N9b, HCC1 Option 2a and SWNSW2 Option 2 added, N2 Option 1 removed) - TAS: +1 row (T2 Option 1A added) - VIC: +2 rows (V1 re-coded to NW1, WV2 added) - SA: position shift only; QLD: unchanged

- CQ-NQ: 4 to 2 options (Options 1 and 2 removed) - SQ-CQ: +1 row (Option 7 added) - CNSW-NNSW: 5 to 4 options (Option 2 removed) - TAS-SEV: +1 row (Option 2A added) - all other flow paths: position shifts only (0 to -2 rows)

…ew tables - schema changes: NSW min VRE generation target expanded from single 2029-30 value to yearly trajectory with new IIO modelled row (D:E to D:N); NSW storage energy trajectory likewise (D:F to D:J); NSW REZ max connection limit split into BESS/solar/wind columns (D:G to D:I) - row change: NSW storage power trajectory notes row dropped (-1 row) - new tables: nsw_roadmap_tender_7_firming_target, sa_firm_energy_reliability_mechanism_target - shifts only: lret (-1), SA renewable (+8), TAS x2 and VIC x3 (+17) - unchanged: powering australia plan, CIS generation and dispatchable targets (14 tables updated/confirmed + 2 new, one config file)

- new table: 58 rows / 28 hybrid sites (VRE + BESS sharing a connection point), columns B:G with merged Site Name column - connection capacity limits complement seasonal ratings (operational limits) and maximum capacity (nameplates)

…, new tables - schema change: initial resource limits gained "Connections pipeline to 2029-30" column group (B:O to B:Q) - row changes: initial resource/transmission limits +1 row each (N9 split into N9a/N9b); transmission modifiers +2/-1 rows; group constraint summary 76 to 126 rows; transmission limit summary 32 to 47 rows - new tables: non_rez_connections_pipeline_build_limits, rez_technology_specific_access_rights_limits - shift only: secondary transmission limit summary (+69) (6 tables updated + 2 new, one config file)

- NSW (32 to 33 rows): N9 options reassigned to N9a/N9b split halves (Option 2b to N9a; 2a, 3, 4 to N9b; Option 1 dropped); new HCC1 Option 2a and SWNSW2 Option 2; new Ausgrid cost note below each NSW table - VIC (18 to 19 rows): V1 North West VIC re-coded to NW1 group constraint (identical costs); WV1 renamed Western Victoria (2 of 3 scenario blocks only); new WV2 group constraint (Option 1 cost identical to WV1 Option 1) - TAS (10 to 11 rows): new T2 Option 1A (North West Tasmania) - SA, QLD: position shifts only - known quirk: "(Note 1)" footnote marker embedded in the N9 REZ ID cell, flows through to parsed data (15 tables, 3 scenarios x 5 states, one config file; no schema changes)

- the table in desalination_demand_for_h2.yaml was keyed "water_for_hydrogen" (perhaps copy-paste from the water table?) despite being a different table / electricity demand for desalination (GWh/annum) - overlapped with the water table (which meant that one was silently inaccessible - depening on machine/glob order)

- specifically added "missed_column_on_right_hand_side" (Column AJ contains stray values (equal to col AI + 1 on several rows) that is not real data, so right-hand column check is skipped for this table)

codecov · 2026-07-14T05:03:45Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
see 1 file with indirect coverage changes

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

EllieKallmier

Yep looks like the new configs and csvs to me :)

dylanjmcconnell added 22 commits July 13, 2026 15:14

Added new (7.8) workbook

30124fc

Copied 7.5 configs to 7.8

29ea255

Updated gas_liquid_fuel_h2_price configs

c5f7700

- gas_prices_existing_generators: Dubbo GT x 3 scenarios - gas_prices_new_entrants: state-level entrants replaced by sub-region-level (10 to 30 entrants, per scenario) - gpg_secondary_fuel_prices: Dubbo GT x 3 (remainder unchanged)

Updated locational_cost_factors configs

9752a31

- locational cost factors and technology-specific LCFs: N9 split into N9a/N9b (both have identical N9 factor values) - (Other tables shift +1 row)

Updated rez_augmentations_options configs

dade798

- NSW: +1 row (N9 options reassigned to N9a/N9b, HCC1 Option 2a and SWNSW2 Option 2 added, N2 Option 1 removed) - TAS: +1 row (T2 Option 1A added) - VIC: +2 rows (V1 re-coded to NW1, WV2 added) - SA: position shift only; QLD: unchanged

Updated flow_path_augmentation_options configs

76f7206

- CQ-NQ: 4 to 2 options (Options 1 and 2 removed) - SQ-CQ: +1 row (Option 7 added) - CNSW-NNSW: 5 to 4 options (Option 2 removed) - TAS-SEV: +1 row (Option 2A added) - all other flow paths: position shifts only (0 to -2 rows)

Added hybrid_site_limits config (new sheet in 7.8)

42774dd

- new table: 58 rows / 28 hybrid sites (VRE + BESS sharing a connection point), columns B:G with merged Site Name column - connection capacity limits complement seasonal ratings (operational limits) and maximum capacity (nameplates)

Added skip_checks option to "build_costs.yaml"

1670b62

- specifically added "missed_column_on_right_hand_side" (Column AJ contains stray values (equal to col AI + 1 on several rows) that is not real data, so right-hand column check is skipped for this table)

Fix duplicate table names in 7.3/7.5/7.8 configs

cc9f87f

Deleted some old / stale test csvs's

eba7884

Updated large file exclusion in .pre-commit-config.yaml

dff4c5e

Added all new example output csvs for 7.8

6bf64d1

dylanjmcconnell requested review from EllieKallmier and nick-gorman July 14, 2026 04:54

EllieKallmier mentioned this pull request Jul 16, 2026

new_entrants_summary v7.5/7.8: NSA pumped-hydro rows have mismatched Regional build cost zone (CSA instead of NSA) [+workbook weirdness] Open-ISP/ISPyPSA#131

Open

EllieKallmier approved these changes Jul 21, 2026

View reviewed changes

Navigation Menu

Uh oh!

Config for v7.8 of IASR worksheet - #86

Config for v7.8 of IASR worksheet#86
dylanjmcconnell wants to merge 22 commits into
mainfrom
v7.8

dylanjmcconnell commented Jul 14, 2026

Uh oh!

codecov Bot commented Jul 14, 2026 •

edited

Loading

Uh oh!

EllieKallmier left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

dylanjmcconnell commented Jul 14, 2026

Main changes:

Table changes

New tables (7)

Deleted:

Schema changes (6)

Table name changes

Clashing table names

Changes (Applied to 7.3/7.5/7.8):

Drivers of config changes

Updated rows / data

Granularity restructures

Other

Uh oh!

codecov Bot commented Jul 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

EllieKallmier left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

codecov Bot commented Jul 14, 2026 •

edited

Loading