All issues

Search results

Clean Open Scenarios for Version 2.0

Status: Open.

#523 In IBM/AssetOpsBench;

· DhavalRepo18 opened on Aug 21, 2026

StirrupAgentRunner's default model id never matches a price-table key, so est_cost silently returns None

Status: Open.

#522 In IBM/AssetOpsBench;

· AmirF194 opened on Aug 21, 2026

Code Change based on AA feedback

Status: Open.

#517 In IBM/AssetOpsBench;

· DhavalRepo18 opened on Aug 18, 2026

Bare-name tool alias silently re-registers on a 3rd+ collision, only the 2nd logs a warning

Status: Open.

#515 In IBM/AssetOpsBench;

· AmirF194 opened on Aug 17, 2026

An empty completion crashes plan_execute with a TypeError that blames the regex

Status: Open.

#511 In IBM/AssetOpsBench;

· arthapraha opened on Aug 14, 2026

None of the 2,667 FailureSensorIQ questions reference an entity in the loaded database

Status: Open.

#509 In IBM/AssetOpsBench;

· arthapraha opened on Aug 13, 2026

Two scenarios are answerable with no tools mounted — a contamination control, and what it caught

Status: Open.

#508 In IBM/AssetOpsBench;

· arthapraha opened on Aug 13, 2026

14 of 55 scenario questions can be answered from the shipped data — the audit, with dispositions

Status: Open.

#507 In IBM/AssetOpsBench;

· arthapraha opened on Aug 13, 2026

Are the public artefacts meant to be scoreable end-to-end? Documented ground truth for MAIN and the shipped data overlap by one asset

Status: Open.

#506 In IBM/AssetOpsBench;

· arthapraha opened on Aug 13, 2026

static_json scores differently-named assets as perfect matches when their names share a digit

Status: Open.

#504 In IBM/AssetOpsBench;

· arthapraha opened on Aug 13, 2026

Evidence from 936 runs: an answer-format contract makes plan_execute output gradeable

Status: Open.

#503 In IBM/AssetOpsBench;

· arthapraha opened on Aug 13, 2026

Industrial Automation Challenge Track 1 grader format clarification

Status: Open.

#502 In IBM/AssetOpsBench;

· Harshul-24 opened on Aug 13, 2026