From 7ef5f0424987e6c50ed71b9ca4bca917275d3f66 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 03:48:19 -0700 Subject: [PATCH 01/17] the leaderboard stops invalidating daily - DASLLAMA_VERSION becomes DASLLAMA_RELEASE The one constant conflated three invalidation scopes (tune sidecars, board/records provenance, exchange validity) and was bumped on any kernel change, so every bump voided the whole board and every box's sidecar. It is now DASLLAMA_RELEASE, bumped only on a declared release - a maintainer ruling that bench comparability is broken. Per-change invalidation stays with the finer mechanisms: IMAGE_VERSION and the reflected layout fingerprint (dlims never read this constant - verified). Value stays 15, so every v15 artifact remains valid; wire names (dasllama_version in exchange JSON, sidecar provenance via the new version_key= override on [tune_scope], bench records) are schema-stable. REVIEW.md's kernel-work bump duty is replaced by the declared-release rule; the per-entry kernel-hash hardening is ledgered as followup_general 58. Also: CLAUDE.md's lint-opportunity routing now names REVIEW.das gates for folder-owned patterns; the release_remint_plan.md arc plan lands with the step-0 gate-candidate assessment. Gates: model-free suite 74 files green; compile checks on the renamed roots. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- CLAUDE.md | 2 +- LAWS.md | 1 + modules/dasLLAMA/ARCHITECTURE_ENGINE.md | 12 +- modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md | 4 +- modules/dasLLAMA/BRINGUP.md | 8 +- modules/dasLLAMA/LAWS.md | 10 ++ modules/dasLLAMA/REVIEW.md | 12 +- modules/dasLLAMA/benchmarks/lcpp_bench.das | 6 +- modules/dasLLAMA/dasllama/dasllama_common.das | 2 +- .../dasLLAMA/dasllama/dasllama_exchange.das | 32 +++--- .../dasLLAMA/dasllama/dasllama_math_gen.das | 4 +- .../dasLLAMA/dasllama/dasllama_version.das | 12 +- modules/dasLLAMA/followup_general.md | 13 ++- modules/dasLLAMA/harness/tuner_noise.das | 4 +- modules/dasLLAMA/performance/REVIEW.md | 6 +- modules/dasLLAMA/release_remint_plan.md | 106 ++++++++++++++++++ .../tests/test_bench_records_schema.das | 4 +- .../tests/test_dasllama_lint_escape.das | 2 +- .../dasLLAMA/tests/test_exchange_schema.das | 2 +- plans/dasllama_io_site.md | 5 + utils/dasllama-server/README.md | 2 +- .../dasllama-server/test_exchange_client.das | 36 +++--- utils/internal/dasllama-ladder/README.md | 2 +- utils/internal/dasllama-ladder/REVIEW.md | 2 +- 24 files changed, 214 insertions(+), 75 deletions(-) create mode 100644 modules/dasLLAMA/release_remint_plan.md diff --git a/CLAUDE.md b/CLAUDE.md index e7fba661f9..48e73be794 100644 --- a/CLAUDE.md +++ b/CLAUDE.md @@ -168,7 +168,7 @@ Multiple skill files may apply to one task: creating a new daslib module needs ` New knowledge about daslang syntax, semantics, or conventions - from compiler errors, user corrections, or experimentation - goes into **this file**, or into the relevant `skills/*.md` when it belongs to a skill area. -**Lint opportunities are reportable findings - don't hold back.** When a bug, review note, or probe reveals a pattern a lint rule could catch (especially one that has bitten more than once), SAY SO in the end-of-turn summary and propose the rule to Boris; the suite keeps paying for itself precisely because rules keep getting added. Rules land in `daslib/*_lint.das` (authoring: `skills/internal/perf_lint_authoring.md` / `skills/internal/style_lint_authoring.md`), and the finding's error text must stand on its own - no per-rule doc catalog exists. +**Lint opportunities are reportable findings - don't hold back.** When a bug, review note, or probe reveals a pattern a mechanical check could catch (especially one that has bitten more than once), SAY SO in the end-of-turn summary and propose the rule to Boris; the suite keeps paying for itself precisely because rules keep getting added. Two landing places: a pattern one folder owns (a module's kernel classes, a test-folder discipline, a fixture-sync invariant) lands as a `REVIEW.das` gate in that folder - folder-local lint, and gate code worth writing shareably; a language- or repo-wide pattern lands in `daslib/*_lint.das` (authoring: `skills/internal/perf_lint_authoring.md` / `skills/internal/style_lint_authoring.md`). Either way the finding's error text must stand on its own - no per-rule doc catalog exists. **Syntax and factual corrections are fix-in-place, always.** A compiler error, probe, or user correction showing a claim in CLAUDE.md or `skills/*.md` is wrong, incomplete, or stale gets fixed in the same session and flagged in the end-of-turn summary - never deferred to a proposal. Verify first: grammar truth is `src/parser/ds2_parser.ypp`, behavior truth is a probe-compile with the current binary. diff --git a/LAWS.md b/LAWS.md index cc00a79fa6..cefaaa3045 100644 --- a/LAWS.md +++ b/LAWS.md @@ -30,3 +30,4 @@ compacted, or cited as rules. | 2026-08-28 | CLAUDE.md (document system), daslib/lint_config.das, utils/lint (LINT026 reverse + LINT027 arming), modules/dasLLAMA/.lint_config (deleted), utils/lint/README.md | "remove enable_arch link option entirely. its now mandatory." + "the idea is that arch lnks replace comments, where necessary" - the [arch] reverse pass runs in every folder with no tag; the LINT027 line gate arms on any folder holding a rule document; a citation replaces the comment that would restate the section (the harvester deletes the leftovers) | | 2026-08-28 | REVIEW_COMMON.md (harvest duty), ARCHITECTURE_COMMON.md (anchor form), .claude/agents/harvester.md (FACT names its citer), skills/internal/make_pr.md (row 0a0) | "i would like to ensure that harvested sections of architecture.md are linked to appropriate functions. im thinking a section in REVIEW_COMMON.md should be able to cover it" - a filed FACT lands as statement + anchor + citation from the source function in the same change; the harvester ledger names the citer or the fact is not filed | | 2026-08-28 | ARCHITECTURE_COMMON.md (anchor form), doc/source/reference/language/lint.rst (LINT026), skills/mcp_tools.md, utils/common/arch_citations.das, .github/workflows/extended_checks.yml (changed-set glob) | "should cite own subtree. if need citation outside - make citation in architecture.md in own subtree, in text form. not like automatic cross-link we resolve, but just a paragraph" + lint updated .md on CI, "skipping should be very cheap" - an [arch] citation must target a document whose folder is the citer folder or an ancestor; CI passes changed .md to the lint (a .md positional arms its folder with no .das compiled) | +| 2026-08-30 | CLAUDE.md (lint-opportunity routing) | "not really lint, right? review.das ... review.das is local lint in a sense - and its an interesting, potentially shareable gate code" - folder-owned patterns land as REVIEW.das gates, language/repo-wide ones in daslib/*_lint.das; the routing paragraph names both | diff --git a/modules/dasLLAMA/ARCHITECTURE_ENGINE.md b/modules/dasLLAMA/ARCHITECTURE_ENGINE.md index dac55550bf..ea966c28f4 100644 --- a/modules/dasLLAMA/ARCHITECTURE_ENGINE.md +++ b/modules/dasLLAMA/ARCHITECTURE_ENGINE.md @@ -7,11 +7,13 @@ Companion to `ARCHITECTURE.md`; section numbers are that document's. - **`dasllama.das`** - the public API facade and nothing else: `load_model` -> `create_session` -> generate, re-exported names, the doc surface. No engine logic; a function that does work belongs in the module that owns the concern, and the facade re-exports it. -- **`dasllama_version.das`** - `DASLLAMA_VERSION`, the module's own release counter, and nothing - else. Decoupled from the daslang version and from `LLVM_JIT_CODEGEN_VERSION`; ANY kernel work - bumps it (REVIEW.md), so equal versions mean an equal kernel roster - the sidecar exchange - keys validity on (version, box). A zero-require leaf so the tuner's noise half, the benches, - and the facade chain (`dasllama_common` re-exports it) all reach it without weight. +- **`dasllama_version.das`** - `DASLLAMA_RELEASE`, the module's release number, and nothing + else. Decoupled from the daslang version, `LLVM_JIT_CODEGEN_VERSION` and `IMAGE_VERSION`; + bumped only on a declared release (REVIEW.md), so tune sidecars and board rows live for a + whole release - the sidecar exchange keys validity on (release, box), under the + schema-stable wire name `dasllama_version`. A zero-require leaf so the tuner's noise half, + the benches, and the facade chain (`dasllama_common` re-exports it) all reach it without + weight. - **`dasllama_common.das`** - the engine: `Model`/`Session`/`Config`, the forward loops, the override registries, the runtime knobs. **Not** the load walk (sec.1.3) and **not** GPU residency (`ARCHITECTURE_GPU.md` sec.1.5) - both left, and the seam each left behind is a registered hook, diff --git a/modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md b/modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md index 59e66e1d5e..ef5b6398dd 100644 --- a/modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md +++ b/modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md @@ -56,11 +56,11 @@ full retune when no manifest is armed. `performance/last_known_good_sidecar.json exactly that: a frozen copy of a complete, noise-gated mint, tracked in git (the `*.tune.json` ignore rule deliberately does not match it). Point `DAS_TUNE_MANIFEST` at it and the framework never retunes; on a different box the identity mismatch just serves fallbacks, and a copy minted -before the current `DASLLAMA_VERSION` serves fallbacks on any box - the compile says which with +before the current `DASLLAMA_RELEASE` serves fallbacks on any box - the compile says which with one `WARNING DAS_TUNE_MANIFEST` line per scope. That is the whole contract - it suppresses the re-exec, it does not tune the box, and a number measured under it is not a benchmark. Benches and the rig keep minting their own; refresh the copy when a -re-mint moves the crowns or `DASLLAMA_VERSION` bumps. +re-mint moves the crowns or `DASLLAMA_RELEASE` bumps. ### 2.10 Sanctioned instrumentation rails diff --git a/modules/dasLLAMA/BRINGUP.md b/modules/dasLLAMA/BRINGUP.md index 8206505a8b..5dd4a7354c 100644 --- a/modules/dasLLAMA/BRINGUP.md +++ b/modules/dasLLAMA/BRINGUP.md @@ -59,8 +59,8 @@ The tuner is the detector, so the human never has to be. For a box with existing **Any dasLLAMA source edit between here and the sweep invalidates the exe** - it bakes both the sources and the tune winners, so the rig refuses a stale one and prints the rebuild line. Re-release with `--quick` (inherits the complete sidecar, ~85 s) and carry on; the full - mint is not repeated for a code edit. Exception: kernel work - its `DASLLAMA_VERSION` bump - makes every existing sidecar read version-stale, so that release re-mints. + mint is not repeated for a code edit. Exception: a declared `DASLLAMA_RELEASE` bump + makes every existing sidecar read release-stale, so that release re-mints. 4. **New box only:** the same big model vs llama.cpp (section 3 references) - when the absolutes have no history, the RATIO is the known quantity. @@ -96,8 +96,8 @@ which makes every cell silently re-bake its own duplicate images. The orchestrat env itself when unset, but the converter runs in step 4 need it exported in the shell. **Mint the tune BEFORE the pre-bake, and re-mint after ANY daslang rebuild.** The manifest is -mtime-gated against the binary and version-gated against `DASLLAMA_VERSION`: a rebuild or a -kernel-work bump turns it stale (the refusal names which) and every kernel drops to +mtime-gated against the binary and release-gated against `DASLLAMA_RELEASE`: a rebuild or a +release bump turns it stale (the refusal names which) and every kernel drops to its fallback winner - the m4 pilot pre-baked one identity, then swept a whole board on fallback kernels under a manifest one rebuild older. The bench cells REFUSE to measure on non-manifest winners (`tune gate`; `DASLLAMA_ALLOW_UNTUNED=1` is the dev-run escape - it also diff --git a/modules/dasLLAMA/LAWS.md b/modules/dasLLAMA/LAWS.md index fcb0686fef..cd0ccf97b8 100644 --- a/modules/dasLLAMA/LAWS.md +++ b/modules/dasLLAMA/LAWS.md @@ -39,3 +39,13 @@ `ARCHITECTURE.md` subsections cited from the owning functions via `[arch(at=...)]`, and the `cache_via_image` return contract promoted to a `//!` doc matching its sibling's wording. The module arms `[docs] enforce_arch = true` so every minted anchor stays cited. + +- **2026-08-30** (`REVIEW.md`, `ARCHITECTURE_ENGINE.md`, `ARCHITECTURE_MEASUREMENT.md`, + `performance/REVIEW.md`, `BRINGUP.md`): Boris ruled the version split - "separate dasLLAMA + version from all other versions. current one bumps version on any change. its inpractical. + we need 'major release' thing. otherwise ladderboard invalidates daily", approving the + minimal RELEASE form: "yes. this works for sure. it gives us flexibility we were missing". + `DASLLAMA_VERSION` became `DASLLAMA_RELEASE`, bumped only on a declared release; the + kernel-work bump duty in `REVIEW.md` was replaced by the declared-release rule; wire + field `dasllama_version` stays schema-stable; the per-kernel-hash hardening ledgered as + followup_general 58. diff --git a/modules/dasLLAMA/REVIEW.md b/modules/dasLLAMA/REVIEW.md index 349b52c290..2e646dd24f 100644 --- a/modules/dasLLAMA/REVIEW.md +++ b/modules/dasLLAMA/REVIEW.md @@ -52,12 +52,12 @@ not thereby pick up the other modality's checklist. **A routed file applies BOTH the checklist it routes to and this one; every other file under `modules/dasLLAMA/` applies this one.** -**Any kernel work bumps `DASLLAMA_VERSION` (`dasllama/dasllama_version.das`) in the same -change, and a bump with no kernel work is the same defect.** Kernel work is whatever changes -the generated kernel source, or the set of compiled pipeline variants (PSOs) built from it - -a kernel body, a variant set, or a `[tune]` / `[tune_perm]` / `[tune_companion]` grid. A -host-side bind or dispatch-argument change (an `@off` binding, a uniform value) is not, and -neither is `[tune_scope]` metadata (`covers=`, `tuner=`, `version_of=`). +**`DASLLAMA_RELEASE` (`dasllama/dasllama_version.das`) is bumped only on a declared release - +a maintainer ruling that bench comparability is broken - and a bump riding any other diff is +a defect.** Routine kernel work never bumps it: tune sidecars and board rows stay valid +across code changes (a changed kernel keeping a stale sidecar winner is perf-only drift - +crowns pick among envelope-verified twins), and per-change invalidation lives in the finer +mechanisms (`IMAGE_VERSION`, the reflected layout fingerprint). **A value that cannot change between dispatches of one compiled kernel never reaches that kernel as a uniform, a kargs field, an `@off` bind offset, or a helper parameter.** A value diff --git a/modules/dasLLAMA/benchmarks/lcpp_bench.das b/modules/dasLLAMA/benchmarks/lcpp_bench.das index c43d96e40d..812381b1a1 100644 --- a/modules/dasLLAMA/benchmarks/lcpp_bench.das +++ b/modules/dasLLAMA/benchmarks/lcpp_bench.das @@ -275,7 +275,7 @@ def private asr_measure_spec(spec : AsrModelSpec; reps, threads : int; var jsonM workload = asr_workload(spec), box = box_name(), threads = threads, date = format_time(get_clock(), "%Y-%m-%d"), cmd = bench_cmd_line(), env = bench_env_line(), sha = run_capture("git rev-parse --short=9 HEAD", true), version = das_version(), - dasllama_version = DASLLAMA_VERSION, + dasllama_version = DASLLAMA_RELEASE, tune = tune_summary(), tune_sha = tune_manifest_sha(), noise = tune_manifest_noise(), hardware = gather_hardware()) run.files |> emplace(file_identity(model_path, "weights")) @@ -553,7 +553,7 @@ def private image_cell_main(model, mmproj, image, prompt, json_path : string; re workload = "image-chat", box = box_name(), threads = threads, date = format_time(get_clock(), "%Y-%m-%d"), cmd = bench_cmd_line(), env = bench_env_line(), sha = run_capture("git rev-parse --short=9 HEAD", true), version = das_version(), - dasllama_version = DASLLAMA_VERSION, + dasllama_version = DASLLAMA_RELEASE, tune = tune_summary(), tune_sha = tune_manifest_sha(), noise = tune_manifest_noise(), hardware = gather_hardware(), files <- [file_identity(model, "weights"), file_identity(mmproj, "mmproj"), @@ -1680,7 +1680,7 @@ def main() : int { env = bench_env_line(), sha = run_capture("git rev-parse --short=9 HEAD", true), version = das_version(), - dasllama_version = DASLLAMA_VERSION, + dasllama_version = DASLLAMA_RELEASE, tune = tune_summary(), tune_sha = tune_manifest_sha(), noise = tune_manifest_noise(), diff --git a/modules/dasLLAMA/dasllama/dasllama_common.das b/modules/dasLLAMA/dasllama/dasllama_common.das index 99d5df7740..ab0de58a23 100644 --- a/modules/dasLLAMA/dasllama/dasllama_common.das +++ b/modules/dasLLAMA/dasllama/dasllama_common.das @@ -6,7 +6,7 @@ module dasllama_common shared public require dasllama/dasllama_lint public require daslib/fio -require dasllama/dasllama_version public // DASLLAMA_VERSION — re-exported so the facade chain carries the module's release counter +require dasllama/dasllama_version public // DASLLAMA_RELEASE — re-exported so the facade chain carries the module's release counter require dasllama/dasllama_env // the g_env_* knob globals ([EnvConfig] declarations; ENVIRONMENT.md is generated from them) require dasllama/dasllama_config // DlimConfiguration — this module registers the cpu/metal sources require dasllama/dasllama_kqformat public // KqFmt + kq_sb + the stride truth — re-exported so every requirer keeps seeing the enum diff --git a/modules/dasLLAMA/dasllama/dasllama_exchange.das b/modules/dasLLAMA/dasllama/dasllama_exchange.das index 3a3b93c95d..493c6e5fc5 100644 --- a/modules/dasLLAMA/dasllama/dasllama_exchange.das +++ b/modules/dasLLAMA/dasllama/dasllama_exchange.das @@ -6,7 +6,7 @@ module dasllama_exchange shared public require dasllama/dasllama_lint public require dasllama/dasllama_exchange_schema public // SidecarInfo/BoxIdentity + the validators -require dasllama/dasllama_version // DASLLAMA_VERSION — the exchange lookup key +require dasllama/dasllama_version // DASLLAMA_RELEASE — the exchange lookup key require dasllama/dasllama_env // g_env_exchange — the env override rail require llvm/daslib/llvm_tune // box identity, manifest path, the scope-resolver seam require dashv/dashv_boost // outbound HTTP + url_encode @@ -213,7 +213,7 @@ def private exchange_write_applied(text : string; sha, doc_box, manifest_path, l } //! Download sidecar `sha` and adopt it as the sidecar at `manifest_path`, behind the full -//! client-side gate: content hash, schema, `DASLLAMA_VERSION` (the load-bearing staleness +//! client-side gate: content hash, schema, `DASLLAMA_RELEASE` (the load-bearing staleness //! check — the mtime rail reads any fresh download as valid), optional listing-box match. //! Returns "" on success, else the refusal reason. Never trusts the exchange. def exchange_fetch_and_apply(base_url : string; sha : string; manifest_path : string; @@ -236,8 +236,8 @@ def exchange_fetch_and_apply(base_url : string; sha : string; manifest_path : st if (!parse_sidecar_info(text, info)) { return "malformed sidecar" } - if (info.dasllama_version != DASLLAMA_VERSION) { - return "made for dasllama version {info.dasllama_version}, this engine is {DASLLAMA_VERSION}" + if (info.dasllama_version != DASLLAMA_RELEASE) { + return "made for dasllama version {info.dasllama_version}, this engine is {DASLLAMA_RELEASE}" } if (!empty(expected_box) && info.box != expected_box) { return "box does not match the listing" @@ -469,19 +469,19 @@ def private exchange_scope_resolver(scope_name : string; manifest_path : string; return false } let box = tune_box_identity() - print("exchange: scope '{scope_name}' is untuned - looking up a sidecar for this box (dasllama version {DASLLAMA_VERSION})\n") - sc_event("lookup", "version={DASLLAMA_VERSION}") + print("exchange: scope '{scope_name}' is untuned - looking up a sidecar for this box (dasllama version {DASLLAMA_RELEASE})\n") + sc_event("lookup", "version={DASLLAMA_RELEASE}") var hits : array defer() { delete hits } - if (!exchange_lookup(policy.url, DASLLAMA_VERSION, box, hits)) { + if (!exchange_lookup(policy.url, DASLLAMA_RELEASE, box, hits)) { print("exchange: {policy.url} is unreachable - tuning locally\n") sc_event("none", "reason=unreachable") return false } if (empty(hits)) { - print("exchange: nobody has shared a sidecar for this box yet (version {DASLLAMA_VERSION}) - tuning locally\n") + print("exchange: nobody has shared a sidecar for this box yet (version {DASLLAMA_RELEASE}) - tuning locally\n") sc_event("none", "reason=no_hits") return false } @@ -686,14 +686,14 @@ def exchange_status_json(policy : ExchangePolicy) : string { } cur_tab |> insert("shared", JV(state_submitted_for(manifest) == sha256_hex(text))) cur_tab |> insert("local", JV(parsed && box_match_key(info.box) == box_match_key(tune_box_identity()) && sidecar_origin(text) != "exchange")) - cur_tab |> insert("version_ok", JV(info.dasllama_version == DASLLAMA_VERSION)) + cur_tab |> insert("version_ok", JV(info.dasllama_version == DASLLAMA_RELEASE)) } var top <- { "policy" => JV((url = policy.url, accept = policy.accept, submit = policy.submit, configured = policy.configured)), "consent" => JV(exchange_consent_status()), "consent_notice" => JV(EXCHANGE_CONSENT_NOTICE), - "engine_version" => JV(int64(DASLLAMA_VERSION)), + "engine_version" => JV(int64(DASLLAMA_RELEASE)), "box" => JV(tune_box_identity()), "manifest" => JV(manifest), "current" => JV(cur_tab) @@ -708,7 +708,7 @@ def exchange_status_json(policy : ExchangePolicy) : string { //! owns when that is acceptable). `{reachable, version, hits:[...]}` in the ladder's order. def exchange_matches_json(policy : ExchangePolicy) : string { var hits : array - let ok = exchange_lookup(policy.url, DASLLAMA_VERSION, tune_box_identity(), hits) + let ok = exchange_lookup(policy.url, DASLLAMA_RELEASE, tune_box_identity(), hits) var arr : array arr |> reserve(length(hits)) for (h in hits) { @@ -716,7 +716,7 @@ def exchange_matches_json(policy : ExchangePolicy) : string { noise = h.noise, written = h.written, kernel_count = int64(h.kernel_count), engine_sha = h.engine_sha, dasllama_version = int64(h.dasllama_version)))) } - var doc = JV((reachable = ok, version = int64(DASLLAMA_VERSION), hits = JV(arr))) + var doc = JV((reachable = ok, version = int64(DASLLAMA_RELEASE), hits = JV(arr))) let out = write_json_compact(doc) delete_json(doc) delete hits @@ -738,10 +738,10 @@ def exchange_boot_submit_check(policy : ExchangePolicy) { || sidecar_origin(text) == "exchange") { return } - if (info.dasllama_version != DASLLAMA_VERSION) { - // the version keys EXCHANGE validity only (the local rail keys on mtime + box) — say why - // this box's sidecar quietly stops being offered after an engine version bump - to_log(LOG_INFO, "dasllama exchange: local sidecar is v{info.dasllama_version}, engine is v{DASLLAMA_VERSION} - not offered for submission (re-tune to publish)\n") + if (info.dasllama_version != DASLLAMA_RELEASE) { + // the release keys EXCHANGE validity only (the local rail keys on mtime + box) — say why + // this box's sidecar quietly stops being offered after a release bump + to_log(LOG_INFO, "dasllama exchange: local sidecar is v{info.dasllama_version}, engine is v{DASLLAMA_RELEASE} - not offered for submission (re-tune to publish)\n") return } let raw_sha = sha256_hex(text) diff --git a/modules/dasLLAMA/dasllama/dasllama_math_gen.das b/modules/dasLLAMA/dasllama/dasllama_math_gen.das index a41db57bea..c7e75be3ed 100644 --- a/modules/dasLLAMA/dasllama/dasllama_math_gen.das +++ b/modules/dasLLAMA/dasllama/dasllama_math_gen.das @@ -16,7 +16,7 @@ require dasllama/dasllama_gemm_schema require daslib/jobque_boost public require dasllama/dasllama_par require dasllama/dasllama_env // DASLLAMA_ALLOW_UNTUNED wires tune_suppress_mint at [init] -require dasllama/dasllama_version // nolint:STYLE030 — version_of= below names DASLLAMA_VERSION by string; the module must be in this compile +require dasllama/dasllama_version // nolint:STYLE030 — version_of= below names DASLLAMA_RELEASE by string; the module must be in this compile require math // The GEMM family as a [tune] client (gemm_generator_plan.md part 3; promoted from the M2 @@ -56,7 +56,7 @@ require math // entries for (the completeness set — drift shows up as a loud "missing:" list at startup). [tune_scope(name = "dasllama", tuner = "../harness/dasllama_tuner.das", covers = "dasllama_math;dasllama_math_default;dasllama_math_aarch64_neon;dasllama_kv_codec;dasllama_convert", - version_of = "dasllama_version/DASLLAMA_VERSION")] + version_of = "dasllama_version/DASLLAMA_RELEASE", version_key = "dasllama_version")] struct private DasllamaTuneScope {} //! The layout companion (six-function stamp): the repack interleave (mr) the stamped tile reads. diff --git a/modules/dasLLAMA/dasllama/dasllama_version.das b/modules/dasLLAMA/dasllama/dasllama_version.das index 2dde677409..8c21045d04 100644 --- a/modules/dasLLAMA/dasllama/dasllama_version.das +++ b/modules/dasLLAMA/dasllama/dasllama_version.das @@ -6,7 +6,11 @@ module dasllama_version shared public require dasllama/dasllama_lint public -//! dasLLAMA's release counter — decoupled from the daslang version and LLVM_JIT_CODEGEN_VERSION. -//! ANY kernel work bumps it (REVIEW.md): equal versions mean an equal kernel roster, and the -//! sidecar exchange keys validity on (version, box). Bench records and sidecar provenance carry it. -let DASLLAMA_VERSION = 15 // v15: merged rosters - the M5 tower flash lineage (its v13-v14) and the vulkan MoE decode arc (master's v13) numbered independently +//! dasLLAMA's RELEASE number — decoupled from the daslang version, LLVM_JIT_CODEGEN_VERSION +//! and IMAGE_VERSION. Bumped ONLY on a declared release: when the maintainer rules that bench +//! comparability is broken and the leaderboard must re-mint. Routine kernel work does NOT bump +//! it — per-change invalidation lives in finer mechanisms (IMAGE_VERSION and the reflected +//! layout fingerprint for images; kernel-identity hashing for tune winners when it lands). +//! Tune sidecars scope on it, the sidecar exchange keys validity on (release, box), and bench +//! records carry it — all under the wire name `dasllama_version`, which is schema-stable. +let DASLLAMA_RELEASE = 15 // release 15 == the last DASLLAMA_VERSION value, so every v15 artifact stays valid across the rename diff --git a/modules/dasLLAMA/followup_general.md b/modules/dasLLAMA/followup_general.md index df9d7113d0..744f1481eb 100644 --- a/modules/dasLLAMA/followup_general.md +++ b/modules/dasLLAMA/followup_general.md @@ -505,7 +505,7 @@ - **`check_committed_records` gate in `performance/REVIEW.das`** (fused-image-span review round): machine-check the two records-provenance rules - every `runs[]` row's `hardware.remote_desktop == "off"`, every row `sha` and sidecar `provenance.engine_sha` - an ancestor of HEAD, and `provenance.dasllama_version` equal to `DASLLAMA_VERSION` at that + an ancestor of HEAD, and `provenance.dasllama_version` equal to `DASLLAMA_RELEASE` at that commit. When it lands, the two prose rules in `performance/REVIEW.md` collapse to the "weakening that gate is a defect" residue form. Also owed: a re-mint of the gemma-3-4b cpu image row (hand-minted in the gemma3v arc; still stamps `parsec` + a pre-branch sha, and @@ -665,3 +665,14 @@ before the widening - headroom-only today (whisper large-v3's twin is ~632M elements). Done = `long_length` overloads in `dasllama_plane` and the buffer-sizing call sites moved onto them. + +58. **Per-entry kernel-identity hashes in llvm_tune - the fine invalidation the release + split trades away.** With tune sidecars scoped to `DASLLAMA_RELEASE` (bumped only on a + declared release), a kernel changed mid-release keeps its stale sidecar winner - accepted + as perf-only drift (crowns pick among envelope-verified twins; races re-verify at mint). + The principled hardening: each sidecar kernel entry carries its kernel's identity hash + (the per-function AOT semantic hash the JIT dll cache already folds - in-tree precedent), + and a mismatching entry alone re-races or falls back while the rest of the sidecar stays + valid. A generic llvm_tune feature, useful beyond dasLLAMA. Done = entry-level staleness + by kernel hash, the release scope untouched, and the refusal-reason rail naming + "kernel-hash" beside the existing reasons. diff --git a/modules/dasLLAMA/harness/tuner_noise.das b/modules/dasLLAMA/harness/tuner_noise.das index 2d9365eef0..9827fc1330 100644 --- a/modules/dasLLAMA/harness/tuner_noise.das +++ b/modules/dasLLAMA/harness/tuner_noise.das @@ -12,7 +12,7 @@ module tuner_noise shared public require dasllama/dasllama_lint public require llvm/daslib/llvm_tune -require dasllama/dasllama_version // DASLLAMA_VERSION — stamped into sidecar provenance (zero-require leaf) +require dasllama/dasllama_version // DASLLAMA_RELEASE — stamped into sidecar provenance (zero-require leaf) require tuner_phrases // provenance phrase leaf — render-charset-pinned by test_exchange_schema require daslib/strings_boost require daslib/fio // popen + get_das_root — the engine-sha probe @@ -172,7 +172,7 @@ def noise_provenance_stamp() { tune_provenance_note("noise_floor_cv_pct", "{g_floor_pct:0.2f}") tune_provenance_note("mode", "normal") // one protocol; the key stays for readers of older sidecars tune_provenance_note("engine_sha", engine_sha()) - tune_provenance_note("dasllama_version", "{DASLLAMA_VERSION}") + tune_provenance_note("dasllama_version", "{DASLLAMA_RELEASE}") } // the engine commit this mint measured, "unknown" outside a repo (the shipped SDK) diff --git a/modules/dasLLAMA/performance/REVIEW.md b/modules/dasLLAMA/performance/REVIEW.md index f66082236f..fcc230bf26 100644 --- a/modules/dasLLAMA/performance/REVIEW.md +++ b/modules/dasLLAMA/performance/REVIEW.md @@ -25,8 +25,8 @@ naming the re-stamp.** The commit stamps are a `das` row's `sha` and a sidecar's (`DEFAULT_REF_SHA`, `../benchmarks/setup_lcpp_ref.das`) is a defect - re-mint.** **A diff that writes a sidecar to `records/` whose `provenance.dasllama_version` differs from -`DASLLAMA_VERSION` (`../dasllama/dasllama_version.das`) is a defect - re-mint.** Read -`DASLLAMA_VERSION` at the commit the sidecar's `provenance.engine_sha` names. +`DASLLAMA_RELEASE` (`../dasllama/dasllama_version.das`) is a defect - re-mint.** Read +`DASLLAMA_RELEASE` at the commit the sidecar's `provenance.engine_sha` names. **A diff that writes a row to `records/.json` mints that row from a board cell.** A board cell is one `gen_bench_records.das` spawns, or a manual `../benchmarks/lcpp_bench.das` cell @@ -48,7 +48,7 @@ submit) goes through `../dasllama/dasllama_exchange.das`.** The mechanical half `dashv` requirer under the module) is `REVIEW.das`'s to enforce. **Weakening the exchange download gate, the submission strip, or the submit rails is a -defect.** The download gate checks content sha, schema, and `DASLLAMA_VERSION`. The submit +defect.** The download gate checks content sha, schema, and `DASLLAMA_RELEASE`. The submit rails stop a sidecar that came from the exchange, or was minted on another box, from being submitted. `utils/dasllama-server/test_exchange_client.das` enforces the download gate, the strip, and the rails. diff --git a/modules/dasLLAMA/release_remint_plan.md b/modules/dasLLAMA/release_remint_plan.md new file mode 100644 index 0000000000..8d87f5e827 --- /dev/null +++ b/modules/dasLLAMA/release_remint_plan.md @@ -0,0 +1,106 @@ +# The release-split + coverage + arc-end re-mint arc + +Branch `bbatkin/release-remint` off master 507362fd9 (PR #3905 merged). Three ruled jobs: +the version split (so the board survives routine changes), the m5-image arc's coverage debt, +and the arc-end board re-mint on the b10659 ref pin. One PR. + +## Rulings (Boris, 2026-08-30) + +- The gate candidates from the m5-image round are REVIEW.das-shaped, not daslib lints — + assess scope first (step 0); update the CLAUDE.md routing wording so "lint opportunities" + can land as folder-local REVIEW.das gates. No strong opinion on which land in this arc. +- Plane `long_length` (followup 57) rides this arc. +- M4 re-mints its canary rows + proves the Efficiency-tier gate. M1 gets NO runs + ("we've measured multiple times") — its stale canary rows retire. +- The version split is approved in the minimal RELEASE form: "it gives us flexibility we + were missing". Leaderboard must stop invalidating on every bump — a 'major release' + scope, declared by Boris, not derived from diffs. + +## Slice V — the release split (FIRST: the re-mint must land on the new scope) + +Recon facts: `DASLLAMA_VERSION` (dasllama_version.das:12, v15) is consumed ONLY by the tune +scope (`dasllama_math_gen.das` `version_of=`), the sidecar exchange (`dasllama_exchange.das` +accept/lookup/submit), records stamping (`lcpp_bench.das` x3, `tuner_noise.das` provenance +note) and tests. Dlim identity never reads it — `IMAGE_VERSION` (dasllama_image.das) is a +separate per-change counter and stays exactly as it is. + +- Rename `DASLLAMA_VERSION` -> `DASLLAMA_RELEASE`, value stays 15 (existing v15 artifacts + remain valid; older sidecars refuse as before). The rename is deliberate: the bump duty + changes from "ANY kernel work bumps it" to "bumped only when Boris declares comparability + broken", and the old spelling breaking loudly is the sweep guarantee. +- Wire/schema field names (`dasllama_version` in exchange JSON, sidecar provenance, bench + records) KEEP their spelling — they now carry the release number; no schema break. +- Docs sweep: the bump-duty rule in `REVIEW.md`, plus mentions in `ARCHITECTURE_ENGINE.md`, + `ARCHITECTURE_MEASUREMENT.md`, `performance/REVIEW.md`, `BRINGUP.md`, ladder + README/REVIEW, server README. +- Hazard accepted (ruled): within a release a changed kernel can keep a stale sidecar winner + — perf-only drift (crowns pick twins; races verified the envelope at mint). The principled + hardening — per-entry kernel identity hashes in llvm_tune, the JIT-dll-cache + self-invalidation pattern — is ledgered as its own generic llvm_tune item, not blocking. +- LAWS.md entries for the ruling (module folder + repo root for the CLAUDE.md wording). + +## Step 0 — gate-candidate scope assessment (DONE, 2026-08-30) + +- **tgmem-less `@workgroup` class: not a gate — a LENS fix, rides this arc.** The + `[metal_dispatch]` apply already reads `tgmem=` (dasllama_metal_lens.das:236) and collects + `@workgroup` members (sec.292); `@workgroup` always rides the DYNAMIC shmem buffer + (msl_emit wg_bytes/wg_off), so a dispatch without `tgmem=` on such a class is always the + qk_rope bug. Fix: auto-default `tgmem=` to the generated `*_msl_tgmem` constant when the + class has `@workgroup` members (explicit arg still overrides); omission becomes + impossible at compile. Audit existing omission sites during implementation. +- **tests/msl fail-closed fixture sync (followup 45): REVIEW.das cell, rides this arc.** + `modules/dasMetal/REVIEW.das` already exists (the RP law) — the followup's "creates it" + clause is stale; add the list-A-equals-list-B cell (~30 lines). +- **`set_*`/`reset_*` pin-leak walk: parked, own PR.** Needs an exception list (tests whose + subject IS the pin) — judgment-laden, a modules/dasLLAMA/tests REVIEW.das walk when done. +- **gemm_f32 into an ensure_length'd target: parked with spec, own PR.** Function-local + dataflow heuristic (target allocated un-zeroed in the same function, no zero/fill before + the accumulate) — highest false-positive risk of the four. + +## Slice A — census tower rows (tests/test_kernel_coverage.das) + +`cov_tower` exists (whisper-mixed, gemma4uv, gemma4v, gemma3v, qwen3a-conv). Missing rows +for the arc's kernel families: gemma4a Conformer, canary FastConformer (q8 decoder +artifact), qwen25v window ViT (win_attn + row_gather), qwen3v GPU stem, and a +tower-flash-eligible leg (hs 72, npos%64==0 -> flash + kv_hc). Reconcile against the census +NEVER-DISPATCHED report; blind-spot entries move onto real rows. + +## Slice B — cell plumbing + followup 57 + +- `gen_bench_records.das:1015` `is_metal_served_family` keys on Whisper alone -> extend to + the four new servable capabilities (canary Q8_0 decoder lane, canary Metal FastConformer, + gemma4a/qwen3a Metal rail, qwen25v Metal tower) + whatever catalog/spec rows the canary + Q8_0 artifact needs. Receipt/anti-sandbag arms follow the whisper shape. +- Followup 57: `long_length` overloads for the Plane types in `dasllama_plane`, buffer-sizing + call sites moved onto them. +- Retire the stale `records/m1.json` canary rows (they pin the deleted + `canary-qwen-2.5b-decoder-f16.gguf`; no M1 runs by ruling). + +## Slice C — fresh tune manifests on M5 (quiet box) + +`benchmarks/lcpp_bench.tune.json` (v14) + the rig sidecar `performance/m5.tune.json` (v9!) +re-mint under the new release scope; refresh `last_known_good_sidecar.json`. Sanity floor +first; never `--quick` (followup 32); no rebuilds mid-race. + +## Slice D — the full M5 board re-mint (ref pin b10659) + +clean-cpu + stock ref builds already minted in `llama.cpp-ref-6fdd0ac`. das cpu vs +clean-cpu, das `--accel` vs stock, the Metal text/image/audio boards, the four new cells +from slice B minted here. Parity pregate per row; predictions logged before each cell; one +process per box, cv>3% void; `gen_site_records` closes it. Full board on one pin = one +provenance (the v14/fallback-stamp taint is not per-cell diagnosable). + +## Slice E — M4 over ssh + +Canary rows re-mint (Q8_0 decoder artifact) + the Efficiency-tier gate proof: live-lane +print shows the fast-tier-only pool, pp/tg spot-check against existing rows within cv. + +## Done + +- Tune sidecars and board rows survive routine version-less changes; only a declared + release invalidates them. +- Census NEVER-DISPATCHED list holds only entries with no stockable carrier. +- Board fully re-minted on b10659 under release scope; site regenerated; M4 canary rows + fresh; M1 canary rows retired. +- Ledger updates: memory `test_coverage_debt.md` items closed; llvm_tune per-kernel-hash + hardening ledgered. diff --git a/modules/dasLLAMA/tests/test_bench_records_schema.das b/modules/dasLLAMA/tests/test_bench_records_schema.das index 735ca009f9..9da6ddf2f8 100644 --- a/modules/dasLLAMA/tests/test_bench_records_schema.das +++ b/modules/dasLLAMA/tests/test_bench_records_schema.das @@ -23,7 +23,7 @@ def private make_asr_run(engine, workload : string) : BenchRun { cmd = "test-cmd", noise = engine == "das" ? "ok" : "", parity = engine == "das" ? "ok" : "", - dasllama_version = engine == "das" ? DASLLAMA_VERSION : 0, + dasllama_version = engine == "das" ? DASLLAMA_RELEASE : 0, versions = engine == "das" ? "" : "whisper.cpp @ abcdef123") r.tests |> insert("asr:jfk.wav", BenchTest(ms = 197.1lf, audio_s = 11.0lf)) r.tests |> insert("asr:gb1.wav", BenchTest(ms = 6585.0lf, audio_s = 198.7lf)) @@ -60,7 +60,7 @@ def test_asr_round_trip(t : T?) { t |> equal(back[0].runs[0].parity, "ok") t |> equal(back[0].runs[1].parity, "") // the engine's own release counter: stamped on das rows, absent (0) on reference rows - t |> equal(back[0].runs[0].dasllama_version, DASLLAMA_VERSION) + t |> equal(back[0].runs[0].dasllama_version, DASLLAMA_RELEASE) t |> success(back[0].runs[0].dasllama_version >= 1, "the counter starts at 1 - 0 means unstamped") t |> equal(back[0].runs[1].dasllama_version, 0) remove(TMP) diff --git a/modules/dasLLAMA/tests/test_dasllama_lint_escape.das b/modules/dasLLAMA/tests/test_dasllama_lint_escape.das index ec4ad33a97..870fbfe1b7 100644 --- a/modules/dasLLAMA/tests/test_dasllama_lint_escape.das +++ b/modules/dasLLAMA/tests/test_dasllama_lint_escape.das @@ -7,6 +7,6 @@ require dasllama/dasllama_version [test] def test_lint_escape(t : T?) { t |> run("options _dasllama_internal admits a direct engine require") @(t : T?) { - t |> success(DASLLAMA_VERSION >= 4, "engine version constant readable through the direct require") + t |> success(DASLLAMA_RELEASE >= 4, "engine version constant readable through the direct require") } } diff --git a/modules/dasLLAMA/tests/test_exchange_schema.das b/modules/dasLLAMA/tests/test_exchange_schema.das index 52eac6744b..02ae6f8759 100644 --- a/modules/dasLLAMA/tests/test_exchange_schema.das +++ b/modules/dasLLAMA/tests/test_exchange_schema.das @@ -86,7 +86,7 @@ def test_corpus_sidecars(t : T?) { def private make_das_run() : BenchRun { var r = BenchRun(engine = "das", backend = "cpu", flavor = "tuned", box = "testbox", threads = 8, date = "2026-08-10", cmd = "daslang -jit bench.das", env = "DASLLAMA_BOX=test", - sha = "abc123def", version = "0.6.4", dasllama_version = DASLLAMA_VERSION, + sha = "abc123def", version = "0.6.4", dasllama_version = DASLLAMA_RELEASE, tune = "k4q8_tile_gen=mr8 (manifest)", tune_sha = "cafe0123beef", exec_fmt = "q8 blob") r.hardware.cpu = "Test CPU 9000" r.tests |> insert("pp512", BenchTest(tok_s = 100.0lf, stddev = 1.0lf)) diff --git a/plans/dasllama_io_site.md b/plans/dasllama_io_site.md index b6ffa28b5f..f9d2a91652 100644 --- a/plans/dasllama_io_site.md +++ b/plans/dasllama_io_site.md @@ -28,6 +28,11 @@ from the first commit, watchdog contract, ndjson logging). ## Versioning decisions (Boris, 2026-08-10) +> SUPERSEDED 2026-08-30 (the release-split arc): the constant is now `DASLLAMA_RELEASE`, +> bumped ONLY on a declared release - routine kernel work no longer bumps it, so sidecars +> and board rows live for a whole release. Wire field `dasllama_version` unchanged. The +> per-kernel partial re-race below remains the ledgered hardening (followup_general 58). + - **dasLLAMA gets its own version**, decoupled from daslang's version AND from `LLVM_JIT_CODEGEN_VERSION`. **Any kernel work bumps it.** The rule is enforced in `modules/dasLLAMA/REVIEW.md`; the constant (`DASLLAMA_VERSION`) lands in the same diff --git a/utils/dasllama-server/README.md b/utils/dasllama-server/README.md index 7183e31e85..c3412fb47f 100644 --- a/utils/dasllama-server/README.md +++ b/utils/dasllama-server/README.md @@ -197,7 +197,7 @@ Windows locks the DLLs. | `POST` | `/restart` | Drain like `/shutdown`, then exit with code **4** - the watchdog relaunches, picking up the saved config (3 stays the tune-restart code) | | `GET` | `/exchange` | The sidecar-exchange surface: policy (url/accept/submit/configured), the consent state (`consent`: accepted/declined/empty, `consent_notice`: the first-contact text), + the current tune sidecar's identity and share state (sha, origin, box/applied_box, version gate, shared-yet) | | `GET` | `/exchange/matches` | Live lookup of this box against the exchange (a network call - seconds; the control page requests it explicitly) | -| `POST` | `/exchange/apply` | `{"sha": ...}`: download + validate (content sha, schema, `DASLLAMA_VERSION`) + adopt that sidecar, then drain and exit **4** so the relaunch stamps its winners | +| `POST` | `/exchange/apply` | `{"sha": ...}`: download + validate (content sha, schema, `DASLLAMA_RELEASE`) + adopt that sidecar, then drain and exit **4** so the relaunch stamps its winners | | `POST` | `/exchange/submit` | Privacy-strip and submit this box's own tune to the exchange (refuses exchange-sourced or foreign-box sidecars) | | `POST` | `/exchange/retune` | Arm a local re-tune: removes the sidecar, skips the exchange once, restarts - the next boot races this box (~12 min, quiet machine) | | `POST` | `/exchange/consent` | `{"accept": true\|false}`: record the first-contact choice (the GDPR gate below); replies `{ok, accepted, restarting?}`. Accept on an untuned/stale box drains and exits **4** so the relaunch runs the lookup | diff --git a/utils/dasllama-server/test_exchange_client.das b/utils/dasllama-server/test_exchange_client.das index b8f54de32f..ac459b1a76 100644 --- a/utils/dasllama-server/test_exchange_client.das +++ b/utils/dasllama-server/test_exchange_client.das @@ -3,7 +3,7 @@ options persistent_heap require dastest/testing_boost public require dasllama/dasllama_exchange -require dasllama/dasllama // DASLLAMA_VERSION — the fixture stamps (facade-public) +require dasllama/dasllama // DASLLAMA_RELEASE — the fixture stamps (facade-public) require dashv/dashv_boost require llvm/daslib/llvm_tune require daslib/jobque_boost @@ -46,13 +46,13 @@ def sibling_box : string { } def verified_doc : string - => fixture_sidecar(tune_box_identity(), DASLLAMA_VERSION, "vec16") + => fixture_sidecar(tune_box_identity(), DASLLAMA_RELEASE, "vec16") def crossbox_doc : string - => fixture_sidecar(sibling_box(), DASLLAMA_VERSION, "vec8_u4") + => fixture_sidecar(sibling_box(), DASLLAMA_RELEASE, "vec8_u4") def oldversion_doc : string - => fixture_sidecar(tune_box_identity(), DASLLAMA_VERSION + 1, "vec16") + => fixture_sidecar(tune_box_identity(), DASLLAMA_RELEASE + 1, "vec16") def tamper_sha : string => sha256_hex("tampered") @@ -80,12 +80,12 @@ class FakeExchange : HvWebServer { JV((sha = sha256_hex(xdoc), box = sibling_box(), tier = "cpu", verified = false, noise = "ok", written = "2026-08-11T00:00:00Z", kernel_count = 2, engine_sha = "8a538d795", - dasllama_version = DASLLAMA_VERSION, url = "/api/sidecar/{sha256_hex(xdoc)}")), + dasllama_version = DASLLAMA_RELEASE, url = "/api/sidecar/{sha256_hex(xdoc)}")), JV((sha = sha256_hex(vdoc), box = tune_box_identity(), tier = "exact", verified = true, noise = "ok", written = "2026-08-11T00:00:00Z", kernel_count = 2, engine_sha = "8a538d795", - dasllama_version = DASLLAMA_VERSION, url = "/api/sidecar/{sha256_hex(vdoc)}"))] - var top = JV((version = DASLLAMA_VERSION, hits = JV(hits))) + dasllama_version = DASLLAMA_RELEASE, url = "/api/sidecar/{sha256_hex(vdoc)}"))] + var top = JV((version = DASLLAMA_RELEASE, hits = JV(hits))) g_hits_body = write_json(top) delete_json(top) GET("/api/sidecars") <| @(var req : HttpRequest?; var resp : HttpResponse?) : http_status { @@ -214,7 +214,7 @@ def test_lookup_and_pick(t : T?) { with_fake_exchange() $(base_url) { t |> run("lookup parses the ladder response") @(tt : T?) { var hits : array - tt |> success(exchange_lookup(base_url, DASLLAMA_VERSION, tune_box_identity(), hits)) + tt |> success(exchange_lookup(base_url, DASLLAMA_RELEASE, tune_box_identity(), hits)) tt |> equal(length(hits), 2) tt |> equal(hits[0].tier, "cpu") tt |> success(!hits[0].verified, "sibling hit is unverified") @@ -222,7 +222,7 @@ def test_lookup_and_pick(t : T?) { tt |> success(hits[1].verified, "exact hit is verified") tt |> equal(hits[1].sha, sha256_hex(verified_doc())) tt |> equal(hits[1].kernel_count, 2) - tt |> equal(hits[1].dasllama_version, DASLLAMA_VERSION) + tt |> equal(hits[1].dasllama_version, DASLLAMA_RELEASE) // the pick: verified skips the unverified head; any takes it tt |> equal(exchange_pick(hits, "verified"), 1) tt |> equal(exchange_pick(hits, "any"), 0) @@ -230,7 +230,7 @@ def test_lookup_and_pick(t : T?) { } t |> run("lookup fails loudly on transport") @(tt : T?) { var hits : array - tt |> success(!exchange_lookup("http://127.0.0.1:1", DASLLAMA_VERSION, tune_box_identity(), hits)) + tt |> success(!exchange_lookup("http://127.0.0.1:1", DASLLAMA_RELEASE, tune_box_identity(), hits)) delete hits } } @@ -309,7 +309,7 @@ def test_privacy_strip(t : T?) { binary = "/Users/borisbatkin/bin/daslang", weird = "C:\\Users\\bob\\thing", noise = "ok", - dasllama_version = "{DASLLAMA_VERSION}"))) + dasllama_version = "{DASLLAMA_RELEASE}"))) let text = write_json(doc) delete_json(doc) let stripped = exchange_strip_private(text) @@ -327,14 +327,14 @@ def test_privacy_strip(t : T?) { } t |> run("a slash in the box identity is not a path") @(tt : T?) { let apu_box = "linux|x86_64||6.1.0-49-amd64|AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics" - let stripped = exchange_strip_private(fixture_sidecar(apu_box, DASLLAMA_VERSION, "vec16")) + let stripped = exchange_strip_private(fixture_sidecar(apu_box, DASLLAMA_RELEASE, "vec16")) tt |> success(find(stripped, apu_box) >= 0, "box survives") var errs : array tt |> success(validate_sidecar_submission(stripped, errs), "box intact, so the doc is still submission-grade") delete errs } t |> run("a path smuggled into the identity keys is still stripped") @(tt : T?) { - let smuggled = exchange_strip_private(fixture_sidecar("linux|x86_64||6.1|/home/alice/tool", DASLLAMA_VERSION, "vec16")) + let smuggled = exchange_strip_private(fixture_sidecar("linux|x86_64||6.1|/home/alice/tool", DASLLAMA_RELEASE, "vec16")) tt |> success(find(smuggled, "alice") < 0, "path-shaped box is gone") var errs : array tt |> success(!validate_sidecar_submission(smuggled, errs), "and the document is refused") @@ -346,7 +346,7 @@ def test_privacy_strip(t : T?) { box = tune_box_identity(), applied_box = "darwin|arm64|Mac|25F84|C:\\Users\\bob", trailing = "Graphics/", - dasllama_version = "{DASLLAMA_VERSION}"))) + dasllama_version = "{DASLLAMA_RELEASE}"))) let text = write_json(doc) delete_json(doc) let cleaned = exchange_strip_private(text) @@ -356,7 +356,7 @@ def test_privacy_strip(t : T?) { var abs_doc = JV(( kernels = (dot = "vec16"), provenance = (box = tune_box_identity(), leak = "/ Users/ alice", home = "~/ alice", - dasllama_version = "{DASLLAMA_VERSION}"))) + dasllama_version = "{DASLLAMA_RELEASE}"))) let abs_text = write_json(abs_doc) delete_json(abs_doc) tt |> success(find(exchange_strip_private(abs_text), "alice") < 0, "leading-slash and tilde values are gone") @@ -390,10 +390,10 @@ def test_submit_rails(t : T?) { tt |> equal(exchange_fetch_and_apply(base_url, sha256_hex(verified_doc()), manifest), "") tt |> success(find(exchange_submit_current(policy), "came from the exchange") >= 0) // a foreign-box file never goes back up - fwrite(manifest, fixture_sidecar("darwin|arm64|Mac|25F84|Apple M1 Max", DASLLAMA_VERSION, "vec16")) + fwrite(manifest, fixture_sidecar("darwin|arm64|Mac|25F84|Apple M1 Max", DASLLAMA_RELEASE, "vec16")) tt |> success(find(exchange_submit_current(policy), "not measured on this box") >= 0) // this box's own tune submits, and the state file remembers it - let own = fixture_sidecar(tune_box_identity(), DASLLAMA_VERSION, "vec16") + let own = fixture_sidecar(tune_box_identity(), DASLLAMA_RELEASE, "vec16") fwrite(manifest, own) tt |> equal(exchange_submit_current(policy), "") GET("{base_url}/last/sidecar") $(resp) { @@ -428,7 +428,7 @@ def private fixture_records : string { tests = (pp512 = (tok_s = 100.0lf, stddev = 1.0lf)), source = "community", sha = "abc123", version = "0.6.4", exec_fmt = "interleaved", tune = "tuned", tune_sha = "deadbeef", - dasllama_version = DASLLAMA_VERSION)) + dasllama_version = DASLLAMA_RELEASE)) var runs_arr : array runs_arr |> push(run_das) var model = JV((gguf = "test-model-Q8_0.gguf", arch = "Test 1B", quant = "Q8_0", diff --git a/utils/internal/dasllama-ladder/README.md b/utils/internal/dasllama-ladder/README.md index b3b246e25e..c39041546d 100644 --- a/utils/internal/dasllama-ladder/README.md +++ b/utils/internal/dasllama-ladder/README.md @@ -57,7 +57,7 @@ Three tables, one migration stream (`ladder_migration_*`): Validation is `dasllama/dasllama_exchange_schema` (required through the registered package name, re-exported `public`): submission grade for community uploads, shape grade for official imports (official -history predates `DASLLAMA_VERSION`). `Source` and `Verified` are always stamped by the store; +history predates the `dasllama_version` stamp). `Source` and `Verified` are always stamped by the store; nothing submitter-supplied reaches those columns. Sidecar submissions are privacy-stripped server-side before hashing and storage (`exchange_strip_private` - `provenance.binary` and any path-shaped value; the submitting client runs the same strip, so a clean upload round-trips diff --git a/utils/internal/dasllama-ladder/REVIEW.md b/utils/internal/dasllama-ladder/REVIEW.md index b1ecb308f7..c020fdbf55 100644 --- a/utils/internal/dasllama-ladder/REVIEW.md +++ b/utils/internal/dasllama-ladder/REVIEW.md @@ -61,7 +61,7 @@ engine-free `dasllama/dasllama_exchange_schema`, and only `ladder_store.das` req **A write path that stores a document without validating it first is a defect: every sidecar - community or planted - passes `validate_sidecar_submission`, every community record store passes `validate_record_submission`, and `import_official_store` passes `validate_record_store` -(shape only - official records predate the `DASLLAMA_VERSION` stamp).** +(shape only - official records predate the `dasllama_version` stamp).** **Never write `Source` or `Verified` outside `ladder_store.das`, and never let a value from a public (proxied) request reach either column - the loopback operator surface sets `Verified` From 6be2b952223859a7241ca8aa9621bc47c53b8a1a Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 03:54:49 -0700 Subject: [PATCH 02/17] two gates from the m5-image round land - the tgmem lens refusal and the msl fail-closed sync cell [metal_dispatch] on a class with @workgroup members now refuses at compile when tgmem= is absent - the generated builder would bind ZERO threadgroup memory and the kernel reads whatever length the encoder last had (the qk_rope bug class; it shipped working only via sticky encoder state). All 93 @workgroup classes at HEAD already pass tgmem=, so this is pure prevention. Negative+positive controls ride test_metal_misc_kernels as spawned compiles (the tgmem-less fixture must refuse with the message; the tgmem= twin must compile). modules/dasMetal/REVIEW.das grows check_fail_closed_sync (followup 45): the tests/msl/_fail_closed fixture list and test_msl_fail_closed.das's check_rejects asserts must match both directions - either drift is a finding (negative-controlled both ways). REVIEW.md carries the weakening-residue rule. Gates: kernels suite 7/7 files green (misc 4/4 incl. the new lens gate); modules/dasMetal/REVIEW.das OK. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- .../dasLLAMA/dasllama/dasllama_metal_lens.das | 7 ++ modules/dasLLAMA/followup_general.md | 11 ++- .../tests/test_metal_misc_kernels.das | 67 +++++++++++++++++++ modules/dasMetal/REVIEW.das | 37 ++++++++++ modules/dasMetal/REVIEW.md | 5 ++ 5 files changed, 121 insertions(+), 6 deletions(-) diff --git a/modules/dasLLAMA/dasllama/dasllama_metal_lens.das b/modules/dasLLAMA/dasllama/dasllama_metal_lens.das index d2734d01df..7389f822ff 100644 --- a/modules/dasLLAMA/dasllama/dasllama_metal_lens.das +++ b/modules/dasLLAMA/dasllama/dasllama_metal_lens.das @@ -278,6 +278,7 @@ class MetalDispatch : AstStructureAnnotation { // Collect @ssbo/@uniform buffer fields in @binding order. @workgroup + hidden/method // fields are skipped; field-annotation validity is msl_emit's job, not the lens's. var bufs : array + var has_wg = false bufs |> reserve(length(st.fields)) for (field in st.fields) { var is_ssbo = false @@ -291,6 +292,7 @@ class MetalDispatch : AstStructureAnnotation { is_buf = true } elif (annDecl.name == "workgroup") { is_wg = true + has_wg = true } } if (is_wg || !is_buf) continue @@ -318,6 +320,11 @@ class MetalDispatch : AstStructureAnnotation { } sort(bufs) $(a, b) => a.binding < b.binding + if (has_wg && empty(tgmem)) { + errors := "[metal_dispatch] {fn_name}: '{st.name}' has @workgroup members but no tgmem= - the generated builder would bind ZERO threadgroup memory and the kernel reads whatever length the encoder last had (garbage, or worse: right by luck). Pass tgmem = \"_tgmem\" (the emitter's generated byte-size constant for this kernel's source)" + return false + } + // @default = name (bare identifier): a sibling field's name resolves to its builder // param (the rope rebind shape), anything else passes through as a module global var fldnames : table diff --git a/modules/dasLLAMA/followup_general.md b/modules/dasLLAMA/followup_general.md index 744f1481eb..2278d04120 100644 --- a/modules/dasLLAMA/followup_general.md +++ b/modules/dasLLAMA/followup_general.md @@ -551,12 +551,11 @@ its own gate design). Done = either path serving the Omni-3B encode with a poison-discriminating tier-1 gate. -45. **The `tests/msl/_fail_closed/` fixture list and `test_msl_fail_closed.das`'s - `check_rejects` calls are hand-synced (37 files, 37 calls, nothing checks).** A fixture - added without its needle assert (or an assert whose fixture was deleted) drifts silently. - Done = a `modules/dasMetal/REVIEW.das` gate cell (the module has none yet - this creates - it): every `_fail_closed/*.das` basename appears as a `check_rejects` argument and vice - versa - the list-A-equals-list-B shape. +45. **RESOLVED (2026-08-30, the release-remint arc) - the fixture/assert sync is a + `modules/dasMetal/REVIEW.das` cell.** `check_fail_closed_sync` walks + `tests/msl/_fail_closed/*.das` and the `check_rejects` calls both directions; either + drift is a finding (negative-controlled both ways at landing). The module's REVIEW.das + already existed (the RP law) by the time this landed. 46. **The `// clock: control` marker (dasllama REVIEW.md's ad-hoc-profiling split) has no mechanical check.** Done = a `REVIEW.das` cell or lint: every `ref_time_ticks()` / diff --git a/modules/dasLLAMA/tests/test_metal_misc_kernels.das b/modules/dasLLAMA/tests/test_metal_misc_kernels.das index 5826b3b2a1..39c9126023 100644 --- a/modules/dasLLAMA/tests/test_metal_misc_kernels.das +++ b/modules/dasLLAMA/tests/test_metal_misc_kernels.das @@ -14,6 +14,9 @@ require ?das_metal _metal_kernel_common // shared buf helpers + eyeball-dump c require ?das_metal _mtl_toy // the [metal_dispatch] multi-kernel fixture require llvm/daslib/f16_cvt // f32_to_f16 — packing the synthetic scale planes require math +require daslib/fio // the lens tgmem gate's spawned compiles +require strings +require daslib/strings_boost // The decode-side elementwise/misc corpus vs direct CPU oracles on synthetic data: copy_row, // argmax (the CPU sampler's exact lowest-index tie-break, exercised with deliberate exact @@ -1911,3 +1914,67 @@ def test_metal_misc_kernels(t : T?) { } } } + +// a spawned one-class [metal_dispatch] program: @workgroup state, tgmem= present or absent +def private spawn_wg_fixture(with_tgmem : bool; tag : string) : tuple { + let tgarg = with_tgmem ? "tgmem = \"wg_fixture_msl_tgmem\", " : "" + let src = join([ + "options gen2", + "options _dasllama_internal = true", + "", + "require dasllama/dasllama_lint public", + "require das_metal", + "require metal/msl_shader", + "require dasllama/dasllama_metal_common", + "require dasllama/dasllama_metal_lens", + "", + "[metal_dispatch(name = \"enc_wg_fixture\", pso = \"g_wg_fixture_pso\", {tgarg}tg = 64, grid = \"n/64\", params = \"n : int64\")]", + "class WgFixture \{", + " @ssbo @binding = 0 @role = \"write\" ys : array", + " @workgroup acc : float[64]", + "", + " [metal_kernel(name = \"wg_fixture_msl\")]", + " def kmain \{", + " let i = gl_GlobalInvocationID.x", + " acc[gl_LocalInvocationID.x] = 1.0", + " ys[i] = acc[gl_LocalInvocationID.x]", + " \}", + "\}", + "", + "var g_wg_fixture_pso : MetalComputePipeline?", + "", + "[export]", + "def main() \{", + " print(\"ok\\n\")", + "\}"], "\n") + let dir_r = create_temp_directory_result("dasllama_lens_{tag}") + if (!(dir_r is value)) { + return (rc = -1, out = "temp dir failed") + } + let dir = unsafe(dir_r.value) + let path = path_join(dir, "prog.das") + if (!fwrite(path, src)) { + return (rc = -1, out = "fwrite failed") + } + let argv <- get_command_line_arguments() + let self = find(to_generic_path(argv[0]), "/") < 0 ? argv[0] : get_full_file_name(normalize(argv[0])) + var out : string + let rc = run_and_capture([self, "-compile-only", path], out, 120.0) + rmdir_rec_result(dir) + return (rc = rc, out = out) +} + +[test] +def test_lens_tgmem_gate(t : T?) { + t |> run("[metal_dispatch] on @workgroup state refuses to compile without tgmem=") @(t : T?) { + static_if (typeinfo builtin_module_exists(das_metal)) { + let bad = spawn_wg_fixture(false, "bad") + t |> success(bad.rc != 0, "the tgmem-less fixture must not compile") + t |> success(find(bad.out, "no tgmem=") >= 0, "the refusal names the gate: {bad.out}") + let good = spawn_wg_fixture(true, "ok") + t |> equal(0, good.rc, "the tgmem= twin compiles: {good.out}") + } else { + feint("das_metal is not built on this platform; lens tgmem gate skipped\n") + } + } +} diff --git a/modules/dasMetal/REVIEW.das b/modules/dasMetal/REVIEW.das index 5304ede04d..4834fa3018 100644 --- a/modules/dasMetal/REVIEW.das +++ b/modules/dasMetal/REVIEW.das @@ -30,6 +30,42 @@ def private check_rp_law { } } +let private FC_DIR = "tests/msl/_fail_closed" +let private FC_TEST = "tests/msl/test_msl_fail_closed.das" + +// every _fail_closed/*.das fixture has its check_rejects needle assert and vice versa - the +// two lists are hand-synced, and a fixture without its assert (or an assert whose fixture +// was deleted) drifts silently: the suite stays green while the rejection it pins is gone +def private check_fail_closed_sync { + var fixtures : table + dir(FC_DIR) $(name) { + if (name |> ends_with(".das")) { + fixtures |> insert(slice(name, 0, length(name) - 4)) + } + } + var asserted : table + var line_no = 0 + for (line in split(fread(FC_TEST), "\n")) { + line_no++ + let at = find(line, "check_rejects(t, \"") + continue if (at < 0) + let rest = slice(line, at + length("check_rejects(t, \"")) + let q = find(rest, "\"") + continue if (q <= 0) + asserted[slice(rest, 0, q)] = line_no + } + for (fx in keys(fixtures)) { + if (!key_exists(asserted, fx)) { + gate_finding(FC_TEST, 1, "fixture {FC_DIR}/{fx}.das has no check_rejects assert - its rejection is unpinned") + } + } + for (name, ln in keys(asserted), values(asserted)) { + if (!key_exists(fixtures, name)) { + gate_finding(FC_TEST, ln, "check_rejects(\"{name}\") has no {FC_DIR}/{name}.das fixture - the assert is stranded") + } + } +} + [export] def main() : int { if (!fexist("modules/dasMetal/REVIEW.das") || !fexist(EMITTER)) { @@ -37,5 +73,6 @@ def main() : int { return 2 } check_rp_law() + check_fail_closed_sync() return gate_verdict("dasmetal") } diff --git a/modules/dasMetal/REVIEW.md b/modules/dasMetal/REVIEW.md index d100589112..54915e2294 100644 --- a/modules/dasMetal/REVIEW.md +++ b/modules/dasMetal/REVIEW.md @@ -50,6 +50,11 @@ the diff puts it.** An emitted-text fixture answers to `tests/msl/REVIEW.md` (re Narrowing the file it scans weakens it. So does making its finding text stop naming what failed. `relaxed_precision = false` keeps the op off the tensor-unit fast path. +- **Weakening `REVIEW.das`'s fail-closed sync check is a defect.** That check holds the + `tests/msl/_fail_closed/` fixture list and `test_msl_fail_closed.das`'s `check_rejects` + asserts equal both directions - a fixture without its assert leaves a rejection unpinned, + and a stranded assert is a rejection the emitter no longer makes. + - **Never zero a cooperative tensor element by element before a `matmul2d` `run` accumulates into it - `get_destination_cooperative_tensor` already hands it back zeroed.** That walk forces every element into real storage before the accumulation loop, and that costs the op From 59810188d2bf4df091ec8143f77764115ce84d57 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 04:07:19 -0700 Subject: [PATCH 03/17] the census learns the towers, the board learns the metal ASR families Slice A (kernel coverage): cov_tower grows the gemma4a whole-chunk row (GPU mel + convs + 12 Conformer blocks off raw samples), the canary FastConformer row (32 rel-pos XL blocks), the qwen25v single-window row (win-attn + row-gather), the qwen3v GPU-stem row, the qwen3a mel now built from samples so the GPU mel hook dispatches, the gemma3v flash-off leg (head_restride + the slab route rode only sticky luck before) and the crowned twin-W leg (cvt_half + the half GEMMs). Every target family verified dispatching in the census report. Slice B (board plumbing): AsrModelSpec grows metal_served - the whisper pair, canary, qwen3a, gemma4a and omni declare the end-to-end Metal serve on their catalog rows; is_metal_served_family reads the flag (parakeet stays CPU by measurement). The like-for-like GPU ref pairs extend beyond whisper-cli: mtmd gets its -ngl 99 arm, nemo a torch-MPS --device arm (canary_qwen_bench.py). The stale m1/m4 canary rows pinning the retired f16 decoder are removed (m1 retired by ruling - no more m1 runs; m4 re-mints on the q8 artifact in the Efficiency-gate pass); site records regenerated. Followup 45 stays resolved; followup 57 verified no-work (Plane length overloads already return int64) and re-ledgered as such. Gates: census suite green with all new rows dispatching; records/site/specs/ exchange schema tests 72/72. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- .../benchmarks/asr/canary_qwen_bench.py | 8 +- modules/dasLLAMA/followup_general.md | 10 +- .../performance/gen_bench_records.das | 17 +- .../dasLLAMA/performance/profile_common.das | 24 +- modules/dasLLAMA/performance/records/m1.json | 166 ---- modules/dasLLAMA/performance/records/m4.json | 229 ----- .../dasLLAMA/tests/test_kernel_coverage.das | 152 +++- site/files/dasllama/bench_records.json | 825 +++++------------- 8 files changed, 399 insertions(+), 1032 deletions(-) diff --git a/modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py b/modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py index 0b024e41b6..af69ca5fe1 100644 --- a/modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py +++ b/modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py @@ -1,7 +1,8 @@ #!/usr/bin/env python3 -# NeMo SALM (canary-qwen-2.5b) CPU transcribe bench — the reference-engine side of the +# NeMo SALM (canary-qwen-2.5b) transcribe bench — the reference-engine side of the # Canary-Qwen ASR A/B (llama.cpp has NO canary/SALM support, and onnx-asr ships no canary -# export, so NeMo greedy IS the only reference). Engine-level (no HTTP), greedy, CPU; the +# export, so NeMo greedy IS the only reference). Engine-level (no HTTP), greedy; --device +# picks the torch device (cpu default, mps = the Apple-GPU reference arm); the # timed region is model.generate() only (model + audio load excluded), mirroring # asr_bench.das's per-transcribe BENCH line. Same greedy config as canary_qwen_oracle.py. # @@ -22,6 +23,7 @@ def main(): ap.add_argument("--max-new-tokens", type=int, default=256) ap.add_argument("--prompt", default="Transcribe the following: ") ap.add_argument("--threads", type=int, default=0) + ap.add_argument("--device", default="cpu") args = ap.parse_args() import torch @@ -35,6 +37,8 @@ def main(): t_load = time.perf_counter() model = SALM.from_pretrained(args.model) model.eval() + if args.device != "cpu": + model = model.to(args.device) load_ms = (time.perf_counter() - t_load) * 1000.0 print(f"LOAD\t{args.model}\t{load_ms:.3f}", flush=True) diff --git a/modules/dasLLAMA/followup_general.md b/modules/dasLLAMA/followup_general.md index 2278d04120..3318b027e4 100644 --- a/modules/dasLLAMA/followup_general.md +++ b/modules/dasLLAMA/followup_general.md @@ -659,11 +659,11 @@ the arc-end re-mint on the b10659 ref pin, fresh tune manifest), and the stale m1/m4 canary rows re-mint or retire. -57. **Plane types have no `long_length`.** `length(PlaneF)` / `length(PlaneU16)` return - `int`, so every `uint64(length(t.blob) * 4l)` spelling caps a plane at 2^31 elements - before the widening - headroom-only today (whisper large-v3's twin is ~632M elements). - Done = `long_length` overloads in `dasllama_plane` and the buffer-sizing call sites - moved onto them. +57. **RESOLVED (2026-08-30, verified no-work) - the Plane `length` overloads already return + `int64`.** `dasllama_plane.das` sec.108-112: `def length(pl : PlaneF) : int64 => pl.n` + (all five Plane types), so `uint64(length(t.blob) * 4l)` is int64 arithmetic end to end + and no plane caps at 2^31. The ledger entry's premise ("return `int`") was wrong when + written; the das-array staging twins cannot exceed 2^31 elements by the array limit. 58. **Per-entry kernel-identity hashes in llvm_tune - the fine invalidation the release split trades away.** With tune sidecars scoped to `DASLLAMA_RELEASE` (bumped only on a diff --git a/modules/dasLLAMA/performance/gen_bench_records.das b/modules/dasLLAMA/performance/gen_bench_records.das index 915c029366..c53d7017c8 100644 --- a/modules/dasLLAMA/performance/gen_bench_records.das +++ b/modules/dasLLAMA/performance/gen_bench_records.das @@ -1010,9 +1010,10 @@ def private image_ref_pass(file, path, mm, pic, bin, flavor : string; ngl : int; // ===== ASR legs (the audio workloads, same adjacency discipline as the LLM legs) ===== // das side: one lcpp_bench --asr child per catalog model, absorbed via the same cell protocol -// the families the metal das leg serves end to end (tower + decoder); the Conformer and -// GGUF-tower rows would trip the --ngl anti-sandbag (their towers keep the CPU by design) -def private is_metal_served_family(spec : AsrModelSpec) : bool => find(spec.display, "Whisper") >= 0 +// the families the metal das leg serves end to end (tower + decoder) declare it on their +// catalog row; an unflagged row (parakeet — its GPU arm measures slower and keeps the CPU +// by design) would trip the --ngl anti-sandbag +def private is_metal_served_family(spec : AsrModelSpec) : bool => spec.metal_served def private asr_das_cell(spec : AsrModelSpec; cfg : Args; threads : int; cellPath, store, exe : string; var models : array; var failed : array; leg : string = "") { @@ -1111,7 +1112,7 @@ def private asr_ref_pass(spec : AsrModelSpec; ref : AsrRef; versions : string; c } } to_log(LOG_INFO, "gen_bench_records: {ref.tool} over {length(clips)} clip(s) in one process (python model load amortized)\n") - let pyargs <- asr_pybench_args(ref.tool, ref.handle, clips, threads, cfg.asr_reps) + let pyargs <- asr_pybench_args(ref.tool, ref.handle, clips, threads, cfg.asr_reps, gpu ? "mps" : "") rr.cmd = argv_line(pyargs) var out = run_capture_argv(pyargs) if (find(out, "BENCH") < 0) { @@ -1172,7 +1173,7 @@ def private asr_ref_pass(spec : AsrModelSpec; ref : AsrRef; versions : string; c var enc_ms = 0.0lf var rtext = "" let ms = (ref.tool == "mtmd" - ? run_asr_mtmd(model_path, "{spec.root}{ref.handle}", wav_path, threads, cfg.asr_reps, cmd, enc_ms, rtext) + ? run_asr_mtmd(model_path, "{spec.root}{ref.handle}", wav_path, threads, cfg.asr_reps, cmd, enc_ms, rtext, gpu) : run_asr_cli(ref.tool, model_path, wav_path, threads, cfg.asr_reps, cmd, gpu)) rr.cmd = cmd // last clip's line; they differ only in -f if (ms > 0.0lf) { @@ -1511,7 +1512,11 @@ def main : int { settle(cfg) asr_ref_pass(spec, rf, toolVersions?[rf.tool] ?? "", cfg, threads, hw, box, date, store, models, failed) static_if (typeinfo builtin_module_exists(das_metal)) { - if (rf.tool == "whisper-cli" && is_metal_served_family(spec)) { // the metal das row's like-for-like pair + // the metal das row's like-for-like pair: whisper-cli gets its own -ngl + // arm, mtmd its -ngl 99 arm, nemo its torch-MPS arm; parakeet-cli and + // onnx have no GPU arm worth pairing (measured slower / CPU-only export) + let gpu_pair = rf.tool == "whisper-cli" || rf.tool == "mtmd" || rf.tool == "nemo" + if (gpu_pair && is_metal_served_family(spec)) { settle(cfg) asr_ref_pass(spec, rf, toolVersions?[rf.tool] ?? "", cfg, threads, hw, box, date, store, models, failed, true) } diff --git a/modules/dasLLAMA/performance/profile_common.das b/modules/dasLLAMA/performance/profile_common.das index c2de3da96d..dd256bb92e 100644 --- a/modules/dasLLAMA/performance/profile_common.das +++ b/modules/dasLLAMA/performance/profile_common.das @@ -1122,6 +1122,9 @@ struct AsrModelSpec { // model-speed, and bytes mis-sort it — large-v3-turbo is 1.51 GB against Parakeet's 2.33 GB // yet costs 97.5 s per rep against Parakeet's 38.6 s (m1, the five corpus buckets). tier : Tier = Tier.small + // the das metal leg serves this family end to end (tower + decoder) — the board mints a + // gpu-category row pair for it; false = the --ngl anti-sandbag would refuse the leg + metal_served : bool = false // provenance facet ([[models_provenance]]): `prov` pins the das-side carrier itself // (ProvEntry.root is the symbolic "llm"/"whisper", not this spec's resolved dir); // companions carry the mmproj + reference-side derivatives fetched/verified with it @@ -1170,7 +1173,7 @@ def asr_catalog() : array { // nolint:STYLE038 — flat catalog prov = serve_asr_tower(), companions <- [ProvEntry(name = "ggml-parakeet-tdt-0.6b-v3-q8_0.bin", root = "whisper", recipe = REF_Q8_RECIPE)]), AsrModelSpec(display = "Whisper tiny", das_model = "ggml-tiny.bin", - das_mmproj = "", root = wroot, + das_mmproj = "", root = wroot, metal_served = true, refs <- [AsrRef(tool = "whisper-cli", handle = "ggml-tiny-q8_0.bin", exec_fmt = "q8_0"), AsrRef(tool = "onnx", handle = "whisper-tiny-int8", exec_fmt = "int8")], buckets <- corpus_buckets(), libri_short = "", lang = "en", @@ -1179,7 +1182,7 @@ def asr_catalog() : array { // nolint:STYLE038 — flat catalog bytes = 77691713l, sha256 = "be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21"), companions <- [ProvEntry(name = "ggml-tiny-q8_0.bin", root = "whisper", recipe = REF_Q8_RECIPE)]), AsrModelSpec(display = "Whisper large-v3-turbo", das_model = "ggml-large-v3-turbo.bin", - das_mmproj = "", root = wroot, + das_mmproj = "", root = wroot, metal_served = true, refs <- [AsrRef(tool = "whisper-cli", handle = "ggml-large-v3-turbo-q8_0.bin", exec_fmt = "q8_0"), AsrRef(tool = "onnx", handle = "whisper-turbo-int8", exec_fmt = "int8")], buckets <- corpus_buckets(), libri_short = "", lang = "en", tier = Tier.large, @@ -1192,7 +1195,7 @@ def asr_catalog() : array { // nolint:STYLE038 — flat catalog // audio in BOTH engines, the model's limitation, not a budget choice; 40 s chunked // long-form (the NVIDIA-sanctioned usage) is ledgered AsrModelSpec(display = "Canary-Qwen 2.5B", das_model = "canary-qwen-2.5b-decoder-q8_0.gguf", - das_mmproj = "canary-qwen-2.5b-encoder-f32.bin", root = lroot, + das_mmproj = "canary-qwen-2.5b-encoder-f32.bin", root = lroot, metal_served = true, refs <- [AsrRef(tool = "nemo", handle = "nvidia/canary-qwen-2.5b", exec_fmt = "bf16")], buckets <- ["jfk.wav", "jfk3.wav", "gb1.wav"], libri_short = "", lang = "auto", tier = Tier.large, prov = ProvEntry(name = "canary-qwen-2.5b-decoder-q8_0.gguf", root = "llm", recipe = CANARY_DEC_RECIPE), @@ -1204,7 +1207,7 @@ def asr_catalog() : array { // nolint:STYLE038 — flat catalog //! the 0.6B AuT pair (fetch_models-pinned): the small dense thinker, so its cells are //! cheap - the cpu/accel rows pin the tower and prefill drivers off AsrModelSpec(display = "Qwen3-ASR-0.6B", das_model = "Qwen3-ASR-0.6B-Q8_0.gguf", - das_mmproj = "mmproj-Qwen3-ASR-0.6B-bf16.gguf", root = lroot, + das_mmproj = "mmproj-Qwen3-ASR-0.6B-bf16.gguf", root = lroot, metal_served = true, // mtmd's CPU AuT encode runs near xRT 1 — the same per-rep budget cap as omni's refs <- [AsrRef(tool = "mtmd", handle = "mmproj-Qwen3-ASR-0.6B-bf16.gguf", exec_fmt = "bf16/q8_0", buckets <- ["jfk.wav", "jfk3.wav", "gb1.wav"])], @@ -1221,14 +1224,14 @@ def asr_catalog() : array { // nolint:STYLE038 — flat catalog // the E2B carrier's provenance AND its mmproj companion live on its official // [[model_specs]] row — a companion rides the row that pins its carrier AsrModelSpec(display = "Gemma-4 E2B audio", das_model = "gemma-4-E2B-it-Q8_0.gguf", - das_mmproj = "mmproj-gemma-4-E2B-it-bf16.gguf", root = lroot, + das_mmproj = "mmproj-gemma-4-E2B-it-bf16.gguf", root = lroot, metal_served = true, //! short reference ladder: mtmd encodes on the GPU in its Metal build, so a CPU-only //! run sits near xRT 1 and needs the per-rep budget capped refs <- [AsrRef(tool = "mtmd", handle = "mmproj-gemma-4-E2B-it-bf16.gguf", exec_fmt = "bf16/q8_0", buckets <- ["jfk.wav", "jfk3.wav", "gb1.wav"])], buckets <- ["jfk.wav", "jfk3.wav", "gb1.wav", "hp0.wav"], libri_short = "", lang = "auto", tier = Tier.large), AsrModelSpec(display = "Qwen3-Omni-30B audio", das_model = "Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - das_mmproj = "mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", root = lroot, + das_mmproj = "mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", root = lroot, metal_served = true, //! short reference ladder: near xRT 1 on a CPU-only box, far worse on zen2 refs <- [AsrRef(tool = "mtmd", handle = "mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", exec_fmt = "bf16/q8_0", buckets <- ["jfk.wav", "jfk3.wav", "gb1.wav"])], @@ -1548,13 +1551,13 @@ def run_asr_cli_multi(cli, model_path : string; wav_paths : array; threa //! patched llama-mtmd-cli — one process per clip (30B load is heavy; MTMD_TIMING excludes it). //! Best total over `reps`. def run_asr_mtmd(model_path, mmproj_path, wav_path : string; threads, reps : int; - var cmd_out : string&; var encode_out : double&; var text_out : string&) : double { + var cmd_out : string&; var encode_out : double&; var text_out : string&; gpu : bool = false) : double { var best = -1.0lf encode_out = 0.0lf text_out = "" let args <- [mtmd_bin(), "-m", model_path, "--mmproj", mmproj_path, "--audio", wav_path, "-p", "Transcribe the audio.", "--temp", "0", "--jinja", "--reasoning", "off", - "-ngl", "0", "-t", "{threads}"] + "-ngl", gpu ? "99" : "0", "-t", "{threads}"] cmd_out = argv_line(args) for (_rep in range(reps)) { let out = run_capture_argv(args) @@ -1611,10 +1614,13 @@ def private mtmd_log_line(s : string) : bool { //! The onnx rows ALSO land in [[asr_pybench_out_path]] via --out: parakeet-variant loaders //! wreck the child's stdout pipe on Windows (~1 byte then EOF while the run continues), so //! the caller re-reads the file whenever the captured stream carries no rows. -def asr_pybench_args(tool, handle : string; clips : array; threads, reps : int) : array { +def asr_pybench_args(tool, handle : string; clips : array; threads, reps : int; device : string = "") : array { var args <- (tool == "onnx" ? [onnx_py(), "{asr_dir()}/onnx_bench.py", "--variant", handle, "--out", asr_pybench_out_path()] : [nemo_py(), "{asr_dir()}/canary_qwen_bench.py"]) + if (tool == "nemo" && !empty(device)) { + args |> push_from(["--device", device]) + } args |> push_from(["--threads", "{threads}", "--reps", "{reps}"]) for (c in clips) { args |> push_from(["--wav", "{asr_corpus_dir()}{c}"]) diff --git a/modules/dasLLAMA/performance/records/m1.json b/modules/dasLLAMA/performance/records/m1.json index f7522e9add..b6252ba684 100644 --- a/modules/dasLLAMA/performance/records/m1.json +++ b/modules/dasLLAMA/performance/records/m1.json @@ -4747,172 +4747,6 @@ "arch":"Whisper large-v3-turbo", "size_bytes":1624555275 }, - { - "gguf":"canary-qwen-2.5b-decoder-f16.gguf", - "runs":[ - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-03", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":1205.8699999999999, - "audio_s":11, - "encode_ms":395.21100000000001, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" - }, - "asr:jfk3.wav":{ - "ms":3717.4270000000001, - "audio_s":33, - "encode_ms":1067.527, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":16733.731, - "audio_s":198.734375, - "encode_ms":8313.4670000000006, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." - } - }, - "workload":"asr", - "source":"official", - "sha":"db50a7da2", - "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_gemv_gen=mr4 (manifest)", - "tune_sha":"bf42018efa628277924359a4e145892127c0b36b258a3bcb11996856eac641e9", - "exec_fmt":"q8/q8", - "files":[ - { - "role":"weights", - "name":"canary-qwen-2.5b-decoder-f16.gguf", - "sha256":"db035e415f77aeb48222c81f92a49a68906ae80cef4e0600cde8ea699c12b496", - "bytes":3447348864 - }, - { - "role":"mmproj", - "name":"canary-qwen-2.5b-encoder-f32.bin", - "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", - "bytes":3252768256 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 - } - ] - }, - { - "engine":"nemo", - "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-03", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":8096.7979999999998, - "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":22049.776000000002, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":41200.745000000003, - "audio_s":199 - } - }, - "workload":"asr", - "source":"official", - "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", - "exec_fmt":"bf16", - "files":[ - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 - } - ] - } - ], - "arch":"Canary-Qwen 2.5B", - "size_bytes":3447348864 - }, { "gguf":"gemma-4-E2B-it-Q8_0.gguf", "runs":[ diff --git a/modules/dasLLAMA/performance/records/m4.json b/modules/dasLLAMA/performance/records/m4.json index 244e567942..1cdf4c6326 100644 --- a/modules/dasLLAMA/performance/records/m4.json +++ b/modules/dasLLAMA/performance/records/m4.json @@ -4928,235 +4928,6 @@ "arch":"Whisper large-v3-turbo", "size_bytes":1624555275 }, - { - "gguf":"canary-qwen-2.5b-decoder-f16.gguf", - "runs":[ - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", - "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", - "remote_desktop":"off" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":696.82000000000005, - "audio_s":11, - "encode_ms":257.63900000000001, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" - }, - "asr:jfk3.wav":{ - "ms":2102.2440000000001, - "audio_s":33, - "encode_ms":709.101, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":11595.259, - "audio_s":198.734375, - "encode_ms":7256.8789999999999, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." - } - }, - "workload":"asr", - "source":"official", - "sha":"aef0840b8", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", - "files":[ - { - "role":"weights", - "name":"canary-qwen-2.5b-decoder-f16.gguf", - "sha256":"db035e415f77aeb48222c81f92a49a68906ae80cef4e0600cde8ea699c12b496", - "bytes":3447348864 - }, - { - "role":"mmproj", - "name":"canary-qwen-2.5b-encoder-f32.bin", - "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", - "bytes":3252768256 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - }, - { - "engine":"nemo", - "backend":"cpu", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", - "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", - "remote_desktop":"off" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":3311.6410000000001, - "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":7593.1890000000003, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":19236.055, - "audio_s":199 - } - }, - "workload":"asr", - "source":"official", - "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", - "exec_fmt":"bf16", - "files":[ - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", - "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", - "remote_desktop":"off" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":697.495, - "audio_s":11, - "encode_ms":258.56299999999999, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" - }, - "asr:jfk3.wav":{ - "ms":2110.797, - "audio_s":33, - "encode_ms":712.30100000000004, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":10898.359, - "audio_s":198.734375, - "encode_ms":7041.8029999999999, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." - } - }, - "workload":"asr", - "source":"official", - "sha":"aef0840b8", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", - "files":[ - { - "role":"weights", - "name":"canary-qwen-2.5b-decoder-f16.gguf", - "sha256":"db035e415f77aeb48222c81f92a49a68906ae80cef4e0600cde8ea699c12b496", - "bytes":3447348864 - }, - { - "role":"mmproj", - "name":"canary-qwen-2.5b-encoder-f32.bin", - "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", - "bytes":3252768256 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - } - ], - "arch":"Canary-Qwen 2.5B", - "size_bytes":3447348864 - }, { "gguf":"Qwen3.8-27B-Q4_K_M.gguf", "runs":[ diff --git a/modules/dasLLAMA/tests/test_kernel_coverage.das b/modules/dasLLAMA/tests/test_kernel_coverage.das index 0fdedcde5b..0228fd79a7 100644 --- a/modules/dasLLAMA/tests/test_kernel_coverage.das +++ b/modules/dasLLAMA/tests/test_kernel_coverage.das @@ -17,8 +17,13 @@ require dasllama/dasllama_audio // load_audio_tower — the cov_tower erf-GE require dasllama/dasllama_gemma4uv // the cov_tower embedder row require dasllama/dasllama_gemma4v // the cov_tower ViT row require dasllama/dasllama_gemma3v // the cov_tower SigLIP row (the head-restride kernel) -require dasllama/dasllama_qwen3a // the cov_tower conv2d carrier +require dasllama/dasllama_qwen3a // the cov_tower conv2d + GPU-mel carrier +require dasllama/dasllama_gemma4a // the cov_tower Conformer whole-chunk row +require dasllama/dasllama_canary // the cov_tower FastConformer row +require dasllama/dasllama_qwen25v // the cov_tower window-ViT row +require dasllama/dasllama_qwen3v // the cov_tower GPU-stem row require ?das_metal dasllama/dasllama_metal_tower // set_metal_tower — the census pins the rail ON +require ?das_metal dasllama/dasllama_metal_prefill // metal_prefill_shutdown — the crowned twin-W leg re-arms PSOs require ?das_metal dasllama/dasllama_metal_asr_dec // set_metal_wdec — the cov_tower mixed chunk's decoder half require daslib/jobque_boost require daslib/fio // the zoo paths @@ -210,8 +215,9 @@ def private census_zoo(t : T?) { cov_tower(t) } -// the gemma3v row of cov_tower: the fixed 896 canvas through the gemma-3-4b SigLIP tower on the -// f32 planes — covers the head-restride kernel around the borrowed attention trio +// the gemma3v row of cov_tower: the fixed 896 canvas through the gemma-3-4b SigLIP tower on +// the f32 planes, BOTH attention routes — the 4096-token %64 canvas serves the tower flash +// (flash + kv_hc), then a flash-off encode drives the slab route (head_restride + padded QK/AV) [unused_argument(t)] // off-Apple the gated body is empty def private cov_tower_gemma3v(t : T?) { static_if (typeinfo builtin_module_exists(das_metal)) { @@ -230,10 +236,127 @@ def private cov_tower_gemma3v(t : T?) { with_job_que() { setup_dasllama_jobque() gemma3v_encode(tw, st, planes, 896l, 896l, out) + set_metal_tower_flash(false) + var out2 : array + gemma3v_encode(tw, st, planes, 896l, 896l, out2) + set_metal_tower_flash(true) + delete out2 + } + delete out + delete st + // the crowned twin-W leg: a fresh load under pinned crowns bakes the halfword + // twin, so the f16-route kernels (cvt_half + the half GEMMs) dispatch + set_metal_tensor_crowns("mulmm_q8") + metal_prefill_shutdown() + set_metal_tower_f16(true) + set_gemma3v_q8(false) // the exact lane is the one that bakes the twin + var twt <- load_gemma3v_tower(vpath) + reset_gemma3v_q8() + var stt = Gemma3vState() + var outt : array + with_job_que() { + setup_dasllama_jobque() + gemma3v_encode(twt, stt, planes, 896l, 896l, outt) + } + set_metal_tensor_crowns("") + metal_prefill_shutdown() + delete outt + delete stt + delete twt + delete planes + } + } +} + +// the qwen25v row of cov_tower: one 112x112 window (16 tokens) through the Qwen2.5-Omni +// window ViT — the per-window attention kernel + the row-gather stem sort +[unused_argument(t)] // off-Apple the gated body is empty +def private cov_tower_qwen25v(t : T?) { + static_if (typeinfo builtin_module_exists(das_metal)) { + let vpath = path_join(models_dir(), "mmproj-Qwen2.5-Omni-3B-f16.gguf") + if (model_available(t, vpath)) { + var tw <- load_qwen25v_tower(vpath) + var st = Qwen25vState() + var planes : array + planes |> reserve_resize(112l * 112l * 3l) + for (i in range64(112l * 112l * 3l)) { + planes[i] = sin(float(i) * 0.019) * 0.5 + 0.5 + } + var out : array + with_job_que() { + setup_dasllama_jobque() + qwen25v_encode(tw, st, planes, 112l, 112l, out) + } + delete out + delete planes + delete st + delete tw + } + } +} + +// the qwen3v row of cov_tower: a 96x96 canvas through the Omni-family merger tower — the +// fused GPU stem (patch GEMM + merge-walk assemble) ahead of the block slab +[unused_argument(t)] // off-Apple the gated body is empty +def private cov_tower_qwen3v(t : T?) { + static_if (typeinfo builtin_module_exists(das_metal)) { + let vpath = path_join(models_dir(), "mmproj-Qwen3VL-4B-Instruct-F16.gguf") + if (model_available(t, vpath)) { + var tw <- load_qwen3v_tower(vpath) + var st = Qwen3vState() + var planes : array + planes |> reserve_resize(96l * 96l * 3l) + for (i in range64(96l * 96l * 3l)) { + planes[i] = sin(float(i) * 0.023) * 0.5 + 0.5 + } + var out : array + with_job_que() { + setup_dasllama_jobque() + qwen3v_encode(tw, st, planes, 96l, 96l, out) } delete out delete planes delete st + delete tw + } + } +} + +// the gemma4a row of cov_tower: one whole chunk from raw samples — GPU mel (twiddle-T DFT +// GEMM + mag + filter + log), both subsample convs, and the 12-block Conformer chain +[unused_argument(t)] // off-Apple the gated body is empty +def private cov_tower_gemma4a(t : T?; samples : array) { + static_if (typeinfo builtin_module_exists(das_metal)) { + let gpath = path_join(models_dir(), "mmproj-gemma-4-E2B-it-bf16.gguf") + if (model_available(t, gpath) && !empty(samples)) { + var inscope genc <- load_gemma4a_encoder(gpath) + var gst = Gemma4aState() + var grows : array + with_job_que() { + setup_dasllama_jobque() + gemma4a_encode_all(genc, gst, samples, grows) + } + delete grows + delete gst + } + } +} + +// the canary row of cov_tower: CPU mel, then the 32-block Metal FastConformer chain — the +// bidirectional rel-pos XL attention and the centered-k9 depthwise kernels +[unused_argument(t)] // off-Apple the gated body is empty +def private cov_tower_canary(t : T?; samples : array) { + static_if (typeinfo builtin_module_exists(das_metal)) { + let cnpath = path_join(models_dir(), "canary-qwen-2.5b-encoder-f32.bin") + if (model_available(t, cnpath) && !empty(samples)) { + var inscope cenc <- load_canary_encoder(cnpath) + var cst = CanaryState() + with_job_que() { + setup_dasllama_jobque() + canary_log_mel(cenc, samples, cst) + canary_encode(cenc, cst) + } + delete cst } } } @@ -268,7 +391,9 @@ def private cov_tower_gemma4v(t : T?) { // cov_tower: the tower-driver kernels (LN / f32 mul_mm / the gelu flavors / posadd / the // borrowed trio / the gemma4v clamp, rope2d, GEGLU-quick) AND the decoder-side cross-KV kernels // go non-zero — a whisper tiny MIXED chunk (f32 enc = the tower LUT flavor, q8 dec = the wdec -// driver) plus a small gemma4uv canvas plus a 96x96 gemma4v canvas (the E2B tower) +// driver), the qwen3a GPU-mel + conv2d window, the gemma4a whole-chunk Conformer, the canary +// FastConformer chain, small gemma4uv/gemma4v canvases, the gemma3v flash+slab pair, the +// qwen25v single window, and the qwen3v GPU-stem canvas [unused_argument(t)] // off-Apple the gated body is empty def private cov_tower(t : T?) { static_if (typeinfo builtin_module_exists(das_metal)) { @@ -291,7 +416,6 @@ def private cov_tower(t : T?) { delete ws } } - delete samples // the erf-GELU carrier (whisper is the LUT flavor): one qwen2audio chunk on varied mel let apath = path_join(models_dir(), "qwen2audio-mmproj-f32.gguf") if (model_available(t, apath)) { @@ -309,29 +433,33 @@ def private cov_tower(t : T?) { delete aenc delete atw } - // the qwen3a conv2d carrier: one padded window drives the im2col2d + padded tile GEMMs + // the qwen3a conv2d + mel carrier: the mel built from raw samples so the GPU mel hook + // (twiddle-T DFT GEMM + power + mel-major log store) dispatches, then one padded + // window drives the im2col2d + padded tile GEMMs let qpath = path_join(models_dir(), "mmproj-Qwen3-ASR-0.6B-bf16.gguf") - if (model_available(t, qpath)) { + if (model_available(t, qpath) && !empty(samples)) { var inscope qtw <- load_qwen3a_tower(qpath) - var qmel = WhisperMel(n_mel = qtw.core.n_mel, n_len = 900l) - qmel.data |> resize(qtw.core.n_mel * 900l) - for (i in range(length(qmel.data))) { - qmel.data[i] = cos(float(i) * 0.0091) * 0.7 - } var qenc <- make_encoder_state(qtw.core) var qcs = Qwen3aConvState() var qrows : array with_job_que() { setup_dasllama_jobque() + var qmel <- log_mel_qwen3a(samples, qtw.core.n_mel) qwen3a_encode_all(qtw, qenc, qcs, qmel, qrows) + delete qmel } delete qrows delete qcs delete qenc } + cov_tower_gemma4a(t, samples) + cov_tower_canary(t, samples) + delete samples cov_tower_gemma4uv(t) cov_tower_gemma4v(t) cov_tower_gemma3v(t) + cov_tower_qwen25v(t) + cov_tower_qwen3v(t) } } diff --git a/site/files/dasllama/bench_records.json b/site/files/dasllama/bench_records.json index 79289692d5..888234c47d 100644 --- a/site/files/dasllama/bench_records.json +++ b/site/files/dasllama/bench_records.json @@ -13660,609 +13660,6 @@ "arch":"Whisper large-v3-turbo", "size_bytes":1624555275 }, - { - "gguf":"canary-qwen-2.5b-decoder-f16.gguf", - "runs":[ - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-03", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":1205.8699999999999, - "audio_s":11, - "encode_ms":395.21100000000001, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" - }, - "asr:jfk3.wav":{ - "ms":3717.4270000000001, - "audio_s":33, - "encode_ms":1067.527, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":16733.731, - "audio_s":198.734375, - "encode_ms":8313.4670000000006, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." - } - }, - "workload":"asr", - "source":"official", - "sha":"db50a7da2", - "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_gemv_gen=mr4 (manifest)", - "tune_sha":"bf42018efa628277924359a4e145892127c0b36b258a3bcb11996856eac641e9", - "exec_fmt":"q8/q8", - "files":[ - { - "role":"weights", - "name":"canary-qwen-2.5b-decoder-f16.gguf", - "sha256":"db035e415f77aeb48222c81f92a49a68906ae80cef4e0600cde8ea699c12b496", - "bytes":3447348864 - }, - { - "role":"mmproj", - "name":"canary-qwen-2.5b-encoder-f32.bin", - "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", - "bytes":3252768256 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 - } - ] - }, - { - "engine":"nemo", - "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-03", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":8096.7979999999998, - "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":22049.776000000002, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":41200.745000000003, - "audio_s":199 - } - }, - "workload":"asr", - "source":"official", - "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", - "exec_fmt":"bf16", - "files":[ - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", - "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", - "remote_desktop":"off" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":696.82000000000005, - "audio_s":11, - "encode_ms":257.63900000000001, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" - }, - "asr:jfk3.wav":{ - "ms":2102.2440000000001, - "audio_s":33, - "encode_ms":709.101, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":11595.259, - "audio_s":198.734375, - "encode_ms":7256.8789999999999, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." - } - }, - "workload":"asr", - "source":"official", - "sha":"aef0840b8", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", - "files":[ - { - "role":"weights", - "name":"canary-qwen-2.5b-decoder-f16.gguf", - "sha256":"db035e415f77aeb48222c81f92a49a68906ae80cef4e0600cde8ea699c12b496", - "bytes":3447348864 - }, - { - "role":"mmproj", - "name":"canary-qwen-2.5b-encoder-f32.bin", - "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", - "bytes":3252768256 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - }, - { - "engine":"nemo", - "backend":"cpu", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", - "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", - "remote_desktop":"off" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":3311.6410000000001, - "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":7593.1890000000003, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":19236.055, - "audio_s":199 - } - }, - "workload":"asr", - "source":"official", - "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", - "exec_fmt":"bf16", - "files":[ - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", - "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", - "remote_desktop":"off" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":697.495, - "audio_s":11, - "encode_ms":258.56299999999999, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" - }, - "asr:jfk3.wav":{ - "ms":2110.797, - "audio_s":33, - "encode_ms":712.30100000000004, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":10898.359, - "audio_s":198.734375, - "encode_ms":7041.8029999999999, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." - } - }, - "workload":"asr", - "source":"official", - "sha":"aef0840b8", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", - "files":[ - { - "role":"weights", - "name":"canary-qwen-2.5b-decoder-f16.gguf", - "sha256":"db035e415f77aeb48222c81f92a49a68906ae80cef4e0600cde8ea699c12b496", - "bytes":3447348864 - }, - { - "role":"mmproj", - "name":"canary-qwen-2.5b-encoder-f32.bin", - "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", - "bytes":3252768256 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", - "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", - "remote_desktop":"off" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":2156.663, - "audio_s":11, - "encode_ms":651.01199999999994, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" - }, - "asr:jfk3.wav":{ - "ms":6602.6859999999997, - "audio_s":33, - "encode_ms":1808.6010000000001, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":26226.955999999998, - "audio_s":198.734375, - "encode_ms":13483.357, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." - } - }, - "workload":"asr", - "source":"official", - "sha":"37a2c1662", - "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", - "files":[ - { - "role":"weights", - "name":"canary-qwen-2.5b-decoder-f16.gguf", - "sha256":"25ce019d76747fde50aa560d1fb539fea9b6b7e6ad0a2b213c0168f94af33774", - "bytes":3447348960 - }, - { - "role":"mmproj", - "name":"canary-qwen-2.5b-encoder-f32.bin", - "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", - "bytes":3252768256 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", - "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":1658.674, - "audio_s":11, - "encode_ms":396.928, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" - }, - "asr:jfk3.wav":{ - "ms":5153.2179999999998, - "audio_s":33, - "encode_ms":1059.069, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":20661.634999999998, - "audio_s":198.734375, - "encode_ms":10373.755999999999, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." - } - }, - "workload":"asr", - "source":"official", - "sha":"7e02c2451", - "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", - "files":[ - { - "role":"weights", - "name":"canary-qwen-2.5b-decoder-f16.gguf", - "sha256":"9eaa11538394c48ac669ffc31739d6d3915307b1097cbff250065f42aeeb5318", - "bytes":3447348960 - }, - { - "role":"mmproj", - "name":"canary-qwen-2.5b-encoder-f32.bin", - "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", - "bytes":3252768256 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - }, - { - "engine":"nemo", - "backend":"cpu", - "flavor":"stock", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", - "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":6286.0159999999996, - "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":19843.406999999999, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":51910.167000000001, - "audio_s":199 - } - }, - "workload":"asr", - "source":"official", - "versions":"nemo 3.1.0+06312c963 / torch 2.12.1+cu130", - "exec_fmt":"bf16", - "files":[ - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - } - ] - } - ], - "arch":"Canary-Qwen 2.5B", - "size_bytes":3447348960 - }, { "gguf":"gemma-4-E2B-it-Q8_0.gguf", "runs":[ @@ -18173,5 +17570,227 @@ "params_b":4.0222720000000001, "active_b":4.0222720000000001, "size_bytes":4280405600 + }, + { + "gguf":"canary-qwen-2.5b-decoder-f16.gguf", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":2156.663, + "audio_s":11, + "encode_ms":651.01199999999994, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":6602.6859999999997, + "audio_s":33, + "encode_ms":1808.6010000000001, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":26226.955999999998, + "audio_s":198.734375, + "encode_ms":13483.357, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"37a2c1662", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-f16.gguf", + "sha256":"25ce019d76747fde50aa560d1fb539fea9b6b7e6ad0a2b213c0168f94af33774", + "bytes":3447348960 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m canary-qwen-2.5b-decoder-f16.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1658.674, + "audio_s":11, + "encode_ms":396.928, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":5153.2179999999998, + "audio_s":33, + "encode_ms":1059.069, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":20661.634999999998, + "audio_s":198.734375, + "encode_ms":10373.755999999999, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"7e02c2451", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-f16.gguf", + "sha256":"9eaa11538394c48ac669ffc31739d6d3915307b1097cbff250065f42aeeb5318", + "bytes":3447348960 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"nemo", + "backend":"cpu", + "flavor":"stock", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":6286.0159999999996, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":19843.406999999999, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":51910.167000000001, + "audio_s":199 + } + }, + "workload":"asr", + "source":"official", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1+cu130", + "exec_fmt":"bf16", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + } + ], + "arch":"Canary-Qwen 2.5B", + "size_bytes":3447348960 } ] \ No newline at end of file From f5417ba8fcfa7599a8219040e6051bd35af932b5 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 03:31:02 -0700 Subject: [PATCH 04/17] dasllama.io news: Apple M5 support lands The 2026-08-30 entry: M5 as a first-class target - tensor-API kernels under the per-box crowns, GPU vision towers and speech encoders, the hybrid all-compute CPU pool - with the first official M5 Max board rows quoted from records/m5.json. Regenerated index.html/feed.xml/sitemap.xml also catch the old entries up to their ASCII-normalized _news sources (deploy output already matched). Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc (cherry picked from commit 20ac6e6d3399ddc1da0d264028beaa2a6bcbfb24) --- site-dasllama/_news/2026-08-30-apple-m5.md | 22 ++++++++++++ site-dasllama/feed.xml | 40 ++++++++++++++++------ site-dasllama/index.html | 37 ++++++++++++++------ site-dasllama/sitemap.xml | 2 +- 4 files changed, 80 insertions(+), 21 deletions(-) create mode 100644 site-dasllama/_news/2026-08-30-apple-m5.md diff --git a/site-dasllama/_news/2026-08-30-apple-m5.md b/site-dasllama/_news/2026-08-30-apple-m5.md new file mode 100644 index 0000000000..8083da9211 --- /dev/null +++ b/site-dasllama/_news/2026-08-30-apple-m5.md @@ -0,0 +1,22 @@ +--- +date: 2026-08-30 +tag: hardware +title: Apple M5 support lands - text, vision and speech, tuned on the new silicon. +--- + +dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick up the +M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown +them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane +learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the +pool spanning both tiers with decode parking the slower one. + +First official rows on an M5 Max (pp512 / tg128, Metal, llama-bench protocol): +gemma-4-E2B Q8_0 - das 8692.8 / 161.7 tok/s, llama.cpp 7527.4 / 136.6; gpt-oss-20b - +das 3989.4 / 163.2, llama.cpp 3475.3 / 147.5; Qwen3-30B-A3B - das 3506.8 / 165.2, +llama.cpp 3425.5 / 136.4. The image turn rides the same rails - the gemma-4-12B image +encode lands at 7.2 ms. Full rows for the box are on the +[board](https://daslang.io/dasllama.html). + +Bringing a new chip up one model at a time - watching kernels tuned for one generation +get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely +fun. diff --git a/site-dasllama/feed.xml b/site-dasllama/feed.xml index ff7c3f9039..34d1af91df 100644 --- a/site-dasllama/feed.xml +++ b/site-dasllama/feed.xml @@ -4,39 +4,59 @@ dasllama.io -2026-08-18T00:00:00Z +2026-08-30T00:00:00Z https://dasllama.io/ -Qwen 3.8 27B joins the board — the new dense hybrid runs on CPU and Metal. +Apple M5 support lands - text, vision and speech, tuned on the new silicon. + +https://dasllama.io/#n-2026-08-30-apple-m5 +2026-08-30T00:00:00Z +<p>dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick up the +M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown +them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane +learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the +pool spanning both tiers with decode parking the slower one.</p> +<p>First official rows on an M5 Max (pp512 / tg128, Metal, llama-bench protocol): +gemma-4-E2B Q8_0 - das 8692.8 / 161.7 tok/s, llama.cpp 7527.4 / 136.6; gpt-oss-20b - +das 3989.4 / 163.2, llama.cpp 3475.3 / 147.5; Qwen3-30B-A3B - das 3506.8 / 165.2, +llama.cpp 3425.5 / 136.4. The image turn rides the same rails - the gemma-4-12B image +encode lands at 7.2 ms. Full rows for the box are on the +<a href="https://daslang.io/dasllama.html">board</a>.</p> +<p>Bringing a new chip up one model at a time - watching kernels tuned for one generation +get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely +fun.</p> + + +Qwen 3.8 27B joins the board - the new dense hybrid runs on CPU and Metal. https://dasllama.io/#n-2026-08-18-qwen38-27b 2026-08-18T00:00:00Z <p>Qwen 3.8 27B is out, and it needed no new architecture support in dasLLAMA: the 3.8 -generation keeps the qwen3.5 architecture — Gated-DeltaNet recurrent layers interleaved -3:1 with gated full attention — so it loads on the existing family path as a pure +generation keeps the qwen3.5 architecture - Gated-DeltaNet recurrent layers interleaved +3:1 with gated full attention - so it loads on the existing family path as a pure scale-up. The Q4_K_M file's attention and FFN planes serve natively on the kq rails, CPU and Metal alike (the DeltaNet projections transcode to q8 at load), and the model joins the official board catalog.</p> -<p>On an M1 Max (pp512 / tg128, llama-bench protocol): Metal — das 147.0 / 14.5 tok/s, -llama.cpp 137.6 / 11.5; CPU — das 33.2 / 5.8, llama.cpp 29.8 / 5.6. On an M4 Pro: -Metal — das 127.0 / 12.8, llama.cpp 126.2 / 11.5; CPU — das 45.8 / 11.6, llama.cpp +<p>On an M1 Max (pp512 / tg128, llama-bench protocol): Metal - das 147.0 / 14.5 tok/s, +llama.cpp 137.6 / 11.5; CPU - das 33.2 / 5.8, llama.cpp 29.8 / 5.6. On an M4 Pro: +Metal - das 127.0 / 12.8, llama.cpp 126.2 / 11.5; CPU - das 45.8 / 11.6, llama.cpp 40.4 / 11.0. Full rows for both boxes are on the <a href="https://daslang.io/dasllama.html">board</a>.</p> -Metal support lands in speech-to-text — whisper large-v3-turbo at 49x realtime on an M1 Max. +Metal support lands in speech-to-text - whisper large-v3-turbo at 49x realtime on an M1 Max. https://dasllama.io/#n-2026-08-17-metal-asr 2026-08-17T00:00:00Z <p>Speech-to-text now serves on Metal: whisper's cross-attention and decoder run on the GPU by default on Apple silicon, and the full-GPU mode powers the new gpu category on the -board. On an M1 Max, whisper large-v3-turbo transcribes a 3:19 clip in 4.0 s — 49x +board. On an M1 Max, whisper large-v3-turbo transcribes a 3:19 clip in 4.0 s - 49x realtime, against 36x for whisper.cpp's Metal path and 12x for our CPU lane. The <a href="https://daslang.io/dasllama.html">board</a> now splits ASR into the same cpu / cpu + accel / gpu categories the LLM board has.</p> -dasllama.io is live — news, the full ladder, and the sidecar exchange. +dasllama.io is live - news, the full ladder, and the sidecar exchange. https://dasllama.io/#n-2026-08-10-dasllama-io-is-live 2026-08-10T00:00:00Z diff --git a/site-dasllama/index.html b/site-dasllama/index.html index 0b24f0ab83..ad326e1f1f 100644 --- a/site-dasllama/index.html +++ b/site-dasllama/index.html @@ -63,31 +63,48 @@

Local inference, written in daslang.

-
-
2026-08-18models

Qwen 3.8 27B joins the board — the new dense hybrid runs on CPU and Metal.latest

▾
+
+
2026-08-30hardware

Apple M5 support lands - text, vision and speech, tuned on the new silicon.latest

▾
+

dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick up the +M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown +them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane +learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the +pool spanning both tiers with decode parking the slower one.

+

First official rows on an M5 Max (pp512 / tg128, Metal, llama-bench protocol): +gemma-4-E2B Q8_0 - das 8692.8 / 161.7 tok/s, llama.cpp 7527.4 / 136.6; gpt-oss-20b - +das 3989.4 / 163.2, llama.cpp 3475.3 / 147.5; Qwen3-30B-A3B - das 3506.8 / 165.2, +llama.cpp 3425.5 / 136.4. The image turn rides the same rails - the gemma-4-12B image +encode lands at 7.2 ms. Full rows for the box are on the +board.

+

Bringing a new chip up one model at a time - watching kernels tuned for one generation +get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely +fun.

+
+
+
2026-08-18models

Qwen 3.8 27B joins the board - the new dense hybrid runs on CPU and Metal.

▾

Qwen 3.8 27B is out, and it needed no new architecture support in dasLLAMA: the 3.8 -generation keeps the qwen3.5 architecture — Gated-DeltaNet recurrent layers interleaved -3:1 with gated full attention — so it loads on the existing family path as a pure +generation keeps the qwen3.5 architecture - Gated-DeltaNet recurrent layers interleaved +3:1 with gated full attention - so it loads on the existing family path as a pure scale-up. The Q4_K_M file's attention and FFN planes serve natively on the kq rails, CPU and Metal alike (the DeltaNet projections transcode to q8 at load), and the model joins the official board catalog.

-

On an M1 Max (pp512 / tg128, llama-bench protocol): Metal — das 147.0 / 14.5 tok/s, -llama.cpp 137.6 / 11.5; CPU — das 33.2 / 5.8, llama.cpp 29.8 / 5.6. On an M4 Pro: -Metal — das 127.0 / 12.8, llama.cpp 126.2 / 11.5; CPU — das 45.8 / 11.6, llama.cpp +

On an M1 Max (pp512 / tg128, llama-bench protocol): Metal - das 147.0 / 14.5 tok/s, +llama.cpp 137.6 / 11.5; CPU - das 33.2 / 5.8, llama.cpp 29.8 / 5.6. On an M4 Pro: +Metal - das 127.0 / 12.8, llama.cpp 126.2 / 11.5; CPU - das 45.8 / 11.6, llama.cpp 40.4 / 11.0. Full rows for both boxes are on the board.

-
2026-08-17engine

Metal support lands in speech-to-text — whisper large-v3-turbo at 49x realtime on an M1 Max.

▾
+
2026-08-17engine

Metal support lands in speech-to-text - whisper large-v3-turbo at 49x realtime on an M1 Max.

▾

Speech-to-text now serves on Metal: whisper's cross-attention and decoder run on the GPU by default on Apple silicon, and the full-GPU mode powers the new gpu category on the -board. On an M1 Max, whisper large-v3-turbo transcribes a 3:19 clip in 4.0 s — 49x +board. On an M1 Max, whisper large-v3-turbo transcribes a 3:19 clip in 4.0 s - 49x realtime, against 36x for whisper.cpp's Metal path and 12x for our CPU lane. The board now splits ASR into the same cpu / cpu + accel / gpu categories the LLM board has.

-
2026-08-10site

dasllama.io is live — news, the full ladder, and the sidecar exchange.

▾
+
2026-08-10site

dasllama.io is live - news, the full ladder, and the sidecar exchange.

▾

Everything measured now lives here, community submissions included. daslang.io/dasllama.html stays the promotional scoreboard and carries official measurements only.

diff --git a/site-dasllama/sitemap.xml b/site-dasllama/sitemap.xml index d076b00e90..b7c8f0f3a8 100644 --- a/site-dasllama/sitemap.xml +++ b/site-dasllama/sitemap.xml @@ -1,6 +1,6 @@ -https://dasllama.io/2026-08-18 +https://dasllama.io/2026-08-30 https://dasllama.io/ladder.html https://dasllama.io/sidecars.html From bbdcf8da1c1e1b25fafbb3cfede153d10090403c Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 04:37:52 -0700 Subject: [PATCH 05/17] the GPU ref pairs get real binaries - metal mtmd twin + the stock mtmd sibling setup_asr_rig builds a build-metal llama-mtmd-cli beside build-cpu on Apple boxes (the CPU-only build's -ngl is inert - a gpu ref leg through it would stamp a CPU run under a metal label), profile_common resolves it (mtmd_bin_metal, empty = the gpu leg skips loudly), and setup_lcpp_ref builds llama-mtmd-cli beside llama-bench so the sibling rule resolves the image refs on a fresh box. Slice C outcome + slice D predictions logged in the plan. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- .../dasLLAMA/benchmarks/asr/_pybench_rows.txt | 9 +- .../dasLLAMA/benchmarks/setup_lcpp_ref.das | 4 +- .../performance/gen_bench_records.das | 4 + .../performance/last_known_good_sidecar.json | 2545 +++++++++-------- .../dasLLAMA/performance/profile_common.das | 9 +- .../dasLLAMA/performance/setup_asr_rig.das | 10 + modules/dasLLAMA/release_remint_plan.md | 20 + 7 files changed, 1334 insertions(+), 1267 deletions(-) diff --git a/modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt b/modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt index bc26e6f74d..3450c22414 100644 --- a/modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt +++ b/modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt @@ -1,7 +1,2 @@ -LOAD onnx-community/whisper-tiny 346.364 -BENCH onnx-whisper-tiny-int8 jfk.wav 11.000 1 450.111 24.438 -BENCH onnx-whisper-tiny-int8 jfk.wav 11.000 2 416.283 26.424 -SKIP onnx-whisper-tiny-int8 jfk3.wav single-window adapter: 33s > 30s -SKIP onnx-whisper-tiny-int8 gb1.wav single-window adapter: 199s > 30s -SKIP onnx-whisper-tiny-int8 hp0.wav single-window adapter: 273s > 30s -SKIP onnx-whisper-tiny-int8 hp0x2.wav single-window adapter: 547s > 30s +LOAD onnx-community/whisper-large-v3-turbo 976.173 +BENCH onnx-whisper-turbo-int8 jfk.wav 11.000 1 2172.818 5.063 diff --git a/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das b/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das index 8931a2b221..3bcb2b6e7d 100644 --- a/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das +++ b/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das @@ -167,7 +167,9 @@ def private build_flavor(dest, f, short_sha : string; jobs : int) : int { return 1 } } - if (run_visible("cmake --build \"{build_dir}\" --config Release --target llama-bench -j {jobs}") != 0) { + // llama-mtmd-cli rides along: the image/audio-chat ref cells resolve it as llama-bench's + // sibling (gen_bench_records' sibling_mtmd rule) - a bench-only build mints das-only rows + if (run_visible("cmake --build \"{build_dir}\" --config Release --target llama-bench llama-mtmd-cli -j {jobs}") != 0) { print("error: build failed for {f}\n") return 1 } diff --git a/modules/dasLLAMA/performance/gen_bench_records.das b/modules/dasLLAMA/performance/gen_bench_records.das index c53d7017c8..ebf3ad9353 100644 --- a/modules/dasLLAMA/performance/gen_bench_records.das +++ b/modules/dasLLAMA/performance/gen_bench_records.das @@ -1071,6 +1071,10 @@ def private asr_ref_pass(spec : AsrModelSpec; ref : AsrRef; versions : string; c to_log(LOG_WARNING, "gen_bench_records: SKIP {spec.display} ref {ref.tool} - tool not on this box\n") return } + if (gpu && ref.tool == "mtmd" && empty(mtmd_bin_metal())) { + to_log(LOG_WARNING, "gen_bench_records: SKIP {spec.display} ref mtmd gpu - no build-metal mtmd on this box (setup_asr_rig builds it on Apple)\n") + return + } let t0 = ref_time_ticks() to_log(LOG_INFO, "gen_bench_records: START {spec.display} ref {ref.tool}\n") logger_info("bench.records", "cell start", JV({"model" => JV(spec.display), "engine" => JV(asr_engine_name(ref.tool)), "leg" => JV("asr")})) diff --git a/modules/dasLLAMA/performance/last_known_good_sidecar.json b/modules/dasLLAMA/performance/last_known_good_sidecar.json index a096238dba..32079a7578 100644 --- a/modules/dasLLAMA/performance/last_known_good_sidecar.json +++ b/modules/dasLLAMA/performance/last_known_good_sidecar.json @@ -1,619 +1,626 @@ { "kernels" : { - "add_inplace" : "vec8_u4", - "cvt_f32_to_f16" : "u4", - "rope_scaled_neox_tab" : "u4", - "q51q8_tile_gen" : "mr4_nrsplit2", + "add_inplace" : "vec8_u2", + "cvt_f32_to_f16" : "vec16", + "rope_scaled_neox_tab" : "vec8_u2", + "q51q8_tile_gen" : "mr4", "softmax" : "vec8_u2", "mul_inplace" : "vec8_u2", "quantize_q8_0_bs_into_ptr" : "plain", "dot_q8kv" : "vec4_u2", "dot_q8q8" : "vec16", - "quantize_q8kv_row" : "u2", - "axpy_f16" : "vec4_u4", + "quantize_q8kv_row" : "plain", + "axpy_f16" : "vec8_u2", "q40q8_tile_gen" : "mr8", "axpy_tq4kv" : "vec8_u2", "cvt_tq4kv_to_f32" : "vec8_u2", - "axpy" : "vec8_u8", + "axpy" : "vec8_u2", "dot_q8q8kv" : "vec16", - "dot_mx4q8" : "u8", + "dot_mx4q8" : "u2", "softmax_sink" : "vec8_u2", - "dot_q8q8_laneq4x4" : "u4", + "dot_q8q8_laneq4x4" : "u2", "dot_bf16" : "vec8_u2", "add_scale_inplace" : "vec8_u2", "cvt_q8kv_to_f32" : "vec8_u2", - "axpy_q8kv" : "u2", + "axpy_q8kv" : "vec8_u2", "dot_q8q8_f16s" : "vec16", "q8q8_tile_gen" : "mr8_budget", "quantize_q8_0_into_ptr" : "plain", "k4q8_tile_gen" : "mr8", - "k5q8_tile_gen" : "mr8", + "k5q8_tile_gen" : "mr4", "k6q8_tile_gen" : "mr4", "gemm_f32_uk_4x16" : "u2", "dot_q51e" : "vec16", - "dot_f16" : "vec8_u4", - "cvt_f16_to_f32" : "vec16", - "dot" : "vec8_u4", + "dot_f16" : "vec8_u2", + "cvt_f16_to_f32" : "vec8_u2", + "dot" : "vec8_u2", "dot_q8tq4kv" : "vec16", - "scale_inplace" : "vec16_u2", - "quantize_tq4kv_row" : "plain", + "scale_inplace" : "vec8_u2", "dot_q4" : "vec4_u4", - "copy_floats" : "vec8_u8", + "quantize_tq4kv_row" : "plain", + "copy_floats" : "vec8_u2", "rmsnorm" : "vec8" }, "provenance" : { "validation" : "ok", - "noise_probes" : "start cv 0.55%; mid1 cv 0.15%; mid2 cv 0.32%; end cv 0.66%", + "noise_probes" : "start cv 0.26%; mid1 cv 0.10%; mid2 cv 0.20%; end cv 0.29%", "platform" : "darwin", - "noise_floor_cv_pct" : "0.66", - "engine_sha" : "1df0a9620", - "box" : "darwin|arm64|MacBookPro18,2|25F84|Apple M1 Max", - "written" : "2026-08-17T12:33:37.001Z", - "mode" : "paranoid", - "dasllama_version" : "4", + "noise_floor_cv_pct" : "0.29", + "engine_sha" : "366669a53", + "box" : "darwin|arm64|Mac17,6|25G72|Apple M5 Max", + "written" : "2026-08-30T11:34:13.982Z", + "validation_demoted" : "0", + "mode" : "normal", + "dasllama_version" : "15", "noise" : "ok", - "binary" : "/Users/borisbatkin/Work/daScript/bin/daslang", + "binary" : "./bin/daslang", "arch" : "arm64", - "validation_max_drift_pct" : "0.41" + "validation_max_drift_pct" : "0.73" }, "race" : { "cvt_q8kv_to_f32" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 522, - "best_us" : 512 + "med_us" : 376.78125, + "best_us" : 376.25 }, "vec32" : { - "med_us" : 522, - "best_us" : 512 + "med_us" : 375.53125, + "best_us" : 374.9375 }, "vec32_u4" : { - "med_us" : 522, - "best_us" : 512 + "med_us" : 376.5, + "best_us" : 375.90625 }, "vec32_u8" : { - "med_us" : 522, - "best_us" : 512 + "med_us" : 376.65625, + "best_us" : 376.09375 }, "vec16_u2" : { - "med_us" : 521, - "best_us" : 510 + "med_us" : 376.125, + "best_us" : 376.03125 }, "vec16_u4" : { - "med_us" : 521, - "best_us" : 511 + "med_us" : 376.25, + "best_us" : 376.0625 }, "vec16_u8" : { - "med_us" : 521, - "best_us" : 511 + "med_us" : 376.46875, + "best_us" : 375.90625 }, "vec4" : { - "med_us" : 522, - "best_us" : 512 + "med_us" : 375.40625, + "best_us" : 374.46875 }, "vec8" : { - "med_us" : 522, - "best_us" : 512 + "med_us" : 375.5, + "best_us" : 375.15625 }, "vec4_u4" : { - "med_us" : 521, - "best_us" : 511 + "med_us" : 376.375, + "best_us" : 376.15625 }, "vec8_u4" : { - "med_us" : 523, - "best_us" : 513 + "med_us" : 375.90625, + "best_us" : 374.96875 }, "plain" : { - "med_us" : 522, - "best_us" : 512 + "med_us" : 375.90625, + "best_us" : 374.96875 }, "u2" : { - "med_us" : 521, - "best_us" : 510 + "med_us" : 376.375, + "best_us" : 375.875 }, "u4" : { - "med_us" : 521, - "best_us" : 510 + "med_us" : 376.40625, + "best_us" : 376.0625 }, "u8" : { - "med_us" : 521, - "best_us" : 510 + "med_us" : 376.71875, + "best_us" : 375.90625 }, "vec4_u2" : { - "med_us" : 521, - "best_us" : 511 + "med_us" : 376.46875, + "best_us" : 375.96875 }, "vec4_u8" : { - "med_us" : 521, - "best_us" : 511 + "med_us" : 376.28125, + "best_us" : 376.0625 }, "vec8_u2" : { - "med_us" : 523, - "best_us" : 513 + "med_us" : 375.71875, + "best_us" : 374.90625 }, "vec8_u8" : { - "med_us" : 523, - "best_us" : 513 + "med_us" : 375.5, + "best_us" : 375.25 }, "vec16" : { - "med_us" : 522, - "best_us" : 512 + "med_us" : 375.1875, + "best_us" : 374.71875 } } }, "add_inplace" : { - "winner" : "vec8_u4", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 497, - "best_us" : 495 + "med_us" : 335.59375, + "best_us" : 334.3125 }, "vec32" : { - "med_us" : 502, - "best_us" : 499 + "med_us" : 362.65625, + "best_us" : 360.3125 }, "vec32_u4" : { - "med_us" : 495, - "best_us" : 493 + "med_us" : 337.125, + "best_us" : 336.84375 }, "vec32_u8" : { - "med_us" : 495, - "best_us" : 492 + "med_us" : 335.28125, + "best_us" : 334.5 }, "vec16_u2" : { - "med_us" : 512, - "best_us" : 509 + "med_us" : 339.34375, + "best_us" : 339.28125 }, "vec16_u4" : { - "med_us" : 516, - "best_us" : 513 + "med_us" : 338.53125, + "best_us" : 337.5625 }, "vec16_u8" : { - "med_us" : 594, - "best_us" : 594 + "med_us" : 411.0625, + "best_us" : 408.90625 }, "vec4" : { - "med_us" : 506, - "best_us" : 504 + "med_us" : 361.5, + "best_us" : 360.1875 }, "vec8" : { - "med_us" : 502, - "best_us" : 499 + "med_us" : 361.625, + "best_us" : 360.03125 }, "vec4_u4" : { - "med_us" : 503, - "best_us" : 500 + "med_us" : 337.84375, + "best_us" : 336.375 }, "vec8_u4" : { - "med_us" : 495, - "best_us" : 492 + "med_us" : 336.5625, + "best_us" : 335.78125 }, "plain" : { - "med_us" : 506, - "best_us" : 503 + "med_us" : 361.15625, + "best_us" : 360.3125 }, "u2" : { - "med_us" : 507, - "best_us" : 505 + "med_us" : 361.5625, + "best_us" : 359.78125 }, "u4" : { - "med_us" : 505, - "best_us" : 502 + "med_us" : 338.125, + "best_us" : 336.4375 }, "u8" : { - "med_us" : 500, - "best_us" : 497 + "med_us" : 336.65625, + "best_us" : 334.65625 }, "vec4_u2" : { - "med_us" : 506, - "best_us" : 503 + "med_us" : 361.8125, + "best_us" : 359.875 }, "vec4_u8" : { - "med_us" : 500, - "best_us" : 497 + "med_us" : 336.25, + "best_us" : 335.1875 }, "vec8_u2" : { - "med_us" : 498, - "best_us" : 495 + "med_us" : 336.375, + "best_us" : 334.46875 }, "vec8_u8" : { - "med_us" : 495, - "best_us" : 492 + "med_us" : 342.15625, + "best_us" : 339.28125 }, "vec16" : { - "med_us" : 518, - "best_us" : 515 + "med_us" : 338.375, + "best_us" : 336.875 } } }, "axpy_q8kv" : { - "winner" : "u2", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 551, - "best_us" : 547 + "med_us" : 395.59375, + "best_us" : 395.4375 }, "vec32" : { - "med_us" : 572, - "best_us" : 569 + "med_us" : 393.71875, + "best_us" : 393.5625 }, "vec32_u4" : { - "med_us" : 551, - "best_us" : 548 + "med_us" : 396.0625, + "best_us" : 396 }, "vec32_u8" : { - "med_us" : 551, - "best_us" : 547 + "med_us" : 395.3125, + "best_us" : 395.1875 }, "vec16_u2" : { - "med_us" : 549, - "best_us" : 546 + "med_us" : 394.9375, + "best_us" : 394.8125 }, "vec16_u4" : { - "med_us" : 549, - "best_us" : 546 + "med_us" : 395.5625, + "best_us" : 394.90625 }, "vec16_u8" : { - "med_us" : 549, - "best_us" : 546 + "med_us" : 395.125, + "best_us" : 394.9375 }, "vec4" : { - "med_us" : 572, - "best_us" : 569 + "med_us" : 393.6875, + "best_us" : 393.53125 }, "vec8" : { - "med_us" : 572, - "best_us" : 569 + "med_us" : 393.6875, + "best_us" : 393.40625 }, "vec4_u4" : { - "med_us" : 571, - "best_us" : 568 + "med_us" : 393.09375, + "best_us" : 392.65625 }, "vec8_u4" : { - "med_us" : 554, - "best_us" : 551 + "med_us" : 396.09375, + "best_us" : 395.375 }, "plain" : { - "med_us" : 572, - "best_us" : 569 + "med_us" : 393.78125, + "best_us" : 393.53125 }, "u2" : { - "med_us" : 549, - "best_us" : 546 + "med_us" : 394.59375, + "best_us" : 394.46875 }, "u4" : { - "med_us" : 549, - "best_us" : 546 + "med_us" : 395.5, + "best_us" : 394.9375 }, "u8" : { - "med_us" : 549, - "best_us" : 546 + "med_us" : 395.53125, + "best_us" : 394.90625 }, "vec4_u2" : { - "med_us" : 571, - "best_us" : 568 + "med_us" : 393.59375, + "best_us" : 393.4375 }, "vec4_u8" : { - "med_us" : 571, - "best_us" : 568 + "med_us" : 394.5625, + "best_us" : 393.75 }, "vec8_u2" : { - "med_us" : 640, - "best_us" : 640 + "med_us" : 395.25, + "best_us" : 395.125 }, "vec8_u8" : { - "med_us" : 554, - "best_us" : 551 + "med_us" : 395.96875, + "best_us" : 395.5625 }, "vec16" : { - "med_us" : 572, - "best_us" : 569 + "med_us" : 393.59375, + "best_us" : 393.4375 } } }, "cvt_f32_to_f16" : { - "winner" : "u4", + "winner" : "vec16", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 6.37927280644459, "rows" : { "vec32_u2" : { - "med_us" : 500, - "best_us" : 497 + "med_us" : 347.3125, + "best_us" : 346.65625 }, "vec32" : { - "med_us" : 501, - "best_us" : 498 + "med_us" : 347.40625, + "best_us" : 347.3125 }, "vec32_u4" : { - "med_us" : 492, - "best_us" : 490 + "med_us" : 347.5625, + "best_us" : 347.3125 }, "vec32_u8" : { - "med_us" : 490, - "best_us" : 489 + "med_us" : 347.34375, + "best_us" : 347.28125 }, "vec16_u2" : { - "med_us" : 502.5, - "best_us" : 500 + "med_us" : 336.40625, + "best_us" : 335.53125 }, "vec16_u4" : { - "med_us" : 501, - "best_us" : 498 + "med_us" : 335.5625, + "best_us" : 334.90625 }, "vec16_u8" : { - "med_us" : 492, - "best_us" : 490 + "med_us" : 336.15625, + "best_us" : 335.96875 }, "vec4" : { - "med_us" : 579, - "best_us" : 579 + "med_us" : 363.59375, + "best_us" : 363.125 }, "vec8" : { - "med_us" : 501, - "best_us" : 499 + "med_us" : 358.96875, + "best_us" : 358.71875 }, "vec4_u4" : { - "med_us" : 578, - "best_us" : 578 + "med_us" : 363.375, + "best_us" : 362.71875 }, "vec8_u4" : { - "med_us" : 493, - "best_us" : 490 + "med_us" : 358.6875, + "best_us" : 358.625 }, "plain" : { - "med_us" : 501, - "best_us" : 498 + "med_us" : 358.84375, + "best_us" : 358.6875 }, "u2" : { - "med_us" : 497, - "best_us" : 496 + "med_us" : 358.90625, + "best_us" : 358.71875 }, "u4" : { - "med_us" : 490, - "best_us" : 490 + "med_us" : 358.65625, + "best_us" : 358.625 }, "u8" : { - "med_us" : 492, - "best_us" : 489 + "med_us" : 358.6875, + "best_us" : 358.5625 }, "vec4_u2" : { - "med_us" : 580, - "best_us" : 580 + "med_us" : 364.53125, + "best_us" : 363.78125 }, "vec4_u8" : { - "med_us" : 571, - "best_us" : 571 + "med_us" : 362.5, + "best_us" : 361.0625 }, "vec8_u2" : { - "med_us" : 499, - "best_us" : 497 + "med_us" : 358.828125, + "best_us" : 358.375 }, "vec8_u8" : { - "med_us" : 492, - "best_us" : 489 + "med_us" : 358.8125, + "best_us" : 358.21875 }, "vec16" : { - "med_us" : 502, - "best_us" : 499 + "med_us" : 335.9375, + "best_us" : 335.65625 } } }, "rope_scaled_neox_tab" : { - "winner" : "u4", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 817, - "best_us" : 817 + "med_us" : 684.9310344827586, + "best_us" : 683.6551724137931 }, "vec32" : { - "med_us" : 748, - "best_us" : 748 + "med_us" : 639.5483870967741, + "best_us" : 638.9677419354839 }, "vec32_u4" : { - "med_us" : 797, - "best_us" : 797 + "med_us" : 640.1612903225806, + "best_us" : 638.741935483871 }, "vec32_u8" : { - "med_us" : 796, - "best_us" : 796 + "med_us" : 639.5806451612904, + "best_us" : 637.4193548387096 }, "vec16_u2" : { - "med_us" : 651, - "best_us" : 651 + "med_us" : 384.5625, + "best_us" : 380.59375 }, "vec16_u4" : { - "med_us" : 649, - "best_us" : 649 + "med_us" : 375.34375, + "best_us" : 374.65625 }, "vec16_u8" : { - "med_us" : 649, - "best_us" : 649 + "med_us" : 374.4375, + "best_us" : 373.9375 }, "vec4" : { - "med_us" : 696, - "best_us" : 696 + "med_us" : 396.59375, + "best_us" : 394.75 }, "vec8" : { - "med_us" : 628, - "best_us" : 625 + "med_us" : 370.5, + "best_us" : 368.15625 }, "vec4_u4" : { - "med_us" : 619, - "best_us" : 616 + "med_us" : 370.84375, + "best_us" : 369.1875 }, "vec8_u4" : { - "med_us" : 620, - "best_us" : 617 + "med_us" : 371.53125, + "best_us" : 369.4375 }, "plain" : { - "med_us" : 696, - "best_us" : 696 + "med_us" : 406.71875, + "best_us" : 406.125 }, "u2" : { - "med_us" : 662, - "best_us" : 662 + "med_us" : 383.0625, + "best_us" : 382.28125 }, "u4" : { - "med_us" : 619, - "best_us" : 616 + "med_us" : 372.28125, + "best_us" : 370.375 }, "u8" : { - "med_us" : 743, - "best_us" : 743 + "med_us" : 420.75, + "best_us" : 419.09375 }, "vec4_u2" : { - "med_us" : 662, - "best_us" : 662 + "med_us" : 383.625, + "best_us" : 382.59375 }, "vec4_u8" : { - "med_us" : 743, - "best_us" : 743 + "med_us" : 418.8125, + "best_us" : 416.8125 }, "vec8_u2" : { - "med_us" : 644, - "best_us" : 641 + "med_us" : 372.125, + "best_us" : 371.28125 }, "vec8_u8" : { - "med_us" : 708, - "best_us" : 708 + "med_us" : 403.1875, + "best_us" : 401.28125 }, "vec16" : { - "med_us" : 618, - "best_us" : 615 + "med_us" : 368.46875, + "best_us" : 366.65625 } } }, "q51q8_tile_gen" : { - "winner" : "mr4_nrsplit2", + "winner" : "mr4", "rows" : { "mr8" : { - "streamed_us" : 814 + "streamed_us" : 584 }, "dot_maddubs_width256_mr8" : { - "streamed_us" : 6071 + "streamed_us" : 4011 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "streamed_us" : 6073 + "streamed_us" : 3963 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "streamed_us" : 6070 + "streamed_us" : 3930 }, "mr4" : { - "streamed_us" : 816 + "streamed_us" : 588 }, "reference" : { - "streamed_us" : 6214 + "streamed_us" : 3795 }, "mr4_nrsplit2" : { - "streamed_us" : 814 + "streamed_us" : 604 }, "dot_vpdpbusd_width256_mr8" : { - "streamed_us" : 6065 + "streamed_us" : 3943 }, "dot_vpdpbusd_width512_mr16" : { - "streamed_us" : 6068 + "streamed_us" : 3937 }, "mr8_nrsplit2" : { - "streamed_us" : 814 + "streamed_us" : 605 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "streamed_us" : 6070 + "streamed_us" : 3959 } } }, "softmax" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 4508, - "best_us" : 4499 + "med_us" : 3175, + "best_us" : 3170.5 }, "vec32" : { - "med_us" : 4512, - "best_us" : 4502 + "med_us" : 3169.6666666666665, + "best_us" : 3167 }, "vec32_u4" : { - "med_us" : 4507, - "best_us" : 4497 + "med_us" : 3175.6666666666665, + "best_us" : 3166.5 }, "vec32_u8" : { - "med_us" : 4506, - "best_us" : 4497 + "med_us" : 3170.3333333333335, + "best_us" : 3166.6666666666665 }, "vec16_u2" : { - "med_us" : 4505, - "best_us" : 4495 + "med_us" : 3181, + "best_us" : 3176 }, "vec16_u4" : { - "med_us" : 4503, - "best_us" : 4493 + "med_us" : 3178.6666666666665, + "best_us" : 3175.5 }, "vec16_u8" : { - "med_us" : 4528, - "best_us" : 4517 + "med_us" : 4042, + "best_us" : 4038.25 }, "vec4" : { - "med_us" : 4520, - "best_us" : 4509 + "med_us" : 3172.6666666666665, + "best_us" : 3170.6666666666665 }, "vec8" : { - "med_us" : 4512, - "best_us" : 4502 + "med_us" : 3166.1666666666665, + "best_us" : 3165.8333333333335 }, "vec4_u4" : { - "med_us" : 4517, - "best_us" : 4507 + "med_us" : 3175.5, + "best_us" : 3173.3333333333335 }, "vec8_u4" : { - "med_us" : 4507, - "best_us" : 4498 + "med_us" : 3167.5, + "best_us" : 3165.5 }, "plain" : { - "med_us" : 4519, - "best_us" : 4509 + "med_us" : 3173, + "best_us" : 3169.1666666666665 }, "u2" : { - "med_us" : 4522, - "best_us" : 4512 + "med_us" : 3164.3333333333335, + "best_us" : 3163.8333333333335 }, "u4" : { - "med_us" : 4517, - "best_us" : 4508 + "med_us" : 3173.3333333333335, + "best_us" : 3169.6666666666665 }, "u8" : { - "med_us" : 4516, - "best_us" : 4506 + "med_us" : 3165.5, + "best_us" : 3164.1666666666665 }, "vec4_u2" : { - "med_us" : 4520, - "best_us" : 4510 + "med_us" : 3164, + "best_us" : 3162.8333333333335 }, "vec4_u8" : { - "med_us" : 4516, - "best_us" : 4506 + "med_us" : 3165, + "best_us" : 3163.6666666666665 }, "vec8_u2" : { - "med_us" : 4509, - "best_us" : 4498 + "med_us" : 3171.1666666666665, + "best_us" : 3169.3333333333335 }, "vec8_u8" : { - "med_us" : 4506, - "best_us" : 4497 + "med_us" : 3164.6666666666665, + "best_us" : 3162.3333333333335 }, "vec16" : { - "med_us" : 4506, - "best_us" : 4497 + "med_us" : 3185.1666666666665, + "best_us" : 3184.5 } } }, @@ -621,166 +628,167 @@ "winner" : "mr8_budget", "rows" : { "kstep1" : { - "tile_us" : 34760, - "gemv_us" : 303, - "hot_us" : 17 + "tile_us" : 22909, + "gemv_us" : 199, + "hot_us" : 10.3125 }, "kstep2_nrsplit2" : { - "tile_us" : 36025, - "gemv_us" : 303, - "hot_us" : 16.75 + "tile_us" : 24181, + "gemv_us" : 195, + "hot_us" : 9.9375 }, "kstep1_nrsplit2" : { - "tile_us" : 36924, - "gemv_us" : 303, - "hot_us" : 16.8125 + "tile_us" : 24359, + "gemv_us" : 197, + "hot_us" : 9.875 }, "reference" : { - "tile_us" : 50557, - "gemv_us" : 303, - "hot_us" : 16.875 + "tile_us" : 33261, + "gemv_us" : 201, + "hot_us" : 10.3125 }, "kstep4_nrsplit2" : { - "tile_us" : 35805, - "gemv_us" : 303, - "hot_us" : 16.8125 + "tile_us" : 24371, + "gemv_us" : 194, + "hot_us" : 10 }, "kstep4_nrsplit2_mr8_gkstep2" : { - "tile_us" : 32517, - "gemv_us" : 302, - "hot_us" : 15.3125 + "tile_us" : 24036, + "gemv_us" : 195, + "hot_us" : 9.5 }, "kstep1_nrsplit2_mr8" : { - "tile_us" : 37622, - "gemv_us" : 303, - "hot_us" : 15.5 + "tile_us" : 23184, + "gemv_us" : 195, + "hot_us" : 9.5 }, "kstep2_nrsplit2_mr8" : { - "tile_us" : 32343, - "gemv_us" : 303, - "hot_us" : 15.5625 + "tile_us" : 22835, + "gemv_us" : 193, + "hot_us" : 9.75 }, "kstep4_nrsplit2_mr8" : { - "tile_us" : 32819, - "gemv_us" : 302, - "hot_us" : 15.5625 + "tile_us" : 24088, + "gemv_us" : 189, + "hot_us" : 9.5 }, "kstep2_gkstep2" : { - "tile_us" : 34641, - "gemv_us" : 303, - "hot_us" : 16.3125 + "tile_us" : 23340, + "gemv_us" : 193, + "hot_us" : 9.6875 }, "kstep2_gkstep4" : { - "tile_us" : 34617, - "gemv_us" : 303, - "hot_us" : 16.3125 + "tile_us" : 23285, + "gemv_us" : 196, + "hot_us" : 9.5625 }, "kstep4_nrsplit2_mr8_gkstep4" : { - "tile_us" : 31992, - "gemv_us" : 302, - "hot_us" : 15.4375 + "tile_us" : 24041, + "gemv_us" : 196, + "hot_us" : 9.9375 }, "mr8_budget" : { - "tile_us" : 31255, - "gemv_us" : 302, - "hot_us" : 15.375 + "tile_us" : 22148, + "gemv_us" : 190, + "hot_us" : 9.4375 }, "kstep2" : { - "tile_us" : 34625, - "gemv_us" : 303, - "hot_us" : 16.75 + "tile_us" : 23303, + "gemv_us" : 199, + "hot_us" : 10 }, "kstep4" : { - "tile_us" : 33927, - "gemv_us" : 303, - "hot_us" : 16.75 + "tile_us" : 24765, + "gemv_us" : 194, + "hot_us" : 9.875 } } }, "mul_inplace" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 499, - "best_us" : 489 + "med_us" : 336.9375, + "best_us" : 335.53125 }, "vec32" : { - "med_us" : 500, - "best_us" : 490 + "med_us" : 361.3125, + "best_us" : 359.78125 }, "vec32_u4" : { - "med_us" : 496, - "best_us" : 493 + "med_us" : 337.34375, + "best_us" : 336.1875 }, "vec32_u8" : { - "med_us" : 495, - "best_us" : 487 + "med_us" : 335.8125, + "best_us" : 334.40625 }, "vec16_u2" : { - "med_us" : 505, - "best_us" : 496 + "med_us" : 361.75, + "best_us" : 360.3125 }, "vec16_u4" : { - "med_us" : 503, - "best_us" : 491 + "med_us" : 338.34375, + "best_us" : 336.84375 }, "vec16_u8" : { - "med_us" : 498, - "best_us" : 489 + "med_us" : 337.5, + "best_us" : 335.46875 }, "vec4" : { - "med_us" : 507, - "best_us" : 495 + "med_us" : 361.3125, + "best_us" : 359.8125 }, "vec8" : { - "med_us" : 502, - "best_us" : 490 + "med_us" : 361.875, + "best_us" : 359.40625 }, "vec4_u4" : { - "med_us" : 500, - "best_us" : 495 + "med_us" : 337.46875, + "best_us" : 336.875 }, "vec8_u4" : { - "med_us" : 495, - "best_us" : 486 + "med_us" : 337.03125, + "best_us" : 336.625 }, "plain" : { - "med_us" : 506, - "best_us" : 503 + "med_us" : 361.875, + "best_us" : 361.53125 }, "u2" : { - "med_us" : 507, - "best_us" : 495 + "med_us" : 362.09375, + "best_us" : 361.625 }, "u4" : { - "med_us" : 506, - "best_us" : 494 + "med_us" : 338.84375, + "best_us" : 335.90625 }, "u8" : { - "med_us" : 500, - "best_us" : 490 + "med_us" : 337.46875, + "best_us" : 336.1875 }, "vec4_u2" : { - "med_us" : 506, - "best_us" : 494 + "med_us" : 362, + "best_us" : 360.375 }, "vec4_u8" : { - "med_us" : 500, - "best_us" : 491 + "med_us" : 337.125, + "best_us" : 336.8125 }, "vec8_u2" : { - "med_us" : 497, - "best_us" : 488 + "med_us" : 343.375, + "best_us" : 335.8125 }, "vec8_u8" : { - "med_us" : 495, - "best_us" : 486 + "med_us" : 337.125, + "best_us" : 335.34375 }, "vec16" : { - "med_us" : 504, - "best_us" : 494 + "med_us" : 361.15625, + "best_us" : 360.25 } } }, @@ -788,119 +796,119 @@ "winner" : "mr8", "rows" : { "mr8" : { - "tile_us" : 38647, - "gemv_us" : 245, - "hot_us" : 15 + "tile_us" : 27974, + "gemv_us" : 179, + "hot_us" : 10.5625 }, "dot_maddubs_width256_mr8" : { - "tile_us" : 749029, - "gemv_us" : 2939, - "hot_us" : 183.5 + "tile_us" : 467919, + "gemv_us" : 1785, + "hot_us" : 114.875 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "tile_us" : 751383, - "gemv_us" : 2941, - "hot_us" : 183.5 + "tile_us" : 467813, + "gemv_us" : 1842, + "hot_us" : 115.25 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "tile_us" : 748929, - "gemv_us" : 2939, - "hot_us" : 183.5 + "tile_us" : 467907, + "gemv_us" : 1851, + "hot_us" : 115.0625 }, "mr4" : { - "tile_us" : 42684, - "gemv_us" : 255, - "hot_us" : 15.8125 + "tile_us" : 30522, + "gemv_us" : 189, + "hot_us" : 11.8125 }, "reference" : { - "tile_us" : 749899, - "gemv_us" : 2939, - "hot_us" : 183.5 + "tile_us" : 468180, + "gemv_us" : 1756, + "hot_us" : 110.6875 }, "mr4_nrsplit2" : { - "tile_us" : 50812, - "gemv_us" : 259, - "hot_us" : 16.0625 + "tile_us" : 36833, + "gemv_us" : 185, + "hot_us" : 11.5 }, "dot_vpdpbusd_width256_mr8" : { - "tile_us" : 748899, - "gemv_us" : 2939, - "hot_us" : 183.375 + "tile_us" : 467888, + "gemv_us" : 1852, + "hot_us" : 114.9375 }, "dot_vpdpbusd_width512_mr16" : { - "tile_us" : 748818, - "gemv_us" : 2939, - "hot_us" : 183.3125 + "tile_us" : 468219, + "gemv_us" : 1857, + "hot_us" : 111.1875 }, "mr8_nrsplit2" : { - "tile_us" : 45447, - "gemv_us" : 241, - "hot_us" : 15 + "tile_us" : 33355, + "gemv_us" : 168, + "hot_us" : 10.5 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "tile_us" : 748724, - "gemv_us" : 2936, - "hot_us" : 183.3125 + "tile_us" : 468332, + "gemv_us" : 1777, + "hot_us" : 109.6875 } } }, "k5q8_tile_gen" : { - "winner" : "mr8", + "winner" : "mr4", "rows" : { "mr8" : { - "tile_us" : 38689, - "gemv_us" : 596, - "hot_us" : 36.875 + "tile_us" : 57152, + "gemv_us" : 414, + "hot_us" : 26.9375 }, "dot_maddubs_width256_mr8" : { - "tile_us" : 365590, - "gemv_us" : 3710, - "hot_us" : 228.6875 + "tile_us" : 223258, + "gemv_us" : 2134, + "hot_us" : 132.625 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "tile_us" : 363061, - "gemv_us" : 3666, - "hot_us" : 228.3125 + "tile_us" : 223911, + "gemv_us" : 2211, + "hot_us" : 138.4375 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "tile_us" : 364766, - "gemv_us" : 3665, - "hot_us" : 228.25 + "tile_us" : 223523, + "gemv_us" : 2154, + "hot_us" : 133.0625 }, "mr4" : { - "tile_us" : 40456, - "gemv_us" : 589, - "hot_us" : 36.625 + "tile_us" : 28082, + "gemv_us" : 428, + "hot_us" : 26.5 }, "reference" : { - "tile_us" : 365031, - "gemv_us" : 3672, - "hot_us" : 229.3125 + "tile_us" : 223588, + "gemv_us" : 2165, + "hot_us" : 130.75 }, "mr4_nrsplit2" : { - "tile_us" : 44793, - "gemv_us" : 594, - "hot_us" : 37.0625 + "tile_us" : 32572, + "gemv_us" : 411, + "hot_us" : 26 }, "dot_vpdpbusd_width256_mr8" : { - "tile_us" : 365311, - "gemv_us" : 3682, - "hot_us" : 228.5625 + "tile_us" : 223916, + "gemv_us" : 2221, + "hot_us" : 133.1875 }, "dot_vpdpbusd_width512_mr16" : { - "tile_us" : 364726, - "gemv_us" : 3700, - "hot_us" : 228.125 + "tile_us" : 223720, + "gemv_us" : 2138, + "hot_us" : 137.5625 }, "mr8_nrsplit2" : { - "tile_us" : 39618, - "gemv_us" : 594, - "hot_us" : 36.875 + "tile_us" : 82544, + "gemv_us" : 415, + "hot_us" : 27 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "tile_us" : 364311, - "gemv_us" : 3724, - "hot_us" : 228.9375 + "tile_us" : 223996, + "gemv_us" : 2211, + "hot_us" : 138.375 } } }, @@ -908,929 +916,939 @@ "winner" : "mr4", "rows" : { "mr8" : { - "tile_us" : 58603, - "gemv_us" : 512, - "hot_us" : 31.5625 + "tile_us" : 72017, + "gemv_us" : 429, + "hot_us" : 21.6875 }, "dot_maddubs_width256_mr8" : { - "tile_us" : 571098, - "gemv_us" : 13745, - "hot_us" : 858.375 + "tile_us" : 199190, + "gemv_us" : 5518, + "hot_us" : 338.5 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "tile_us" : 571136, - "gemv_us" : 13740, - "hot_us" : 858.5 + "tile_us" : 199398, + "gemv_us" : 5584, + "hot_us" : 341.125 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "tile_us" : 571145, - "gemv_us" : 13744, - "hot_us" : 858.8125 + "tile_us" : 199253, + "gemv_us" : 5568, + "hot_us" : 340.625 }, "mr4" : { - "tile_us" : 52352, - "gemv_us" : 487, - "hot_us" : 30.125 + "tile_us" : 37209, + "gemv_us" : 333, + "hot_us" : 20.4375 }, "reference" : { - "tile_us" : 571617, - "gemv_us" : 13742, - "hot_us" : 858.375 + "tile_us" : 199555, + "gemv_us" : 5643, + "hot_us" : 336.125 }, "mr4_nrsplit2" : { - "tile_us" : 58994, - "gemv_us" : 488, - "hot_us" : 30.1875 + "tile_us" : 38642, + "gemv_us" : 338, + "hot_us" : 21.0625 }, "dot_vpdpbusd_width256_mr8" : { - "tile_us" : 570921, - "gemv_us" : 13745, - "hot_us" : 858.5 + "tile_us" : 199297, + "gemv_us" : 5594, + "hot_us" : 340 }, "dot_vpdpbusd_width512_mr16" : { - "tile_us" : 571283, - "gemv_us" : 13741, - "hot_us" : 858.875 + "tile_us" : 199584, + "gemv_us" : 5628, + "hot_us" : 340.125 }, "mr8_nrsplit2" : { - "tile_us" : 61881, - "gemv_us" : 514, - "hot_us" : 31.625 + "tile_us" : 97667, + "gemv_us" : 337, + "hot_us" : 21.4375 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "tile_us" : 571589, - "gemv_us" : 13741, - "hot_us" : 859 + "tile_us" : 199523, + "gemv_us" : 5627, + "hot_us" : 339.25 } } }, "quantize_q8_0_into_ptr" : { "winner" : "plain", "fallback" : "plain", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 3727, - "best_us" : 3720 + "med_us" : 2445.875, + "best_us" : 2442.5 }, "vec32" : { - "med_us" : 3702, - "best_us" : 3694 + "med_us" : 2405.5, + "best_us" : 2405 }, "vec32_u4" : { - "med_us" : 3727.5, - "best_us" : 3719 + "med_us" : 2445.75, + "best_us" : 2443.75 }, "vec32_u8" : { - "med_us" : 3727, - "best_us" : 3720 + "med_us" : 2445, + "best_us" : 2442.5 }, "vec16_u2" : { - "med_us" : 3702, - "best_us" : 3693 + "med_us" : 2409.5, + "best_us" : 2409 }, "vec16_u4" : { - "med_us" : 3701, - "best_us" : 3693 + "med_us" : 2411.875, + "best_us" : 2408.5 }, "vec16_u8" : { - "med_us" : 3701, - "best_us" : 3693 + "med_us" : 2415.625, + "best_us" : 2413.75 }, "vec4" : { - "med_us" : 3702, - "best_us" : 3693 + "med_us" : 2408, + "best_us" : 2406.125 }, "vec8" : { - "med_us" : 3702, - "best_us" : 3694 + "med_us" : 2409.25, + "best_us" : 2407.125 }, "vec4_u4" : { - "med_us" : 4707, - "best_us" : 4707 + "med_us" : 3073.8333333333335, + "best_us" : 3073 }, "vec8_u4" : { - "med_us" : 3920, - "best_us" : 3920 + "med_us" : 2538.5714285714284, + "best_us" : 2537.5714285714284 }, "plain" : { - "med_us" : 3702, - "best_us" : 3693 + "med_us" : 2406.25, + "best_us" : 2404.5 }, "u2" : { - "med_us" : 3701, - "best_us" : 3693 + "med_us" : 2462.875, + "best_us" : 2462.5 }, "u4" : { - "med_us" : 3701, - "best_us" : 3693 + "med_us" : 2414.5, + "best_us" : 2412.875 }, "u8" : { - "med_us" : 3702, - "best_us" : 3693 + "med_us" : 2414.125, + "best_us" : 2411 }, "vec4_u2" : { - "med_us" : 4705, - "best_us" : 4705 + "med_us" : 3070.1666666666665, + "best_us" : 3068.3333333333335 }, "vec4_u8" : { - "med_us" : 4705, - "best_us" : 4705 + "med_us" : 3066.5, + "best_us" : 3064.5 }, "vec8_u2" : { - "med_us" : 3920, - "best_us" : 3920 + "med_us" : 2539.1428571428573, + "best_us" : 2536.1428571428573 }, "vec8_u8" : { - "med_us" : 3919, - "best_us" : 3919 + "med_us" : 2536.285714285714, + "best_us" : 2533.5714285714284 }, "vec16" : { - "med_us" : 3704, - "best_us" : 3694 + "med_us" : 2409.125, + "best_us" : 2408.5 } } }, "dot_q8kv" : { "winner" : "vec4_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 24.379824627145315, "rows" : { "vec32_u2" : { - "med_us" : 2178, - "best_us" : 2178 + "med_us" : 1289.6, + "best_us" : 1289 }, "vec32" : { - "med_us" : 4204, - "best_us" : 4204 + "med_us" : 1926.2, + "best_us" : 1925.1 }, "vec32_u4" : { - "med_us" : 2178, - "best_us" : 2178 + "med_us" : 1291.6666666666667, + "best_us" : 1290.6 }, "vec32_u8" : { - "med_us" : 2178, - "best_us" : 2178 + "med_us" : 1292.1333333333334, + "best_us" : 1291.3333333333333 }, "vec16_u2" : { - "med_us" : 1219, - "best_us" : 1219 + "med_us" : 875.7727272727273, + "best_us" : 875.2727272727273 }, "vec16_u4" : { - "med_us" : 1219, - "best_us" : 1219 + "med_us" : 875, + "best_us" : 874.7727272727273 }, "vec16_u8" : { - "med_us" : 1219, - "best_us" : 1219 + "med_us" : 875, + "best_us" : 874.2727272727273 }, "vec4" : { - "med_us" : 4204, - "best_us" : 4204 + "med_us" : 1923.2, + "best_us" : 1922.5 }, "vec8" : { - "med_us" : 4206, - "best_us" : 4206 + "med_us" : 1924.8, + "best_us" : 1921.8 }, "vec4_u4" : { - "med_us" : 692, - "best_us" : 689 + "med_us" : 504.796875, + "best_us" : 503.96875 }, "vec8_u4" : { - "med_us" : 914, - "best_us" : 911 + "med_us" : 667.3793103448276, + "best_us" : 666.8965517241379 }, "plain" : { - "med_us" : 4206, - "best_us" : 4206 + "med_us" : 1923.7, + "best_us" : 1922.5 }, "u2" : { - "med_us" : 2062, - "best_us" : 2062 + "med_us" : 1227.6875, + "best_us" : 1227 }, "u4" : { - "med_us" : 2064, - "best_us" : 2064 + "med_us" : 1228.0625, + "best_us" : 1226.3125 }, "u8" : { - "med_us" : 2063, - "best_us" : 2063 + "med_us" : 1227.875, + "best_us" : 1226.5625 }, "vec4_u2" : { - "med_us" : 694, - "best_us" : 689 + "med_us" : 504.625, + "best_us" : 503.75 }, "vec4_u8" : { - "med_us" : 692, - "best_us" : 689 + "med_us" : 504.71875, + "best_us" : 503.8125 }, "vec8_u2" : { - "med_us" : 914, - "best_us" : 911 + "med_us" : 667.3666666666667, + "best_us" : 666.7666666666667 }, "vec8_u8" : { - "med_us" : 914, - "best_us" : 911 + "med_us" : 667.5666666666667, + "best_us" : 667.3 }, "vec16" : { - "med_us" : 4206, - "best_us" : 4206 + "med_us" : 1925, + "best_us" : 1923.2 } } }, "quantize_q8_0_bs_into_ptr" : { "winner" : "plain", "fallback" : "plain", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 3934.5, - "best_us" : 3927 + "med_us" : 2378.25, + "best_us" : 2375.875 }, "vec32" : { - "med_us" : 3871, - "best_us" : 3865 + "med_us" : 2052.3333333333335, + "best_us" : 2048.3333333333335 }, "vec32_u4" : { - "med_us" : 3934, - "best_us" : 3926 + "med_us" : 2386.875, + "best_us" : 2381.5 }, "vec32_u8" : { - "med_us" : 3934, - "best_us" : 3927 + "med_us" : 2379.5, + "best_us" : 2378.625 }, "vec16_u2" : { - "med_us" : 3888, - "best_us" : 3880 + "med_us" : 2370.125, + "best_us" : 2368 }, "vec16_u4" : { - "med_us" : 3887.5, - "best_us" : 3881 + "med_us" : 2356.625, + "best_us" : 2346 }, "vec16_u8" : { - "med_us" : 3887.5, - "best_us" : 3881 + "med_us" : 2354.375, + "best_us" : 2339.875 }, "vec4" : { - "med_us" : 3873, - "best_us" : 3865 + "med_us" : 2098.222222222222, + "best_us" : 2097.8888888888887 }, "vec8" : { - "med_us" : 3872, - "best_us" : 3865 + "med_us" : 2053.1111111111113, + "best_us" : 2043.6666666666667 }, "vec4_u4" : { - "med_us" : 4190, - "best_us" : 4190 + "med_us" : 2521, + "best_us" : 2508.125 }, "vec8_u4" : { - "med_us" : 3912, - "best_us" : 3904 + "med_us" : 2177, + "best_us" : 2171.4444444444443 }, "plain" : { - "med_us" : 3872, - "best_us" : 3865 + "med_us" : 2044.3333333333333, + "best_us" : 2042 }, "u2" : { - "med_us" : 3888, - "best_us" : 3881 + "med_us" : 2355.625, + "best_us" : 2353.375 }, "u4" : { - "med_us" : 3888, - "best_us" : 3881 + "med_us" : 2356, + "best_us" : 2340.75 }, "u8" : { - "med_us" : 3888, - "best_us" : 3880 + "med_us" : 2354.125, + "best_us" : 2348.875 }, "vec4_u2" : { - "med_us" : 4191, - "best_us" : 4191 + "med_us" : 2534.1428571428573, + "best_us" : 2526 }, "vec4_u8" : { - "med_us" : 4190, - "best_us" : 4190 + "med_us" : 2528.4285714285716, + "best_us" : 2516.4285714285716 }, "vec8_u2" : { - "med_us" : 3911, - "best_us" : 3905 + "med_us" : 2151.1111111111113, + "best_us" : 2146.1111111111113 }, "vec8_u8" : { - "med_us" : 3912, - "best_us" : 3905 + "med_us" : 2168.8888888888887, + "best_us" : 2165.1111111111113 }, "vec16" : { - "med_us" : 3871, - "best_us" : 3865 + "med_us" : 2040.3333333333333, + "best_us" : 2038 } } }, "dot_q8q8" : { "winner" : "vec16", "fallback" : "vec16", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 987, - "best_us" : 984 + "med_us" : 586.625, + "best_us" : 586.125 }, "vec32" : { - "med_us" : 967, - "best_us" : 964 + "med_us" : 579.5625, + "best_us" : 579.4375 }, "vec32_u4" : { - "med_us" : 987, - "best_us" : 983 + "med_us" : 588.6875, + "best_us" : 587.125 }, "vec32_u8" : { - "med_us" : 987, - "best_us" : 984 + "med_us" : 587.0625, + "best_us" : 585.1875 }, "vec16_u2" : { - "med_us" : 987, - "best_us" : 983 + "med_us" : 583.625, + "best_us" : 581.90625 }, "vec16_u4" : { - "med_us" : 988, - "best_us" : 984 + "med_us" : 583.78125, + "best_us" : 582.96875 }, "vec16_u8" : { - "med_us" : 988, - "best_us" : 984 + "med_us" : 585.84375, + "best_us" : 584.5625 }, "vec4" : { - "med_us" : 967, - "best_us" : 964 + "med_us" : 579.28125, + "best_us" : 578.84375 }, "vec8" : { - "med_us" : 967, - "best_us" : 963 + "med_us" : 579.75, + "best_us" : 579.09375 }, "vec4_u4" : { - "med_us" : 2703, - "best_us" : 2703 + "med_us" : 1942.8, + "best_us" : 1942.5 }, "vec8_u4" : { - "med_us" : 1304, - "best_us" : 1304 + "med_us" : 748.5384615384615, + "best_us" : 748.3461538461538 }, "plain" : { - "med_us" : 967, - "best_us" : 964 + "med_us" : 579.84375, + "best_us" : 578.1875 }, "u2" : { - "med_us" : 987, - "best_us" : 984 + "med_us" : 584.8125, + "best_us" : 583.4375 }, "u4" : { - "med_us" : 987, - "best_us" : 983 + "med_us" : 590.375, + "best_us" : 587.03125 }, "u8" : { - "med_us" : 987, - "best_us" : 983 + "med_us" : 584.96875, + "best_us" : 583.53125 }, "vec4_u2" : { - "med_us" : 2703, - "best_us" : 2703 + "med_us" : 1944.2, + "best_us" : 1943.7 }, "vec4_u8" : { - "med_us" : 2703, - "best_us" : 2703 + "med_us" : 1944.4, + "best_us" : 1942.8 }, "vec8_u2" : { - "med_us" : 1304, - "best_us" : 1304 + "med_us" : 748.8461538461538, + "best_us" : 747.9230769230769 }, "vec8_u8" : { - "med_us" : 1304, - "best_us" : 1304 + "med_us" : 750.4615384615385, + "best_us" : 750.2692307692307 }, "vec16" : { - "med_us" : 968, - "best_us" : 963 + "med_us" : 579.65625, + "best_us" : 579.09375 } } }, "gemm_f32_uk_4x16" : { "winner" : "u2", "fallback" : "u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 672, - "best_us" : 668 + "med_us" : 539.53125, + "best_us" : 539 }, "vec32" : { - "med_us" : 825, - "best_us" : 825 + "med_us" : 595.5, + "best_us" : 594.8125 }, "vec32_u4" : { - "med_us" : 707, - "best_us" : 707 + "med_us" : 550.9375, + "best_us" : 550.34375 }, "vec32_u8" : { - "med_us" : 699, - "best_us" : 696 + "med_us" : 546.71875, + "best_us" : 546.09375 }, "vec16_u2" : { - "med_us" : 671, - "best_us" : 667 + "med_us" : 540.09375, + "best_us" : 539.65625 }, "vec16_u4" : { - "med_us" : 708, - "best_us" : 708 + "med_us" : 549.34375, + "best_us" : 547.4375 }, "vec16_u8" : { - "med_us" : 699, - "best_us" : 696 + "med_us" : 547.46875, + "best_us" : 545.84375 }, "vec4" : { - "med_us" : 825, - "best_us" : 825 + "med_us" : 595.875, + "best_us" : 595.34375 }, "vec8" : { - "med_us" : 825, - "best_us" : 825 + "med_us" : 595.75, + "best_us" : 595.25 }, "vec4_u4" : { - "med_us" : 707, - "best_us" : 707 + "med_us" : 551.75, + "best_us" : 551.375 }, "vec8_u4" : { - "med_us" : 708, - "best_us" : 708 + "med_us" : 551.15625, + "best_us" : 550.34375 }, "plain" : { - "med_us" : 825, - "best_us" : 825 + "med_us" : 595.78125, + "best_us" : 594.84375 }, "u2" : { - "med_us" : 671, - "best_us" : 667 + "med_us" : 540.3125, + "best_us" : 539.1875 }, "u4" : { - "med_us" : 708, - "best_us" : 708 + "med_us" : 553, + "best_us" : 551 }, "u8" : { - "med_us" : 699, - "best_us" : 696 + "med_us" : 549.4375, + "best_us" : 547.15625 }, "vec4_u2" : { - "med_us" : 671, - "best_us" : 667 + "med_us" : 540.84375, + "best_us" : 540.0625 }, "vec4_u8" : { - "med_us" : 699, - "best_us" : 696 + "med_us" : 546.53125, + "best_us" : 546.46875 }, "vec8_u2" : { - "med_us" : 671, - "best_us" : 667 + "med_us" : 540.40625, + "best_us" : 539.875 }, "vec8_u8" : { - "med_us" : 699, - "best_us" : 696 + "med_us" : 547.15625, + "best_us" : 546.40625 }, "vec16" : { - "med_us" : 825, - "best_us" : 825 + "med_us" : 595.90625, + "best_us" : 595.1875 } } }, "quantize_q8kv_row" : { - "winner" : "u2", + "winner" : "plain", "fallback" : "plain", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 1827, - "best_us" : 1824 + "med_us" : 1203.6875, + "best_us" : 1202.125 }, "vec32" : { - "med_us" : 1811, - "best_us" : 1808 + "med_us" : 1176.8125, + "best_us" : 1174.625 }, "vec32_u4" : { - "med_us" : 1827, - "best_us" : 1824 + "med_us" : 1203.375, + "best_us" : 1201.0625 }, "vec32_u8" : { - "med_us" : 1827, - "best_us" : 1824 + "med_us" : 1196.4705882352941, + "best_us" : 1194 }, "vec16_u2" : { - "med_us" : 1800, - "best_us" : 1797 + "med_us" : 1176.4117647058824, + "best_us" : 1174.8235294117646 }, "vec16_u4" : { - "med_us" : 1800, - "best_us" : 1797 + "med_us" : 1176.3529411764705, + "best_us" : 1174.8235294117646 }, "vec16_u8" : { - "med_us" : 1800, - "best_us" : 1797 + "med_us" : 1171.6470588235295, + "best_us" : 1169.9411764705883 }, "vec4" : { - "med_us" : 1811, - "best_us" : 1808 + "med_us" : 1176.6470588235295, + "best_us" : 1173.4705882352941 }, "vec8" : { - "med_us" : 1811, - "best_us" : 1808 + "med_us" : 1176.125, + "best_us" : 1173.5 }, "vec4_u4" : { - "med_us" : 2307, - "best_us" : 2307 + "med_us" : 1501.8461538461538, + "best_us" : 1501 }, "vec8_u4" : { - "med_us" : 1885, - "best_us" : 1882 + "med_us" : 1232.1875, + "best_us" : 1230.6875 }, "plain" : { - "med_us" : 1811, - "best_us" : 1808 + "med_us" : 1175.1176470588234, + "best_us" : 1174.235294117647 }, "u2" : { - "med_us" : 1800, - "best_us" : 1797 + "med_us" : 1176.0625, + "best_us" : 1174.125 }, "u4" : { - "med_us" : 1800, - "best_us" : 1797 + "med_us" : 1171.625, + "best_us" : 1169.875 }, "u8" : { - "med_us" : 1800, - "best_us" : 1797 + "med_us" : 1176.2941176470588, + "best_us" : 1174.8823529411766 }, "vec4_u2" : { - "med_us" : 2307, - "best_us" : 2307 + "med_us" : 1498.5384615384614, + "best_us" : 1497.8461538461538 }, "vec4_u8" : { - "med_us" : 2305, - "best_us" : 2305 + "med_us" : 1500.3846153846155, + "best_us" : 1498.3846153846155 }, "vec8_u2" : { - "med_us" : 1885, - "best_us" : 1882 + "med_us" : 1235.375, + "best_us" : 1234.875 }, "vec8_u8" : { - "med_us" : 1885, - "best_us" : 1882 + "med_us" : 1234, + "best_us" : 1233.6875 }, "vec16" : { - "med_us" : 1811, - "best_us" : 1808 + "med_us" : 1175.5, + "best_us" : 1174.625 } } }, "dot_f16" : { - "winner" : "vec8_u4", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 372, - "best_us" : 372 + "med_us" : 283.90625, + "best_us" : 283.75 }, "vec32" : { - "med_us" : 374, - "best_us" : 374 + "med_us" : 284.5625, + "best_us" : 284.3125 }, "vec32_u4" : { - "med_us" : 370, - "best_us" : 370 + "med_us" : 284.125, + "best_us" : 283.96875 }, "vec32_u8" : { - "med_us" : 374, - "best_us" : 374 + "med_us" : 285.5625, + "best_us" : 285.375 }, "vec16_u2" : { - "med_us" : 351, - "best_us" : 351 + "med_us" : 269.21875, + "best_us" : 269.1875 }, "vec16_u4" : { - "med_us" : 350, - "best_us" : 343 + "med_us" : 269.125, + "best_us" : 268.6875 }, "vec16_u8" : { - "med_us" : 348, - "best_us" : 348 + "med_us" : 270.3125, + "best_us" : 270.1875 }, "vec4" : { - "med_us" : 610, - "best_us" : 610 + "med_us" : 421.5, + "best_us" : 419.8125 }, "vec8" : { - "med_us" : 344, - "best_us" : 336 + "med_us" : 257.03125, + "best_us" : 256.4375 }, "vec4_u4" : { - "med_us" : 610, - "best_us" : 610 + "med_us" : 417.5625, + "best_us" : 416.9375 }, "vec8_u4" : { - "med_us" : 335, - "best_us" : 329 + "med_us" : 260.4375, + "best_us" : 260.375 }, "plain" : { - "med_us" : 7376, - "best_us" : 7376 + "med_us" : 3920, + "best_us" : 3891.4 }, "u2" : { - "med_us" : 7376, - "best_us" : 7376 + "med_us" : 3940.5, + "best_us" : 3914.75 }, "u4" : { - "med_us" : 7377, - "best_us" : 7377 + "med_us" : 3944.5, + "best_us" : 3918.75 }, "u8" : { - "med_us" : 7375, - "best_us" : 7375 + "med_us" : 4000.75, + "best_us" : 3948.25 }, "vec4_u2" : { - "med_us" : 610, - "best_us" : 610 + "med_us" : 418.3125, + "best_us" : 417.8125 }, "vec4_u8" : { - "med_us" : 606, - "best_us" : 606 + "med_us" : 418.75, + "best_us" : 417.9375 }, "vec8_u2" : { - "med_us" : 348, - "best_us" : 341 + "med_us" : 260.15625, + "best_us" : 259.625 }, "vec8_u8" : { - "med_us" : 340, - "best_us" : 333 + "med_us" : 261.21875, + "best_us" : 261.03125 }, "vec16" : { - "med_us" : 348, - "best_us" : 348 + "med_us" : 269.5, + "best_us" : 268.03125 } } }, "axpy_f16" : { - "winner" : "vec4_u4", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 470, - "best_us" : 470 + "med_us" : 285.875, + "best_us" : 285.5 }, "vec32" : { - "med_us" : 472, - "best_us" : 472 + "med_us" : 296.5, + "best_us" : 296.3125 }, "vec32_u4" : { - "med_us" : 465, - "best_us" : 465 + "med_us" : 285.125, + "best_us" : 284.9375 }, "vec32_u8" : { - "med_us" : 465, - "best_us" : 465 + "med_us" : 285.28125, + "best_us" : 285.0625 }, "vec16_u2" : { - "med_us" : 466, - "best_us" : 466 + "med_us" : 301.96875, + "best_us" : 300.28125 }, "vec16_u4" : { - "med_us" : 463, - "best_us" : 463 + "med_us" : 288.28125, + "best_us" : 287.90625 }, "vec16_u8" : { - "med_us" : 464, - "best_us" : 464 + "med_us" : 288.34375, + "best_us" : 286.90625 }, "vec4" : { - "med_us" : 459, - "best_us" : 457 + "med_us" : 301.34375, + "best_us" : 301.125 }, "vec8" : { - "med_us" : 472, - "best_us" : 472 + "med_us" : 301.5, + "best_us" : 301.21875 }, "vec4_u4" : { - "med_us" : 440, - "best_us" : 438 + "med_us" : 287.9375, + "best_us" : 287.125 }, "vec8_u4" : { - "med_us" : 469, - "best_us" : 469 + "med_us" : 284.65625, + "best_us" : 283.96875 }, "plain" : { - "med_us" : 478, - "best_us" : 478 + "med_us" : 302.84375, + "best_us" : 302.375 }, "u2" : { - "med_us" : 470, - "best_us" : 470 + "med_us" : 284.4375, + "best_us" : 283.9375 }, "u4" : { - "med_us" : 468, - "best_us" : 468 + "med_us" : 284.84375, + "best_us" : 284.28125 }, "u8" : { - "med_us" : 471, - "best_us" : 471 + "med_us" : 283.625, + "best_us" : 283.28125 }, "vec4_u2" : { - "med_us" : 461, - "best_us" : 458 + "med_us" : 300.21875, + "best_us" : 298.1875 }, "vec4_u8" : { - "med_us" : 453, - "best_us" : 451 + "med_us" : 288.9375, + "best_us" : 287.40625 }, "vec8_u2" : { - "med_us" : 471, - "best_us" : 471 + "med_us" : 284.90625, + "best_us" : 284.53125 }, "vec8_u8" : { - "med_us" : 468, - "best_us" : 468 + "med_us" : 284.65625, + "best_us" : 284.46875 }, "vec16" : { - "med_us" : 472, - "best_us" : 472 + "med_us" : 298.21875, + "best_us" : 296.9375 } } }, "cvt_f16_to_f32" : { - "winner" : "vec16", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 415, - "best_us" : 415 + "med_us" : 252.71875, + "best_us" : 249.8125 }, "vec32" : { - "med_us" : 418, - "best_us" : 418 + "med_us" : 249.90625, + "best_us" : 248.53125 }, "vec32_u4" : { - "med_us" : 415, - "best_us" : 415 + "med_us" : 251.28125, + "best_us" : 248.875 }, "vec32_u8" : { - "med_us" : 414, - "best_us" : 414 + "med_us" : 250.40625, + "best_us" : 249.46875 }, "vec16_u2" : { - "med_us" : 383, - "best_us" : 382 + "med_us" : 250.28125, + "best_us" : 247.09375 }, "vec16_u4" : { - "med_us" : 383, - "best_us" : 382 + "med_us" : 253.03125, + "best_us" : 249 }, "vec16_u8" : { - "med_us" : 386, - "best_us" : 385 + "med_us" : 253.1875, + "best_us" : 248 }, "vec4" : { - "med_us" : 413, - "best_us" : 413 + "med_us" : 253.125, + "best_us" : 245.1875 }, "vec8" : { - "med_us" : 415, - "best_us" : 415 + "med_us" : 248.65625, + "best_us" : 241.75 }, "vec4_u4" : { - "med_us" : 414, - "best_us" : 414 + "med_us" : 252.34375, + "best_us" : 251.65625 }, "vec8_u4" : { - "med_us" : 418, - "best_us" : 418 + "med_us" : 250.0625, + "best_us" : 249.78125 }, "plain" : { - "med_us" : 416, - "best_us" : 416 + "med_us" : 250.96875, + "best_us" : 247.28125 }, "u2" : { - "med_us" : 415, - "best_us" : 415 + "med_us" : 251.40625, + "best_us" : 248.4375 }, "u4" : { - "med_us" : 416, - "best_us" : 416 + "med_us" : 249.53125, + "best_us" : 245.71875 }, "u8" : { - "med_us" : 415, - "best_us" : 415 + "med_us" : 250.4375, + "best_us" : 246.65625 }, "vec4_u2" : { - "med_us" : 413, - "best_us" : 413 + "med_us" : 257.40625, + "best_us" : 246.75 }, "vec4_u8" : { - "med_us" : 414, - "best_us" : 414 + "med_us" : 251.84375, + "best_us" : 251.25 }, "vec8_u2" : { - "med_us" : 415, - "best_us" : 415 + "med_us" : 250.125, + "best_us" : 249.28125 }, "vec8_u8" : { - "med_us" : 415, - "best_us" : 415 + "med_us" : 250.6875, + "best_us" : 247.28125 }, "vec16" : { - "med_us" : 385, - "best_us" : 382 + "med_us" : 251.34375, + "best_us" : 247.84375 } } }, "dot" : { - "winner" : "vec8_u4", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 2619, - "best_us" : 2581 + "med_us" : 1632.090909090909, + "best_us" : 1626.2727272727273 }, "vec32" : { - "med_us" : 2645, - "best_us" : 2591 + "med_us" : 1640, + "best_us" : 1634.5454545454545 }, "vec32_u4" : { - "med_us" : 2585, - "best_us" : 2559 + "med_us" : 1633.2727272727273, + "best_us" : 1631.5454545454545 }, "vec32_u8" : { - "med_us" : 2570, - "best_us" : 2564 + "med_us" : 1643.9166666666667, + "best_us" : 1640 }, "vec16_u2" : { - "med_us" : 2601, - "best_us" : 2547 + "med_us" : 1633.1666666666667, + "best_us" : 1631.25 }, "vec16_u4" : { - "med_us" : 2576, - "best_us" : 2527 + "med_us" : 1626.6666666666667, + "best_us" : 1624.9166666666667 }, "vec16_u8" : { - "med_us" : 2567, - "best_us" : 2517 + "med_us" : 1628.9166666666667, + "best_us" : 1626.0833333333333 }, "vec4" : { - "med_us" : 2638, - "best_us" : 2576 + "med_us" : 1790.090909090909, + "best_us" : 1786.8181818181818 }, "vec8" : { - "med_us" : 2618.5, - "best_us" : 2564 + "med_us" : 1646.25, + "best_us" : 1635.5 }, "vec4_u4" : { - "med_us" : 2634, - "best_us" : 2581 + "med_us" : 1784.2727272727273, + "best_us" : 1772.5454545454545 }, "vec8_u4" : { - "med_us" : 2573, - "best_us" : 2523 + "med_us" : 1627.1666666666667, + "best_us" : 1625.9166666666667 }, "plain" : { - "med_us" : 30271, - "best_us" : 30271 + "med_us" : 15937, + "best_us" : 15883 }, "u2" : { - "med_us" : 30233, - "best_us" : 30233 + "med_us" : 15919, + "best_us" : 15776 }, "u4" : { - "med_us" : 30234, - "best_us" : 30234 + "med_us" : 15781, + "best_us" : 15751 }, "u8" : { - "med_us" : 30240, - "best_us" : 30240 + "med_us" : 16019, + "best_us" : 15736 }, "vec4_u2" : { - "med_us" : 2636.5, - "best_us" : 2578 + "med_us" : 1786, + "best_us" : 1777.090909090909 }, "vec4_u8" : { - "med_us" : 2634, - "best_us" : 2580 + "med_us" : 1786.6363636363637, + "best_us" : 1774.6363636363637 }, "vec8_u2" : { - "med_us" : 2593, - "best_us" : 2542 + "med_us" : 1635.6666666666667, + "best_us" : 1626.75 }, "vec8_u8" : { - "med_us" : 2564, - "best_us" : 2514 + "med_us" : 1627.9166666666667, + "best_us" : 1625.6666666666667 }, "vec16" : { - "med_us" : 2623, - "best_us" : 2569 + "med_us" : 1641.909090909091, + "best_us" : 1636.7272727272727 } } }, @@ -1838,755 +1856,763 @@ "winner" : "mr8", "rows" : { "mr8" : { - "tile_us" : 39967, - "gemv_us" : 222, - "hot_us" : 13.6875 + "tile_us" : 29255, + "gemv_us" : 163, + "hot_us" : 10.0625 }, "dot_maddubs_width256_mr8" : { - "tile_us" : 458717, - "gemv_us" : 1802, - "hot_us" : 112.6875 + "tile_us" : 307455, + "gemv_us" : 1225, + "hot_us" : 76.25 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "tile_us" : 458542, - "gemv_us" : 1803, - "hot_us" : 112.625 + "tile_us" : 307740, + "gemv_us" : 1205, + "hot_us" : 76 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "tile_us" : 458552, - "gemv_us" : 1804, - "hot_us" : 112.625 + "tile_us" : 307758, + "gemv_us" : 1223, + "hot_us" : 75.8125 }, "mr4" : { - "tile_us" : 45501, - "gemv_us" : 237, - "hot_us" : 14.75 + "tile_us" : 32834, + "gemv_us" : 175, + "hot_us" : 10.4375 }, "reference" : { - "tile_us" : 458639, - "gemv_us" : 1804, - "hot_us" : 112.5625 + "tile_us" : 307401, + "gemv_us" : 1175, + "hot_us" : 75.0625 }, "mr4_nrsplit2" : { - "tile_us" : 50055, - "gemv_us" : 236, - "hot_us" : 14.75 + "tile_us" : 36775, + "gemv_us" : 176, + "hot_us" : 11.0625 }, "dot_vpdpbusd_width256_mr8" : { - "tile_us" : 458563, - "gemv_us" : 1805, - "hot_us" : 112.5625 + "tile_us" : 307919, + "gemv_us" : 1172, + "hot_us" : 74.25 }, "dot_vpdpbusd_width512_mr16" : { - "tile_us" : 458521, - "gemv_us" : 1805, - "hot_us" : 112.5625 + "tile_us" : 307904, + "gemv_us" : 1168, + "hot_us" : 74.5 }, "mr8_nrsplit2" : { - "tile_us" : 45387, - "gemv_us" : 220, - "hot_us" : 13.6875 + "tile_us" : 33119, + "gemv_us" : 154, + "hot_us" : 9.625 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "tile_us" : 458535, - "gemv_us" : 1805, - "hot_us" : 112.625 + "tile_us" : 307657, + "gemv_us" : 1169, + "hot_us" : 74.625 } } }, "axpy" : { - "winner" : "vec8_u8", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 500, - "best_us" : 497 + "med_us" : 361.5625, + "best_us" : 337.65625 }, "vec32" : { - "med_us" : 501, - "best_us" : 499 + "med_us" : 361.40625, + "best_us" : 359.21875 }, "vec32_u4" : { - "med_us" : 500, - "best_us" : 497 + "med_us" : 338.34375, + "best_us" : 337.875 }, "vec32_u8" : { - "med_us" : 495, - "best_us" : 492 + "med_us" : 337.21875, + "best_us" : 336.875 }, "vec16_u2" : { - "med_us" : 507, - "best_us" : 504 + "med_us" : 362.53125, + "best_us" : 362.34375 }, "vec16_u4" : { - "med_us" : 507, - "best_us" : 504 + "med_us" : 338.28125, + "best_us" : 337.84375 }, "vec16_u8" : { - "med_us" : 506, - "best_us" : 504 + "med_us" : 338.15625, + "best_us" : 336.3125 }, "vec4" : { - "med_us" : 505, - "best_us" : 503 + "med_us" : 363.15625, + "best_us" : 361.5 }, "vec8" : { - "med_us" : 502, - "best_us" : 499 + "med_us" : 363.65625, + "best_us" : 360.9375 }, "vec4_u4" : { - "med_us" : 507, - "best_us" : 503 + "med_us" : 338.625, + "best_us" : 337.625 }, "vec8_u4" : { - "med_us" : 499, - "best_us" : 496 + "med_us" : 337.59375, + "best_us" : 336.59375 }, "plain" : { - "med_us" : 506, - "best_us" : 503 + "med_us" : 362.71875, + "best_us" : 361.6875 }, "u2" : { - "med_us" : 507, - "best_us" : 506 + "med_us" : 362.90625, + "best_us" : 362.5625 }, "u4" : { - "med_us" : 506, - "best_us" : 503 + "med_us" : 338.15625, + "best_us" : 337.5625 }, "u8" : { - "med_us" : 502, - "best_us" : 499 + "med_us" : 338.15625, + "best_us" : 336.625 }, "vec4_u2" : { - "med_us" : 506, - "best_us" : 503 + "med_us" : 362.25, + "best_us" : 361.25 }, "vec4_u8" : { - "med_us" : 504, - "best_us" : 503 + "med_us" : 338.53125, + "best_us" : 337.8125 }, "vec8_u2" : { - "med_us" : 501, - "best_us" : 498 + "med_us" : 337.65625, + "best_us" : 336.71875 }, "vec8_u8" : { - "med_us" : 495, - "best_us" : 492 + "med_us" : 337.1875, + "best_us" : 335.78125 }, "vec16" : { - "med_us" : 506, - "best_us" : 503 + "med_us" : 362.53125, + "best_us" : 362.03125 } } }, "dot_q8q8kv" : { "winner" : "vec16", "fallback" : "vec16", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 238, - "best_us" : 233 + "med_us" : 140.5, + "best_us" : 140 }, "vec32" : { - "med_us" : 233, - "best_us" : 228 + "med_us" : 129.5, + "best_us" : 128.875 }, "vec32_u4" : { - "med_us" : 238, - "best_us" : 233 + "med_us" : 140.03125, + "best_us" : 140 }, "vec32_u8" : { - "med_us" : 238, - "best_us" : 233 + "med_us" : 140.53125, + "best_us" : 140 }, "vec16_u2" : { - "med_us" : 237, - "best_us" : 233 + "med_us" : 139.65625, + "best_us" : 139.59375 }, "vec16_u4" : { - "med_us" : 237, - "best_us" : 233 + "med_us" : 140.0625, + "best_us" : 139.65625 }, "vec16_u8" : { - "med_us" : 237, - "best_us" : 233 + "med_us" : 139.84375, + "best_us" : 139.53125 }, "vec4" : { - "med_us" : 233, - "best_us" : 228 + "med_us" : 136.3125, + "best_us" : 136.125 }, "vec8" : { - "med_us" : 233, - "best_us" : 228 + "med_us" : 136.375, + "best_us" : 136.0625 }, "vec4_u4" : { - "med_us" : 666, - "best_us" : 666 + "med_us" : 488.96875, + "best_us" : 488.03125 }, "vec8_u4" : { - "med_us" : 320, - "best_us" : 320 + "med_us" : 194.71875, + "best_us" : 194.09375 }, "plain" : { - "med_us" : 233, - "best_us" : 228 + "med_us" : 136.375, + "best_us" : 136.28125 }, "u2" : { - "med_us" : 237, - "best_us" : 233 + "med_us" : 139.65625, + "best_us" : 139.28125 }, "u4" : { - "med_us" : 237, - "best_us" : 233 + "med_us" : 139.84375, + "best_us" : 139.5 }, "u8" : { - "med_us" : 237, - "best_us" : 233 + "med_us" : 139.625, + "best_us" : 139.1875 }, "vec4_u2" : { - "med_us" : 666, - "best_us" : 666 + "med_us" : 488.6875, + "best_us" : 488.15625 }, "vec4_u8" : { - "med_us" : 666, - "best_us" : 666 + "med_us" : 488.5625, + "best_us" : 488.4375 }, "vec8_u2" : { - "med_us" : 320, - "best_us" : 320 + "med_us" : 194.9375, + "best_us" : 193.9375 }, "vec8_u8" : { - "med_us" : 320, - "best_us" : 320 + "med_us" : 194.1875, + "best_us" : 194.125 }, "vec16" : { - "med_us" : 233, - "best_us" : 228 + "med_us" : 129.40625, + "best_us" : 128.90625 } } }, "dot_mx4q8" : { - "winner" : "u8", + "winner" : "u2", "fallback" : "u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 269, - "best_us" : 269 + "med_us" : 164.21875, + "best_us" : 163.625 }, "vec32" : { - "med_us" : 282, - "best_us" : 282 + "med_us" : 163.6875, + "best_us" : 163.625 }, "vec32_u4" : { - "med_us" : 251, - "best_us" : 246 + "med_us" : 163.65625, + "best_us" : 163.625 }, "vec32_u8" : { - "med_us" : 247, - "best_us" : 242 + "med_us" : 164.59375, + "best_us" : 164.0625 }, "vec16_u2" : { - "med_us" : 270, - "best_us" : 270 + "med_us" : 164.28125, + "best_us" : 164.25 }, "vec16_u4" : { - "med_us" : 253, - "best_us" : 246 + "med_us" : 163.6875, + "best_us" : 163.625 }, "vec16_u8" : { - "med_us" : 247, - "best_us" : 242 + "med_us" : 164.625, + "best_us" : 164.46875 }, "vec4" : { - "med_us" : 282, - "best_us" : 282 + "med_us" : 163.65625, + "best_us" : 163.59375 }, "vec8" : { - "med_us" : 282, - "best_us" : 282 + "med_us" : 164.03125, + "best_us" : 163.65625 }, "vec4_u4" : { - "med_us" : 251, - "best_us" : 246 + "med_us" : 163.625, + "best_us" : 163.40625 }, "vec8_u4" : { - "med_us" : 251, - "best_us" : 246 + "med_us" : 163.59375, + "best_us" : 163.59375 }, "plain" : { - "med_us" : 282, - "best_us" : 282 + "med_us" : 188.28125, + "best_us" : 187.71875 }, "u2" : { - "med_us" : 270, - "best_us" : 270 + "med_us" : 163.78125, + "best_us" : 163.46875 }, "u4" : { - "med_us" : 255, - "best_us" : 246 + "med_us" : 164.25, + "best_us" : 164.21875 }, "u8" : { - "med_us" : 247, - "best_us" : 242 + "med_us" : 164.6875, + "best_us" : 164.09375 }, "vec4_u2" : { - "med_us" : 270, - "best_us" : 270 + "med_us" : 164.34375, + "best_us" : 164.15625 }, "vec4_u8" : { - "med_us" : 247, - "best_us" : 242 + "med_us" : 164.5, + "best_us" : 164.3125 }, "vec8_u2" : { - "med_us" : 269, - "best_us" : 269 + "med_us" : 164.21875, + "best_us" : 164.0625 }, "vec8_u8" : { - "med_us" : 247, - "best_us" : 242 + "med_us" : 164.875, + "best_us" : 164.375 }, "vec16" : { - "med_us" : 282, - "best_us" : 282 + "med_us" : 163.75, + "best_us" : 163.65625 } } }, "dot_q8q8_laneq4x4" : { - "winner" : "u4", + "winner" : "u2", "fallback" : "u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 1029, - "best_us" : 1026 + "med_us" : 753.8076923076923, + "best_us" : 752.8461538461538 }, "vec32" : { - "med_us" : 1038, - "best_us" : 1034 + "med_us" : 756.9230769230769, + "best_us" : 755.9230769230769 }, "vec32_u4" : { - "med_us" : 1020, - "best_us" : 1017 + "med_us" : 754, + "best_us" : 753.7307692307693 }, "vec32_u8" : { - "med_us" : 1017, - "best_us" : 1014 + "med_us" : 850.5217391304348, + "best_us" : 847.8695652173913 }, "vec16_u2" : { - "med_us" : 1028, - "best_us" : 1025 + "med_us" : 751.9615384615385, + "best_us" : 750.5769230769231 }, "vec16_u4" : { - "med_us" : 1020, - "best_us" : 1017 + "med_us" : 753.8846153846154, + "best_us" : 753.1923076923077 }, "vec16_u8" : { - "med_us" : 1017, - "best_us" : 1014 + "med_us" : 847.6521739130435, + "best_us" : 844.3478260869565 }, "vec4" : { - "med_us" : 1038, - "best_us" : 1034 + "med_us" : 756.6153846153846, + "best_us" : 755.8461538461538 }, "vec8" : { - "med_us" : 1038, - "best_us" : 1034 + "med_us" : 755.5384615384615, + "best_us" : 755.2307692307693 }, "vec4_u4" : { - "med_us" : 1020, - "best_us" : 1017 + "med_us" : 755.0769230769231, + "best_us" : 754.3846153846154 }, "vec8_u4" : { - "med_us" : 1020, - "best_us" : 1017 + "med_us" : 753.9230769230769, + "best_us" : 753.0769230769231 }, "plain" : { - "med_us" : 1038, - "best_us" : 1034 + "med_us" : 755.1538461538462, + "best_us" : 754.9230769230769 }, "u2" : { - "med_us" : 1029, - "best_us" : 1025 + "med_us" : 753.5769230769231, + "best_us" : 752.2692307692307 }, "u4" : { - "med_us" : 1020, - "best_us" : 1017 + "med_us" : 753.7307692307693, + "best_us" : 753.1153846153846 }, "u8" : { - "med_us" : 1017, - "best_us" : 1014 + "med_us" : 847.5652173913044, + "best_us" : 845.5652173913044 }, "vec4_u2" : { - "med_us" : 1028, - "best_us" : 1025 + "med_us" : 750.9615384615385, + "best_us" : 750.1923076923077 }, "vec4_u8" : { - "med_us" : 1017, - "best_us" : 1014 + "med_us" : 848.2608695652174, + "best_us" : 846.8695652173913 }, "vec8_u2" : { - "med_us" : 1029, - "best_us" : 1026 + "med_us" : 751.1923076923077, + "best_us" : 750.8076923076923 }, "vec8_u8" : { - "med_us" : 1017, - "best_us" : 1014 + "med_us" : 847.9130434782609, + "best_us" : 846 }, "vec16" : { - "med_us" : 1038, - "best_us" : 1034 + "med_us" : 756.92, + "best_us" : 756.32 } } }, "scale_inplace" : { - "winner" : "vec16_u2", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 416, - "best_us" : 415 + "med_us" : 254.21875, + "best_us" : 253.46875 }, "vec32" : { - "med_us" : 415, - "best_us" : 414 + "med_us" : 250.3125, + "best_us" : 248.15625 }, "vec32_u4" : { - "med_us" : 416, - "best_us" : 414 + "med_us" : 254, + "best_us" : 251.125 }, "vec32_u8" : { - "med_us" : 413, - "best_us" : 413 + "med_us" : 252.53125, + "best_us" : 250.46875 }, "vec16_u2" : { - "med_us" : 411, - "best_us" : 411 + "med_us" : 271.59375, + "best_us" : 269.0625 }, "vec16_u4" : { - "med_us" : 409, - "best_us" : 409 + "med_us" : 266.96875, + "best_us" : 266.1875 }, "vec16_u8" : { - "med_us" : 430, - "best_us" : 427 + "med_us" : 1114, + "best_us" : 1113.1764705882354 }, "vec4" : { - "med_us" : 422, - "best_us" : 420 + "med_us" : 246.84375, + "best_us" : 246.03125 }, "vec8" : { - "med_us" : 415, - "best_us" : 414 + "med_us" : 248.4375, + "best_us" : 247.3125 }, "vec4_u4" : { - "med_us" : 425, - "best_us" : 425 + "med_us" : 247.75, + "best_us" : 247.15625 }, "vec8_u4" : { - "med_us" : 414, - "best_us" : 414 + "med_us" : 253.5625, + "best_us" : 252.25 }, "plain" : { - "med_us" : 422, - "best_us" : 421 + "med_us" : 246.03125, + "best_us" : 244.84375 }, "u2" : { - "med_us" : 425, - "best_us" : 424 + "med_us" : 247.0625, + "best_us" : 246.3125 }, "u4" : { - "med_us" : 426, - "best_us" : 425 + "med_us" : 249.5, + "best_us" : 247.625 }, "u8" : { - "med_us" : 425, - "best_us" : 423 + "med_us" : 249.53125, + "best_us" : 249.09375 }, "vec4_u2" : { - "med_us" : 425, - "best_us" : 425 + "med_us" : 247.1875, + "best_us" : 245.96875 }, "vec4_u8" : { - "med_us" : 424, - "best_us" : 423 + "med_us" : 249.53125, + "best_us" : 247.90625 }, "vec8_u2" : { - "med_us" : 416, - "best_us" : 415 + "med_us" : 253.09375, + "best_us" : 252 }, "vec8_u8" : { - "med_us" : 413, - "best_us" : 413 + "med_us" : 250.40625, + "best_us" : 248.3125 }, "vec16" : { - "med_us" : 413, - "best_us" : 413 + "med_us" : 268.9375, + "best_us" : 268.15625 } } }, "dot_q4" : { "winner" : "vec4_u4", "fallback" : "vec4_u4", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 2829, - "best_us" : 2829 + "med_us" : 1631.5833333333333, + "best_us" : 1629.9166666666667 }, "vec32" : { - "med_us" : 3096, - "best_us" : 3096 + "med_us" : 1971.7, + "best_us" : 1970.7 }, "vec32_u4" : { - "med_us" : 2672, - "best_us" : 2672 + "med_us" : 1562.0833333333333, + "best_us" : 1554.6666666666667 }, "vec32_u8" : { - "med_us" : 2590, - "best_us" : 2590 + "med_us" : 1527.3846153846155, + "best_us" : 1523.5384615384614 }, "vec16_u2" : { - "med_us" : 1453, - "best_us" : 1453 + "med_us" : 1015.9473684210526, + "best_us" : 1014.9473684210526 }, "vec16_u4" : { - "med_us" : 1452, - "best_us" : 1452 + "med_us" : 1017.6842105263158, + "best_us" : 1016.1052631578947 }, "vec16_u8" : { - "med_us" : 1453, - "best_us" : 1453 + "med_us" : 1015.421052631579, + "best_us" : 1014.4736842105264 }, "vec4" : { - "med_us" : 3096, - "best_us" : 3096 + "med_us" : 1970.6, + "best_us" : 1970.3 }, "vec8" : { - "med_us" : 3098, - "best_us" : 3098 + "med_us" : 1976.4, + "best_us" : 1972.8 }, "vec4_u4" : { - "med_us" : 1123, - "best_us" : 1120 + "med_us" : 817.0416666666666, + "best_us" : 815.5416666666666 }, "vec8_u4" : { - "med_us" : 1153, - "best_us" : 1150 + "med_us" : 850.0434782608696, + "best_us" : 849.4347826086956 }, "plain" : { - "med_us" : 3096, - "best_us" : 3096 + "med_us" : 1971.2, + "best_us" : 1968.7 }, "u2" : { - "med_us" : 1446, - "best_us" : 1446 + "med_us" : 1026.1052631578948, + "best_us" : 1025.2105263157894 }, "u4" : { - "med_us" : 1448, - "best_us" : 1448 + "med_us" : 1025.9473684210527, + "best_us" : 1025.0526315789473 }, "u8" : { - "med_us" : 1446, - "best_us" : 1446 + "med_us" : 1025.2631578947369, + "best_us" : 1024.3684210526317 }, "vec4_u2" : { - "med_us" : 1125, - "best_us" : 1120 + "med_us" : 816.5416666666666, + "best_us" : 815.9583333333334 }, "vec4_u8" : { - "med_us" : 1123, - "best_us" : 1120 + "med_us" : 817.2083333333334, + "best_us" : 815.875 }, "vec8_u2" : { - "med_us" : 1153, - "best_us" : 1150 + "med_us" : 849.1304347826087, + "best_us" : 848.8260869565217 }, "vec8_u8" : { - "med_us" : 1153, - "best_us" : 1150 + "med_us" : 848.8695652173913, + "best_us" : 847.4782608695652 }, "vec16" : { - "med_us" : 3098, - "best_us" : 3098 + "med_us" : 1971.1, + "best_us" : 1970.7 } } }, "copy_floats" : { - "winner" : "vec8_u8", + "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 474.5, - "best_us" : 442 + "med_us" : 268.53125, + "best_us" : 266.375 }, "vec32" : { - "med_us" : 450, - "best_us" : 388 + "med_us" : 269.78125, + "best_us" : 267.53125 }, "vec32_u4" : { - "med_us" : 463, - "best_us" : 440 + "med_us" : 268.9375, + "best_us" : 267.6875 }, "vec32_u8" : { - "med_us" : 450, - "best_us" : 389 + "med_us" : 268.5, + "best_us" : 266.75 }, "vec16_u2" : { - "med_us" : 466, - "best_us" : 434 + "med_us" : 269.71875, + "best_us" : 266.34375 }, "vec16_u4" : { - "med_us" : 474, - "best_us" : 442 + "med_us" : 269.03125, + "best_us" : 268 }, "vec16_u8" : { - "med_us" : 475.5, - "best_us" : 442 + "med_us" : 270.34375, + "best_us" : 267.125 }, "vec4" : { - "med_us" : 463, - "best_us" : 435 + "med_us" : 269.84375, + "best_us" : 267.3125 }, "vec8" : { - "med_us" : 464, - "best_us" : 431 + "med_us" : 270.125, + "best_us" : 266.375 }, "vec4_u4" : { - "med_us" : 465, - "best_us" : 438 + "med_us" : 268.5, + "best_us" : 267.53125 }, "vec8_u4" : { - "med_us" : 462, - "best_us" : 438 + "med_us" : 269.0625, + "best_us" : 266.5 }, "plain" : { - "med_us" : 463, - "best_us" : 440 + "med_us" : 273.6875, + "best_us" : 267.65625 }, "u2" : { - "med_us" : 450, - "best_us" : 386 + "med_us" : 270.03125, + "best_us" : 266 }, "u4" : { - "med_us" : 463, - "best_us" : 442 + "med_us" : 270, + "best_us" : 267.15625 }, "u8" : { - "med_us" : 461.5, - "best_us" : 437 + "med_us" : 272.21875, + "best_us" : 266.65625 }, "vec4_u2" : { - "med_us" : 464.5, - "best_us" : 435 + "med_us" : 269.5625, + "best_us" : 266.59375 }, "vec4_u8" : { - "med_us" : 467.5, - "best_us" : 438 + "med_us" : 268.71875, + "best_us" : 266.75 }, "vec8_u2" : { - "med_us" : 451, - "best_us" : 435 + "med_us" : 269.8125, + "best_us" : 267.03125 }, "vec8_u8" : { - "med_us" : 442, - "best_us" : 425 + "med_us" : 267.90625, + "best_us" : 267.28125 }, "vec16" : { - "med_us" : 451, - "best_us" : 388 + "med_us" : 270, + "best_us" : 267.46875 } } }, "rmsnorm" : { "winner" : "vec8", "fallback" : "plain", - "floor_pct" : 0.5528627898888653, + "floor_pct" : 0.25998991791017084, + "margin_pct" : 85.90106889058553, "rows" : { "vec32_u2" : { - "med_us" : 923, - "best_us" : 903 + "med_us" : 620.53125, + "best_us" : 620.0625 }, "vec32" : { - "med_us" : 912, - "best_us" : 912 + "med_us" : 615.40625, + "best_us" : 614.9375 }, "vec32_u4" : { - "med_us" : 912, - "best_us" : 912 + "med_us" : 620.34375, + "best_us" : 619.75 }, "vec32_u8" : { - "med_us" : 916, - "best_us" : 916 + "med_us" : 623.40625, + "best_us" : 622.21875 }, "vec16_u2" : { - "med_us" : 901, - "best_us" : 881 + "med_us" : 602.09375, + "best_us" : 600.71875 }, "vec16_u4" : { - "med_us" : 898, - "best_us" : 879 + "med_us" : 606.53125, + "best_us" : 605.84375 }, "vec16_u8" : { - "med_us" : 893, - "best_us" : 874 + "med_us" : 615.8125, + "best_us" : 615.25 }, "vec4" : { - "med_us" : 1014, - "best_us" : 1014 + "med_us" : 689.3448275862069, + "best_us" : 688.6206896551724 }, "vec8" : { - "med_us" : 883, - "best_us" : 863 + "med_us" : 595.796875, + "best_us" : 594.46875 }, "vec4_u4" : { - "med_us" : 1008, - "best_us" : 1008 + "med_us" : 694.3333333333334, + "best_us" : 693.9629629629629 }, "vec8_u4" : { - "med_us" : 883, - "best_us" : 863 + "med_us" : 600.171875, + "best_us" : 599.71875 }, "plain" : { - "med_us" : 8140, - "best_us" : 8140 + "med_us" : 4344.5, + "best_us" : 4259.25 }, "u2" : { - "med_us" : 8144, - "best_us" : 8144 + "med_us" : 4303.25, + "best_us" : 4242.25 }, "u4" : { - "med_us" : 8136, - "best_us" : 8136 + "med_us" : 4251.5, + "best_us" : 4244.5 }, "u8" : { - "med_us" : 8137, - "best_us" : 8137 + "med_us" : 4315, + "best_us" : 4297 }, "vec4_u2" : { - "med_us" : 1014, - "best_us" : 1014 + "med_us" : 689.8571428571429, + "best_us" : 688.8571428571429 }, "vec4_u8" : { - "med_us" : 1008, - "best_us" : 1008 + "med_us" : 694.7586206896551, + "best_us" : 693.6896551724138 }, "vec8_u2" : { - "med_us" : 881, - "best_us" : 862 + "med_us" : 599.546875, + "best_us" : 599.125 }, "vec8_u8" : { - "med_us" : 887, - "best_us" : 867 + "med_us" : 599.578125, + "best_us" : 598.09375 }, "vec16" : { - "med_us" : 900, - "best_us" : 880 + "med_us" : 601.78125, + "best_us" : 600.78125 } } } @@ -2595,9 +2621,10 @@ "jobque_spin_us" : 30000, "target_chunk_work" : 1, "norm_par_threshold" : 256000, - "gemv_lane_cap" : 0, + "gemv_lane_cap" : 6, "matmul_min_chunk_rows" : 16, "batch_grid_2d" : 0, + "metal_devw_small_panel_mb" : 32, "team_rank_gate" : -1, "kv_store_par_threshold" : 256000, "q8_l2_budget" : 4194304, @@ -2605,12 +2632,14 @@ "jobque_join_poll" : 50, "q8_token_block" : 128, "requant_par_threshold" : 256000, - "metal_tensor" : "", + "metal_tensor" : "mulmm_bf16,mulmm_q8,moe_mulmm_q8,attn_qkmm,attn_avmm,kq_mulmm_k4,kq_mulmm_k5,kq_mulmm_k6,gemmb_q8,gemmb_sk_q8,gemm64b_q8", "matmul_min_chunk_rows_gemv" : 64, "attn_par_threshold" : 100000, "batch_lane_cap" : 0, + "metal_cvt_min_rows" : 256, + "metal_tall_floor" : 64, "act_par_threshold" : 100000, - "threads" : 8, + "threads" : 18, "dispatch_worker_limit" : 0, "q8_batch_chunks_per_job" : 4, "q8_chunks_per_job" : 2, diff --git a/modules/dasLLAMA/performance/profile_common.das b/modules/dasLLAMA/performance/profile_common.das index dd256bb92e..5dc7e5851b 100644 --- a/modules/dasLLAMA/performance/profile_common.das +++ b/modules/dasLLAMA/performance/profile_common.das @@ -1330,6 +1330,13 @@ def nemo_py() : string { // patched with patches/mtmd-timing.patch. CPU-only is deliberate: the fast historical mtmd numbers // rode Metal (GPU) despite the "CPU-only" label — ggml's Conformer audio ops don't route through // BLAS/AMX, so a genuine CPU encode is ~16 s (and das's optimized scalar Conformer beats it). +//! The Metal twin of mtmd_bin() — the same patched checkout built with Metal ON +//! (setup_asr_rig's build-metal, Apple boxes); "" when absent, and the gpu ref leg skips loudly. +def mtmd_bin_metal() : string { + let c = normalize("../llama.cpp-mtmd-ref/build-metal/bin/llama-mtmd-cli") + return stat(c).is_valid ? c : "" +} + def mtmd_bin() : string { let env = g_env_prof.mtmd_bin if (!empty(env)) { @@ -1555,7 +1562,7 @@ def run_asr_mtmd(model_path, mmproj_path, wav_path : string; threads, reps : int var best = -1.0lf encode_out = 0.0lf text_out = "" - let args <- [mtmd_bin(), "-m", model_path, "--mmproj", mmproj_path, "--audio", wav_path, + let args <- [gpu ? mtmd_bin_metal() : mtmd_bin(), "-m", model_path, "--mmproj", mmproj_path, "--audio", wav_path, "-p", "Transcribe the audio.", "--temp", "0", "--jinja", "--reasoning", "off", "-ngl", gpu ? "99" : "0", "-t", "{threads}"] cmd_out = argv_line(args) diff --git a/modules/dasLLAMA/performance/setup_asr_rig.das b/modules/dasLLAMA/performance/setup_asr_rig.das index a22784c029..30d3ccfb7a 100644 --- a/modules/dasLLAMA/performance/setup_asr_rig.das +++ b/modules/dasLLAMA/performance/setup_asr_rig.das @@ -314,6 +314,16 @@ def private setup_refs(cfg : Args) : bool { run_capture("cmake -S \"{lroot}\" -B \"{lroot}/build-cpu\" -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=OFF && cmake --build \"{lroot}/build-cpu\" --config Release -j 8 --target llama-mtmd-cli", false) to_log(LOG_INFO, "setup_asr_rig: set MTMD_BIN={lroot}/build-cpu/bin/llama-mtmd-cli\n") } + // the Metal twin (Apple boxes): the same patched checkout, Metal ON - the gpu ref leg + // pairs the das metal ASR rows against it (a -ngl on the CPU-only build is inert) + if (is_apple_box() && !stat(mtmd_bin_metal()).is_valid && stat(normalize("{lroot}/CMakeLists.txt")).is_valid) { + to_log(LOG_INFO, "setup_asr_rig: building llama-mtmd-cli (build-metal: Metal ON)\n") + run_capture("cmake -S \"{lroot}\" -B \"{lroot}/build-metal\" -DCMAKE_BUILD_TYPE=Release && cmake --build \"{lroot}/build-metal\" --config Release -j 8 --target llama-mtmd-cli", false) + if (empty(mtmd_bin_metal())) { + to_log(LOG_WARNING, "setup_asr_rig: build-metal mtmd did not materialize - the gpu ref leg will skip\n") + ok = false + } + } return ok } diff --git a/modules/dasLLAMA/release_remint_plan.md b/modules/dasLLAMA/release_remint_plan.md index 8d87f5e827..3dad8ce77e 100644 --- a/modules/dasLLAMA/release_remint_plan.md +++ b/modules/dasLLAMA/release_remint_plan.md @@ -82,6 +82,26 @@ NEVER-DISPATCHED report; blind-spot entries move onto real rows. re-mint under the new release scope; refresh `last_known_good_sidecar.json`. Sanity floor first; never `--quick` (followup 32); no rebuilds mid-race. +## Slice C — DONE 2026-08-30: manifests minted under release scope + +Predictions vs outcomes (the game): mint 6-12 min / noise ok — **held** (7.3 min release, +noise ok); >=36/40 winners identical to v14 — **held** (37/40; three near-tie elementwise +flips); provenance stamps release 15 under the wire key — **held**. The box-manifest mint +(m5.tune.json) agreed with the bench sidecar on all 40 winners; LKG refreshed. Ref-side +plumbing landed on the way: setup_asr_rig builds a build-metal mtmd twin on Apple (the CPU +build's -ngl is inert), setup_lcpp_ref builds llama-mtmd-cli beside llama-bench (the +sibling rule), stock + metal mtmd binaries built on this box. + +## Slice D predictions (logged BEFORE the sweep, 2026-08-30) + +- Text metal cells reproduce the committed m5 rows within cv (E2B ~8.7k pp / ~162 tg; + every das/ref ratio holds green). +- CPU: E2B pp ~850 das vs ~840 clean-cpu@18; MoE Q4KM pp ahead post-split (26B-A4B ~1.4x). +- New ASR gpu cells: whisper turbo 1.0-1.4x vs whisper-cli metal; canary gb1 ~2.5-3x vs + nemo-MPS; gemma4a jfk ~1.0-1.25x and qwen3a jfk ~1.4-1.7x vs mtmd-metal; omni ahead + 1.1-1.5x on the ref ladder. +- qwen25v image cell: enc ~106 ms vs mtmd ~117 (das ahead all three axes). + ## Slice D — the full M5 board re-mint (ref pin b10659) clean-cpu + stock ref builds already minted in `llama.cpp-ref-6fdd0ac`. das cpu vs From 345dcd667ba2fee13b1a90e15b65391c46fbae5b Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 07:24:40 -0700 Subject: [PATCH 06/17] the standalone exe forwards again - 12 vulkan-arc hooks join the gpu_tier boot-restore A serialized exe restores globals as DATA, so function values arrive null unless a boot-restore [init] heals them (dasllama_config's restore_dlim_source_defaults states the law; dasllama_gpu_tier HAS such an [init]). The vulkan decode-mirror/ffn-tail arc added 12 declaration-defaulted hook globals that never joined it, and put one - g_moe_gpu_attn_dec_claim, via prefill_claim_mirrors - on the UNCONDITIONAL prefill tail. Every standalone-exe forward died with 'invoke null function': all 10 board text models refused at the parity pregate, the four decoder-gguf ASR families' cpu and accel cells crashed, image cells never ran. No -jit gate could see it - script mode runs the declaration initializers - which is why months of green suites proved nothing about the exe rail. Found by git-bisect (first bad 40023887c) + a staged exe probe; the 12 join the restore. test_exe_smoke joins the model-free suite: builds _exe_smoke_root.das with -jit -exe and runs the artifact through a 4-token generate (negative-controlled: red on the crash without the fix, green with it). SmolLM2 small tier; skips honestly without it. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- .../dasLLAMA/dasllama/dasllama_gpu_tier.das | 36 +++++++++++++ modules/dasLLAMA/tests/_exe_smoke_root.das | 36 +++++++++++++ modules/dasLLAMA/tests/run.das | 1 + modules/dasLLAMA/tests/test_exe_smoke.das | 54 +++++++++++++++++++ 4 files changed, 127 insertions(+) create mode 100644 modules/dasLLAMA/tests/_exe_smoke_root.das create mode 100644 modules/dasLLAMA/tests/test_exe_smoke.das diff --git a/modules/dasLLAMA/dasllama/dasllama_gpu_tier.das b/modules/dasLLAMA/dasllama/dasllama_gpu_tier.das index af0a73fc8f..252026a516 100644 --- a/modules/dasLLAMA/dasllama/dasllama_gpu_tier.das +++ b/modules/dasLLAMA/dasllama/dasllama_gpu_tier.das @@ -1554,4 +1554,40 @@ def private restore_gpu_tier_fn_defaults { // nolint:STYLE037,STYLE038 — flat if (g_moe_gpu_bake_tag == null) { g_moe_gpu_bake_tag = @@moe_gpu_no_bake_tag } + if (g_rdec_prefill_ids == null) { + g_rdec_prefill_ids = @@rdec_unset_prefill_ids + } + if (g_rdec_set_emb == null) { + g_rdec_set_emb = @@rdec_unset_set_emb + } + if (g_rdec_upload_emb_f32 == null) { + g_rdec_upload_emb_f32 = @@rdec_unset_upload_emb_f32 + } + if (g_moe_gpu_ffn_xf == null) { + g_moe_gpu_ffn_xf = @@moe_gpu_unset_ffn_xf + } + if (g_moe_gpu_ffn_xf_ok == null) { + g_moe_gpu_ffn_xf_ok = @@moe_gpu_no_ffn_xf + } + if (g_moe_gpu_ffn_xf_begin == null) { + g_moe_gpu_ffn_xf_begin = @@moe_gpu_unset_ffn_xf_begin + } + if (g_moe_gpu_ffn_xf_join == null) { + g_moe_gpu_ffn_xf_join = @@moe_gpu_unset_ffn_xf_join + } + if (g_moe_gpu_ffn_xf_rows == null) { + g_moe_gpu_ffn_xf_rows = @@moe_gpu_no_ffn_xf_rows + } + if (g_moe_gpu_attn_dec == null) { + g_moe_gpu_attn_dec = @@moe_gpu_unset_attn_dec + } + if (g_moe_gpu_attn_dec_ok == null) { + g_moe_gpu_attn_dec_ok = @@moe_gpu_no_attn_dec + } + if (g_moe_gpu_attn_dec_claim == null) { + g_moe_gpu_attn_dec_claim = @@moe_gpu_noop_attn_dec_claim + } + if (g_moe_gpu_attn_dec_hydrate == null) { + g_moe_gpu_attn_dec_hydrate = @@moe_gpu_unset_attn_dec_hydrate + } } diff --git a/modules/dasLLAMA/tests/_exe_smoke_root.das b/modules/dasLLAMA/tests/_exe_smoke_root.das new file mode 100644 index 0000000000..dc1fe2128b --- /dev/null +++ b/modules/dasLLAMA/tests/_exe_smoke_root.das @@ -0,0 +1,36 @@ +options gen2 +options stack = 524288 // every dasllama program root takes this budget + +require dasllama/dasllama +require daslib/jobque_boost +require daslib/fio + +// The standalone-exe smoke root (test_exe_smoke builds it with -jit -exe and runs the artifact): +// one tiny load + a 4-token generate through the facade. A serialized exe restores globals as +// DATA - function values arrive null unless a boot-restore [init] heals them - so this is the +// one context the -jit suites can never cover; the vulkan decode-mirror claim shipped crashing +// exactly here while every script-mode gate stayed green. + +[export] +def main { + let path = get_env_variable("DASLLAMA_EXE_SMOKE_MODEL") + if (empty(path)) { + print("EXE_SMOKE_SKIP no model\n") + return + } + var m <- load_model(path, QuantMode.q8) + allow_cpu_prefill() + with_job_que() { + setup_dasllama_jobque() + var s <- create_session(m) + var prompt <- encode(m, "Once upon a time", true) + let params = SamplingParams() + let n = generate(m, s, prompt, params, 4l) $(_id : int64; _piece : string) : bool { + return true + } + print("EXE_SMOKE_OK {n}\n") + delete prompt + delete s + } + delete m +} diff --git a/modules/dasLLAMA/tests/run.das b/modules/dasLLAMA/tests/run.das index fb75dfa9e3..87cba09f67 100644 --- a/modules/dasLLAMA/tests/run.das +++ b/modules/dasLLAMA/tests/run.das @@ -93,6 +93,7 @@ def private suite_files(name : string) : array { // nolint:STYLE038 - "modules/dasLLAMA/tests/test_dispatch_shaping.das", "modules/dasLLAMA/tests/test_env_registry.das", "modules/dasLLAMA/tests/test_exchange_schema.das", + "modules/dasLLAMA/tests/test_exe_smoke.das", "modules/dasLLAMA/tests/test_facade_docs.das", "modules/dasLLAMA/tests/test_flash.das", "modules/dasLLAMA/tests/test_forward.das", diff --git a/modules/dasLLAMA/tests/test_exe_smoke.das b/modules/dasLLAMA/tests/test_exe_smoke.das new file mode 100644 index 0000000000..7729b9e527 --- /dev/null +++ b/modules/dasLLAMA/tests/test_exe_smoke.das @@ -0,0 +1,54 @@ +options gen2 +options stack = 524288 // every dasllama program root takes this budget +options _dasllama_internal = true // spawns the fixture; its own requires stay light + +require dastest/testing_boost public +require daslib/fio +require math +require daslib/strings_boost +require strings +require _model_tier + +// The standalone-exe context gate: build _exe_smoke_root.das with `-jit -exe` and run the +// artifact. A serialized exe restores globals as DATA - function-typed globals arrive null +// unless a boot-restore [init] heals them (dasllama_config's restore_dlim_source_defaults is +// the precedent) - and every -jit suite is structurally blind to that class: the vulkan +// decode-mirror claim shipped crashing every exe forward while all script-mode gates ran +// green. One tiny model, one 4-token generate, ~90 s; skips honestly without the model. + +def private self_daslang() : string { + let argv <- get_command_line_arguments() + return find(to_generic_path(argv[0]), "/") < 0 ? argv[0] : get_full_file_name(normalize(argv[0])) +} + +[test] +def test_exe_smoke(t : T?) { + t |> run("a -jit -exe build of the facade generates on the serialized-globals rail") @(t : T?) { + let model = path_join(models_dir(), "SmolLM2-135M-Instruct-Q8_0.gguf") + if (!model_available(t, model)) { + return + } + let dir_r = create_temp_directory_result("dasllama_exe_smoke") + if (!(dir_r is value)) { + t |> failure("temp dir failed") + return + } + let dir = unsafe(dir_r.value) + let exe = path_join(dir, "smoke.exe") // daslang -exe appends `.exe` to -output itself + var bout = "" + let brc = run_and_capture([self_daslang(), "-jit", "-exe", "-output", path_join(dir, "smoke"), + "modules/dasLLAMA/tests/_exe_smoke_root.das"], bout, 600.0) + t |> equal(0, brc, "the -exe build succeeds: {slice(bout, max(0, length(bout) - 400))}") + if (brc != 0 || !stat(exe).is_valid) { + t |> success(stat(exe).is_valid, "the exe artifact exists at -output") + rmdir_rec_result(dir) + return + } + var out = "" + let rc = run_and_capture(["/usr/bin/env", "DASLLAMA_ALLOW_UNTUNED=1", + "DASLLAMA_EXE_SMOKE_MODEL={model}", exe], out, 300.0) + t |> equal(0, rc, "the exe runs clean: {slice(out, max(0, length(out) - 400))}") + t |> success(find(out, "EXE_SMOKE_OK") >= 0, "the generate completed in the exe: {slice(out, max(0, length(out) - 400))}") + rmdir_rec_result(dir) + } +} From 77dfc242d22e0ff592994b2d5510f6196938cea3 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 18:13:45 -0700 Subject: [PATCH 07/17] the M5 board lands whole - four reds run down, two of them real bugs The full re-mint on the b10659 pin: 10 text models (metal pp 1.07-1.23x / tg to 1.33x ahead; the CPU board debuts vs clean-cpu with the MoE 32-row split at pp 1.60-1.68x, accel to 1.82x), the image board with honest metal ref pairs at last (the patched sibling), the full ASR board with GPU ref twins (das metal ahead of whisper-cli-metal, mtmd-metal and nemo-MPS everywhere but the ledgered canary gb1 CPU front), and the owed board cells: canary q8 decoder + Metal FastConformer, gemma4a/qwen3a metal rails, and the qwen vision carriers - Qwen3VL-4B and Qwen2.5-Omni-3B verified 40/40 against the live oracle, flipped official, their image cells minted (the qwen25v tower reproduces the arc: enc 106.0 vs 118.0 ms). Red 1, gpt-oss pp halved (3989 -> 2047): the followup-53 scaffold migration renumbered the mx4 tensor twin's x/y binds to the family contract (xf@3 y@4) and the HAND-BOUND race arm kept 2/3 - the twin read the zeroed output buffer as X, the race honestly measured garbage (maxdiff == maxref), refused the crown, and serving fell to the simdgroup family. Race arm fixed, both manifests re-minted (moe_mulmm_mx4 tensor-crowned again), cell respotted: pp 3995.1 - the pre-merge number. Third incident of the hand-bound-race class; the census opaque-dispatch gate is now the priority lint candidate. Red 2, the canary nemo ref: NeMo's generate mutates the prompt list in place (warm reps degenerate to a 3-token stub) and torch.set_num_threads beside an MPS device degenerates EVERY rep; the crashed cell then laundered a stale onnx row through the rowless-pipe --out fallback, which never checked the tool. Bench rebuilds prompts per rep, discards degenerate reps loudly, keeps the threads knob CPU-only; the fallback is onnx-only. Honest rows: das metal 2.29x/2.02x ahead on jfk/jfk3, 0.68x on gb1 (the ledgered CPU mel+subsample front). Red 3 (onnx whisper 1/5 clips) closed by-design (single-window adapter, documented SKIP). The two dasllama_math accel-override globals join a boot-restore [init] (REVIEW.das gate green). Site records regenerated; records/site/specs gates green. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/LAWS.md | 7 + modules/dasLLAMA/PERF_LEDGER.md | 17 + modules/dasLLAMA/REVIEW.das | 36 + modules/dasLLAMA/REVIEW.md | 8 + .../benchmarks/asr/canary_qwen_bench.py | 19 +- .../dasLLAMA/benchmarks/setup_lcpp_ref.das | 12 +- modules/dasLLAMA/dasllama/dasllama_math.das | 13 + .../dasllama/dasllama_metal_prefill.das | 6 +- modules/dasLLAMA/followup_general.md | 9 + .../performance/gen_bench_records.das | 9 +- .../performance/last_known_good_sidecar.json | 2418 +- modules/dasLLAMA/performance/model_specs.das | 8 +- modules/dasLLAMA/performance/records/m5.json | 8155 +++++- .../records/m5.tune.144fd7914ced.json | 2648 ++ .../records/m5.tune.3865c28dd577.json | 2648 ++ modules/dasLLAMA/release_remint_plan.md | 11 + site/files/dasllama/bench_records.json | 23433 ++++++++++------ 17 files changed, 29501 insertions(+), 9956 deletions(-) create mode 100644 modules/dasLLAMA/performance/records/m5.tune.144fd7914ced.json create mode 100644 modules/dasLLAMA/performance/records/m5.tune.3865c28dd577.json diff --git a/modules/dasLLAMA/LAWS.md b/modules/dasLLAMA/LAWS.md index cd0ccf97b8..47ffa7f679 100644 --- a/modules/dasLLAMA/LAWS.md +++ b/modules/dasLLAMA/LAWS.md @@ -49,3 +49,10 @@ kernel-work bump duty in `REVIEW.md` was replaced by the declared-release rule; wire field `dasllama_version` stays schema-stable; the per-kernel-hash hardening ledgered as followup_general 58. + +- **2026-08-30** (`REVIEW.md`, `REVIEW.das`): on the serialized-exe null-function crash + (the vulkan decode-mirror claim; every -jit gate green while every exe forward died), + Boris confirmed the rule - "likely REVIEW.md candidate?" ... "yes. excellent followup" - + a declaration-initialized function-typed global joins its file's boot-restore [init] in + the same change; check_exe_fn_global_restore is the mechanical half, test_exe_smoke the + end-to-end tripwire. diff --git a/modules/dasLLAMA/PERF_LEDGER.md b/modules/dasLLAMA/PERF_LEDGER.md index e6891cee51..ba30a33a16 100644 --- a/modules/dasLLAMA/PERF_LEDGER.md +++ b/modules/dasLLAMA/PERF_LEDGER.md @@ -1160,3 +1160,20 @@ group; wording kept. per-region walk vs the dense flat sweep. Instrument: `harness/moe_kq_probe.das` (synthetic-k4 bare-kernel cells at expert shapes, dense-shape control included); ref bar re-taken against the b10659 clean-cpu build at the arc-end re-mint. + +- **The mlxfast arena trunk is a standing M5 kernel-shape intel source - watch it, adopt + shamelessly (Boris, 2026-08-30: "if there are better shapes on M5 - we are shamelessly + adopting").** The arena (yukon.org/mlxfast, repo Layr-Labs/mlxfast-gemma4-26b-a4b-engine, + local clone ~/Work/mlxfast) runs a collective ratchet: every accepted submission lands on + `main`, so the trunk is a continuously-updated record of what 26 solvers' search found on + Apple silicon. The 2026-08 delta (+30% composite in 33 commits, 100% kernel work) carries + three candidates for our Metal kernels, cited in ~/.claude/plans/mtp-research/mlxfast.md: + (1) tight-grid dispatch - launch only causally/structurally valid threadgroups instead of + early-returning ~75% of them (their decode step waived 158k of 211k tgs; our QK/AV grids + have the same triangular waste, mlxfast-reports engine.md item 4); (2) identity `scale*q` + elision (~4.4 GB/prefill of traffic on their shapes); (3) a nine-dispatch norm/residual + fusion. Re-check the trunk each arc; diff since the last-read sha before every adoption + pass. License verified 2026-08-30: MIT top to bottom - harness + submissions (c) 2026 + Layr Labs, vendored mlx-swift incl. Metal kernels (c) 2023 ml-explore/Apple - so adoption + is clean with those two attribution lines (the NAX arc's steel_attention_nax credit is the + house pattern); model weights are not in the repo and carry their own terms. diff --git a/modules/dasLLAMA/REVIEW.das b/modules/dasLLAMA/REVIEW.das index 0160b4d3e7..a2b8f1bfe1 100644 --- a/modules/dasLLAMA/REVIEW.das +++ b/modules/dasLLAMA/REVIEW.das @@ -240,12 +240,48 @@ def private check_gpu_role_partition { } } +// A serialized exe restores globals as DATA - a function value assigned in a declaration +// initializer arrives NULL, and only a boot-restore [init] heals it (dasllama_config's +// restore_dlim_source_defaults states the law). So every `var g_x = @@fn` declaration must +// have an `if (g_x == null)` restore guard in the SAME file, or the first exe run to reach +// its invoke dies with `invoke null function` while every -jit gate stays green - the vulkan +// decode-mirror claim shipped exactly that way. +def private check_exe_fn_global_restore { + dir("modules/dasLLAMA/dasllama") $(name) { + if (!(name |> ends_with(".das"))) { + return + } + let path = "modules/dasLLAMA/dasllama/{name}" + let text = fread(path) + var line_no = 0 + for (line in split(text, "\n")) { + line_no++ + var rest = "" + if (line |> starts_with("var private ")) { + rest = slice(line, length("var private ")) + } elif (line |> starts_with("var ")) { + rest = slice(line, length("var ")) + } else { + continue + } + let gname = ident_prefix(rest) + continue if (!(gname |> starts_with("g_"))) + let eq = find(line, "= @@") + continue if (eq < 0 || (find(line, "//") >= 0 && find(line, "//") < eq)) + if (find(text, "if ({gname} == null)") < 0) { + gate_finding(path, line_no, "function global `{gname}` has a declaration initializer but no `if ({gname} == null)` boot-restore guard - a serialized exe restores it as NULL and the first invoke dies (add it to the file's restore [init])") + } + } + } +} + [export] def main() : int { if (!fexist("modules/dasLLAMA/REVIEW.das") || !fexist(FACADE)) { to_log(LOG_ERROR, "modules/dasLLAMA/REVIEW.das: run from the repo root\n") return 2 } + check_exe_fn_global_restore() check_gpu_role_partition() check_fastmath_default() var inscope tut_texts : array diff --git a/modules/dasLLAMA/REVIEW.md b/modules/dasLLAMA/REVIEW.md index 2e646dd24f..ab3603ea96 100644 --- a/modules/dasLLAMA/REVIEW.md +++ b/modules/dasLLAMA/REVIEW.md @@ -63,6 +63,14 @@ mechanisms (`IMAGE_VERSION`, the reflected layout fingerprint). kernel as a uniform, a kargs field, an `@off` bind offset, or a helper parameter.** A value that can change between dispatches goes in a uniform, a kargs field, or an `@off` bind offset. +**A function-typed global with a declaration initializer joins its file's boot-restore +`[init]` in the same change, and weakening `REVIEW.das`'s restore check is a defect.** A +serialized exe restores globals as data - the function value arrives null, and the first +invoke to reach it dies at exe runtime while every `-jit` gate stays green (script mode runs +the declaration initializers). The restore guard (`if (g_x == null) { g_x = @@sentinel }`) +lets a real registrar win in either `[init]` order; `test_exe_smoke` is the end-to-end +tripwire for the class, the `REVIEW.das` check is the per-diff one. + **Never reorder or merge the float multiplies in a function that builds a RoPE angle table (`dasllama/dasllama_rope.das`) - keep the multiply order the code already has.** A regrouping moves the angles in the last bits and flips token-exact fixtures. diff --git a/modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py b/modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py index af69ca5fe1..19fd482f63 100644 --- a/modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py +++ b/modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py @@ -27,7 +27,10 @@ def main(): args = ap.parse_args() import torch - if args.threads > 0: + if args.threads > 0 and args.device == "cpu": + # CPU-arm only: set_num_threads alongside an MPS device degenerates SALM.generate + # to a 3-token stub (reproduced 2026-08-30, torch in the pinned venv) - the threads + # knob is meaningless off-CPU anyway torch.set_num_threads(args.threads) import soundfile as sf from transformers import GenerationConfig @@ -54,13 +57,21 @@ def main(): info = sf.info(wav) audio_s = info.frames / info.samplerate base = wav.rsplit("/", 1)[-1] - prompts = [[{"role": "user", "content": f"{args.prompt}{tag}", "audio": [wav]}]] for rep in range(args.reps): + # prompts rebuilt PER REP: model.generate mutates the chat list in place, and a + # reused list degenerates the next rep to a few tokens (fast on MPS, where it + # silently won best-of; on CPU the encode cost hid it while the transcript was + # still garbage). A rep that emits almost nothing is invalid either way. + prompts = [[{"role": "user", "content": f"{args.prompt}{tag}", "audio": [wav]}]] t0 = time.perf_counter() with torch.inference_mode(): - model.generate(prompts=prompts, generation_config=gen_cfg, - max_new_tokens=args.max_new_tokens) + out = model.generate(prompts=prompts, generation_config=gen_cfg, + max_new_tokens=args.max_new_tokens) ms = (time.perf_counter() - t0) * 1000.0 + n_ids = len(out[0]) if out is not None and len(out) else 0 + if n_ids < 8: + print(f"DEGENERATE\t{args.model}\t{base}\t{rep}\t{n_ids} ids - rep discarded", flush=True) + continue speed = audio_s / (ms / 1000.0) print(f"BENCH\t{args.model}\t{base}\t{audio_s:.0f}\t{rep}\t{ms:.3f}\t{speed:.4f}", flush=True) diff --git a/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das b/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das index 3bcb2b6e7d..cc75a9e447 100644 --- a/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das +++ b/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das @@ -168,7 +168,17 @@ def private build_flavor(dest, f, short_sha : string; jobs : int) : int { } } // llama-mtmd-cli rides along: the image/audio-chat ref cells resolve it as llama-bench's - // sibling (gen_bench_records' sibling_mtmd rule) - a bench-only build mints das-only rows + // sibling (gen_bench_records' sibling_mtmd rule) - a bench-only build mints das-only rows. + // The sibling needs mtmd-timing.patch (parse_mtmd_image reads MTMD_TIMING lines - an + // unpatched sibling mints "no rep parsed" failures); -3 rides pin drift, and a tree that + // already carries the print skips the apply + if (find(fread(path_join(dest, "tools/mtmd/mtmd-cli.cpp")), "MTMD_TIMING") < 0) { + let patch = get_full_file_name("modules/dasLLAMA/benchmarks/asr/patches/mtmd-timing.patch") + if (run_visible("git -C \"{dest}\" apply -3 \"{patch}\"") != 0) { + print("error: mtmd-timing.patch does not apply at this pin - port the patch before building the sibling\n") + return 1 + } + } if (run_visible("cmake --build \"{build_dir}\" --config Release --target llama-bench llama-mtmd-cli -j {jobs}") != 0) { print("error: build failed for {f}\n") return 1 diff --git a/modules/dasLLAMA/dasllama/dasllama_math.das b/modules/dasLLAMA/dasllama/dasllama_math.das index 58e5f2cfe5..c19aa52c8e 100644 --- a/modules/dasLLAMA/dasllama/dasllama_math.das +++ b/modules/dasLLAMA/dasllama/dasllama_math.das @@ -684,6 +684,19 @@ def clear_float_batch_override() { g_fp_override_active = false } +// Function values do not survive program serialization (a baked exe restores globals as DATA - +// the declaration defaults arrive null); the g_fp_override_active gate keeps the invokes off +// the null today, but the restore holds the invariant structurally (REVIEW.md's rule) +[init] +def private restore_float_override_defaults { + if (g_mm_fp_batch_override == null) { + g_mm_fp_batch_override = @@fp_batch_override_unset + } + if (g_mm_bf16_batch_override == null) { + g_mm_bf16_batch_override = @@bf16_batch_override_unset + } +} + def float_batch_override_active() : bool => g_fp_override_active // the one body: the float-override seam then the core. Both weight forms below reach it with a diff --git a/modules/dasLLAMA/dasllama/dasllama_metal_prefill.das b/modules/dasLLAMA/dasllama/dasllama_metal_prefill.das index 169c66ed0a..b73e4bc3af 100644 --- a/modules/dasLLAMA/dasllama/dasllama_metal_prefill.das +++ b/modules/dasLLAMA/dasllama/dasllama_metal_prefill.das @@ -6575,9 +6575,9 @@ def private race_moe_mulmm_mx4(dev : MetalDevice?; queue : MetalCommandQueue?) : kn_tgmem(enc, MetalMoeMulMmMx4T_metal_moe_mulmm_mx4_t_msl_tgmem, 0) kn_buffer(enc, bnq, 0ul, 0) kn_buffer(enc, bee, 0ul, 1) - kn_buffer(enc, bxa, 0ul, 2) - kn_buffer(enc, by_twin, 0ul, 3) - kn_kargs(enc, rka, 5) + kn_buffer(enc, bxa, 0ul, 3) //! the scaffold family contract: xf@3, y@4 (the followup-53 + kn_buffer(enc, by_twin, 0ul, 4) //! renumber; the old 2/3 read the OUTPUT buffer as X - the race + kn_kargs(enc, rka, 5) //! then un-crowned a correct twin and gpt-oss pp halved) kn_buffer(enc, bcnt, 0ul, 6) kn_buffer(enc, bbase, 0ul, 7) kn_buffer(enc, bwbb, 0ul, 12) diff --git a/modules/dasLLAMA/followup_general.md b/modules/dasLLAMA/followup_general.md index 3318b027e4..84ace854bd 100644 --- a/modules/dasLLAMA/followup_general.md +++ b/modules/dasLLAMA/followup_general.md @@ -675,3 +675,12 @@ valid. A generic llvm_tune feature, useful beyond dasLLAMA. Done = entry-level staleness by kernel hash, the release scope untouched, and the refusal-reason rail naming "kernel-hash" beside the existing reasons. + +59. **daslang's AST serializer could restore function-typed globals by name - retiring the + boot-restore class outright.** A serialized exe restores globals as data, so function + values arrive null; today every module carrying `var g_x = @@fn` declaration defaults + owes a boot-restore `[init]` (the REVIEW.das restore check + test_exe_smoke guard the + dasLLAMA tree, minted after the vulkan decode-mirror claim shipped crashing every exe + forward). The root fix is daslang-core: serialize a function value as its mangled name + and re-resolve at restore - the whole hazard class disappears language-wide, and the + restore inits + the gate collapse to history. das-core scope, its own arc. diff --git a/modules/dasLLAMA/performance/gen_bench_records.das b/modules/dasLLAMA/performance/gen_bench_records.das index ebf3ad9353..22f3cb5307 100644 --- a/modules/dasLLAMA/performance/gen_bench_records.das +++ b/modules/dasLLAMA/performance/gen_bench_records.das @@ -1120,9 +1120,12 @@ def private asr_ref_pass(spec : AsrModelSpec; ref : AsrRef; versions : string; c rr.cmd = argv_line(pyargs) var out = run_capture_argv(pyargs) if (find(out, "BENCH") < 0) { - // pipe came back rowless — fall back to the --out file (Windows: parakeet loaders - // wreck the child's stdout pipe; the file survives everything) - let sidecar = fread(asr_pybench_out_path()) + // pipe came back rowless — for onnx ONLY, fall back to its --out file (Windows: + // parakeet loaders wreck the child's stdout pipe; the file survives everything). + // Only onnx WRITES that file, so any other tool reading it would launder a STALE + // onnx row into its own record under a matching clip name (a nemo-mps crash did + // exactly that - the recovered "nemo" jfk was onnx-whisper-turbo's). + let sidecar = ref.tool == "onnx" ? fread(asr_pybench_out_path()) : "" if (find(sidecar, "BENCH") >= 0) { to_log(LOG_INFO, "gen_bench_records: {ref.tool} pipe was rowless - rows recovered from --out file\n") out = sidecar diff --git a/modules/dasLLAMA/performance/last_known_good_sidecar.json b/modules/dasLLAMA/performance/last_known_good_sidecar.json index 32079a7578..aa49d1af38 100644 --- a/modules/dasLLAMA/performance/last_known_good_sidecar.json +++ b/modules/dasLLAMA/performance/last_known_good_sidecar.json @@ -3,7 +3,7 @@ "add_inplace" : "vec8_u2", "cvt_f32_to_f16" : "vec16", "rope_scaled_neox_tab" : "vec8_u2", - "q51q8_tile_gen" : "mr4", + "q51q8_tile_gen" : "mr8_nrsplit2", "softmax" : "vec8_u2", "mul_inplace" : "vec8_u2", "quantize_q8_0_bs_into_ptr" : "plain", @@ -27,7 +27,7 @@ "q8q8_tile_gen" : "mr8_budget", "quantize_q8_0_into_ptr" : "plain", "k4q8_tile_gen" : "mr8", - "k5q8_tile_gen" : "mr4", + "k5q8_tile_gen" : "mr8", "k6q8_tile_gen" : "mr4", "gemm_f32_uk_4x16" : "u2", "dot_q51e" : "vec16", @@ -35,7 +35,7 @@ "cvt_f16_to_f32" : "vec8_u2", "dot" : "vec8_u2", "dot_q8tq4kv" : "vec16", - "scale_inplace" : "vec8_u2", + "scale_inplace" : "plain", "dot_q4" : "vec4_u4", "quantize_tq4kv_row" : "plain", "copy_floats" : "vec8_u2", @@ -43,584 +43,584 @@ }, "provenance" : { "validation" : "ok", - "noise_probes" : "start cv 0.26%; mid1 cv 0.10%; mid2 cv 0.20%; end cv 0.29%", + "noise_probes" : "start cv 0.08%; mid1 cv 0.05%; mid2 cv 0.10%; end cv 0.10%", "platform" : "darwin", - "noise_floor_cv_pct" : "0.29", - "engine_sha" : "366669a53", + "noise_floor_cv_pct" : "0.10", + "engine_sha" : "fa67fe165", "box" : "darwin|arm64|Mac17,6|25G72|Apple M5 Max", - "written" : "2026-08-30T11:34:13.982Z", + "written" : "2026-08-31T01:12:23.099Z", "validation_demoted" : "0", "mode" : "normal", "dasllama_version" : "15", "noise" : "ok", "binary" : "./bin/daslang", "arch" : "arm64", - "validation_max_drift_pct" : "0.73" + "validation_max_drift_pct" : "0.41" }, "race" : { "cvt_q8kv_to_f32" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 376.78125, - "best_us" : 376.25 + "med_us" : 376.6875, + "best_us" : 375.9375 }, "vec32" : { - "med_us" : 375.53125, - "best_us" : 374.9375 + "med_us" : 375.59375, + "best_us" : 375.34375 }, "vec32_u4" : { - "med_us" : 376.5, - "best_us" : 375.90625 + "med_us" : 377.0625, + "best_us" : 376.71875 }, "vec32_u8" : { - "med_us" : 376.65625, - "best_us" : 376.09375 + "med_us" : 376.40625, + "best_us" : 376.3125 }, "vec16_u2" : { - "med_us" : 376.125, - "best_us" : 376.03125 + "med_us" : 376.5, + "best_us" : 376.375 }, "vec16_u4" : { - "med_us" : 376.25, - "best_us" : 376.0625 + "med_us" : 376.5625, + "best_us" : 376.34375 }, "vec16_u8" : { - "med_us" : 376.46875, - "best_us" : 375.90625 + "med_us" : 376.4375, + "best_us" : 376.0625 }, "vec4" : { - "med_us" : 375.40625, - "best_us" : 374.46875 + "med_us" : 375.25, + "best_us" : 375.09375 }, "vec8" : { - "med_us" : 375.5, + "med_us" : 375.65625, "best_us" : 375.15625 }, "vec4_u4" : { - "med_us" : 376.375, - "best_us" : 376.15625 + "med_us" : 376.28125, + "best_us" : 375.9375 }, "vec8_u4" : { - "med_us" : 375.90625, - "best_us" : 374.96875 + "med_us" : 376.1875, + "best_us" : 375.4375 }, "plain" : { - "med_us" : 375.90625, + "med_us" : 375.09375, "best_us" : 374.96875 }, "u2" : { - "med_us" : 376.375, - "best_us" : 375.875 + "med_us" : 376.59375, + "best_us" : 376.15625 }, "u4" : { - "med_us" : 376.40625, - "best_us" : 376.0625 + "med_us" : 377.09375, + "best_us" : 376.6875 }, "u8" : { - "med_us" : 376.71875, - "best_us" : 375.90625 + "med_us" : 376.6875, + "best_us" : 376.5625 }, "vec4_u2" : { - "med_us" : 376.46875, - "best_us" : 375.96875 + "med_us" : 376.28125, + "best_us" : 375.71875 }, "vec4_u8" : { - "med_us" : 376.28125, - "best_us" : 376.0625 + "med_us" : 376.53125, + "best_us" : 376.125 }, "vec8_u2" : { - "med_us" : 375.71875, - "best_us" : 374.90625 + "med_us" : 375.9375, + "best_us" : 375.625 }, "vec8_u8" : { - "med_us" : 375.5, - "best_us" : 375.25 + "med_us" : 376, + "best_us" : 375.84375 }, "vec16" : { - "med_us" : 375.1875, - "best_us" : 374.71875 + "med_us" : 375.625, + "best_us" : 375.125 } } }, "add_inplace" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 335.59375, - "best_us" : 334.3125 + "med_us" : 337.25, + "best_us" : 336.53125 }, "vec32" : { - "med_us" : 362.65625, - "best_us" : 360.3125 + "med_us" : 362.3125, + "best_us" : 360.9375 }, "vec32_u4" : { - "med_us" : 337.125, - "best_us" : 336.84375 + "med_us" : 338.25, + "best_us" : 336.78125 }, "vec32_u8" : { - "med_us" : 335.28125, - "best_us" : 334.5 + "med_us" : 336.3125, + "best_us" : 336 }, "vec16_u2" : { - "med_us" : 339.34375, - "best_us" : 339.28125 + "med_us" : 340.375, + "best_us" : 340.125 }, "vec16_u4" : { - "med_us" : 338.53125, - "best_us" : 337.5625 + "med_us" : 339, + "best_us" : 337.875 }, "vec16_u8" : { - "med_us" : 411.0625, - "best_us" : 408.90625 + "med_us" : 413.875, + "best_us" : 413.15625 }, "vec4" : { - "med_us" : 361.5, - "best_us" : 360.1875 + "med_us" : 362.03125, + "best_us" : 361 }, "vec8" : { - "med_us" : 361.625, - "best_us" : 360.03125 + "med_us" : 362.59375, + "best_us" : 361.4375 }, "vec4_u4" : { - "med_us" : 337.84375, - "best_us" : 336.375 + "med_us" : 337.90625, + "best_us" : 337.3125 }, "vec8_u4" : { - "med_us" : 336.5625, - "best_us" : 335.78125 + "med_us" : 337.78125, + "best_us" : 335 }, "plain" : { - "med_us" : 361.15625, - "best_us" : 360.3125 + "med_us" : 362.875, + "best_us" : 362.375 }, "u2" : { - "med_us" : 361.5625, - "best_us" : 359.78125 + "med_us" : 363.09375, + "best_us" : 360.8125 }, "u4" : { - "med_us" : 338.125, - "best_us" : 336.4375 + "med_us" : 337.90625, + "best_us" : 337.21875 }, "u8" : { - "med_us" : 336.65625, - "best_us" : 334.65625 + "med_us" : 336.9375, + "best_us" : 336.28125 }, "vec4_u2" : { - "med_us" : 361.8125, - "best_us" : 359.875 + "med_us" : 363.21875, + "best_us" : 361.59375 }, "vec4_u8" : { - "med_us" : 336.25, - "best_us" : 335.1875 + "med_us" : 338.0625, + "best_us" : 337.34375 }, "vec8_u2" : { - "med_us" : 336.375, - "best_us" : 334.46875 + "med_us" : 339.6875, + "best_us" : 335.96875 }, "vec8_u8" : { - "med_us" : 342.15625, - "best_us" : 339.28125 + "med_us" : 336.53125, + "best_us" : 336.34375 }, "vec16" : { - "med_us" : 338.375, - "best_us" : 336.875 + "med_us" : 340.46875, + "best_us" : 339.0625 } } }, "axpy_q8kv" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 395.59375, - "best_us" : 395.4375 + "med_us" : 395.96875, + "best_us" : 395.8125 }, "vec32" : { - "med_us" : 393.71875, - "best_us" : 393.5625 + "med_us" : 393.78125, + "best_us" : 393.625 }, "vec32_u4" : { - "med_us" : 396.0625, - "best_us" : 396 + "med_us" : 395.59375, + "best_us" : 395.375 }, "vec32_u8" : { - "med_us" : 395.3125, - "best_us" : 395.1875 + "med_us" : 395.65625, + "best_us" : 394.90625 }, "vec16_u2" : { - "med_us" : 394.9375, - "best_us" : 394.8125 + "med_us" : 395.53125, + "best_us" : 395.375 }, "vec16_u4" : { - "med_us" : 395.5625, - "best_us" : 394.90625 + "med_us" : 395.0625, + "best_us" : 394.6875 }, "vec16_u8" : { - "med_us" : 395.125, - "best_us" : 394.9375 + "med_us" : 394.90625, + "best_us" : 394.75 }, "vec4" : { - "med_us" : 393.6875, - "best_us" : 393.53125 + "med_us" : 396.0625, + "best_us" : 396 }, "vec8" : { - "med_us" : 393.6875, - "best_us" : 393.40625 + "med_us" : 396.34375, + "best_us" : 396.21875 }, "vec4_u4" : { - "med_us" : 393.09375, - "best_us" : 392.65625 + "med_us" : 393.5625, + "best_us" : 393.53125 }, "vec8_u4" : { - "med_us" : 396.09375, - "best_us" : 395.375 + "med_us" : 395.75, + "best_us" : 395.25 }, "plain" : { - "med_us" : 393.78125, - "best_us" : 393.53125 + "med_us" : 393.46875, + "best_us" : 393.4375 }, "u2" : { - "med_us" : 394.59375, - "best_us" : 394.46875 + "med_us" : 395.375, + "best_us" : 394.9375 }, "u4" : { - "med_us" : 395.5, + "med_us" : 395.53125, "best_us" : 394.9375 }, "u8" : { - "med_us" : 395.53125, - "best_us" : 394.90625 + "med_us" : 394.9375, + "best_us" : 394.78125 }, "vec4_u2" : { - "med_us" : 393.59375, - "best_us" : 393.4375 + "med_us" : 394.125, + "best_us" : 393.96875 }, "vec4_u8" : { - "med_us" : 394.5625, - "best_us" : 393.75 + "med_us" : 393.5, + "best_us" : 393.4375 }, "vec8_u2" : { - "med_us" : 395.25, - "best_us" : 395.125 + "med_us" : 397.5, + "best_us" : 397.3125 }, "vec8_u8" : { - "med_us" : 395.96875, - "best_us" : 395.5625 + "med_us" : 395.6875, + "best_us" : 395.59375 }, "vec16" : { - "med_us" : 393.59375, - "best_us" : 393.4375 + "med_us" : 393.5, + "best_us" : 393.40625 } } }, "cvt_f32_to_f16" : { "winner" : "vec16", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, - "margin_pct" : 6.37927280644459, + "floor_pct" : 0.07927948634535505, + "margin_pct" : 6.354806394006708, "rows" : { "vec32_u2" : { - "med_us" : 347.3125, - "best_us" : 346.65625 + "med_us" : 347.28125, + "best_us" : 347 }, "vec32" : { "med_us" : 347.40625, - "best_us" : 347.3125 + "best_us" : 347.375 }, "vec32_u4" : { - "med_us" : 347.5625, - "best_us" : 347.3125 + "med_us" : 347.25, + "best_us" : 347.15625 }, "vec32_u8" : { - "med_us" : 347.34375, - "best_us" : 347.28125 + "med_us" : 347.28125, + "best_us" : 347.1875 }, "vec16_u2" : { - "med_us" : 336.40625, - "best_us" : 335.53125 + "med_us" : 336.265625, + "best_us" : 335.6875 }, "vec16_u4" : { - "med_us" : 335.5625, - "best_us" : 334.90625 + "med_us" : 335.90625, + "best_us" : 330.90625 }, "vec16_u8" : { - "med_us" : 336.15625, - "best_us" : 335.96875 + "med_us" : 336.140625, + "best_us" : 335.90625 }, "vec4" : { - "med_us" : 363.59375, - "best_us" : 363.125 + "med_us" : 363.46875, + "best_us" : 363.25 }, "vec8" : { - "med_us" : 358.96875, + "med_us" : 358.90625, "best_us" : 358.71875 }, "vec4_u4" : { - "med_us" : 363.375, - "best_us" : 362.71875 + "med_us" : 362.875, + "best_us" : 362.15625 }, "vec8_u4" : { - "med_us" : 358.6875, - "best_us" : 358.625 + "med_us" : 358.8125, + "best_us" : 358.6875 }, "plain" : { - "med_us" : 358.84375, - "best_us" : 358.6875 + "med_us" : 358.96875, + "best_us" : 358.71875 }, "u2" : { - "med_us" : 358.90625, - "best_us" : 358.71875 + "med_us" : 359.0625, + "best_us" : 358.75 }, "u4" : { - "med_us" : 358.65625, - "best_us" : 358.625 + "med_us" : 358.6875, + "best_us" : 358.59375 }, "u8" : { - "med_us" : 358.6875, - "best_us" : 358.5625 + "med_us" : 358.84375, + "best_us" : 358.71875 }, "vec4_u2" : { - "med_us" : 364.53125, - "best_us" : 363.78125 + "med_us" : 364.4375, + "best_us" : 363.84375 }, "vec4_u8" : { - "med_us" : 362.5, - "best_us" : 361.0625 + "med_us" : 362.09375, + "best_us" : 361.28125 }, "vec8_u2" : { - "med_us" : 358.828125, - "best_us" : 358.375 + "med_us" : 358.734375, + "best_us" : 358.09375 }, "vec8_u8" : { - "med_us" : 358.8125, - "best_us" : 358.21875 + "med_us" : 358.71875, + "best_us" : 358.6875 }, "vec16" : { "med_us" : 335.9375, - "best_us" : 335.65625 + "best_us" : 335.5 } } }, "rope_scaled_neox_tab" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.10445413575244844, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 684.9310344827586, - "best_us" : 683.6551724137931 + "med_us" : 685.7142857142857, + "best_us" : 684.1071428571429 }, "vec32" : { - "med_us" : 639.5483870967741, - "best_us" : 638.9677419354839 + "med_us" : 639.7666666666667, + "best_us" : 638.0333333333333 }, "vec32_u4" : { - "med_us" : 640.1612903225806, - "best_us" : 638.741935483871 + "med_us" : 639.3225806451613, + "best_us" : 639.1612903225806 }, "vec32_u8" : { - "med_us" : 639.5806451612904, - "best_us" : 637.4193548387096 + "med_us" : 639.6774193548387, + "best_us" : 638.0967741935484 }, "vec16_u2" : { - "med_us" : 384.5625, - "best_us" : 380.59375 + "med_us" : 384.3125, + "best_us" : 382.8125 }, "vec16_u4" : { - "med_us" : 375.34375, - "best_us" : 374.65625 + "med_us" : 375.84375, + "best_us" : 375.40625 }, "vec16_u8" : { - "med_us" : 374.4375, - "best_us" : 373.9375 + "med_us" : 376, + "best_us" : 375.875 }, "vec4" : { - "med_us" : 396.59375, - "best_us" : 394.75 + "med_us" : 394.96875, + "best_us" : 394.5625 }, "vec8" : { - "med_us" : 370.5, - "best_us" : 368.15625 + "med_us" : 375, + "best_us" : 372.53125 }, "vec4_u4" : { - "med_us" : 370.84375, - "best_us" : 369.1875 + "med_us" : 370.03125, + "best_us" : 368.78125 }, "vec8_u4" : { "med_us" : 371.53125, - "best_us" : 369.4375 + "best_us" : 370.875 }, "plain" : { - "med_us" : 406.71875, - "best_us" : 406.125 + "med_us" : 395.46875, + "best_us" : 394.53125 }, "u2" : { - "med_us" : 383.0625, - "best_us" : 382.28125 + "med_us" : 381.46875, + "best_us" : 381.15625 }, "u4" : { - "med_us" : 372.28125, - "best_us" : 370.375 + "med_us" : 371.8125, + "best_us" : 370.15625 }, "u8" : { - "med_us" : 420.75, - "best_us" : 419.09375 + "med_us" : 419.03125, + "best_us" : 418.8125 }, "vec4_u2" : { - "med_us" : 383.625, - "best_us" : 382.59375 + "med_us" : 383.4375, + "best_us" : 380.28125 }, "vec4_u8" : { - "med_us" : 418.8125, - "best_us" : 416.8125 + "med_us" : 419.1875, + "best_us" : 419.0625 }, "vec8_u2" : { - "med_us" : 372.125, - "best_us" : 371.28125 + "med_us" : 371.15625, + "best_us" : 370.4375 }, "vec8_u8" : { - "med_us" : 403.1875, - "best_us" : 401.28125 + "med_us" : 404.125, + "best_us" : 402.96875 }, "vec16" : { - "med_us" : 368.46875, - "best_us" : 366.65625 + "med_us" : 369.5, + "best_us" : 367.03125 } } }, "q51q8_tile_gen" : { - "winner" : "mr4", + "winner" : "mr8_nrsplit2", "rows" : { "mr8" : { - "streamed_us" : 584 + "streamed_us" : 605 }, "dot_maddubs_width256_mr8" : { - "streamed_us" : 4011 + "streamed_us" : 3987 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "streamed_us" : 3963 + "streamed_us" : 3945 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "streamed_us" : 3930 + "streamed_us" : 4017 }, "mr4" : { - "streamed_us" : 588 + "streamed_us" : 597 }, "reference" : { - "streamed_us" : 3795 + "streamed_us" : 3819 }, "mr4_nrsplit2" : { "streamed_us" : 604 }, "dot_vpdpbusd_width256_mr8" : { - "streamed_us" : 3943 + "streamed_us" : 3998 }, "dot_vpdpbusd_width512_mr16" : { - "streamed_us" : 3937 + "streamed_us" : 4017 }, "mr8_nrsplit2" : { - "streamed_us" : 605 + "streamed_us" : 572 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "streamed_us" : 3959 + "streamed_us" : 4024 } } }, "softmax" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 3175, - "best_us" : 3170.5 + "med_us" : 3178.8333333333335, + "best_us" : 3176 }, "vec32" : { - "med_us" : 3169.6666666666665, - "best_us" : 3167 + "med_us" : 3174.6666666666665, + "best_us" : 3172.3333333333335 }, "vec32_u4" : { - "med_us" : 3175.6666666666665, - "best_us" : 3166.5 + "med_us" : 3171.5, + "best_us" : 3170.1666666666665 }, "vec32_u8" : { - "med_us" : 3170.3333333333335, - "best_us" : 3166.6666666666665 + "med_us" : 3170.6666666666665, + "best_us" : 3169.8333333333335 }, "vec16_u2" : { - "med_us" : 3181, - "best_us" : 3176 + "med_us" : 3185.3333333333335, + "best_us" : 3183.5 }, "vec16_u4" : { - "med_us" : 3178.6666666666665, - "best_us" : 3175.5 + "med_us" : 3187.1666666666665, + "best_us" : 3183.6666666666665 }, "vec16_u8" : { - "med_us" : 4042, - "best_us" : 4038.25 + "med_us" : 4018.5, + "best_us" : 4011.5 }, "vec4" : { - "med_us" : 3172.6666666666665, - "best_us" : 3170.6666666666665 + "med_us" : 3175.3333333333335, + "best_us" : 3173.6666666666665 }, "vec8" : { - "med_us" : 3166.1666666666665, - "best_us" : 3165.8333333333335 + "med_us" : 3174.6666666666665, + "best_us" : 3169.3333333333335 }, "vec4_u4" : { - "med_us" : 3175.5, + "med_us" : 3183.6666666666665, "best_us" : 3173.3333333333335 }, "vec8_u4" : { - "med_us" : 3167.5, - "best_us" : 3165.5 + "med_us" : 3172.5, + "best_us" : 3171 }, "plain" : { - "med_us" : 3173, - "best_us" : 3169.1666666666665 + "med_us" : 3173.6666666666665, + "best_us" : 3172.3333333333335 }, "u2" : { - "med_us" : 3164.3333333333335, - "best_us" : 3163.8333333333335 + "med_us" : 3174.6666666666665, + "best_us" : 3172.5 }, "u4" : { - "med_us" : 3173.3333333333335, - "best_us" : 3169.6666666666665 + "med_us" : 3174.5, + "best_us" : 3173 }, "u8" : { - "med_us" : 3165.5, - "best_us" : 3164.1666666666665 + "med_us" : 3169.5, + "best_us" : 3166.3333333333335 }, "vec4_u2" : { - "med_us" : 3164, - "best_us" : 3162.8333333333335 + "med_us" : 3174.8333333333335, + "best_us" : 3168.8333333333335 }, "vec4_u8" : { - "med_us" : 3165, - "best_us" : 3163.6666666666665 + "med_us" : 3171.5, + "best_us" : 3169.6666666666665 }, "vec8_u2" : { - "med_us" : 3171.1666666666665, - "best_us" : 3169.3333333333335 + "med_us" : 3173.5, + "best_us" : 3170.5 }, "vec8_u8" : { - "med_us" : 3164.6666666666665, - "best_us" : 3162.3333333333335 + "med_us" : 3170, + "best_us" : 3168.3333333333335 }, "vec16" : { - "med_us" : 3185.1666666666665, - "best_us" : 3184.5 + "med_us" : 3192.3333333333335, + "best_us" : 3185.3333333333335 } } }, @@ -628,167 +628,167 @@ "winner" : "mr8_budget", "rows" : { "kstep1" : { - "tile_us" : 22909, - "gemv_us" : 199, - "hot_us" : 10.3125 + "tile_us" : 22920, + "gemv_us" : 202, + "hot_us" : 10.5 }, "kstep2_nrsplit2" : { - "tile_us" : 24181, - "gemv_us" : 195, - "hot_us" : 9.9375 + "tile_us" : 24125, + "gemv_us" : 202, + "hot_us" : 10.4375 }, "kstep1_nrsplit2" : { - "tile_us" : 24359, - "gemv_us" : 197, - "hot_us" : 9.875 + "tile_us" : 24406, + "gemv_us" : 203, + "hot_us" : 10.1875 }, "reference" : { - "tile_us" : 33261, - "gemv_us" : 201, - "hot_us" : 10.3125 + "tile_us" : 33481, + "gemv_us" : 205, + "hot_us" : 10.625 }, "kstep4_nrsplit2" : { - "tile_us" : 24371, - "gemv_us" : 194, - "hot_us" : 10 + "tile_us" : 24383, + "gemv_us" : 203, + "hot_us" : 10.4375 }, "kstep4_nrsplit2_mr8_gkstep2" : { - "tile_us" : 24036, - "gemv_us" : 195, - "hot_us" : 9.5 + "tile_us" : 24158, + "gemv_us" : 196, + "hot_us" : 9.625 }, "kstep1_nrsplit2_mr8" : { - "tile_us" : 23184, - "gemv_us" : 195, - "hot_us" : 9.5 + "tile_us" : 23255, + "gemv_us" : 204, + "hot_us" : 9.9375 }, "kstep2_nrsplit2_mr8" : { - "tile_us" : 22835, - "gemv_us" : 193, - "hot_us" : 9.75 + "tile_us" : 22893, + "gemv_us" : 199, + "hot_us" : 9.9375 }, "kstep4_nrsplit2_mr8" : { - "tile_us" : 24088, - "gemv_us" : 189, - "hot_us" : 9.5 + "tile_us" : 24139, + "gemv_us" : 197, + "hot_us" : 9.625 }, "kstep2_gkstep2" : { - "tile_us" : 23340, - "gemv_us" : 193, - "hot_us" : 9.6875 + "tile_us" : 23337, + "gemv_us" : 195, + "hot_us" : 9.9375 }, "kstep2_gkstep4" : { - "tile_us" : 23285, - "gemv_us" : 196, - "hot_us" : 9.5625 + "tile_us" : 23358, + "gemv_us" : 197, + "hot_us" : 10.125 }, "kstep4_nrsplit2_mr8_gkstep4" : { - "tile_us" : 24041, - "gemv_us" : 196, - "hot_us" : 9.9375 + "tile_us" : 24149, + "gemv_us" : 200, + "hot_us" : 9.4375 }, "mr8_budget" : { - "tile_us" : 22148, - "gemv_us" : 190, - "hot_us" : 9.4375 + "tile_us" : 22220, + "gemv_us" : 199, + "hot_us" : 9.9375 }, "kstep2" : { - "tile_us" : 23303, - "gemv_us" : 199, - "hot_us" : 10 + "tile_us" : 23337, + "gemv_us" : 203, + "hot_us" : 10.4375 }, "kstep4" : { - "tile_us" : 24765, - "gemv_us" : 194, - "hot_us" : 9.875 + "tile_us" : 24847, + "gemv_us" : 203, + "hot_us" : 10.3125 } } }, "mul_inplace" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 336.9375, - "best_us" : 335.53125 + "med_us" : 362.84375, + "best_us" : 342.1875 }, "vec32" : { - "med_us" : 361.3125, - "best_us" : 359.78125 + "med_us" : 363.3125, + "best_us" : 360.84375 }, "vec32_u4" : { - "med_us" : 337.34375, - "best_us" : 336.1875 + "med_us" : 336.875, + "best_us" : 336.25 }, "vec32_u8" : { - "med_us" : 335.8125, - "best_us" : 334.40625 + "med_us" : 336.96875, + "best_us" : 335.46875 }, "vec16_u2" : { - "med_us" : 361.75, - "best_us" : 360.3125 + "med_us" : 362.59375, + "best_us" : 362.09375 }, "vec16_u4" : { - "med_us" : 338.34375, - "best_us" : 336.84375 + "med_us" : 337.65625, + "best_us" : 336.625 }, "vec16_u8" : { - "med_us" : 337.5, - "best_us" : 335.46875 + "med_us" : 338.53125, + "best_us" : 338 }, "vec4" : { - "med_us" : 361.3125, - "best_us" : 359.8125 + "med_us" : 362.65625, + "best_us" : 361.4375 }, "vec8" : { - "med_us" : 361.875, - "best_us" : 359.40625 + "med_us" : 363.09375, + "best_us" : 362.3125 }, "vec4_u4" : { - "med_us" : 337.46875, - "best_us" : 336.875 + "med_us" : 338.8125, + "best_us" : 338.1875 }, "vec8_u4" : { - "med_us" : 337.03125, - "best_us" : 336.625 + "med_us" : 338.53125, + "best_us" : 337.5625 }, "plain" : { - "med_us" : 361.875, - "best_us" : 361.53125 + "med_us" : 363.53125, + "best_us" : 362.46875 }, "u2" : { - "med_us" : 362.09375, - "best_us" : 361.625 + "med_us" : 363.5625, + "best_us" : 362.5625 }, "u4" : { - "med_us" : 338.84375, - "best_us" : 335.90625 + "med_us" : 338.25, + "best_us" : 337.625 }, "u8" : { - "med_us" : 337.46875, - "best_us" : 336.1875 + "med_us" : 338.875, + "best_us" : 337.4375 }, "vec4_u2" : { - "med_us" : 362, - "best_us" : 360.375 + "med_us" : 362.71875, + "best_us" : 361.71875 }, "vec4_u8" : { - "med_us" : 337.125, - "best_us" : 336.8125 + "med_us" : 338.84375, + "best_us" : 337 }, "vec8_u2" : { - "med_us" : 343.375, - "best_us" : 335.8125 + "med_us" : 347.1875, + "best_us" : 339.75 }, "vec8_u8" : { - "med_us" : 337.125, - "best_us" : 335.34375 + "med_us" : 337.3125, + "best_us" : 336.25 }, "vec16" : { - "med_us" : 361.15625, - "best_us" : 360.25 + "med_us" : 362.90625, + "best_us" : 361.875 } } }, @@ -796,119 +796,119 @@ "winner" : "mr8", "rows" : { "mr8" : { - "tile_us" : 27974, - "gemv_us" : 179, - "hot_us" : 10.5625 + "tile_us" : 28020, + "gemv_us" : 180, + "hot_us" : 11.1875 }, "dot_maddubs_width256_mr8" : { - "tile_us" : 467919, - "gemv_us" : 1785, - "hot_us" : 114.875 + "tile_us" : 469260, + "gemv_us" : 1844, + "hot_us" : 115.25 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "tile_us" : 467813, - "gemv_us" : 1842, - "hot_us" : 115.25 + "tile_us" : 469587, + "gemv_us" : 1847, + "hot_us" : 114.75 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "tile_us" : 467907, - "gemv_us" : 1851, - "hot_us" : 115.0625 + "tile_us" : 469352, + "gemv_us" : 1854, + "hot_us" : 114.125 }, "mr4" : { - "tile_us" : 30522, - "gemv_us" : 189, + "tile_us" : 30623, + "gemv_us" : 185, "hot_us" : 11.8125 }, "reference" : { - "tile_us" : 468180, - "gemv_us" : 1756, - "hot_us" : 110.6875 + "tile_us" : 469899, + "gemv_us" : 1828, + "hot_us" : 111.75 }, "mr4_nrsplit2" : { - "tile_us" : 36833, - "gemv_us" : 185, - "hot_us" : 11.5 + "tile_us" : 36943, + "gemv_us" : 190, + "hot_us" : 11.8125 }, "dot_vpdpbusd_width256_mr8" : { - "tile_us" : 467888, - "gemv_us" : 1852, - "hot_us" : 114.9375 + "tile_us" : 469184, + "gemv_us" : 1807, + "hot_us" : 113.6875 }, "dot_vpdpbusd_width512_mr16" : { - "tile_us" : 468219, - "gemv_us" : 1857, - "hot_us" : 111.1875 + "tile_us" : 469366, + "gemv_us" : 1848, + "hot_us" : 114.9375 }, "mr8_nrsplit2" : { - "tile_us" : 33355, - "gemv_us" : 168, - "hot_us" : 10.5 + "tile_us" : 33535, + "gemv_us" : 175, + "hot_us" : 11.125 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "tile_us" : 468332, - "gemv_us" : 1777, - "hot_us" : 109.6875 + "tile_us" : 469387, + "gemv_us" : 1846, + "hot_us" : 112.875 } } }, "k5q8_tile_gen" : { - "winner" : "mr4", + "winner" : "mr8", "rows" : { "mr8" : { - "tile_us" : 57152, - "gemv_us" : 414, - "hot_us" : 26.9375 + "tile_us" : 27437, + "gemv_us" : 429, + "hot_us" : 26.375 }, "dot_maddubs_width256_mr8" : { - "tile_us" : 223258, - "gemv_us" : 2134, - "hot_us" : 132.625 + "tile_us" : 224665, + "gemv_us" : 2184, + "hot_us" : 135.8125 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "tile_us" : 223911, - "gemv_us" : 2211, - "hot_us" : 138.4375 + "tile_us" : 225355, + "gemv_us" : 2226, + "hot_us" : 134.1875 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "tile_us" : 223523, - "gemv_us" : 2154, - "hot_us" : 133.0625 + "tile_us" : 225169, + "gemv_us" : 2222, + "hot_us" : 133 }, "mr4" : { - "tile_us" : 28082, - "gemv_us" : 428, - "hot_us" : 26.5 + "tile_us" : 28262, + "gemv_us" : 420, + "hot_us" : 27.0625 }, "reference" : { - "tile_us" : 223588, - "gemv_us" : 2165, - "hot_us" : 130.75 + "tile_us" : 224541, + "gemv_us" : 2219, + "hot_us" : 136.1875 }, "mr4_nrsplit2" : { - "tile_us" : 32572, - "gemv_us" : 411, - "hot_us" : 26 + "tile_us" : 32662, + "gemv_us" : 433, + "hot_us" : 26.8125 }, "dot_vpdpbusd_width256_mr8" : { - "tile_us" : 223916, - "gemv_us" : 2221, - "hot_us" : 133.1875 + "tile_us" : 225099, + "gemv_us" : 2226, + "hot_us" : 132.9375 }, "dot_vpdpbusd_width512_mr16" : { - "tile_us" : 223720, - "gemv_us" : 2138, - "hot_us" : 137.5625 + "tile_us" : 225007, + "gemv_us" : 2221, + "hot_us" : 137.5 }, "mr8_nrsplit2" : { - "tile_us" : 82544, - "gemv_us" : 415, - "hot_us" : 27 + "tile_us" : 29763, + "gemv_us" : 422, + "hot_us" : 27.375 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "tile_us" : 223996, - "gemv_us" : 2211, - "hot_us" : 138.375 + "tile_us" : 224864, + "gemv_us" : 2216, + "hot_us" : 138.3125 } } }, @@ -916,939 +916,939 @@ "winner" : "mr4", "rows" : { "mr8" : { - "tile_us" : 72017, - "gemv_us" : 429, - "hot_us" : 21.6875 + "tile_us" : 43133, + "gemv_us" : 358, + "hot_us" : 22.1875 }, "dot_maddubs_width256_mr8" : { - "tile_us" : 199190, - "gemv_us" : 5518, - "hot_us" : 338.5 + "tile_us" : 199965, + "gemv_us" : 5547, + "hot_us" : 342.6875 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "tile_us" : 199398, - "gemv_us" : 5584, - "hot_us" : 341.125 + "tile_us" : 199820, + "gemv_us" : 5768, + "hot_us" : 359.6875 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "tile_us" : 199253, - "gemv_us" : 5568, - "hot_us" : 340.625 + "tile_us" : 200052, + "gemv_us" : 5577, + "hot_us" : 352.0625 }, "mr4" : { - "tile_us" : 37209, - "gemv_us" : 333, - "hot_us" : 20.4375 + "tile_us" : 37241, + "gemv_us" : 337, + "hot_us" : 20.625 }, "reference" : { - "tile_us" : 199555, - "gemv_us" : 5643, - "hot_us" : 336.125 + "tile_us" : 200477, + "gemv_us" : 5601, + "hot_us" : 343.25 }, "mr4_nrsplit2" : { - "tile_us" : 38642, - "gemv_us" : 338, - "hot_us" : 21.0625 + "tile_us" : 38548, + "gemv_us" : 329, + "hot_us" : 21.125 }, "dot_vpdpbusd_width256_mr8" : { - "tile_us" : 199297, - "gemv_us" : 5594, - "hot_us" : 340 + "tile_us" : 199808, + "gemv_us" : 5534, + "hot_us" : 349.25 }, "dot_vpdpbusd_width512_mr16" : { - "tile_us" : 199584, - "gemv_us" : 5628, - "hot_us" : 340.125 + "tile_us" : 200090, + "gemv_us" : 5534, + "hot_us" : 344.6875 }, "mr8_nrsplit2" : { - "tile_us" : 97667, - "gemv_us" : 337, - "hot_us" : 21.4375 + "tile_us" : 42855, + "gemv_us" : 351, + "hot_us" : 22.125 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "tile_us" : 199523, - "gemv_us" : 5627, - "hot_us" : 339.25 + "tile_us" : 199904, + "gemv_us" : 5555, + "hot_us" : 343.5 } } }, "quantize_q8_0_into_ptr" : { "winner" : "plain", "fallback" : "plain", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.10445413575244844, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 2445.875, - "best_us" : 2442.5 + "med_us" : 2447.875, + "best_us" : 2445.25 }, "vec32" : { - "med_us" : 2405.5, - "best_us" : 2405 + "med_us" : 2411.25, + "best_us" : 2409 }, "vec32_u4" : { - "med_us" : 2445.75, - "best_us" : 2443.75 + "med_us" : 2450.625, + "best_us" : 2445.75 }, "vec32_u8" : { - "med_us" : 2445, - "best_us" : 2442.5 + "med_us" : 2447.625, + "best_us" : 2445.125 }, "vec16_u2" : { - "med_us" : 2409.5, - "best_us" : 2409 + "med_us" : 2414, + "best_us" : 2412.875 }, "vec16_u4" : { - "med_us" : 2411.875, - "best_us" : 2408.5 + "med_us" : 2414, + "best_us" : 2413.125 }, "vec16_u8" : { - "med_us" : 2415.625, - "best_us" : 2413.75 + "med_us" : 2466.375, + "best_us" : 2465.375 }, "vec4" : { - "med_us" : 2408, - "best_us" : 2406.125 + "med_us" : 2412, + "best_us" : 2410.875 }, "vec8" : { - "med_us" : 2409.25, - "best_us" : 2407.125 + "med_us" : 2411.375, + "best_us" : 2410.25 }, "vec4_u4" : { - "med_us" : 3073.8333333333335, - "best_us" : 3073 + "med_us" : 3061.8333333333335, + "best_us" : 3058.1666666666665 }, "vec8_u4" : { - "med_us" : 2538.5714285714284, - "best_us" : 2537.5714285714284 + "med_us" : 2542.1428571428573, + "best_us" : 2539.4285714285716 }, "plain" : { - "med_us" : 2406.25, - "best_us" : 2404.5 + "med_us" : 2412.125, + "best_us" : 2410.375 }, "u2" : { - "med_us" : 2462.875, - "best_us" : 2462.5 + "med_us" : 2414.875, + "best_us" : 2412.5 }, "u4" : { - "med_us" : 2414.5, - "best_us" : 2412.875 + "med_us" : 2417.25, + "best_us" : 2415.375 }, "u8" : { - "med_us" : 2414.125, - "best_us" : 2411 + "med_us" : 2415.875, + "best_us" : 2412.875 }, "vec4_u2" : { - "med_us" : 3070.1666666666665, - "best_us" : 3068.3333333333335 + "med_us" : 3073.5, + "best_us" : 3071 }, "vec4_u8" : { - "med_us" : 3066.5, - "best_us" : 3064.5 + "med_us" : 3073.3333333333335, + "best_us" : 3070.6666666666665 }, "vec8_u2" : { - "med_us" : 2539.1428571428573, - "best_us" : 2536.1428571428573 + "med_us" : 2593, + "best_us" : 2591.714285714286 }, "vec8_u8" : { - "med_us" : 2536.285714285714, - "best_us" : 2533.5714285714284 + "med_us" : 2541.714285714286, + "best_us" : 2540.8571428571427 }, "vec16" : { - "med_us" : 2409.125, - "best_us" : 2408.5 + "med_us" : 2411.125, + "best_us" : 2410.25 } } }, "dot_q8kv" : { "winner" : "vec4_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, - "margin_pct" : 24.379824627145315, + "floor_pct" : 0.07927948634535505, + "margin_pct" : 24.373033413245427, "rows" : { "vec32_u2" : { - "med_us" : 1289.6, - "best_us" : 1289 + "med_us" : 1292.2666666666667, + "best_us" : 1291.7333333333333 }, "vec32" : { "med_us" : 1926.2, - "best_us" : 1925.1 + "best_us" : 1924.7 }, "vec32_u4" : { - "med_us" : 1291.6666666666667, - "best_us" : 1290.6 + "med_us" : 1291.2, + "best_us" : 1290.6666666666667 }, "vec32_u8" : { - "med_us" : 1292.1333333333334, - "best_us" : 1291.3333333333333 + "med_us" : 1291.8, + "best_us" : 1291.2666666666667 }, "vec16_u2" : { - "med_us" : 875.7727272727273, - "best_us" : 875.2727272727273 + "med_us" : 875.2272727272727, + "best_us" : 874.9545454545455 }, "vec16_u4" : { - "med_us" : 875, - "best_us" : 874.7727272727273 + "med_us" : 875.8181818181819, + "best_us" : 875.3181818181819 }, "vec16_u8" : { - "med_us" : 875, - "best_us" : 874.2727272727273 + "med_us" : 875.5454545454545, + "best_us" : 874.8181818181819 }, "vec4" : { - "med_us" : 1923.2, - "best_us" : 1922.5 + "med_us" : 1925.4, + "best_us" : 1923.9 }, "vec8" : { - "med_us" : 1924.8, - "best_us" : 1921.8 + "med_us" : 1924.7, + "best_us" : 1923.7 }, "vec4_u4" : { - "med_us" : 504.796875, - "best_us" : 503.96875 + "med_us" : 504.75, + "best_us" : 504.15625 }, "vec8_u4" : { - "med_us" : 667.3793103448276, - "best_us" : 666.8965517241379 + "med_us" : 667.7, + "best_us" : 667.1333333333333 }, "plain" : { - "med_us" : 1923.7, - "best_us" : 1922.5 + "med_us" : 1925.4, + "best_us" : 1924.2 }, "u2" : { - "med_us" : 1227.6875, - "best_us" : 1227 + "med_us" : 1228, + "best_us" : 1227.0625 }, "u4" : { - "med_us" : 1228.0625, - "best_us" : 1226.3125 + "med_us" : 1228.8125, + "best_us" : 1227.4375 }, "u8" : { - "med_us" : 1227.875, - "best_us" : 1226.5625 + "med_us" : 1228.5, + "best_us" : 1227.1875 }, "vec4_u2" : { - "med_us" : 504.625, - "best_us" : 503.75 + "med_us" : 504.734375, + "best_us" : 504.28125 }, "vec4_u8" : { - "med_us" : 504.71875, - "best_us" : 503.8125 + "med_us" : 504.78125, + "best_us" : 504.28125 }, "vec8_u2" : { - "med_us" : 667.3666666666667, - "best_us" : 666.7666666666667 + "med_us" : 667.4, + "best_us" : 666.9333333333333 }, "vec8_u8" : { - "med_us" : 667.5666666666667, - "best_us" : 667.3 + "med_us" : 667.4666666666667, + "best_us" : 667.0333333333333 }, "vec16" : { - "med_us" : 1925, - "best_us" : 1923.2 + "med_us" : 1924.9, + "best_us" : 1923.8 } } }, "quantize_q8_0_bs_into_ptr" : { "winner" : "plain", "fallback" : "plain", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.10445413575244844, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 2378.25, - "best_us" : 2375.875 + "med_us" : 2389.125, + "best_us" : 2384.375 }, "vec32" : { - "med_us" : 2052.3333333333335, - "best_us" : 2048.3333333333335 + "med_us" : 2053.777777777778, + "best_us" : 2049.3333333333335 }, "vec32_u4" : { - "med_us" : 2386.875, - "best_us" : 2381.5 + "med_us" : 2395.75, + "best_us" : 2390.375 }, "vec32_u8" : { - "med_us" : 2379.5, - "best_us" : 2378.625 + "med_us" : 2399.375, + "best_us" : 2381 }, "vec16_u2" : { - "med_us" : 2370.125, - "best_us" : 2368 + "med_us" : 2371.25, + "best_us" : 2353.5 }, "vec16_u4" : { - "med_us" : 2356.625, - "best_us" : 2346 + "med_us" : 2366.5, + "best_us" : 2360.375 }, "vec16_u8" : { - "med_us" : 2354.375, - "best_us" : 2339.875 + "med_us" : 2365.875, + "best_us" : 2357 }, "vec4" : { - "med_us" : 2098.222222222222, - "best_us" : 2097.8888888888887 + "med_us" : 2055.5555555555557, + "best_us" : 2051.6666666666665 }, "vec8" : { - "med_us" : 2053.1111111111113, - "best_us" : 2043.6666666666667 + "med_us" : 2056.777777777778, + "best_us" : 2055 }, "vec4_u4" : { - "med_us" : 2521, - "best_us" : 2508.125 + "med_us" : 2536, + "best_us" : 2529.714285714286 }, "vec8_u4" : { - "med_us" : 2177, - "best_us" : 2171.4444444444443 + "med_us" : 2183.5, + "best_us" : 2172.875 }, "plain" : { - "med_us" : 2044.3333333333333, - "best_us" : 2042 + "med_us" : 2055.222222222222, + "best_us" : 2050.777777777778 }, "u2" : { - "med_us" : 2355.625, - "best_us" : 2353.375 + "med_us" : 2362.125, + "best_us" : 2359.875 }, "u4" : { - "med_us" : 2356, - "best_us" : 2340.75 + "med_us" : 2365.625, + "best_us" : 2350.125 }, "u8" : { - "med_us" : 2354.125, - "best_us" : 2348.875 + "med_us" : 2369.375, + "best_us" : 2354.375 }, "vec4_u2" : { - "med_us" : 2534.1428571428573, - "best_us" : 2526 + "med_us" : 2565.714285714286, + "best_us" : 2552.8571428571427 }, "vec4_u8" : { - "med_us" : 2528.4285714285716, - "best_us" : 2516.4285714285716 + "med_us" : 2529.8571428571427, + "best_us" : 2518 }, "vec8_u2" : { - "med_us" : 2151.1111111111113, - "best_us" : 2146.1111111111113 + "med_us" : 2177.777777777778, + "best_us" : 2171.6666666666665 }, "vec8_u8" : { - "med_us" : 2168.8888888888887, - "best_us" : 2165.1111111111113 + "med_us" : 2182.777777777778, + "best_us" : 2177.1111111111113 }, "vec16" : { - "med_us" : 2040.3333333333333, - "best_us" : 2038 + "med_us" : 2057.4444444444443, + "best_us" : 2050.3333333333335 } } }, "dot_q8q8" : { "winner" : "vec16", "fallback" : "vec16", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 586.625, - "best_us" : 586.125 + "med_us" : 585.875, + "best_us" : 584.125 }, "vec32" : { - "med_us" : 579.5625, - "best_us" : 579.4375 + "med_us" : 576.0625, + "best_us" : 575.34375 }, "vec32_u4" : { - "med_us" : 588.6875, - "best_us" : 587.125 + "med_us" : 585.25, + "best_us" : 584.09375 }, "vec32_u8" : { - "med_us" : 587.0625, - "best_us" : 585.1875 + "med_us" : 583.65625, + "best_us" : 582.96875 }, "vec16_u2" : { - "med_us" : 583.625, - "best_us" : 581.90625 + "med_us" : 580.46875, + "best_us" : 578.46875 }, "vec16_u4" : { - "med_us" : 583.78125, - "best_us" : 582.96875 + "med_us" : 582, + "best_us" : 580.59375 }, "vec16_u8" : { - "med_us" : 585.84375, - "best_us" : 584.5625 + "med_us" : 589.75, + "best_us" : 588.5 }, "vec4" : { - "med_us" : 579.28125, - "best_us" : 578.84375 + "med_us" : 575.3125, + "best_us" : 574.78125 }, "vec8" : { - "med_us" : 579.75, - "best_us" : 579.09375 + "med_us" : 575.65625, + "best_us" : 575.3125 }, "vec4_u4" : { - "med_us" : 1942.8, - "best_us" : 1942.5 + "med_us" : 1945.8, + "best_us" : 1944.2 }, "vec8_u4" : { - "med_us" : 748.5384615384615, - "best_us" : 748.3461538461538 + "med_us" : 770.76, + "best_us" : 770.16 }, "plain" : { - "med_us" : 579.84375, - "best_us" : 578.1875 + "med_us" : 576.03125, + "best_us" : 575.4375 }, "u2" : { - "med_us" : 584.8125, - "best_us" : 583.4375 + "med_us" : 582.3125, + "best_us" : 580.96875 }, "u4" : { - "med_us" : 590.375, - "best_us" : 587.03125 + "med_us" : 579.5, + "best_us" : 578.875 }, "u8" : { - "med_us" : 584.96875, - "best_us" : 583.53125 + "med_us" : 578.40625, + "best_us" : 578.09375 }, "vec4_u2" : { - "med_us" : 1944.2, - "best_us" : 1943.7 + "med_us" : 1945.5, + "best_us" : 1944.7 }, "vec4_u8" : { - "med_us" : 1944.4, - "best_us" : 1942.8 + "med_us" : 1945.1, + "best_us" : 1944.3 }, "vec8_u2" : { - "med_us" : 748.8461538461538, - "best_us" : 747.9230769230769 + "med_us" : 748.8076923076923, + "best_us" : 747.0384615384615 }, "vec8_u8" : { - "med_us" : 750.4615384615385, - "best_us" : 750.2692307692307 + "med_us" : 748.1153846153846, + "best_us" : 747.7307692307693 }, "vec16" : { - "med_us" : 579.65625, - "best_us" : 579.09375 + "med_us" : 576.03125, + "best_us" : 575.5 } } }, "gemm_f32_uk_4x16" : { "winner" : "u2", "fallback" : "u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.10445413575244844, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 539.53125, - "best_us" : 539 + "med_us" : 540.34375, + "best_us" : 539.625 }, "vec32" : { "med_us" : 595.5, - "best_us" : 594.8125 + "best_us" : 595.21875 }, "vec32_u4" : { - "med_us" : 550.9375, - "best_us" : 550.34375 + "med_us" : 550.78125, + "best_us" : 549.96875 }, "vec32_u8" : { - "med_us" : 546.71875, - "best_us" : 546.09375 + "med_us" : 546.875, + "best_us" : 546.25 }, "vec16_u2" : { - "med_us" : 540.09375, - "best_us" : 539.65625 + "med_us" : 539.8125, + "best_us" : 539.4375 }, "vec16_u4" : { - "med_us" : 549.34375, - "best_us" : 547.4375 + "med_us" : 551.15625, + "best_us" : 550.8125 }, "vec16_u8" : { - "med_us" : 547.46875, - "best_us" : 545.84375 + "med_us" : 547.3125, + "best_us" : 546.65625 }, "vec4" : { - "med_us" : 595.875, - "best_us" : 595.34375 + "med_us" : 595.46875, + "best_us" : 595 }, "vec8" : { - "med_us" : 595.75, - "best_us" : 595.25 + "med_us" : 595.53125, + "best_us" : 595.40625 }, "vec4_u4" : { - "med_us" : 551.75, - "best_us" : 551.375 + "med_us" : 551.5625, + "best_us" : 550.96875 }, "vec8_u4" : { - "med_us" : 551.15625, - "best_us" : 550.34375 + "med_us" : 551.125, + "best_us" : 550.90625 }, "plain" : { - "med_us" : 595.78125, - "best_us" : 594.84375 + "med_us" : 595.5, + "best_us" : 595.3125 }, "u2" : { - "med_us" : 540.3125, - "best_us" : 539.1875 + "med_us" : 540.625, + "best_us" : 539.65625 }, "u4" : { - "med_us" : 553, - "best_us" : 551 + "med_us" : 550.65625, + "best_us" : 549.90625 }, "u8" : { - "med_us" : 549.4375, - "best_us" : 547.15625 + "med_us" : 547.3125, + "best_us" : 546.6875 }, "vec4_u2" : { - "med_us" : 540.84375, - "best_us" : 540.0625 + "med_us" : 539.9375, + "best_us" : 539.625 }, "vec4_u8" : { - "med_us" : 546.53125, - "best_us" : 546.46875 + "med_us" : 547.40625, + "best_us" : 546.625 }, "vec8_u2" : { - "med_us" : 540.40625, - "best_us" : 539.875 + "med_us" : 539.1875, + "best_us" : 538.59375 }, "vec8_u8" : { - "med_us" : 547.15625, - "best_us" : 546.40625 + "med_us" : 547.5625, + "best_us" : 547.25 }, "vec16" : { - "med_us" : 595.90625, - "best_us" : 595.1875 + "med_us" : 595.65625, + "best_us" : 595.40625 } } }, "quantize_q8kv_row" : { "winner" : "plain", "fallback" : "plain", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 1203.6875, - "best_us" : 1202.125 + "med_us" : 1206.1875, + "best_us" : 1205.5625 }, "vec32" : { - "med_us" : 1176.8125, - "best_us" : 1174.625 + "med_us" : 1176.7058823529412, + "best_us" : 1175.4705882352941 }, "vec32_u4" : { - "med_us" : 1203.375, - "best_us" : 1201.0625 + "med_us" : 1204.0625, + "best_us" : 1200.25 }, "vec32_u8" : { - "med_us" : 1196.4705882352941, - "best_us" : 1194 + "med_us" : 1203.5625, + "best_us" : 1203.25 }, "vec16_u2" : { - "med_us" : 1176.4117647058824, - "best_us" : 1174.8235294117646 + "med_us" : 1173.4117647058824, + "best_us" : 1171.6470588235295 }, "vec16_u4" : { - "med_us" : 1176.3529411764705, - "best_us" : 1174.8235294117646 + "med_us" : 1177.0588235294117, + "best_us" : 1176.8823529411766 }, "vec16_u8" : { - "med_us" : 1171.6470588235295, - "best_us" : 1169.9411764705883 + "med_us" : 1177.5625, + "best_us" : 1176.8125 }, "vec4" : { - "med_us" : 1176.6470588235295, - "best_us" : 1173.4705882352941 + "med_us" : 1171.25, + "best_us" : 1168.75 }, "vec8" : { - "med_us" : 1176.125, - "best_us" : 1173.5 + "med_us" : 1170.1176470588234, + "best_us" : 1169.5294117647059 }, "vec4_u4" : { - "med_us" : 1501.8461538461538, - "best_us" : 1501 + "med_us" : 1501.7692307692307, + "best_us" : 1500.2307692307693 }, "vec8_u4" : { - "med_us" : 1232.1875, - "best_us" : 1230.6875 + "med_us" : 1235.125, + "best_us" : 1235 }, "plain" : { - "med_us" : 1175.1176470588234, - "best_us" : 1174.235294117647 + "med_us" : 1181.3125, + "best_us" : 1180.25 }, "u2" : { - "med_us" : 1176.0625, - "best_us" : 1174.125 + "med_us" : 1177.5, + "best_us" : 1177.25 }, "u4" : { - "med_us" : 1171.625, - "best_us" : 1169.875 + "med_us" : 1177.0588235294117, + "best_us" : 1176.235294117647 }, "u8" : { - "med_us" : 1176.2941176470588, - "best_us" : 1174.8823529411766 + "med_us" : 1177.235294117647, + "best_us" : 1176.8235294117646 }, "vec4_u2" : { - "med_us" : 1498.5384615384614, - "best_us" : 1497.8461538461538 + "med_us" : 1500.076923076923, + "best_us" : 1497.076923076923 }, "vec4_u8" : { - "med_us" : 1500.3846153846155, - "best_us" : 1498.3846153846155 + "med_us" : 1500.076923076923, + "best_us" : 1499.1538461538462 }, "vec8_u2" : { - "med_us" : 1235.375, - "best_us" : 1234.875 + "med_us" : 1232.75, + "best_us" : 1231.0625 }, "vec8_u8" : { - "med_us" : 1234, - "best_us" : 1233.6875 + "med_us" : 1232.875, + "best_us" : 1232.625 }, "vec16" : { - "med_us" : 1175.5, - "best_us" : 1174.625 + "med_us" : 1176.3529411764705, + "best_us" : 1175.1176470588234 } } }, "dot_f16" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 283.90625, - "best_us" : 283.75 + "med_us" : 283.59375, + "best_us" : 283.34375 }, "vec32" : { "med_us" : 284.5625, - "best_us" : 284.3125 + "best_us" : 284.5 }, "vec32_u4" : { - "med_us" : 284.125, - "best_us" : 283.96875 + "med_us" : 284.03125, + "best_us" : 283.75 }, "vec32_u8" : { "med_us" : 285.5625, - "best_us" : 285.375 + "best_us" : 285.21875 }, "vec16_u2" : { - "med_us" : 269.21875, - "best_us" : 269.1875 + "med_us" : 269.125, + "best_us" : 268.9375 }, "vec16_u4" : { - "med_us" : 269.125, - "best_us" : 268.6875 + "med_us" : 269, + "best_us" : 268.40625 }, "vec16_u8" : { - "med_us" : 270.3125, - "best_us" : 270.1875 + "med_us" : 270.21875, + "best_us" : 269.46875 }, "vec4" : { - "med_us" : 421.5, - "best_us" : 419.8125 + "med_us" : 421.875, + "best_us" : 421.3125 }, "vec8" : { - "med_us" : 257.03125, - "best_us" : 256.4375 + "med_us" : 257.84375, + "best_us" : 256.6875 }, "vec4_u4" : { - "med_us" : 417.5625, - "best_us" : 416.9375 + "med_us" : 417.34375, + "best_us" : 416.34375 }, "vec8_u4" : { - "med_us" : 260.4375, - "best_us" : 260.375 + "med_us" : 260.6875, + "best_us" : 259.40625 }, "plain" : { - "med_us" : 3920, - "best_us" : 3891.4 + "med_us" : 3977.4, + "best_us" : 3968.2 }, "u2" : { - "med_us" : 3940.5, - "best_us" : 3914.75 + "med_us" : 3969.75, + "best_us" : 3962.75 }, "u4" : { - "med_us" : 3944.5, - "best_us" : 3918.75 + "med_us" : 4030.75, + "best_us" : 3997.5 }, "u8" : { - "med_us" : 4000.75, - "best_us" : 3948.25 + "med_us" : 4013.8, + "best_us" : 3995.4 }, "vec4_u2" : { - "med_us" : 418.3125, - "best_us" : 417.8125 + "med_us" : 421.09375, + "best_us" : 420.46875 }, "vec4_u8" : { - "med_us" : 418.75, - "best_us" : 417.9375 + "med_us" : 418.03125, + "best_us" : 417.65625 }, "vec8_u2" : { - "med_us" : 260.15625, - "best_us" : 259.625 + "med_us" : 260.25, + "best_us" : 260.09375 }, "vec8_u8" : { - "med_us" : 261.21875, - "best_us" : 261.03125 + "med_us" : 261.03125, + "best_us" : 260.625 }, "vec16" : { - "med_us" : 269.5, - "best_us" : 268.03125 + "med_us" : 269.25, + "best_us" : 268.96875 } } }, "axpy_f16" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 285.875, - "best_us" : 285.5 + "med_us" : 286.25, + "best_us" : 285.1875 }, "vec32" : { - "med_us" : 296.5, - "best_us" : 296.3125 + "med_us" : 301.0625, + "best_us" : 298.625 }, "vec32_u4" : { - "med_us" : 285.125, - "best_us" : 284.9375 + "med_us" : 285.5625, + "best_us" : 284.84375 }, "vec32_u8" : { - "med_us" : 285.28125, - "best_us" : 285.0625 + "med_us" : 286.125, + "best_us" : 285.75 }, "vec16_u2" : { - "med_us" : 301.96875, - "best_us" : 300.28125 + "med_us" : 301.8125, + "best_us" : 300.84375 }, "vec16_u4" : { - "med_us" : 288.28125, - "best_us" : 287.90625 + "med_us" : 288.1875, + "best_us" : 287.5625 }, "vec16_u8" : { - "med_us" : 288.34375, - "best_us" : 286.90625 + "med_us" : 288.03125, + "best_us" : 287.78125 }, "vec4" : { - "med_us" : 301.34375, - "best_us" : 301.125 + "med_us" : 301.6875, + "best_us" : 300.71875 }, "vec8" : { - "med_us" : 301.5, - "best_us" : 301.21875 + "med_us" : 301.75, + "best_us" : 300.75 }, "vec4_u4" : { - "med_us" : 287.9375, + "med_us" : 288.0625, "best_us" : 287.125 }, "vec8_u4" : { - "med_us" : 284.65625, - "best_us" : 283.96875 + "med_us" : 284.75, + "best_us" : 284.28125 }, "plain" : { - "med_us" : 302.84375, - "best_us" : 302.375 + "med_us" : 302.1875, + "best_us" : 301.9375 }, "u2" : { - "med_us" : 284.4375, - "best_us" : 283.9375 + "med_us" : 285.1875, + "best_us" : 284.5625 }, "u4" : { - "med_us" : 284.84375, - "best_us" : 284.28125 + "med_us" : 285.03125, + "best_us" : 284.8125 }, "u8" : { - "med_us" : 283.625, - "best_us" : 283.28125 + "med_us" : 284.65625, + "best_us" : 283.90625 }, "vec4_u2" : { - "med_us" : 300.21875, - "best_us" : 298.1875 + "med_us" : 303.15625, + "best_us" : 302.15625 }, "vec4_u8" : { - "med_us" : 288.9375, - "best_us" : 287.40625 + "med_us" : 288.1875, + "best_us" : 287.53125 }, "vec8_u2" : { - "med_us" : 284.90625, - "best_us" : 284.53125 + "med_us" : 285.25, + "best_us" : 285.21875 }, "vec8_u8" : { - "med_us" : 284.65625, - "best_us" : 284.46875 + "med_us" : 284.6875, + "best_us" : 284.34375 }, "vec16" : { - "med_us" : 298.21875, - "best_us" : 296.9375 + "med_us" : 300.6875, + "best_us" : 298.21875 } } }, "cvt_f16_to_f32" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 252.71875, - "best_us" : 249.8125 + "med_us" : 252.59375, + "best_us" : 251.9375 }, "vec32" : { - "med_us" : 249.90625, - "best_us" : 248.53125 + "med_us" : 252.21875, + "best_us" : 251.5625 }, "vec32_u4" : { - "med_us" : 251.28125, - "best_us" : 248.875 + "med_us" : 254.5625, + "best_us" : 250.3125 }, "vec32_u8" : { - "med_us" : 250.40625, - "best_us" : 249.46875 + "med_us" : 252.78125, + "best_us" : 251.9375 }, "vec16_u2" : { - "med_us" : 250.28125, - "best_us" : 247.09375 + "med_us" : 252.15625, + "best_us" : 252.0625 }, "vec16_u4" : { - "med_us" : 253.03125, - "best_us" : 249 + "med_us" : 251.53125, + "best_us" : 249.4375 }, "vec16_u8" : { - "med_us" : 253.1875, - "best_us" : 248 + "med_us" : 255.21875, + "best_us" : 251.78125 }, "vec4" : { - "med_us" : 253.125, - "best_us" : 245.1875 + "med_us" : 254.875, + "best_us" : 248.0625 }, "vec8" : { - "med_us" : 248.65625, - "best_us" : 241.75 + "med_us" : 250.4375, + "best_us" : 244.75 }, "vec4_u4" : { - "med_us" : 252.34375, - "best_us" : 251.65625 + "med_us" : 252.625, + "best_us" : 251.4375 }, "vec8_u4" : { - "med_us" : 250.0625, - "best_us" : 249.78125 + "med_us" : 251.3125, + "best_us" : 250.34375 }, "plain" : { - "med_us" : 250.96875, - "best_us" : 247.28125 + "med_us" : 252.15625, + "best_us" : 243.0625 }, "u2" : { - "med_us" : 251.40625, - "best_us" : 248.4375 + "med_us" : 251.59375, + "best_us" : 249.75 }, "u4" : { - "med_us" : 249.53125, - "best_us" : 245.71875 + "med_us" : 251.5625, + "best_us" : 248.71875 }, "u8" : { - "med_us" : 250.4375, - "best_us" : 246.65625 + "med_us" : 253.4375, + "best_us" : 249.21875 }, "vec4_u2" : { - "med_us" : 257.40625, - "best_us" : 246.75 + "med_us" : 246.9375, + "best_us" : 244.96875 }, "vec4_u8" : { - "med_us" : 251.84375, - "best_us" : 251.25 + "med_us" : 253.1875, + "best_us" : 251.4375 }, "vec8_u2" : { - "med_us" : 250.125, - "best_us" : 249.28125 + "med_us" : 252.3125, + "best_us" : 250.3125 }, "vec8_u8" : { - "med_us" : 250.6875, - "best_us" : 247.28125 + "med_us" : 250.5625, + "best_us" : 248.0625 }, "vec16" : { - "med_us" : 251.34375, - "best_us" : 247.84375 + "med_us" : 252.65625, + "best_us" : 249.84375 } } }, "dot" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 1632.090909090909, - "best_us" : 1626.2727272727273 + "med_us" : 1641.909090909091, + "best_us" : 1639.4545454545455 }, "vec32" : { - "med_us" : 1640, - "best_us" : 1634.5454545454545 + "med_us" : 1638.8181818181818, + "best_us" : 1631.5454545454545 }, "vec32_u4" : { - "med_us" : 1633.2727272727273, - "best_us" : 1631.5454545454545 + "med_us" : 1630.8181818181818, + "best_us" : 1629.090909090909 }, "vec32_u8" : { - "med_us" : 1643.9166666666667, - "best_us" : 1640 + "med_us" : 1648.090909090909, + "best_us" : 1646.7272727272727 }, "vec16_u2" : { - "med_us" : 1633.1666666666667, - "best_us" : 1631.25 + "med_us" : 1632.3333333333333, + "best_us" : 1626.9166666666667 }, "vec16_u4" : { - "med_us" : 1626.6666666666667, - "best_us" : 1624.9166666666667 + "med_us" : 1631.5, + "best_us" : 1626.75 }, "vec16_u8" : { - "med_us" : 1628.9166666666667, - "best_us" : 1626.0833333333333 + "med_us" : 1630.909090909091, + "best_us" : 1626.2727272727273 }, "vec4" : { - "med_us" : 1790.090909090909, - "best_us" : 1786.8181818181818 + "med_us" : 1796.090909090909, + "best_us" : 1794.6363636363637 }, "vec8" : { - "med_us" : 1646.25, - "best_us" : 1635.5 + "med_us" : 1654.3333333333333, + "best_us" : 1649.5833333333333 }, "vec4_u4" : { - "med_us" : 1784.2727272727273, - "best_us" : 1772.5454545454545 + "med_us" : 1792.2727272727273, + "best_us" : 1790 }, "vec8_u4" : { "med_us" : 1627.1666666666667, - "best_us" : 1625.9166666666667 + "best_us" : 1621.5833333333333 }, "plain" : { - "med_us" : 15937, - "best_us" : 15883 + "med_us" : 16049, + "best_us" : 16026 }, "u2" : { - "med_us" : 15919, - "best_us" : 15776 + "med_us" : 15981, + "best_us" : 15951 }, "u4" : { - "med_us" : 15781, - "best_us" : 15751 + "med_us" : 15963, + "best_us" : 15786 }, "u8" : { - "med_us" : 16019, - "best_us" : 15736 + "med_us" : 16046, + "best_us" : 15992 }, "vec4_u2" : { - "med_us" : 1786, - "best_us" : 1777.090909090909 + "med_us" : 1798.7272727272727, + "best_us" : 1795.2727272727273 }, "vec4_u8" : { - "med_us" : 1786.6363636363637, - "best_us" : 1774.6363636363637 + "med_us" : 1794.5454545454545, + "best_us" : 1792.1818181818182 }, "vec8_u2" : { - "med_us" : 1635.6666666666667, - "best_us" : 1626.75 + "med_us" : 1625.8333333333333, + "best_us" : 1624.5 }, "vec8_u8" : { - "med_us" : 1627.9166666666667, - "best_us" : 1625.6666666666667 + "med_us" : 1637.25, + "best_us" : 1629.75 }, "vec16" : { - "med_us" : 1641.909090909091, - "best_us" : 1636.7272727272727 + "med_us" : 1633.8181818181818, + "best_us" : 1631 } } }, @@ -1856,763 +1856,763 @@ "winner" : "mr8", "rows" : { "mr8" : { - "tile_us" : 29255, - "gemv_us" : 163, - "hot_us" : 10.0625 + "tile_us" : 29269, + "gemv_us" : 162, + "hot_us" : 9.6875 }, "dot_maddubs_width256_mr8" : { - "tile_us" : 307455, - "gemv_us" : 1225, - "hot_us" : 76.25 + "tile_us" : 308767, + "gemv_us" : 1220, + "hot_us" : 75.9375 }, "dot_vpdpbusd_width256_mr8_nrsplit2" : { - "tile_us" : 307740, - "gemv_us" : 1205, - "hot_us" : 76 + "tile_us" : 308992, + "gemv_us" : 1220, + "hot_us" : 75.8125 }, "dot_maddubs_width256_mr8_nrsplit2" : { - "tile_us" : 307758, - "gemv_us" : 1223, - "hot_us" : 75.8125 + "tile_us" : 308988, + "gemv_us" : 1177, + "hot_us" : 75.6875 }, "mr4" : { - "tile_us" : 32834, - "gemv_us" : 175, - "hot_us" : 10.4375 + "tile_us" : 32923, + "gemv_us" : 172, + "hot_us" : 10.875 }, "reference" : { - "tile_us" : 307401, - "gemv_us" : 1175, - "hot_us" : 75.0625 + "tile_us" : 308996, + "gemv_us" : 1165, + "hot_us" : 74.375 }, "mr4_nrsplit2" : { - "tile_us" : 36775, - "gemv_us" : 176, - "hot_us" : 11.0625 + "tile_us" : 36733, + "gemv_us" : 177, + "hot_us" : 11 }, "dot_vpdpbusd_width256_mr8" : { - "tile_us" : 307919, - "gemv_us" : 1172, - "hot_us" : 74.25 + "tile_us" : 309072, + "gemv_us" : 1221, + "hot_us" : 75.8125 }, "dot_vpdpbusd_width512_mr16" : { - "tile_us" : 307904, - "gemv_us" : 1168, - "hot_us" : 74.5 + "tile_us" : 309410, + "gemv_us" : 1221, + "hot_us" : 75.8125 }, "mr8_nrsplit2" : { - "tile_us" : 33119, - "gemv_us" : 154, - "hot_us" : 9.625 + "tile_us" : 33222, + "gemv_us" : 159, + "hot_us" : 9.75 }, "dot_vpdpbusd_width512_mr16_nrsplit2" : { - "tile_us" : 307657, - "gemv_us" : 1169, - "hot_us" : 74.625 + "tile_us" : 309142, + "gemv_us" : 1191, + "hot_us" : 75.5625 } } }, "axpy" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 361.5625, - "best_us" : 337.65625 + "med_us" : 337.6875, + "best_us" : 337.53125 }, "vec32" : { - "med_us" : 361.40625, - "best_us" : 359.21875 + "med_us" : 363.28125, + "best_us" : 362.375 }, "vec32_u4" : { - "med_us" : 338.34375, - "best_us" : 337.875 + "med_us" : 338.625, + "best_us" : 338.40625 }, "vec32_u8" : { - "med_us" : 337.21875, - "best_us" : 336.875 + "med_us" : 337.90625, + "best_us" : 337.5625 }, "vec16_u2" : { - "med_us" : 362.53125, - "best_us" : 362.34375 + "med_us" : 363.34375, + "best_us" : 362.5 }, "vec16_u4" : { - "med_us" : 338.28125, - "best_us" : 337.84375 + "med_us" : 338.8125, + "best_us" : 338.34375 }, "vec16_u8" : { - "med_us" : 338.15625, - "best_us" : 336.3125 + "med_us" : 338.3125, + "best_us" : 337.96875 }, "vec4" : { - "med_us" : 363.15625, - "best_us" : 361.5 + "med_us" : 363.3125, + "best_us" : 362.625 }, "vec8" : { - "med_us" : 363.65625, - "best_us" : 360.9375 + "med_us" : 363.03125, + "best_us" : 362.78125 }, "vec4_u4" : { - "med_us" : 338.625, - "best_us" : 337.625 + "med_us" : 338.90625, + "best_us" : 338.3125 }, "vec8_u4" : { - "med_us" : 337.59375, - "best_us" : 336.59375 + "med_us" : 338.59375, + "best_us" : 338.5 }, "plain" : { - "med_us" : 362.71875, - "best_us" : 361.6875 + "med_us" : 363.28125, + "best_us" : 363.03125 }, "u2" : { - "med_us" : 362.90625, - "best_us" : 362.5625 + "med_us" : 363.53125, + "best_us" : 362.71875 }, "u4" : { - "med_us" : 338.15625, - "best_us" : 337.5625 + "med_us" : 338.71875, + "best_us" : 338.4375 }, "u8" : { - "med_us" : 338.15625, - "best_us" : 336.625 + "med_us" : 337.9375, + "best_us" : 337.59375 }, "vec4_u2" : { - "med_us" : 362.25, - "best_us" : 361.25 + "med_us" : 363.40625, + "best_us" : 363.28125 }, "vec4_u8" : { - "med_us" : 338.53125, - "best_us" : 337.8125 + "med_us" : 338.40625, + "best_us" : 338.28125 }, "vec8_u2" : { - "med_us" : 337.65625, - "best_us" : 336.71875 + "med_us" : 340.1875, + "best_us" : 338.0625 }, "vec8_u8" : { - "med_us" : 337.1875, - "best_us" : 335.78125 + "med_us" : 338.15625, + "best_us" : 337.21875 }, "vec16" : { - "med_us" : 362.53125, - "best_us" : 362.03125 + "med_us" : 363.0625, + "best_us" : 362.96875 } } }, "dot_q8q8kv" : { "winner" : "vec16", "fallback" : "vec16", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 140.5, - "best_us" : 140 + "med_us" : 140.0625, + "best_us" : 139.9375 }, "vec32" : { - "med_us" : 129.5, - "best_us" : 128.875 + "med_us" : 129.3125, + "best_us" : 128.8125 }, "vec32_u4" : { - "med_us" : 140.03125, - "best_us" : 140 + "med_us" : 140.09375, + "best_us" : 140.03125 }, "vec32_u8" : { - "med_us" : 140.53125, - "best_us" : 140 + "med_us" : 140.40625, + "best_us" : 139.9375 }, "vec16_u2" : { - "med_us" : 139.65625, - "best_us" : 139.59375 + "med_us" : 139.84375, + "best_us" : 139.625 }, "vec16_u4" : { - "med_us" : 140.0625, - "best_us" : 139.65625 + "med_us" : 139.71875, + "best_us" : 139.53125 }, "vec16_u8" : { - "med_us" : 139.84375, - "best_us" : 139.53125 + "med_us" : 139.8125, + "best_us" : 139.6875 }, "vec4" : { - "med_us" : 136.3125, - "best_us" : 136.125 + "med_us" : 136.15625, + "best_us" : 136.03125 }, "vec8" : { - "med_us" : 136.375, - "best_us" : 136.0625 + "med_us" : 136.625, + "best_us" : 136.25 }, "vec4_u4" : { - "med_us" : 488.96875, - "best_us" : 488.03125 + "med_us" : 488.875, + "best_us" : 488.5 }, "vec8_u4" : { - "med_us" : 194.71875, + "med_us" : 194.65625, "best_us" : 194.09375 }, "plain" : { - "med_us" : 136.375, - "best_us" : 136.28125 + "med_us" : 136.5, + "best_us" : 136.34375 }, "u2" : { - "med_us" : 139.65625, - "best_us" : 139.28125 + "med_us" : 139.90625, + "best_us" : 139.53125 }, "u4" : { - "med_us" : 139.84375, - "best_us" : 139.5 + "med_us" : 139.53125, + "best_us" : 139.21875 }, "u8" : { - "med_us" : 139.625, - "best_us" : 139.1875 + "med_us" : 139.84375, + "best_us" : 139.65625 }, "vec4_u2" : { - "med_us" : 488.6875, - "best_us" : 488.15625 + "med_us" : 488.78125, + "best_us" : 488.5625 }, "vec4_u8" : { - "med_us" : 488.5625, - "best_us" : 488.4375 + "med_us" : 488.5, + "best_us" : 488.0625 }, "vec8_u2" : { - "med_us" : 194.9375, - "best_us" : 193.9375 + "med_us" : 194.78125, + "best_us" : 194.40625 }, "vec8_u8" : { - "med_us" : 194.1875, - "best_us" : 194.125 + "med_us" : 194.5, + "best_us" : 194 }, "vec16" : { - "med_us" : 129.40625, - "best_us" : 128.90625 + "med_us" : 129.03125, + "best_us" : 128.8125 } } }, "dot_mx4q8" : { "winner" : "u2", "fallback" : "u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.10445413575244844, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 164.21875, - "best_us" : 163.625 + "med_us" : 164.15625, + "best_us" : 164.0625 }, "vec32" : { - "med_us" : 163.6875, - "best_us" : 163.625 + "med_us" : 168.625, + "best_us" : 168.53125 }, "vec32_u4" : { - "med_us" : 163.65625, - "best_us" : 163.625 + "med_us" : 163.8125, + "best_us" : 163.6875 }, "vec32_u8" : { "med_us" : 164.59375, - "best_us" : 164.0625 + "best_us" : 164.40625 }, "vec16_u2" : { - "med_us" : 164.28125, - "best_us" : 164.25 + "med_us" : 164.21875, + "best_us" : 164.0625 }, "vec16_u4" : { - "med_us" : 163.6875, - "best_us" : 163.625 + "med_us" : 163.75, + "best_us" : 163.5625 }, "vec16_u8" : { - "med_us" : 164.625, - "best_us" : 164.46875 + "med_us" : 164.59375, + "best_us" : 164.375 }, "vec4" : { - "med_us" : 163.65625, - "best_us" : 163.59375 + "med_us" : 163.875, + "best_us" : 163.71875 }, "vec8" : { - "med_us" : 164.03125, - "best_us" : 163.65625 + "med_us" : 163.90625, + "best_us" : 163.625 }, "vec4_u4" : { - "med_us" : 163.625, - "best_us" : 163.40625 + "med_us" : 163.6875, + "best_us" : 163.5625 }, "vec8_u4" : { - "med_us" : 163.59375, - "best_us" : 163.59375 + "med_us" : 163.6875, + "best_us" : 163.6875 }, "plain" : { - "med_us" : 188.28125, - "best_us" : 187.71875 + "med_us" : 163.84375, + "best_us" : 163.625 }, "u2" : { - "med_us" : 163.78125, - "best_us" : 163.46875 + "med_us" : 164.15625, + "best_us" : 164.125 }, "u4" : { - "med_us" : 164.25, - "best_us" : 164.21875 + "med_us" : 163.78125, + "best_us" : 163.65625 }, "u8" : { - "med_us" : 164.6875, - "best_us" : 164.09375 + "med_us" : 164.625, + "best_us" : 164.15625 }, "vec4_u2" : { - "med_us" : 164.34375, - "best_us" : 164.15625 + "med_us" : 164.25, + "best_us" : 164.09375 }, "vec4_u8" : { - "med_us" : 164.5, - "best_us" : 164.3125 + "med_us" : 164.8125, + "best_us" : 164.46875 }, "vec8_u2" : { - "med_us" : 164.21875, + "med_us" : 164.15625, "best_us" : 164.0625 }, "vec8_u8" : { - "med_us" : 164.875, - "best_us" : 164.375 + "med_us" : 164.84375, + "best_us" : 164.46875 }, "vec16" : { - "med_us" : 163.75, - "best_us" : 163.65625 + "med_us" : 163.65625, + "best_us" : 163.59375 } } }, "dot_q8q8_laneq4x4" : { "winner" : "u2", "fallback" : "u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.10445413575244844, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 753.8076923076923, - "best_us" : 752.8461538461538 + "med_us" : 753.9615384615385, + "best_us" : 752.3846153846154 }, "vec32" : { - "med_us" : 756.9230769230769, - "best_us" : 755.9230769230769 + "med_us" : 755.9615384615385, + "best_us" : 755.5384615384615 }, "vec32_u4" : { - "med_us" : 754, - "best_us" : 753.7307692307693 + "med_us" : 753.76, + "best_us" : 753.36 }, "vec32_u8" : { - "med_us" : 850.5217391304348, + "med_us" : 850.3478260869565, "best_us" : 847.8695652173913 }, "vec16_u2" : { - "med_us" : 751.9615384615385, - "best_us" : 750.5769230769231 + "med_us" : 751.0769230769231, + "best_us" : 750.6538461538462 }, "vec16_u4" : { - "med_us" : 753.8846153846154, - "best_us" : 753.1923076923077 + "med_us" : 754.0384615384615, + "best_us" : 753.4230769230769 }, "vec16_u8" : { - "med_us" : 847.6521739130435, - "best_us" : 844.3478260869565 + "med_us" : 849.8695652173913, + "best_us" : 847.9565217391304 }, "vec4" : { - "med_us" : 756.6153846153846, - "best_us" : 755.8461538461538 + "med_us" : 756.9230769230769, + "best_us" : 756.8076923076923 }, "vec8" : { - "med_us" : 755.5384615384615, - "best_us" : 755.2307692307693 + "med_us" : 756.7692307692307, + "best_us" : 756.5 }, "vec4_u4" : { - "med_us" : 755.0769230769231, - "best_us" : 754.3846153846154 + "med_us" : 755, + "best_us" : 753.6153846153846 }, "vec8_u4" : { - "med_us" : 753.9230769230769, - "best_us" : 753.0769230769231 + "med_us" : 754.6538461538462, + "best_us" : 754.3461538461538 }, "plain" : { - "med_us" : 755.1538461538462, - "best_us" : 754.9230769230769 + "med_us" : 756.0769230769231, + "best_us" : 755.6153846153846 }, "u2" : { - "med_us" : 753.5769230769231, - "best_us" : 752.2692307692307 + "med_us" : 753.3076923076923, + "best_us" : 751.9230769230769 }, "u4" : { - "med_us" : 753.7307692307693, - "best_us" : 753.1153846153846 + "med_us" : 754.5769230769231, + "best_us" : 753.6538461538462 }, "u8" : { - "med_us" : 847.5652173913044, - "best_us" : 845.5652173913044 + "med_us" : 850.6521739130435, + "best_us" : 847.0434782608696 }, "vec4_u2" : { - "med_us" : 750.9615384615385, - "best_us" : 750.1923076923077 + "med_us" : 751.1538461538462, + "best_us" : 750.4615384615385 }, "vec4_u8" : { - "med_us" : 848.2608695652174, - "best_us" : 846.8695652173913 + "med_us" : 849.7826086956521, + "best_us" : 846.9130434782609 }, "vec8_u2" : { - "med_us" : 751.1923076923077, - "best_us" : 750.8076923076923 + "med_us" : 752.1538461538462, + "best_us" : 750.8461538461538 }, "vec8_u8" : { - "med_us" : 847.9130434782609, - "best_us" : 846 + "med_us" : 848.1739130434783, + "best_us" : 844.6521739130435 }, "vec16" : { - "med_us" : 756.92, - "best_us" : 756.32 + "med_us" : 756.6923076923077, + "best_us" : 756.0384615384615 } } }, "scale_inplace" : { - "winner" : "vec8_u2", + "winner" : "plain", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, - "margin_pct" : 0, + "floor_pct" : 0.07927948634535505, + "margin_pct" : 3.0145530145530146, "rows" : { "vec32_u2" : { - "med_us" : 254.21875, - "best_us" : 253.46875 + "med_us" : 256.65625, + "best_us" : 253.90625 }, "vec32" : { - "med_us" : 250.3125, - "best_us" : 248.15625 + "med_us" : 251.71875, + "best_us" : 250.6875 }, "vec32_u4" : { - "med_us" : 254, - "best_us" : 251.125 + "med_us" : 254.40625, + "best_us" : 252.96875 }, "vec32_u8" : { - "med_us" : 252.53125, - "best_us" : 250.46875 + "med_us" : 253.9375, + "best_us" : 252.0625 }, "vec16_u2" : { - "med_us" : 271.59375, - "best_us" : 269.0625 + "med_us" : 269.34375, + "best_us" : 268.0625 }, "vec16_u4" : { - "med_us" : 266.96875, - "best_us" : 266.1875 + "med_us" : 270.125, + "best_us" : 267.75 }, "vec16_u8" : { - "med_us" : 1114, - "best_us" : 1113.1764705882354 + "med_us" : 270.15625, + "best_us" : 268.28125 }, "vec4" : { - "med_us" : 246.84375, - "best_us" : 246.03125 + "med_us" : 247.9375, + "best_us" : 246.65625 }, "vec8" : { - "med_us" : 248.4375, - "best_us" : 247.3125 + "med_us" : 249.8125, + "best_us" : 248.3125 }, "vec4_u4" : { - "med_us" : 247.75, - "best_us" : 247.15625 + "med_us" : 250.53125, + "best_us" : 247.5 }, "vec8_u4" : { - "med_us" : 253.5625, - "best_us" : 252.25 + "med_us" : 254.21875, + "best_us" : 252.78125 }, "plain" : { - "med_us" : 246.03125, - "best_us" : 244.84375 + "med_us" : 247.828125, + "best_us" : 247.15625 }, "u2" : { - "med_us" : 247.0625, - "best_us" : 246.3125 + "med_us" : 247.125, + "best_us" : 246.25 }, "u4" : { - "med_us" : 249.5, - "best_us" : 247.625 + "med_us" : 251.09375, + "best_us" : 250.46875 }, "u8" : { - "med_us" : 249.53125, - "best_us" : 249.09375 + "med_us" : 249.875, + "best_us" : 249.5 }, "vec4_u2" : { - "med_us" : 247.1875, - "best_us" : 245.96875 + "med_us" : 247.265625, + "best_us" : 246.25 }, "vec4_u8" : { - "med_us" : 249.53125, - "best_us" : 247.90625 + "med_us" : 249.59375, + "best_us" : 249.25 }, "vec8_u2" : { - "med_us" : 253.09375, - "best_us" : 252 + "med_us" : 255.53125, + "best_us" : 249.21875 }, "vec8_u8" : { - "med_us" : 250.40625, - "best_us" : 248.3125 + "med_us" : 251.34375, + "best_us" : 250.65625 }, "vec16" : { - "med_us" : 268.9375, - "best_us" : 268.15625 + "med_us" : 272.15625, + "best_us" : 270.09375 } } }, "dot_q4" : { "winner" : "vec4_u4", "fallback" : "vec4_u4", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 1631.5833333333333, - "best_us" : 1629.9166666666667 + "med_us" : 1639.1666666666667, + "best_us" : 1637.5 }, "vec32" : { - "med_us" : 1971.7, - "best_us" : 1970.7 + "med_us" : 1973.6, + "best_us" : 1972.7 }, "vec32_u4" : { - "med_us" : 1562.0833333333333, - "best_us" : 1554.6666666666667 + "med_us" : 1569.5833333333333, + "best_us" : 1568.8333333333333 }, "vec32_u8" : { - "med_us" : 1527.3846153846155, - "best_us" : 1523.5384615384614 + "med_us" : 1533.2307692307693, + "best_us" : 1530.3846153846155 }, "vec16_u2" : { - "med_us" : 1015.9473684210526, - "best_us" : 1014.9473684210526 + "med_us" : 1016.5263157894736, + "best_us" : 1016.0526315789474 }, "vec16_u4" : { - "med_us" : 1017.6842105263158, - "best_us" : 1016.1052631578947 + "med_us" : 1016.1052631578947, + "best_us" : 1015.6842105263158 }, "vec16_u8" : { - "med_us" : 1015.421052631579, - "best_us" : 1014.4736842105264 + "med_us" : 1016.421052631579, + "best_us" : 1016.1052631578947 }, "vec4" : { - "med_us" : 1970.6, - "best_us" : 1970.3 + "med_us" : 1973, + "best_us" : 1970.5 }, "vec8" : { - "med_us" : 1976.4, - "best_us" : 1972.8 + "med_us" : 1976.5, + "best_us" : 1973.9 }, "vec4_u4" : { - "med_us" : 817.0416666666666, - "best_us" : 815.5416666666666 + "med_us" : 817.7083333333334, + "best_us" : 816.9583333333334 }, "vec8_u4" : { - "med_us" : 850.0434782608696, - "best_us" : 849.4347826086956 + "med_us" : 849.3913043478261, + "best_us" : 849.0434782608696 }, "plain" : { - "med_us" : 1971.2, - "best_us" : 1968.7 + "med_us" : 1973.2, + "best_us" : 1971 }, "u2" : { - "med_us" : 1026.1052631578948, - "best_us" : 1025.2105263157894 + "med_us" : 1027.421052631579, + "best_us" : 1026.3157894736842 }, "u4" : { - "med_us" : 1025.9473684210527, - "best_us" : 1025.0526315789473 + "med_us" : 1026.5263157894738, + "best_us" : 1026.1052631578948 }, "u8" : { - "med_us" : 1025.2631578947369, - "best_us" : 1024.3684210526317 + "med_us" : 1026.9473684210527, + "best_us" : 1026.5263157894738 }, "vec4_u2" : { - "med_us" : 816.5416666666666, - "best_us" : 815.9583333333334 + "med_us" : 816.9166666666666, + "best_us" : 816.5833333333334 }, "vec4_u8" : { - "med_us" : 817.2083333333334, - "best_us" : 815.875 + "med_us" : 816.8333333333334, + "best_us" : 816.7916666666666 }, "vec8_u2" : { - "med_us" : 849.1304347826087, - "best_us" : 848.8260869565217 + "med_us" : 850.1739130434783, + "best_us" : 849.9130434782609 }, "vec8_u8" : { - "med_us" : 848.8695652173913, - "best_us" : 847.4782608695652 + "med_us" : 849.3478260869565, + "best_us" : 848.5652173913044 }, "vec16" : { - "med_us" : 1971.1, - "best_us" : 1970.7 + "med_us" : 1971.6, + "best_us" : 1970.9 } } }, "copy_floats" : { "winner" : "vec8_u2", "fallback" : "vec8_u2", - "floor_pct" : 0.25998991791017084, + "floor_pct" : 0.07927948634535505, "margin_pct" : 0, "rows" : { "vec32_u2" : { - "med_us" : 268.53125, - "best_us" : 266.375 + "med_us" : 268.5, + "best_us" : 267.9375 }, "vec32" : { - "med_us" : 269.78125, - "best_us" : 267.53125 + "med_us" : 269.4375, + "best_us" : 268.46875 }, "vec32_u4" : { - "med_us" : 268.9375, - "best_us" : 267.6875 + "med_us" : 349.375, + "best_us" : 268.9375 }, "vec32_u8" : { - "med_us" : 268.5, - "best_us" : 266.75 + "med_us" : 517.25, + "best_us" : 270.34375 }, "vec16_u2" : { - "med_us" : 269.71875, - "best_us" : 266.34375 + "med_us" : 269.5, + "best_us" : 267.875 }, "vec16_u4" : { - "med_us" : 269.03125, - "best_us" : 268 + "med_us" : 272.25, + "best_us" : 269.34375 }, "vec16_u8" : { - "med_us" : 270.34375, - "best_us" : 267.125 + "med_us" : 270.78125, + "best_us" : 268.90625 }, "vec4" : { - "med_us" : 269.84375, - "best_us" : 267.3125 + "med_us" : 270.25, + "best_us" : 267.875 }, "vec8" : { - "med_us" : 270.125, - "best_us" : 266.375 + "med_us" : 270.625, + "best_us" : 268.53125 }, "vec4_u4" : { - "med_us" : 268.5, - "best_us" : 267.53125 + "med_us" : 269.3125, + "best_us" : 266.53125 }, "vec8_u4" : { - "med_us" : 269.0625, - "best_us" : 266.5 + "med_us" : 269.3125, + "best_us" : 268.59375 }, "plain" : { - "med_us" : 273.6875, - "best_us" : 267.65625 + "med_us" : 289.40625, + "best_us" : 269.9375 }, "u2" : { - "med_us" : 270.03125, - "best_us" : 266 + "med_us" : 270.28125, + "best_us" : 267.96875 }, "u4" : { - "med_us" : 270, - "best_us" : 267.15625 + "med_us" : 300.0625, + "best_us" : 269.46875 }, "u8" : { - "med_us" : 272.21875, - "best_us" : 266.65625 + "med_us" : 271.03125, + "best_us" : 268.78125 }, "vec4_u2" : { - "med_us" : 269.5625, - "best_us" : 266.59375 + "med_us" : 268.90625, + "best_us" : 268.3125 }, "vec4_u8" : { - "med_us" : 268.71875, - "best_us" : 266.75 + "med_us" : 270.0625, + "best_us" : 268.4375 }, "vec8_u2" : { - "med_us" : 269.8125, - "best_us" : 267.03125 + "med_us" : 269.65625, + "best_us" : 268.125 }, "vec8_u8" : { - "med_us" : 267.90625, - "best_us" : 267.28125 + "med_us" : 270.25, + "best_us" : 268.875 }, "vec16" : { - "med_us" : 270, - "best_us" : 267.46875 + "med_us" : 270.09375, + "best_us" : 269.1875 } } }, "rmsnorm" : { "winner" : "vec8", "fallback" : "plain", - "floor_pct" : 0.25998991791017084, - "margin_pct" : 85.90106889058553, + "floor_pct" : 0.07927948634535505, + "margin_pct" : 86.17916196102279, "rows" : { "vec32_u2" : { - "med_us" : 620.53125, - "best_us" : 620.0625 + "med_us" : 620.5625, + "best_us" : 620.25 }, "vec32" : { - "med_us" : 615.40625, - "best_us" : 614.9375 + "med_us" : 615.625, + "best_us" : 614.78125 }, "vec32_u4" : { - "med_us" : 620.34375, - "best_us" : 619.75 + "med_us" : 620.84375, + "best_us" : 620.375 }, "vec32_u8" : { - "med_us" : 623.40625, - "best_us" : 622.21875 + "med_us" : 623.3125, + "best_us" : 623.21875 }, "vec16_u2" : { - "med_us" : 602.09375, - "best_us" : 600.71875 + "med_us" : 601.828125, + "best_us" : 601.15625 }, "vec16_u4" : { - "med_us" : 606.53125, - "best_us" : 605.84375 + "med_us" : 607.234375, + "best_us" : 606.5625 }, "vec16_u8" : { - "med_us" : 615.8125, - "best_us" : 615.25 + "med_us" : 612.15625, + "best_us" : 611.21875 }, "vec4" : { - "med_us" : 689.3448275862069, - "best_us" : 688.6206896551724 + "med_us" : 688, + "best_us" : 685.5172413793103 }, "vec8" : { - "med_us" : 595.796875, - "best_us" : 594.46875 + "med_us" : 596.765625, + "best_us" : 595.875 }, "vec4_u4" : { - "med_us" : 694.3333333333334, - "best_us" : 693.9629629629629 + "med_us" : 695.1379310344828, + "best_us" : 694.6896551724138 }, "vec8_u4" : { - "med_us" : 600.171875, - "best_us" : 599.71875 + "med_us" : 600.734375, + "best_us" : 600.25 }, "plain" : { - "med_us" : 4344.5, - "best_us" : 4259.25 + "med_us" : 4360.875, + "best_us" : 4320 }, "u2" : { - "med_us" : 4303.25, - "best_us" : 4242.25 + "med_us" : 4332.25, + "best_us" : 4297 }, "u4" : { - "med_us" : 4251.5, - "best_us" : 4244.5 + "med_us" : 4346.25, + "best_us" : 4304.5 }, "u8" : { - "med_us" : 4315, - "best_us" : 4297 + "med_us" : 4354.5, + "best_us" : 4330.25 }, "vec4_u2" : { - "med_us" : 689.8571428571429, - "best_us" : 688.8571428571429 + "med_us" : 691.8571428571429, + "best_us" : 690.5357142857143 }, "vec4_u8" : { - "med_us" : 694.7586206896551, - "best_us" : 693.6896551724138 + "med_us" : 695.1071428571429, + "best_us" : 693.8571428571429 }, "vec8_u2" : { - "med_us" : 599.546875, - "best_us" : 599.125 + "med_us" : 600.15625, + "best_us" : 599.34375 }, "vec8_u8" : { - "med_us" : 599.578125, - "best_us" : 598.09375 + "med_us" : 600.796875, + "best_us" : 600.21875 }, "vec16" : { - "med_us" : 601.78125, - "best_us" : 600.78125 + "med_us" : 601.546875, + "best_us" : 600.625 } } } @@ -2632,7 +2632,7 @@ "jobque_join_poll" : 50, "q8_token_block" : 128, "requant_par_threshold" : 256000, - "metal_tensor" : "mulmm_bf16,mulmm_q8,moe_mulmm_q8,attn_qkmm,attn_avmm,kq_mulmm_k4,kq_mulmm_k5,kq_mulmm_k6,gemmb_q8,gemmb_sk_q8,gemm64b_q8", + "metal_tensor" : "mulmm_bf16,mulmm_q8,moe_mulmm_q8,moe_mulmm_mx4,attn_qkmm,kq_mulmm_k4,kq_mulmm_k5,kq_mulmm_k6,gemmb_q8,gemmb_sk_q8,gemm64b_q8", "matmul_min_chunk_rows_gemv" : 64, "attn_par_threshold" : 100000, "batch_lane_cap" : 0, diff --git a/modules/dasLLAMA/performance/model_specs.das b/modules/dasLLAMA/performance/model_specs.das index 991ce43717..2e6b2253c3 100644 --- a/modules/dasLLAMA/performance/model_specs.das +++ b/modules/dasLLAMA/performance/model_specs.das @@ -402,9 +402,11 @@ def model_specs() : array { // nolint:STYLE038 — flat model-set t parity <- ev_qwen_count([moe_reference = true])), // the qwen vision pairs (the qwen3vl arc): parity-less provenance carriers — // test_vision_chat's deepstack/qwen25o legs and the qwen tier-1 suites are their coverage - ModelSpec(file = "Qwen3VL-4B-Instruct-Q8_0.gguf", display = "Qwen3-VL-4B", + ModelSpec(file = "Qwen3VL-4B-Instruct-Q8_0.gguf", display = "Qwen3-VL-4B", official = true, url = "{HF}/Qwen/Qwen3-VL-4B-Instruct-GGUF/resolve/main/Qwen3VL-4B-Instruct-Q8_0.gguf", bytes = 4280406144l, sha256 = "054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + // verified 40/40 against the live oracle 2026-08-30 (the deepstack tower's carrier) + parity <- ev_qwen_count(), companions <- [ ProvEntry(name = "mmproj-Qwen3VL-4B-Instruct-F16.gguf", root = "llm", url = "{HF}/Qwen/Qwen3-VL-4B-Instruct-GGUF/resolve/main/mmproj-Qwen3VL-4B-Instruct-F16.gguf", @@ -416,9 +418,11 @@ def model_specs() : array { // nolint:STYLE038 — flat model-set t ProvEntry(name = "mmproj-Qwen3VL-8B-Instruct-F16.gguf", root = "llm", url = "{HF}/Qwen/Qwen3-VL-8B-Instruct-GGUF/resolve/main/mmproj-Qwen3VL-8B-Instruct-F16.gguf", bytes = 1159029824l, sha256 = "ca524100ebf825c9a870db1c580d03879e0da0ab2541697e2458e64891cf9d38")]), - ModelSpec(file = "Qwen2.5-Omni-3B-Q8_0.gguf", display = "Qwen2.5-Omni-3B", + ModelSpec(file = "Qwen2.5-Omni-3B-Q8_0.gguf", display = "Qwen2.5-Omni-3B", official = true, url = "{HF}/ggml-org/Qwen2.5-Omni-3B-GGUF/resolve/main/Qwen2.5-Omni-3B-Q8_0.gguf", bytes = 3616087360l, sha256 = "c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + // verified 40/40 against the live oracle 2026-08-30 (the window-ViT tower's carrier) + parity <- ev_qwen_count(), companions <- [ ProvEntry(name = "mmproj-Qwen2.5-Omni-3B-f16.gguf", root = "llm", url = "{HF}/ggml-org/Qwen2.5-Omni-3B-GGUF/resolve/main/mmproj-Qwen2.5-Omni-3B-f16.gguf", diff --git a/modules/dasLLAMA/performance/records/m5.json b/modules/dasLLAMA/performance/records/m5.json index 9e395c450c..72af7a9783 100644 --- a/modules/dasLLAMA/performance/records/m5.json +++ b/modules/dasLLAMA/performance/records/m5.json @@ -8,7 +8,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", @@ -23,23 +23,24 @@ }, "tests":{ "pp512":{ - "tok_s":8692.8377108443274, - "stddev":42.567550659179688 + "tok_s":9074.3052485156186, + "stddev":45.637462615966797 }, "tg128":{ - "tok_s":161.72247100178595, - "stddev":0.25893470644950867 + "tok_s":161.29051694478639, + "stddev":0.29714569449424744 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -55,7 +56,7 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", @@ -70,12 +71,12 @@ }, "tests":{ "pp512":{ - "tok_s":7527.4361060000001, - "stddev":28.764002000000001 + "tok_s":7413.405377, + "stddev":19.497814000000002 }, "tg128":{ - "tok_s":136.59289799999999, - "stddev":0.146476 + "tok_s":137.04832500000001, + "stddev":0.14505699999999999 } }, "source":"official", @@ -96,7 +97,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-26", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ "cpu":"Apple M5 Max", @@ -111,23 +112,24 @@ }, "tests":{ "pp512":{ - "tok_s":417.2733831806496, - "stddev":6.4843430519104004 + "tok_s":418.36604479578892, + "stddev":8.9013547897338867 }, "tg128":{ - "tok_s":103.24245394031865, - "stddev":0.75111651420593262 + "tok_s":102.92598495358818, + "stddev":0.51493358612060547 } }, "source":"official", - "sha":"5e59c0bf1", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"7137eccccd43974aec7a294f4a6153c34fd9c6401e9b6e4f2ba98d797e450a2f", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -143,8 +145,8 @@ "flavor":"clean-cpu", "box":"m5", "threads":6, - "date":"2026-08-25", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-3737e41/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -158,16 +160,16 @@ }, "tests":{ "pp512":{ - "tok_s":281.13087400000001, - "stddev":1.903705 + "tok_s":281.425792, + "stddev":1.3423130000000001 }, "tg128":{ - "tok_s":74.544515000000004, - "stddev":0.40743000000000001 + "tok_s":73.950760000000002, + "stddev":0.93118800000000002 } }, "source":"official", - "sha":"3737e4137", + "sha":"6fdd0ac89", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -184,7 +186,7 @@ "flavor":"accel", "box":"m5", "threads":6, - "date":"2026-08-26", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ "cpu":"Apple M5 Max", @@ -199,23 +201,24 @@ }, "tests":{ "pp512":{ - "tok_s":442.17742567543337, - "stddev":6.7096719741821289 + "tok_s":419.52594596689579, + "stddev":3.7739033699035645 }, "tg128":{ - "tok_s":102.38307420903708, - "stddev":0.39548566937446594 + "tok_s":102.48935453708089, + "stddev":0.36666584014892578 } }, "source":"official", - "sha":"5e59c0bf1", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"7137eccccd43974aec7a294f4a6153c34fd9c6401e9b6e4f2ba98d797e450a2f", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -231,8 +234,8 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-26", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-3737e41/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -246,16 +249,16 @@ }, "tests":{ "pp512":{ - "tok_s":403.17842100000001, - "stddev":8.1003729999999994 + "tok_s":396.91589599999998, + "stddev":4.7512590000000001 }, "tg128":{ - "tok_s":73.163036000000005, - "stddev":1.1093090000000001 + "tok_s":72.762850999999998, + "stddev":0.89491100000000001 } }, "source":"official", - "sha":"3737e4137", + "sha":"6fdd0ac89", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -272,7 +275,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", @@ -287,26 +290,27 @@ }, "tests":{ "img:enc":{ - "ms":37.079999999999998 + "ms":37.649999999999999 }, "img:pp":{ - "tok_s":3542.7974473690188 + "tok_s":5796.2398751579103 }, "img:tg":{ - "tok_s":155.15743307542721, + "tok_s":155.08524518977265, "text":": This is an image of two tabby cats lying on a pink surface." } }, "workload":"image-chat", "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -334,7 +338,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-26", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ "cpu":"Apple M5 Max", @@ -349,26 +353,27 @@ }, "tests":{ "img:enc":{ - "ms":365.37099999999998 + "ms":438.13799999999998 }, "img:pp":{ - "tok_s":429.05942473032513 + "tok_s":394.60903351141332 }, "img:tg":{ - "tok_s":98.923710034821141, + "tok_s":98.218319680986895, "text":": This is an image of two tabby cats lying on a pink surface." } }, "workload":"image-chat", "source":"official", - "sha":"5e59c0bf1", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"7137eccccd43974aec7a294f4a6153c34fd9c6401e9b6e4f2ba98d797e450a2f", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -396,7 +401,7 @@ "flavor":"clean-cpu", "box":"m5", "threads":6, - "date":"2026-08-26", + "date":"2026-08-30", "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", "hardware":{ "cpu":"Apple M5 Max", @@ -411,13 +416,13 @@ }, "tests":{ "img:enc":{ - "ms":13554 + "ms":13547 }, "img:pp":{ - "tok_s":368.65290980755918 + "tok_s":369.42379182156168 }, "img:tg":{ - "tok_s":63.757720661486353 + "tok_s":64.06406406406407 } }, "workload":"image-chat", @@ -451,7 +456,7 @@ "flavor":"accel", "box":"m5", "threads":6, - "date":"2026-08-26", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ "cpu":"Apple M5 Max", @@ -466,26 +471,27 @@ }, "tests":{ "img:enc":{ - "ms":397.846 + "ms":466.53399999999999 }, "img:pp":{ - "tok_s":409.8349888740309 + "tok_s":400.91902977594793 }, "img:tg":{ - "tok_s":98.09114629313558, + "tok_s":98.976582140665514, "text":": This is an image of two tabby cats lying on a pink surface." } }, "workload":"image-chat", "source":"official", - "sha":"5e59c0bf1", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"7137eccccd43974aec7a294f4a6153c34fd9c6401e9b6e4f2ba98d797e450a2f", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -506,25 +512,15 @@ "bytes":173131 } ] - } - ], - "arch":"gemma4v", - "quant":"q8", - "params_b":4.6474501469999998, - "active_b":2.2476226559999999, - "size_bytes":4967497152 - }, - { - "gguf":"gemma-4-12B-it-Q4_K_M.gguf", - "runs":[ + }, { "engine":"das", "backend":"metal", "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -537,41 +533,88 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":1938.9908117881037, - "stddev":3.0214979648590088 + "asr:jfk.wav":{ + "ms":229.541, + "audio_s":11, + "encode_ms":34.915999999999997, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, - "tg128":{ - "tok_s":63.761391280043405, - "stddev":2.6959183216094971 + "asr:jfk3.wav":{ + "ms":618.63599999999997, + "audio_s":33, + "encode_ms":97.418999999999997, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:gb1.wav":{ + "ms":4241.6840000000002, + "audio_s":198.734375, + "encode_ms":542.18299999999999, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens, who created space, he who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":5431.3490000000002, + "audio_s":273.28724999999997, + "encode_ms":792.80399999999997, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number 2,46343, US patents 2,46837 to 2,46840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American Screw Company went on to devise the Pozidrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption: Phillips screw head. The following is an infobox which accompanies this article. Infobox: Part of the series on screw drive types. Slotted, commonly erroneously flathead, Phillips, crosshead, Pozidrive, superdrive, torques, hex, Allen, Robertson, triwing, torque set, spanner head, triple square, XZN, others, polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the 9th of April, 2008 at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered 501(c)3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/copyleft/fdl.html." } }, + "workload":"audio-chat", "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "parity":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-12B-it-Q4_K_M.gguf", - "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", - "bytes":7381382944 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 } ] }, { - "engine":"llama.cpp", - "backend":"metal", + "engine":"llama-mtmd-cli", + "backend":"cpu", "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 6", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -584,35 +627,67 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":1703.5040280000001, - "stddev":1.5609329999999999 + "asr:jfk.wav":{ + "ms":7665.6000000000004, + "encode_ms":7293.6000000000004, + "text":"0.00.001.911 I common_init_result: fitting params to device memory ... 0.00.001.912 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.244.841 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 131072 MiB of total host memory 0.00.439.014 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.440.937 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.446.072 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.726.254 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.766.479 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.934.431 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.934.480 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.01.934.637 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.934.638 W For normal use cases, please use the standard llama-cli 0.01.962.985 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 3) 0.08.432.179 I mtmd batch encoding done in 6469 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" }, - "tg128":{ - "tok_s":60.580466000000001, - "stddev":0.22184499999999999 + "asr:jfk3.wav":{ + "ms":22981.5, + "encode_ms":21865.599999999999, + "text":"0.00.001.811 I common_init_result: fitting params to device memory ... 0.00.001.815 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.244.264 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 131072 MiB of total host memory 0.00.441.386 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.443.350 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.448.614 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.727.787 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.768.148 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.935.732 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.935.779 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.01.935.936 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.935.937 W For normal use cases, please use the standard llama-cli 0.01.971.339 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.19.596.135 I mtmd batch encoding done in 17624 ms 0.21.672.069 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.23.466.215 I mtmd batch encoding done in 1795 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" + }, + "asr:gb1.wav":{ + "ms":142898.70000000001, + "encode_ms":134845, + "text":"0.00.001.770 I common_init_result: fitting params to device memory ... 0.00.001.774 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.240.580 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 131072 MiB of total host memory 0.00.434.527 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.436.386 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.441.357 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.714.417 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.755.141 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.923.490 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.923.539 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.01.923.689 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.923.689 W For normal use cases, please use the standard llama-cli 0.02.004.292 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 9) 0.19.621.280 I mtmd batch encoding done in 17617 ms 0.21.674.324 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 9) 0.39.280.594 I mtmd batch encoding done in 17607 ms 0.41.623.704 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 9) 0.59.330.519 I mtmd batch encoding done in 17707 ms 1.01.882.612 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 9) 1.19.483.455 I mtmd batch encoding done in 17601 ms 1.22.243.872 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 9) 1.39.859.879 I mtmd batch encoding done in 17616 ms 1.42.834.122 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 9) 2.00.447.647 I mtmd batch encoding done in 17614 ms 2.03.627.301 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 9) 2.14.634.052 I mtmd batch encoding done in 11007 ms My fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As far as we can see, there is comfort and hope in the words of the prophet Isaiah. Lift your eyes and look to the heavens, who created space. He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the Shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America.DASLLAMA_IDS: 4754 12339 14522 236764 672 1719 815 6111 21832 4668 532 1822 55882 531 1023 2891 236761 2640 236743 236819 236787 236771 236771 672 5597 236764 9017 2256 528 21912 5745 3662 607 1023 2557 51320 18693 236761 562 2822 990 3209 236764 37061 691 3472 14773 699 506 55748 2787 9539 236761 669 18693 563 5745 236761 2085 659 951 43732 236761 2154 3905 691 496 13919 529 6819 236787 44221 26839 89702 236764 41523 44221 8972 19864 236764 43224 94816 18093 236764 22359 6822 9833 236764 43224 8966 16376 1209 236764 3587 236761 751 19321 1789 34525 2149 236764 532 98134 121873 236764 496 105721 528 506 33722 5661 15150 236761 3143 1758 532 3607 12718 1822 4652 528 506 2509 531 784 27069 528 614 3911 1056 2557 10224 815 2229 531 4483 4180 15668 236761 1030 563 3735 531 29346 506 39793 529 4301 684 35305 532 506 18502 529 67112 506 48621 11661 529 506 10824 236761 3143 101195 7261 506 39793 532 901 17175 1091 95826 236764 14111 901 1053 496 1494 532 29417 5708 528 1972 236761 8468 529 910 23648 532 63485 532 184291 236764 692 795 4305 1091 784 506 919 236761 2343 14522 3124 659 6972 618 1388 529 506 7965 529 1239 1758 532 3607 1015 735 1010 2238 672 11059 10932 532 32717 236761 1599 236789 500 711 7057 236761 5137 4251 7097 66031 2061 607 611 236761 1452 1724 611 9312 795 2462 735 506 2833 532 36637 529 672 2891 236761 669 4400 528 837 901 8390 795 4102 236761 192411 563 5378 1131 506 29151 6998 1023 1902 684 506 18014 529 17324 532 506 86508 531 3050 236761 5137 9338 1131 2557 795 817 580 236761 799 506 55748 3124 236764 692 5004 21404 532 40578 236761 1773 2793 618 692 740 1460 236764 993 563 5931 532 4614 528 506 4171 529 506 59918 81034 236761 79493 822 6114 532 1385 531 506 80958 236764 1015 4464 2557 236761 1293 1015 12076 855 506 129196 20472 886 684 886 532 9139 1091 1546 684 1463 236761 8468 529 914 1822 2066 532 45478 6332 236764 711 886 529 1091 563 9724 236761 669 1638 33797 1015 5618 506 8197 992 10077 506 5618 529 506 6819 39690 692 92377 3124 236761 669 13919 529 506 114357 18693 1602 711 994 21236 531 10824 236761 16961 692 740 14098 600 784 659 21236 2033 236761 3353 3803 14321 506 112792 7965 532 1149 3803 1149 3803 4102 531 14321 5711 236761 106" } }, + "workload":"audio-chat", "source":"official", - "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"gemma-4-12B-it-Q4_K_M.gguf", - "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", - "bytes":7381382944 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 } ] }, { - "engine":"das", + "engine":"llama-mtmd-cli", "backend":"metal", - "flavor":"tuned", + "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-metal/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 99 -t 6", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -625,102 +700,56 @@ "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":7.1980000000000004 + "asr:jfk.wav":{ + "ms":291.60000000000002, + "encode_ms":98.5, + "text":"0.00.022.839 I common_init_result: fitting params to device memory ... 0.00.022.842 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.457.218 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.459.031 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.463.963 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.00.616.707 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.640.223 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.00.831.501 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.831.546 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.00.831.705 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.831.706 W For normal use cases, please use the standard llama-cli 0.00.836.914 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 3) 0.00.875.673 I mtmd batch encoding done in 39 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" }, - "img:pp":{ - "tok_s":1284.7225081736351 + "asr:jfk3.wav":{ + "ms":721.39999999999998, + "encode_ms":212.59999999999999, + "text":"0.00.027.886 I common_init_result: fitting params to device memory ... 0.00.027.890 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.468.945 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.470.789 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.476.235 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.00.632.073 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.656.004 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.00.848.742 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.848.789 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.00.848.951 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.848.951 W For normal use cases, please use the standard llama-cli 0.00.860.453 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.00.912.833 I mtmd batch encoding done in 52 ms 0.00.979.798 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.01.027.521 I mtmd batch encoding done in 48 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 107 106" }, - "img:tg":{ - "tok_s":65.699831751300422, - "text":"Two tabby cats are lying on a pink surface, with one cat on the left and the other on the right." + "asr:gb1.wav":{ + "ms":4274.3000000000002, + "encode_ms":1081.0999999999999, + "text":"0.00.023.642 I common_init_result: fitting params to device memory ... 0.00.023.644 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.463.170 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.465.061 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.470.063 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.00.624.427 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.648.222 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.00.842.829 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.842.877 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.00.843.036 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.843.037 W For normal use cases, please use the standard llama-cli 0.00.899.817 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 9) 0.00.956.606 I mtmd batch encoding done in 57 ms 0.01.023.495 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 9) 0.01.085.254 I mtmd batch encoding done in 62 ms 0.01.159.147 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 9) 0.01.223.969 I mtmd batch encoding done in 65 ms 0.01.302.155 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 9) 0.01.368.919 I mtmd batch encoding done in 66 ms 0.01.451.298 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 9) 0.01.520.715 I mtmd batch encoding done in 69 ms 0.01.607.597 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 9) 0.01.678.850 I mtmd batch encoding done in 71 ms 0.01.770.823 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 9) 0.01.838.313 I mtmd batch encoding done in 68 ms My fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As far as we can see, there is comfort and hope in the words of the prophet Isaiah. Lift your eyes and look to the heavens, who created space. He who brings out the starry hosts one by one and calls them each by name because of his great power and mighty strength. Not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the Shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America.DASLLAMA_IDS: 4754 12339 14522 236764 672 1719 815 6111 21832 4668 532 1822 55882 531 1023 2891 236761 2640 236743 236819 236787 236771 236771 672 5597 236764 9017 2256 528 21912 5745 3662 607 1023 2557 51320 18693 236761 562 2822 990 3209 236764 37061 691 3472 14773 699 506 55748 2787 9539 236761 669 18693 563 5745 236761 2085 659 951 43732 236761 2154 3905 691 496 13919 529 6819 236787 44221 26839 89702 236764 41523 44221 8972 19864 236764 43224 94816 18093 236764 22359 6822 9833 236764 43224 8966 16376 1209 236764 3587 236761 751 19321 1789 34525 2149 236764 532 98134 121873 236764 496 105721 528 506 33722 5661 15150 236761 3143 1758 532 3607 12718 1822 4652 528 506 2509 531 784 27069 528 614 3911 1056 2557 10224 815 2229 531 4483 4180 15668 236761 1030 563 3735 531 29346 506 39793 529 4301 684 35305 532 506 18502 529 67112 506 48621 11661 529 506 10824 236761 3143 101195 7261 506 39793 532 901 17175 1091 95826 236764 14111 901 1053 496 1494 532 29417 5708 528 1972 236761 8468 529 910 23648 532 63485 532 184291 236764 692 795 4305 1091 784 506 919 236761 2343 14522 3124 659 6972 618 1388 529 506 7965 529 1239 1758 532 3607 1015 735 1010 2238 672 11059 10932 532 32717 236761 1599 236789 500 711 7057 236761 5137 4251 7097 66031 2061 607 611 236761 1452 1724 611 9312 795 2462 735 506 2833 532 36637 529 672 2891 236761 669 4400 528 837 901 8390 795 4102 236761 192411 563 5378 1131 506 29151 6998 1023 1902 684 506 18014 529 17324 532 506 86508 531 3050 236761 5137 9338 1131 2557 795 817 580 236761 799 506 55748 3124 236764 692 5004 21404 532 40578 236761 1773 2793 618 692 740 1460 236764 993 563 5931 532 4614 528 506 4171 529 506 59918 81034 236761 79493 822 6114 532 1385 531 506 80958 236764 1015 4464 2557 236761 1293 1015 12076 855 506 129196 20472 886 684 886 532 9139 1091 1546 684 1463 1547 529 914 1822 2066 532 45478 6332 236761 3790 886 529 1091 563 9724 236761 669 1638 33797 1015 5618 506 8197 992 10077 506 5618 529 506 6819 39690 692 92377 3124 236761 669 13919 529 506 114357 18693 1602 711 994 21236 531 10824 236761 16961 692 740 14098 600 784 659 21236 2033 236761 3353 3803 14321 506 112792 7965 532 1149 3803 1149 3803 4102 531 14321 5711 236761 106" } }, - "workload":"image-chat", + "workload":"audio-chat", "source":"official", - "sha":"667d4c1d5", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", - "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"gemma-4-12B-it-Q4_K_M.gguf", - "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", - "bytes":7381382944 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { "role":"mmproj", - "name":"mmproj-gemma-4-12B-it-BF16.gguf", - "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", - "bytes":175115616 + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 - } - ] - } - ], - "arch":"gemma4uv", - "quant":"q8", - "params_b":11.907350576000001, - "active_b":11.906580480000001, - "size_bytes":7381382944 - }, - { - "gguf":"gemma-4-E4B-it-Q8_0.gguf", - "runs":[ - { - "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m5", - "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", - "hardware":{ - "cpu":"Apple M5 Max", - "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":5123.0211944582243, - "stddev":21.226161956787109 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, - "tg128":{ - "tok_s":90.197186400189821, - "stddev":0.03762681782245636 - } - }, - "source":"official", - "sha":"667d4c1d5", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", - "files":[ { - "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 } ] }, @@ -730,8 +759,8 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -744,35 +773,49 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":4331.2716979999996, - "stddev":7.9024109999999999 + "img:enc":{ + "ms":52 }, - "tg128":{ - "tok_s":81.157066999999998, - "stddev":0.26690799999999998 + "img:pp":{ + "tok_s":2362.5557206537892 + }, + "img:tg":{ + "tok_s":122.55840674071236 } }, + "workload":"image-chat", "source":"official", - "sha":"6fdd0ac89", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"das", - "backend":"metal", - "flavor":"tuned", + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -786,38 +829,31 @@ }, "tests":{ "img:enc":{ - "ms":38.402000000000001 + "ms":13548 }, "img:pp":{ - "tok_s":1764.6859198425357 + "tok_s":347.31323722149466 }, "img:tg":{ - "tok_s":88.326299431675466, - "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" + "tok_s":69.884254203974677 } }, "workload":"image-chat", "source":"official", - "sha":"667d4c1d5", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", - "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E4B-it-BF16.gguf", - "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", - "bytes":991552256 + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"image", @@ -826,25 +862,15 @@ "bytes":173131 } ] - } - ], - "arch":"gemma4v", - "quant":"q8", - "params_b":7.5180692899999997, - "active_b":4.5888307199999998, - "size_bytes":8031242688 - }, - { - "gguf":"gpt-oss-20b-mxfp4.gguf", - "runs":[ + }, { "engine":"das", - "backend":"metal", + "backend":"cpu", "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -857,41 +883,88 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":3989.4203630795723, - "stddev":18.226713180541992 + "asr:jfk.wav":{ + "ms":1197.835, + "audio_s":11, + "encode_ms":253.62200000000001, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, - "tg128":{ - "tok_s":163.21584485670596, - "stddev":0.13277889788150787 + "asr:jfk3.wav":{ + "ms":3596.4560000000001, + "audio_s":33, + "encode_ms":716.04499999999996, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:gb1.wav":{ + "ms":28601.455000000002, + "audio_s":198.734375, + "encode_ms":4418.3800000000001, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity, in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created space, he who brings out the starry hosts one by one and calls them each by name, because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":40530.589, + "audio_s":273.28724999999997, + "encode_ms":5921.6099999999997, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number 2,46343, US patents 2,46837 to 2,46840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American Screw Company went on to devise the Pozidrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption: Phillips screw head. The following is an infobox which accompanies this article. Infobox: Part of the series on screw drive types. Slotted, commonly erroneously flathead, Phillips, crosshead, Pozidrive, superdrive, torques, hex, Allen, Robertson, trywing, torque set, spanner head, triple square, XZN, others, polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the 9th of April, 2008 at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered 501(c)3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/copyleft/fdl.html." } }, + "workload":"audio-chat", "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "parity":"ok", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 } ] }, { - "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", + "engine":"das", + "backend":"cpu", + "flavor":"accel", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -904,36 +977,89 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":3475.262072, - "stddev":8.8958180000000002 + "asr:jfk.wav":{ + "ms":1171.615, + "audio_s":11, + "encode_ms":242.10499999999999, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, - "tg128":{ - "tok_s":147.511551, - "stddev":0.410717 + "asr:jfk3.wav":{ + "ms":3506.8780000000002, + "audio_s":33, + "encode_ms":704.21699999999998, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:gb1.wav":{ + "ms":27479.187999999998, + "audio_s":198.734375, + "encode_ms":4291.4830000000002, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity, in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created space, he who brings out the starry hosts one by one and calls them each by name, because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":39693.042000000001, + "audio_s":273.28724999999997, + "encode_ms":5884.8800000000001, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number 2,46343, US patents 2,46837 to 2,46840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American Screw Company went on to devise the Pozidrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption: Phillips screw head. The following is an infobox which accompanies this article. Infobox: Part of the series on screw drive types. Slotted, commonly erroneously flathead, Phillips, crosshead, Pozidrive, superdrive, torques, hex, Allen, Robertson, trywing, torque set, spanner head, triple square, XZN, others, polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the 9th of April, 2008 at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered 501(c)3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/copyleft/fdl.html." } }, + "workload":"audio-chat", "source":"official", - "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 } ] } ], - "arch":"gpt-oss", + "arch":"Gemma-4 E2B audio", "quant":"q8", - "params_b":20.914757183999999, - "active_b":4.1862758400000004, - "size_bytes":12109566560 + "params_b":4.6474501469999998, + "active_b":2.2476226559999999, + "size_bytes":4967497152 }, { - "gguf":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "gguf":"gemma-4-12B-it-Q4_K_M.gguf", "runs":[ { "engine":"das", @@ -941,8 +1067,8 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -956,29 +1082,30 @@ }, "tests":{ "pp512":{ - "tok_s":1107.5193206908937, - "stddev":1.1255176067352295 + "tok_s":2076.9566842879863, + "stddev":1.2408003807067871 }, "tg128":{ - "tok_s":38.298495651945146, - "stddev":0.053260661661624908 + "tok_s":63.680067553550863, + "stddev":2.6998429298400879 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 } ] }, @@ -988,8 +1115,8 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1003,12 +1130,12 @@ }, "tests":{ "pp512":{ - "tok_s":991.28601000000003, - "stddev":0.77159100000000003 + "tok_s":1692.12301, + "stddev":3.1238350000000001 }, "tg128":{ - "tok_s":36.653257000000004, - "stddev":1.1031610000000001 + "tok_s":60.614342999999998, + "stddev":0.31201600000000002 } }, "source":"official", @@ -1017,30 +1144,20 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 } ] - } - ], - "arch":"llama", - "quant":"q8", - "params_b":23.5724032, - "active_b":23.571988480000002, - "size_bytes":14333910592 - }, - { - "gguf":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "runs":[ + }, { "engine":"das", "backend":"metal", "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1053,92 +1170,57 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":3648.4381650295713, - "stddev":15.327509880065918 + "img:enc":{ + "ms":7.1399999999999997 }, - "tg128":{ - "tok_s":118.26094767794341, - "stddev":5.0962691307067871 + "img:pp":{ + "tok_s":1336.8869387860038 + }, + "img:tg":{ + "tok_s":65.407989443719273, + "text":"Two tabby cats are lying on a pink surface, with one cat on the left and the other on the right." } }, + "workload":"image-chat", "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 - } - ] - }, - { - "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", - "box":"m5", - "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M5 Max", - "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":3469.808806, - "stddev":11.919931 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 }, - "tg128":{ - "tok_s":99.490211000000002, - "stddev":0.274507 - } - }, - "source":"official", - "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", - "files":[ { - "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] - } - ], - "arch":"gemma4", - "quant":"q8", - "params_b":25.233142046000001, - "active_b":3.2865648639999998, - "size_bytes":16947541728 - }, - { - "gguf":"Qwen3.6-27B-MTP-Q4_K_M.gguf", - "runs":[ + }, { "engine":"das", - "backend":"metal", + "backend":"cpu", "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1152,40 +1234,41 @@ }, "tests":{ "pp512":{ - "tok_s":888.29681098337915, - "stddev":4.535797119140625 + "tok_s":62.674170617578874, + "stddev":0.96139603853225708 }, "tg128":{ - "tok_s":27.423391866797225, - "stddev":0.11130748689174652 + "tok_s":26.61922102088197, + "stddev":0.27557656168937683 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", - "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", - "bytes":17106773120 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 } ] }, { "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", + "backend":"cpu", + "flavor":"clean-cpu", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1199,44 +1282,34 @@ }, "tests":{ "pp512":{ - "tok_s":739.10453299999995, - "stddev":0.48830800000000002 + "tok_s":57.410412999999998, + "stddev":1.00617 }, "tg128":{ - "tok_s":27.332798, - "stddev":0.96453999999999995 + "tok_s":18.097662, + "stddev":0.036975000000000001 } }, "source":"official", "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", - "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", - "bytes":17106773120 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 } ] - } - ], - "arch":"qwen35", - "quant":"q8", - "params_b":27.320697855999999, - "active_b":23.84986112, - "size_bytes":17106773120 - }, - { - "gguf":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "runs":[ + }, { "engine":"das", - "backend":"metal", - "flavor":"tuned", + "backend":"cpu", + "flavor":"accel", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1250,40 +1323,41 @@ }, "tests":{ "pp512":{ - "tok_s":3506.8078045084162, - "stddev":19.61585807800293 + "tok_s":63.095818781317931, + "stddev":1.0578408241271973 }, "tg128":{ - "tok_s":165.24557967328658, - "stddev":0.11801531910896301 + "tok_s":26.77336700838493, + "stddev":0.22380563616752625 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 } ] }, { "engine":"llama.cpp", - "backend":"metal", + "backend":"cpu", "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1297,44 +1371,34 @@ }, "tests":{ "pp512":{ - "tok_s":3425.5220340000001, - "stddev":13.952795 + "tok_s":57.511476000000002, + "stddev":0.94918599999999997 }, "tg128":{ - "tok_s":136.43157400000001, - "stddev":0.83255500000000005 + "tok_s":18.055194, + "stddev":0.039898999999999997 } }, "source":"official", "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 } ] - } - ], - "arch":"qwen3moe", - "quant":"q8", - "params_b":30.532122623999999, - "active_b":3.3528217599999999, - "size_bytes":18556686752 - }, - { - "gguf":"Qwen3.8-27B-Q4_K_M.gguf", - "runs":[ + }, { - "engine":"das", + "engine":"llama.cpp", "backend":"metal", - "flavor":"tuned", + "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1347,41 +1411,49 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":891.6510131320847, - "stddev":3.1367990970611572 + "img:enc":{ + "ms":95 }, - "tg128":{ - "tok_s":27.886035408758552, - "stddev":0.073721945285797119 + "img:pp":{ + "tok_s":836.40189374013664 + }, + "img:tg":{ + "tok_s":53.235734486774248 } }, + "workload":"image-chat", "source":"official", - "sha":"667d4c1d5", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", + "engine":"das", + "backend":"cpu", + "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1394,36 +1466,231 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":752.63394100000005, - "stddev":0.68924799999999997 + "img:enc":{ + "ms":47.008000000000003 }, - "tg128":{ - "tok_s":25.433668999999998, - "stddev":0.53600499999999995 + "img:pp":{ + "tok_s":66.211364501625781 + }, + "img:tg":{ + "tok_s":26.538236984148597, + "text":"Two tabby cats are lying on a pink surface, with one cat on the left and the other on the right." } }, + "workload":"image-chat", "source":"official", - "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", - "files":[ - { + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":183 + }, + "img:pp":{ + "tok_s":61.095100864553316 + }, + "img:tg":{ + "tok_s":21.036024191427821 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":12.656000000000001 + }, + "img:pp":{ + "tok_s":66.518620096810182 + }, + "img:tg":{ + "tok_s":26.745476671257972, + "text":"Two tabby cats are lying on a pink surface, with one cat on the left and one on the right." + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":196 + }, + "img:pp":{ + "tok_s":60.516099566110981 + }, + "img:tg":{ + "tok_s":18.234657245427091 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] } ], - "arch":"qwen35", + "arch":"gemma4uv", "quant":"q8", - "params_b":26.895998464000002, - "active_b":23.84986112, - "size_bytes":18973870432 + "params_b":11.907350576000001, + "active_b":11.906580480000001, + "size_bytes":7381382944 }, { - "gguf":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "gguf":"gemma-4-E4B-it-Q8_0.gguf", "runs":[ { "engine":"das", @@ -1431,8 +1698,8 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1446,29 +1713,30 @@ }, "tests":{ "pp512":{ - "tok_s":3201.3003848974017, - "stddev":5.6111979484558105 + "tok_s":5303.174039443662, + "stddev":19.52574348449707 }, "tg128":{ - "tok_s":127.311408165347, - "stddev":0.40768790245056152 + "tok_s":90.100203074466052, + "stddev":0.069310650229454041 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", - "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", - "bytes":22663387424 + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 } ] }, @@ -1478,8 +1746,8 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -1493,12 +1761,12 @@ }, "tests":{ "pp512":{ - "tok_s":3183.6708789999998, - "stddev":19.433194 + "tok_s":4338.5063479999999, + "stddev":21.033147 }, "tg128":{ - "tok_s":95.600543000000002, - "stddev":0.52021399999999995 + "tok_s":81.212394000000003, + "stddev":0.18665499999999999 } }, "source":"official", @@ -1507,17 +1775,6830 @@ "files":[ { "role":"weights", - "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", - "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", - "bytes":22663387424 + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 } ] - } - ], - "arch":"qwen35moe", - "quant":"q8", - "params_b":35.505251456000003, - "active_b":2.8626124800000001, - "size_bytes":22663387424 + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":38.494 + }, + "img:pp":{ + "tok_s":3450.2587694077056 + }, + "img:tg":{ + "tok_s":88.112034451805471, + "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":194.16679749428474, + "stddev":7.7699780464172363 + }, + "tg128":{ + "tok_s":53.53051305896588, + "stddev":0.35575971007347107 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":137.888566, + "stddev":1.390531 + }, + "tg128":{ + "tok_s":38.570664999999998, + "stddev":0.44691700000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":199.11424037782649, + "stddev":7.9429254531860352 + }, + "tg128":{ + "tok_s":53.452705191704084, + "stddev":0.16458022594451904 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":197.969393, + "stddev":2.0859160000000001 + }, + "tg128":{ + "tok_s":38.383338999999999, + "stddev":0.36993700000000002 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":68 + }, + "img:pp":{ + "tok_s":1533.2690453230475 + }, + "img:tg":{ + "tok_s":74.557315936626281 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":437.154 + }, + "img:pp":{ + "tok_s":215.11900493670538 + }, + "img:tg":{ + "tok_s":52.402147177980616, + "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":13566 + }, + "img:pp":{ + "tok_s":185.35789228258352 + }, + "img:tg":{ + "tok_s":36.052275799909872 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":481.916 + }, + "img:pp":{ + "tok_s":220.67404604448845 + }, + "img:tg":{ + "tok_s":52.579777488954136, + "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":13544 + }, + "img:pp":{ + "tok_s":172.05930094145648 + }, + "img:tg":{ + "tok_s":38.540286643381911 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + } + ], + "arch":"gemma4v", + "quant":"q8", + "params_b":7.5180692899999997, + "active_b":4.5888307199999998, + "size_bytes":8031242688 + }, + { + "gguf":"gpt-oss-20b-mxfp4.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3995.0863487375218, + "stddev":12.267148971557617 + }, + "tg128":{ + "tok_s":162.71038660356945, + "stddev":0.08905307948589325 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3476.5869210000001, + "stddev":10.988268 + }, + "tg128":{ + "tok_s":148.974492, + "stddev":1.0746880000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":192.31173263635884, + "stddev":4.6414732933044434 + }, + "tg128":{ + "tok_s":67.333461682215813, + "stddev":0.18527121841907501 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":116.08498299999999, + "stddev":2.007914 + }, + "tg128":{ + "tok_s":61.880426, + "stddev":0.32918399999999998 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":208.6934986643252, + "stddev":3.3410212993621826 + }, + "tg128":{ + "tok_s":67.4999621091535, + "stddev":0.20230530202388763 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":115.143388, + "stddev":1.820659 + }, + "tg128":{ + "tok_s":62.010905999999999, + "stddev":0.102575 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 + } + ] + } + ], + "arch":"gpt-oss", + "quant":"q8", + "params_b":20.914757183999999, + "active_b":4.1862758400000004, + "size_bytes":12109566560 + }, + { + "gguf":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":1163.7076712350488, + "stddev":1.7116338014602661 + }, + "tg128":{ + "tok_s":38.282019019075705, + "stddev":0.062324531376361847 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":990.93720900000005, + "stddev":0.50080800000000003 + }, + "tg128":{ + "tok_s":36.567248999999997, + "stddev":1.0317350000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":30.703344970653472, + "stddev":0.090231791138648987 + }, + "tg128":{ + "tok_s":14.40670651563874, + "stddev":0.23729783296585083 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":29.691369999999999, + "stddev":0.19892499999999999 + }, + "tg128":{ + "tok_s":10.019841, + "stddev":0.0096570000000000007 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":31.183978511807652, + "stddev":0.23365247249603271 + }, + "tg128":{ + "tok_s":14.623987603331802, + "stddev":0.34035509824752808 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":29.629745, + "stddev":0.183921 + }, + "tg128":{ + "tok_s":10.018668, + "stddev":0.015122999999999999 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + } + ], + "arch":"llama", + "quant":"q8", + "params_b":23.5724032, + "active_b":23.571988480000002, + "size_bytes":14333910592 + }, + { + "gguf":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3868.4198142873938, + "stddev":16.014259338378906 + }, + "tg128":{ + "tok_s":118.10740587520641, + "stddev":5.1168985366821289 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3476.3057269999999, + "stddev":17.166998 + }, + "tg128":{ + "tok_s":99.504733999999999, + "stddev":0.25623099999999999 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":204.66464442081215, + "stddev":2.2271018028259277 + }, + "tg128":{ + "tok_s":56.295989893220131, + "stddev":0.64074355363845825 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":121.94652499999999, + "stddev":2.1746210000000001 + }, + "tg128":{ + "tok_s":46.571576999999998, + "stddev":0.50411799999999996 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":215.26013442737548, + "stddev":3.4267158508300781 + }, + "tg128":{ + "tok_s":56.175344815312918, + "stddev":0.32794713973999023 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":118.780635, + "stddev":2.2828900000000001 + }, + "tg128":{ + "tok_s":45.717309999999998, + "stddev":0.32566200000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + } + ], + "arch":"gemma4", + "quant":"q8", + "params_b":25.233142046000001, + "active_b":3.2865648639999998, + "size_bytes":16947541728 + }, + { + "gguf":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":903.96579393769446, + "stddev":11.548336982727051 + }, + "tg128":{ + "tok_s":27.354472188144605, + "stddev":0.32067328691482544 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":739.04172000000005, + "stddev":0.21932099999999999 + }, + "tg128":{ + "tok_s":27.355868999999998, + "stddev":0.78283499999999995 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":27.133710667765286, + "stddev":0.096862562000751495 + }, + "tg128":{ + "tok_s":11.2224724820445, + "stddev":0.20752125978469849 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":24.825526, + "stddev":0.091939999999999994 + }, + "tg128":{ + "tok_s":8.0158430000000003, + "stddev":0.0077320000000000002 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":27.555078336651963, + "stddev":0.19137175381183624 + }, + "tg128":{ + "tok_s":11.21845621581156, + "stddev":0.13397875428199768 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":24.906431000000001, + "stddev":0.098793000000000006 + }, + "tg128":{ + "tok_s":8.0361039999999999, + "stddev":0.0080549999999999997 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + } + ], + "arch":"qwen35", + "quant":"q8", + "params_b":27.320697855999999, + "active_b":23.84986112, + "size_bytes":17106773120 + }, + { + "gguf":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3752.852130141313, + "stddev":18.3709716796875 + }, + "tg128":{ + "tok_s":165.710207762376, + "stddev":0.26651418209075928 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3422.407815, + "stddev":13.920318999999999 + }, + "tg128":{ + "tok_s":137.013116, + "stddev":0.53181900000000004 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":211.46727853027505, + "stddev":1.4345347881317139 + }, + "tg128":{ + "tok_s":83.851186093189384, + "stddev":0.50246566534042358 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":132.42653999999999, + "stddev":2.9284650000000001 + }, + "tg128":{ + "tok_s":66.830782999999997, + "stddev":0.74842500000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":223.29478650085298, + "stddev":1.6116943359375 + }, + "tg128":{ + "tok_s":85.222070270588702, + "stddev":1.4714652299880981 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":132.261968, + "stddev":2.3802629999999998 + }, + "tg128":{ + "tok_s":66.229983000000004, + "stddev":0.23175899999999999 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + } + ], + "arch":"qwen3moe", + "quant":"q8", + "params_b":30.532122623999999, + "active_b":3.3528217599999999, + "size_bytes":18556686752 + }, + { + "gguf":"Qwen3.8-27B-Q4_K_M.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":913.87787110893373, + "stddev":10.144181251525879 + }, + "tg128":{ + "tok_s":27.837882924443051, + "stddev":0.22432254254817963 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":752.12047700000005, + "stddev":0.68127599999999999 + }, + "tg128":{ + "tok_s":25.360036000000001, + "stddev":0.56916199999999995 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":30.874932436495232, + "stddev":0.091422267258167267 + }, + "tg128":{ + "tok_s":11.594469009746922, + "stddev":0.10863354057073593 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":27.745199, + "stddev":0.14399400000000001 + }, + "tg128":{ + "tok_s":9.6123250000000002, + "stddev":0.019518000000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":31.316112223124588, + "stddev":0.21900658309459686 + }, + "tg128":{ + "tok_s":11.624427733359934, + "stddev":0.11489127576351166 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":27.619783999999999, + "stddev":0.14457100000000001 + }, + "tg128":{ + "tok_s":9.601915, + "stddev":0.0094240000000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + } + ], + "arch":"qwen35", + "quant":"q8", + "params_b":26.895998464000002, + "active_b":23.84986112, + "size_bytes":18973870432 + }, + { + "gguf":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3417.9313900026973, + "stddev":7.5922303199768066 + }, + "tg128":{ + "tok_s":127.08095638626337, + "stddev":0.34214609861373901 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3183.6694309999998, + "stddev":18.630693000000001 + }, + "tg128":{ + "tok_s":95.593917000000005, + "stddev":0.51324599999999998 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":245.67426193467696, + "stddev":1.5736089944839478 + }, + "tg128":{ + "tok_s":59.45895060962151, + "stddev":0.1826636791229248 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":153.45827, + "stddev":2.5598679999999998 + }, + "tg128":{ + "tok_s":49.663220000000003, + "stddev":0.287603 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":261.949666310331, + "stddev":1.8196882009506226 + }, + "tg128":{ + "tok_s":59.451622478787542, + "stddev":0.6035768985748291 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":155.070379, + "stddev":2.7505120000000001 + }, + "tg128":{ + "tok_s":49.314608999999997, + "stddev":0.35692000000000002 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + } + ], + "arch":"qwen35moe", + "quant":"q8", + "params_b":35.505251456000003, + "active_b":2.8626124800000001, + "size_bytes":22663387424 + }, + { + "gguf":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":146.80199999999999, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":456.37299999999999, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4372.0659999999998, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7318.1199999999999, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":25779.294000000002, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":148.95500000000001, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":454.815, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4336.6459999999997, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7238.0379999999996, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":25523.428, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/parakeet-cli -m ../whisper.cpp/models/ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -ng", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":160.37 + }, + "asr:jfk3.wav":{ + "ms":476.83000000000004 + }, + "asr:gb1.wav":{ + "ms":5468.0200000000004 + }, + "asr:hp0.wav":{ + "ms":9247.1200000000008 + }, + "asr:hp0x2.wav":{ + "ms":31106.959999999999 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", + "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", + "bytes":658909748 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":341.28500000000003, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":733.25099999999998, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":5044.2799999999997, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":7746.7969999999996, + "audio_s":273.28699999999998 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + } + ] + } + ], + "arch":"Parakeet-TDT v2", + "size_bytes":2471664028 + }, + { + "gguf":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":156.066, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":488.05399999999997, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4508.3599999999997, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7450.7749999999996, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":25803.580000000002, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." + }, + "asr:librispeech25":{ + "ms":3507.5410000000002, + "audio_s":215.91506250000006 + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":156.566, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":473.95699999999999, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4379.6679999999997, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7325.3249999999998, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":25813.549999999999, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." + }, + "asr:librispeech25":{ + "ms":3473.3289999999997, + "audio_s":215.91506250000006 + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/parakeet-cli -m ../whisper.cpp/models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -t 6 -ng modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":163.73999999999995 + }, + "asr:jfk3.wav":{ + "ms":490.97000000000003 + }, + "asr:gb1.wav":{ + "ms":5488.3099999999995 + }, + "asr:hp0.wav":{ + "ms":9341.2799999999988 + }, + "asr:hp0x2.wav":{ + "ms":31341.75 + }, + "asr:librispeech25":{ + "ms":3636.5900000000001 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", + "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", + "bytes":668757119 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":347.24700000000001, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":734.53499999999997, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":5025.799, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":7770.2340000000004, + "audio_s":273.28699999999998 + }, + "asr:librispeech25":{ + "ms":6875.7159999999994, + "audio_s":215.91500000000005 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + } + ], + "arch":"Parakeet-TDT v3", + "size_bytes":2508463079 + }, + { + "gguf":"ggml-tiny.bin", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":64.829999999999998, + "audio_s":11, + "encode_ms":44.901000000000003, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":144.654, + "audio_s":33, + "encode_ms":89.942999999999998, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":705.41499999999996, + "audio_s":198.734375, + "encode_ms":364.47399999999999, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":915.20500000000004, + "audio_s":273.28724999999997, + "encode_ms":512.48500000000001, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":1862.3230000000001, + "audio_s":546.57449999999994, + "encode_ms":1052.23, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":63.965000000000003, + "audio_s":11, + "encode_ms":44.777000000000001, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":142.483, + "audio_s":33, + "encode_ms":89.864999999999995, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":694.24099999999999, + "audio_s":198.734375, + "encode_ms":359.411, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":882.49400000000003, + "audio_s":273.28724999999997, + "encode_ms":502.34199999999998, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":1803.672, + "audio_s":546.57449999999994, + "encode_ms":1035.5329999999999, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":38.155000000000001, + "audio_s":11, + "encode_ms":18.172999999999998, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":85.828000000000003, + "audio_s":33, + "encode_ms":34.006, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":465.02699999999999, + "audio_s":198.734375, + "encode_ms":173.75899999999999, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our Space Shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. our no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McHool, Dr. Kultner Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly. knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. in the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens, who created all these, he who brings out the story hosts one by one, and calls them each by name, because of his great power and mighty strength, not one of them is missing. The same creator who names the stars, also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families. and make out what may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":559.66700000000003, + "audio_s":273.28724999999997, + "encode_ms":189.321, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia, at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents, 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the positive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-Wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A US registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":1132.8199999999999, + "audio_s":546.57449999999994, + "encode_ms":427.30000000000001, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia, at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents, 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the positive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-Wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A US registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple mild slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In the info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -bs 1 -bo 1 -nf -ng", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":73.63000000000001 + }, + "asr:jfk3.wav":{ + "ms":174.89999999999998 + }, + "asr:gb1.wav":{ + "ms":891.55000000000007 + }, + "asr:hp0.wav":{ + "ms":1237.3499999999999 + }, + "asr:hp0x2.wav":{ + "ms":2467.3600000000001 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -bs 1 -bo 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":45.450000000000003 + }, + "asr:jfk3.wav":{ + "ms":90.420000000000002 + }, + "asr:gb1.wav":{ + "ms":506.19999999999999 + }, + "asr:hp0.wav":{ + "ms":582.32999999999993 + }, + "asr:hp0x2.wav":{ + "ms":1159.47 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":284.61500000000001, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + } + ] + } + ], + "arch":"Whisper tiny", + "size_bytes":77691713 + }, + { + "gguf":"ggml-large-v3-turbo.bin", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1800.991, + "audio_s":11, + "encode_ms":1739.1610000000001, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":3776.6260000000002, + "audio_s":33, + "encode_ms":3583.2869999999998, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":16202.16, + "audio_s":198.734375, + "encode_ms":14732.120000000001, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." + }, + "asr:hp0.wav":{ + "ms":23945.755000000001, + "audio_s":273.28724999999997, + "encode_ms":22221.735000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + }, + "asr:hp0x2.wav":{ + "ms":46396.821000000004, + "audio_s":546.57449999999994, + "encode_ms":42966.232000000004, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1786.702, + "audio_s":11, + "encode_ms":1719.971, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":3747.1410000000001, + "audio_s":33, + "encode_ms":3562.0059999999999, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":16040.489, + "audio_s":198.734375, + "encode_ms":14674.227000000001, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." + }, + "asr:hp0.wav":{ + "ms":23787.959999999999, + "audio_s":273.28724999999997, + "encode_ms":22094.458999999999, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + }, + "asr:hp0x2.wav":{ + "ms":46194.288999999997, + "audio_s":546.57449999999994, + "encode_ms":42629.678, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":139.619, + "audio_s":11, + "encode_ms":100.297, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":312.37, + "audio_s":33, + "encode_ms":199.87100000000001, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":1469.9100000000001, + "audio_s":198.734375, + "encode_ms":799.71400000000006, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." + }, + "asr:hp0.wav":{ + "ms":1994.0809999999999, + "audio_s":273.28724999999997, + "encode_ms":1210.9110000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + }, + "asr:hp0x2.wav":{ + "ms":3856.6889999999999, + "audio_s":546.57449999999994, + "encode_ms":2302.0590000000002, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward, to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -bs 1 -bo 1 -nf -ng", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":2099.0099999999998 + }, + "asr:jfk3.wav":{ + "ms":4347.2600000000002 + }, + "asr:gb1.wav":{ + "ms":22231.329999999998 + }, + "asr:hp0.wav":{ + "ms":28286.689999999999 + }, + "asr:hp0x2.wav":{ + "ms":61249.5 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -bs 1 -bo 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":153.00000000000003 + }, + "asr:jfk3.wav":{ + "ms":324.18000000000001 + }, + "asr:gb1.wav":{ + "ms":1852.29 + }, + "asr:hp0.wav":{ + "ms":2699.04 + }, + "asr:hp0x2.wav":{ + "ms":5178.1599999999999 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1864.722, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + } + ] + } + ], + "arch":"Whisper large-v3-turbo", + "size_bytes":1624555275 + }, + { + "gguf":"canary-qwen-2.5b-decoder-q8_0.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":307.61900000000003, + "audio_s":11, + "encode_ms":206.45699999999999, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":889.78700000000003, + "audio_s":33, + "encode_ms":552.92899999999997, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":6484.2790000000005, + "audio_s":198.734375, + "encode_ms":5832.9409999999998, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"nemo", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":2469.598, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":6092.9560000000001, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":20080.164000000001, + "audio_s":199 + } + }, + "workload":"asr", + "source":"official", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", + "exec_fmt":"bf16", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"nemo", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --device mps --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":704.654, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":1795.721, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":4383.4219999999996, + "audio_s":199 + } + }, + "workload":"asr", + "source":"official", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", + "exec_fmt":"bf16", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":707.33299999999997, + "audio_s":11, + "encode_ms":284.23899999999998, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":2163.7109999999998, + "audio_s":33, + "encode_ms":895.18299999999999, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":14250.135, + "audio_s":198.734375, + "encode_ms":8003.7449999999999, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":693.39599999999996, + "audio_s":11, + "encode_ms":314.98099999999999, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":2158.46, + "audio_s":33, + "encode_ms":906.07899999999995, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":13924.602000000001, + "audio_s":198.734375, + "encode_ms":7789.9780000000001, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + } + ], + "arch":"Canary-Qwen 2.5B", + "size_bytes":1834425984 + }, + { + "gguf":"Qwen3-ASR-0.6B-Q8_0.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":103.706, + "audio_s":11, + "encode_ms":21.617000000000001, + "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":277.91500000000002, + "audio_s":33, + "encode_ms":58.143999999999998, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":1931.6890000000001, + "audio_s":198.734375, + "encode_ms":322.76400000000001, + "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":2680.482, + "audio_s":273.28724999999997, + "encode_ms":448.30500000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape, in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flat head. Phillips cross head. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." + }, + "asr:hp0x2.wav":{ + "ms":7193.04, + "audio_s":546.57449999999994, + "encode_ms":903.39599999999996, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" + } + }, + "workload":"audio-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"llama-mtmd-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-ASR-0.6B-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 6", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":2587, + "encode_ms":2445, + "text":"0.00.001.879 I common_init_result: fitting params to device memory ... 0.00.001.884 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.096.648 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 131072 MiB of total host memory 0.00.154.379 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.765.049 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.825.981 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.886.461 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.886.493 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.886.666 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.886.666 W For normal use cases, please use the standard llama-cli 0.00.894.447 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.02.439.657 I mtmd batch encoding done in 1545 ms 0.02.514.107 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.03.278.507 I mtmd batch encoding done in 764 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 26 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:jfk3.wav":{ + "ms":7309.5, + "encode_ms":6876.6999999999998, + "text":"0.00.001.848 I common_init_result: fitting params to device memory ... 0.00.001.849 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.093.653 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 131072 MiB of total host memory 0.00.151.034 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.762.322 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.827.655 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.888.689 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.888.723 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.888.886 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.888.886 W For normal use cases, please use the standard llama-cli 0.00.902.961 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.02.443.465 I mtmd batch encoding done in 1540 ms 0.02.517.845 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.04.025.592 I mtmd batch encoding done in 1507 ms 0.04.107.871 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.05.611.727 I mtmd batch encoding done in 1504 ms 0.05.704.032 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.07.223.052 I mtmd batch encoding done in 1519 ms 0.07.327.381 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.07.717.362 I mtmd batch encoding done in 390 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:gb1.wav":{ + "ms":47657.300000000003, + "encode_ms":42413, + "text":"0.00.001.816 I common_init_result: fitting params to device memory ... 0.00.001.820 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.092.344 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 131072 MiB of total host memory 0.00.149.539 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.761.449 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.823.042 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.884.462 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.884.496 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.884.653 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.884.653 W For normal use cases, please use the standard llama-cli 0.00.947.453 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.02.480.295 I mtmd batch encoding done in 1533 ms 0.02.553.903 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.04.080.836 I mtmd batch encoding done in 1527 ms 0.04.163.446 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.05.661.742 I mtmd batch encoding done in 1498 ms 0.05.753.829 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.07.281.957 I mtmd batch encoding done in 1529 ms 0.07.384.792 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.08.894.594 I mtmd batch encoding done in 1510 ms 0.09.008.415 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.10.507.266 I mtmd batch encoding done in 1499 ms 0.10.631.156 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.12.139.037 I mtmd batch encoding done in 1508 ms 0.12.272.766 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 0.13.776.787 I mtmd batch encoding done in 1504 ms 0.13.921.887 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 0.15.439.596 I mtmd batch encoding done in 1517 ms 0.15.594.882 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 0.17.102.069 I mtmd batch encoding done in 1507 ms 0.17.268.265 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 0.18.789.043 I mtmd batch encoding done in 1521 ms 0.18.963.225 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 0.20.458.679 I mtmd batch encoding done in 1495 ms 0.20.645.307 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 0.22.146.825 I mtmd batch encoding done in 1501 ms 0.22.344.075 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 0.23.841.183 I mtmd batch encoding done in 1497 ms 0.24.048.602 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 0.25.551.303 I mtmd batch encoding done in 1503 ms 0.25.767.808 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 0.27.265.663 I mtmd batch encoding done in 1498 ms 0.27.495.709 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 0.29.010.461 I mtmd batch encoding done in 1515 ms 0.29.249.238 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 0.30.748.033 I mtmd batch encoding done in 1499 ms 0.30.994.484 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 0.32.488.521 I mtmd batch encoding done in 1494 ms 0.32.745.138 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 0.34.241.663 I mtmd batch encoding done in 1496 ms 0.34.509.005 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 0.36.002.545 I mtmd batch encoding done in 1493 ms 0.36.282.905 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 0.37.777.469 I mtmd batch encoding done in 1494 ms 0.38.065.473 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 0.39.575.437 I mtmd batch encoding done in 1510 ms 0.39.874.617 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 0.41.369.725 I mtmd batch encoding done in 1495 ms 0.41.683.351 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 0.42.984.927 I mtmd batch encoding done in 1302 ms language EnglishMy fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country. The cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space. Will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see. There is comfort and hope. In the words of the prophet Isaiah. Lift your eyes, and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength. Not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless. America.DASLLAMA_IDS: 11528 6364 151704 5050 12357 8877 13 1096 1899 702 7117 17478 3669 13 758 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 8954 2524 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 13 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 730 12840 2210 1417 402 4260 11 323 68539 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 13 1597 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 13 1597 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 13 4940 279 8521 315 1493 2953 323 3198 11 879 614 1012 2661 419 10968 10755 304 37284 13 1446 525 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 13 4940 419 3146 13 576 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 13 30786 1039 1879 11 553 279 19760 315 18335 13 1597 279 78322 311 3535 13 5633 11618 1119 3550 13 4841 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 13 2619 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 13 52435 697 6414 11 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 13 1597 6738 1105 1817 553 829 13 9211 315 806 2244 2355 13 1597 41627 8170 13 2806 825 315 1105 374 7402 13 576 1852 19919 879 5036 279 9759 13 7281 8788 279 5036 13 4940 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 13 14568 537 470 21000 311 9237 13 14626 582 646 23803 13 2938 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 13 1597 1231 4264 3060 311 16072 13 5159 13 151645" + } + }, + "workload":"audio-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", + "files":[ + { + "role":"weights", + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"llama-mtmd-cli", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-metal/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-ASR-0.6B-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 99 -t 6", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":133.30000000000001, + "encode_ms":47.100000000000001, + "text":"0.00.024.750 I common_init_result: fitting params to device memory ... 0.00.024.752 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.174.596 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.519.198 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.552.269 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.629.520 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.629.554 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.629.694 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.629.695 W For normal use cases, please use the standard llama-cli 0.00.634.390 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.00.655.170 I mtmd batch encoding done in 21 ms 0.00.656.249 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.00.667.229 I mtmd batch encoding done in 11 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 26 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:jfk3.wav":{ + "ms":317.60000000000002, + "encode_ms":90.5, + "text":"0.00.026.445 I common_init_result: fitting params to device memory ... 0.00.026.448 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.183.820 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.529.422 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.562.622 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.639.804 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.639.839 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.639.993 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.639.994 W For normal use cases, please use the standard llama-cli 0.00.650.904 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.00.670.751 I mtmd batch encoding done in 19 ms 0.00.671.826 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.00.684.069 I mtmd batch encoding done in 13 ms 0.00.684.537 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.00.696.933 I mtmd batch encoding done in 13 ms 0.00.697.754 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.00.710.165 I mtmd batch encoding done in 13 ms 0.00.710.621 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.00.721.676 I mtmd batch encoding done in 11 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:gb1.wav":{ + "ms":1836.5999999999999, + "encode_ms":462.60000000000002, + "text":"0.00.029.473 I common_init_result: fitting params to device memory ... 0.00.029.476 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.186.406 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.538.135 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.573.222 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.651.963 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.651.996 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.652.147 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.652.148 W For normal use cases, please use the standard llama-cli 0.00.710.376 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.00.731.108 I mtmd batch encoding done in 21 ms 0.00.732.192 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.00.744.410 I mtmd batch encoding done in 12 ms 0.00.744.889 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.00.757.285 I mtmd batch encoding done in 12 ms 0.00.758.146 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.00.770.597 I mtmd batch encoding done in 12 ms 0.00.771.062 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.00.783.860 I mtmd batch encoding done in 13 ms 0.00.784.686 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.00.797.741 I mtmd batch encoding done in 13 ms 0.00.798.198 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.00.811.519 I mtmd batch encoding done in 13 ms 0.00.811.955 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 0.00.825.534 I mtmd batch encoding done in 13 ms 0.00.826.394 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 0.00.840.189 I mtmd batch encoding done in 14 ms 0.00.840.638 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 0.00.854.710 I mtmd batch encoding done in 14 ms 0.00.855.523 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 0.00.869.852 I mtmd batch encoding done in 15 ms 0.00.870.295 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 0.00.884.880 I mtmd batch encoding done in 15 ms 0.00.885.324 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 0.00.900.128 I mtmd batch encoding done in 15 ms 0.00.900.960 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 0.00.916.007 I mtmd batch encoding done in 15 ms 0.00.916.455 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 0.00.931.701 I mtmd batch encoding done in 15 ms 0.00.932.511 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 0.00.948.087 I mtmd batch encoding done in 16 ms 0.00.948.560 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 0.00.964.344 I mtmd batch encoding done in 16 ms 0.00.964.872 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 0.00.981.056 I mtmd batch encoding done in 16 ms 0.00.981.948 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 0.00.998.417 I mtmd batch encoding done in 16 ms 0.00.998.865 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 0.01.015.499 I mtmd batch encoding done in 16 ms 0.01.016.336 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 0.01.033.276 I mtmd batch encoding done in 17 ms 0.01.033.745 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 0.01.050.891 I mtmd batch encoding done in 17 ms 0.01.051.339 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 0.01.068.707 I mtmd batch encoding done in 17 ms 0.01.069.537 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 0.01.087.246 I mtmd batch encoding done in 18 ms 0.01.087.728 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 0.01.105.350 I mtmd batch encoding done in 18 ms language EnglishMy fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes, and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America.DASLLAMA_IDS: 11528 6364 151704 5050 12357 8877 13 1096 1899 702 7117 17478 3669 13 758 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 8954 2524 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 13 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 730 12840 2210 1417 402 4260 11 323 68539 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 13 1597 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 13 1597 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 13 4940 279 8521 315 1493 2953 323 3198 11 879 614 1012 2661 419 10968 10755 304 37284 13 1446 525 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 13 4940 419 3146 11 279 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 13 30786 1039 1879 11 553 279 19760 315 18335 13 1597 279 78322 311 3535 13 5633 11618 1119 3550 686 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 11 1052 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 13 52435 697 6414 11 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 13 1597 6738 1105 1817 553 829 13 9211 315 806 2244 2355 13 1597 41627 8170 11 537 825 315 1105 374 7402 13 576 1852 19919 879 5036 279 9759 13 7281 8788 279 5036 13 4940 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 13 14568 537 470 21000 311 9237 13 14626 582 646 23803 13 2938 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 13 1597 1231 4264 3060 311 16072 5159 13 151645" + } + }, + "workload":"audio-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", + "files":[ + { + "role":"weights", + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":606.52999999999997, + "audio_s":11, + "encode_ms":411.565, + "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":1735.617, + "audio_s":33, + "encode_ms":1084.2539999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":13149.772000000001, + "audio_s":198.734375, + "encode_ms":6590.6130000000003, + "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":20105.417000000001, + "audio_s":273.28724999999997, + "encode_ms":9199.9110000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design, lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward, to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption: Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spannerhead. Triple Square, XZN. Others, Polydrive, Splinedrive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." + }, + "asr:hp0x2.wav":{ + "ms":52954.673000000003, + "audio_s":546.57449999999994, + "encode_ms":18164.330000000002, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" + } + }, + "workload":"audio-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":434.44900000000001, + "audio_s":11, + "encode_ms":279.5, + "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":1288.857, + "audio_s":33, + "encode_ms":649.18299999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":10537.040000000001, + "audio_s":198.734375, + "encode_ms":3951.0230000000001, + "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":16368.851000000001, + "audio_s":273.28724999999997, + "encode_ms":5735.5129999999999, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape, in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flat head. Phillips cross head. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." + }, + "asr:hp0x2.wav":{ + "ms":46298.241999999998, + "audio_s":546.57449999999994, + "encode_ms":11072.567999999999, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" + } + }, + "workload":"audio-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + } + ], + "arch":"Qwen3-ASR-0.6B", + "size_bytes":804749248 + }, + { + "gguf":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":400.86399999999998, + "audio_s":11, + "encode_ms":37.389000000000003, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":482.91500000000002, + "audio_s":33, + "encode_ms":99.210999999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":6059.6040000000003, + "audio_s":198.734375, + "encode_ms":545.86900000000003, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":8061.1549999999997, + "audio_s":273.28724999999997, + "encode_ms":799.89300000000003, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U.S. patent number two million forty six thousand, three hundred forty three, U.S. patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered five hundred one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at www dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":21517.165000000001, + "audio_s":546.57449999999994, + "encode_ms":1624.9670000000001, + "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips. From Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + } + }, + "workload":"audio-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"llama-mtmd-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 6", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":9293.7999999999993, + "encode_ms":9233.1000000000004, + "text":"0.00.002.177 I common_init_result: fitting params to device memory ... 0.00.002.181 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.097.158 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 131072 MiB of total host memory 0.00.155.606 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.17.100.982 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.17.156.791 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.17.158.621 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.17.158.626 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.17.158.626 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.17.500.835 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.17.500.874 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.17.501.015 W WARN: This is an experimental CLI for testing multimodal capability. 0.17.501.016 W For normal use cases, please use the standard llama-cli 0.17.549.415 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.23.001.102 I mtmd batch encoding done in 5451 ms 0.23.556.025 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.26.296.175 I mtmd batch encoding done in 2740 ms <|im_start|> <|im_start|>DASLLAMA_IDS: 151644 198 151644 151645" + }, + "asr:jfk3.wav":{ + "ms":25946.799999999999, + "encode_ms":25924.900000000001, + "text":"0.00.002.127 I common_init_result: fitting params to device memory ... 0.00.002.131 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.095.702 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 131072 MiB of total host memory 0.00.153.114 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.16.720.520 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.16.776.839 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.16.778.590 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.16.778.592 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.16.778.592 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.17.113.261 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.17.113.303 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.17.113.453 W WARN: This is an experimental CLI for testing multimodal capability. 0.17.113.454 W For normal use cases, please use the standard llama-cli 0.17.165.152 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.22.618.341 I mtmd batch encoding done in 5453 ms 0.23.167.627 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.28.606.348 I mtmd batch encoding done in 5439 ms 0.29.185.104 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.34.623.609 I mtmd batch encoding done in 5438 ms 0.35.225.181 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.40.669.638 I mtmd batch encoding done in 5444 ms 0.41.302.978 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.42.678.531 I mtmd batch encoding done in 1375 ms <|im_start|>DASLLAMA_IDS: 151644 151645" + }, + "asr:gb1.wav":{ + "ms":158997.20000000001, + "encode_ms":158932.70000000001, + "text":"0.00.001.723 I common_init_result: fitting params to device memory ... 0.00.001.724 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.096.143 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 131072 MiB of total host memory 0.00.153.735 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.16.660.036 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.16.715.344 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.16.717.140 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.16.717.141 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.16.717.141 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.17.048.534 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.17.048.577 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.17.048.727 W WARN: This is an experimental CLI for testing multimodal capability. 0.17.048.728 W For normal use cases, please use the standard llama-cli 0.17.148.391 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.22.604.076 I mtmd batch encoding done in 5455 ms 0.23.153.764 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.28.594.654 I mtmd batch encoding done in 5441 ms 0.29.177.458 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.34.617.346 I mtmd batch encoding done in 5440 ms 0.35.223.830 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.40.666.086 I mtmd batch encoding done in 5442 ms 0.41.303.240 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.46.743.320 I mtmd batch encoding done in 5440 ms 0.47.415.426 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.52.857.297 I mtmd batch encoding done in 5442 ms 0.53.548.516 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.58.979.845 I mtmd batch encoding done in 5431 ms 0.59.705.884 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 1.05.139.481 I mtmd batch encoding done in 5434 ms 1.05.901.851 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 1.11.335.223 I mtmd batch encoding done in 5433 ms 1.12.148.858 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 1.17.588.603 I mtmd batch encoding done in 5440 ms 1.18.419.304 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 1.23.850.356 I mtmd batch encoding done in 5431 ms 1.24.706.847 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 1.30.141.584 I mtmd batch encoding done in 5435 ms 1.31.039.464 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 1.36.473.950 I mtmd batch encoding done in 5434 ms 1.37.409.484 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 1.42.847.070 I mtmd batch encoding done in 5437 ms 1.43.810.380 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 1.49.242.840 I mtmd batch encoding done in 5432 ms 1.50.241.960 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 1.55.675.210 I mtmd batch encoding done in 5433 ms 1.56.712.691 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 2.02.146.630 I mtmd batch encoding done in 5434 ms 2.03.228.709 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 2.08.661.578 I mtmd batch encoding done in 5433 ms 2.09.763.324 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 2.15.199.211 I mtmd batch encoding done in 5435 ms 2.16.321.763 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 2.21.757.439 I mtmd batch encoding done in 5436 ms 2.22.925.363 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 2.28.363.755 I mtmd batch encoding done in 5438 ms 2.29.578.729 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 2.35.031.688 I mtmd batch encoding done in 5453 ms 2.36.277.589 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 2.41.711.800 I mtmd batch encoding done in 5434 ms 2.42.988.648 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 2.48.425.831 I mtmd batch encoding done in 5437 ms 2.49.735.495 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 2.54.478.050 I mtmd batch encoding done in 4742 ms <|im_start|>:DASLLAMA_IDS: 151644 25 151645" + } + }, + "workload":"audio-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", + "files":[ + { + "role":"weights", + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"llama-mtmd-cli", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-metal/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 99 -t 6", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":532.79999999999995, + "encode_ms":203.09999999999999, + "text":"0.00.023.416 I common_init_result: fitting params to device memory ... 0.00.023.419 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.189.423 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.366.540 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.402.075 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.404.030 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.01.404.031 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.01.404.031 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.01.814.542 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.814.583 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.01.814.741 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.814.741 W For normal use cases, please use the standard llama-cli 0.01.822.379 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.01.859.240 I mtmd batch encoding done in 37 ms 0.01.861.717 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.01.945.770 I mtmd batch encoding done in 84 ms <|im_start|>assistant And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.DASLLAMA_IDS: 151644 77091 198 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:jfk3.wav":{ + "ms":562.20000000000005, + "encode_ms":492.19999999999999, + "text":"0.00.023.330 I common_init_result: fitting params to device memory ... 0.00.023.333 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.188.759 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.363.376 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.398.905 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.400.755 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.01.400.756 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.01.400.757 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.01.815.385 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.815.427 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.01.815.581 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.815.582 W For normal use cases, please use the standard llama-cli 0.01.829.394 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.01.868.398 I mtmd batch encoding done in 39 ms 0.01.870.696 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.01.956.515 I mtmd batch encoding done in 86 ms 0.01.957.678 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.02.044.762 I mtmd batch encoding done in 87 ms 0.02.046.807 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.02.134.009 I mtmd batch encoding done in 87 ms 0.02.135.080 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.02.219.079 I mtmd batch encoding done in 84 ms <|im_start|>DASLLAMA_IDS: 151644 151645" + }, + "asr:gb1.wav":{ + "ms":7062.1000000000004, + "encode_ms":2526.5, + "text":"0.00.023.552 I common_init_result: fitting params to device memory ... 0.00.023.556 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.192.660 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.369.737 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.405.481 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.407.439 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.01.407.441 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.01.407.441 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.01.828.249 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.828.290 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.01.828.459 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.828.460 W For normal use cases, please use the standard llama-cli 0.01.889.989 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.01.926.777 I mtmd batch encoding done in 37 ms 0.01.929.288 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.02.016.035 I mtmd batch encoding done in 86 ms 0.02.017.127 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.02.104.522 I mtmd batch encoding done in 88 ms 0.02.106.547 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.02.194.890 I mtmd batch encoding done in 88 ms 0.02.196.139 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.02.285.852 I mtmd batch encoding done in 90 ms 0.02.287.926 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.02.373.318 I mtmd batch encoding done in 86 ms 0.02.374.405 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.02.460.619 I mtmd batch encoding done in 86 ms 0.02.461.672 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 0.02.555.146 I mtmd batch encoding done in 93 ms 0.02.557.189 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 0.02.650.980 I mtmd batch encoding done in 94 ms 0.02.652.020 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 0.02.745.074 I mtmd batch encoding done in 93 ms 0.02.747.060 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 0.02.842.578 I mtmd batch encoding done in 96 ms 0.02.843.609 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 0.02.938.422 I mtmd batch encoding done in 95 ms 0.02.939.457 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 0.03.035.982 I mtmd batch encoding done in 96 ms 0.03.037.942 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 0.03.135.943 I mtmd batch encoding done in 98 ms 0.03.136.994 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 0.03.233.392 I mtmd batch encoding done in 97 ms 0.03.235.495 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 0.03.334.089 I mtmd batch encoding done in 98 ms 0.03.335.152 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 0.03.434.043 I mtmd batch encoding done in 99 ms 0.03.435.088 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 0.03.534.640 I mtmd batch encoding done in 100 ms 0.03.536.636 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 0.03.637.634 I mtmd batch encoding done in 101 ms 0.03.638.672 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 0.03.738.590 I mtmd batch encoding done in 100 ms 0.03.740.567 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 0.03.843.096 I mtmd batch encoding done in 102 ms 0.03.844.166 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 0.03.946.995 I mtmd batch encoding done in 103 ms 0.03.948.073 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 0.04.052.665 I mtmd batch encoding done in 105 ms 0.04.054.709 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 0.04.160.863 I mtmd batch encoding done in 106 ms 0.04.162.003 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 0.04.267.833 I mtmd batch encoding done in 106 ms <|im_start|>: My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America.DASLLAMA_IDS: 151644 25 3017 12357 8877 11 419 1899 702 7117 17478 3669 323 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 23220 7779 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 25 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 26832 848 64 910 672 4260 11 323 7543 276 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 323 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 11 323 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 315 279 8521 315 1493 2953 323 3198 879 614 1012 2661 419 10968 10755 323 37284 13 1446 2299 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 315 419 3146 13 576 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 7797 1039 1879 553 279 19760 315 18335 323 279 78322 311 3535 13 5633 11618 1119 3550 686 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 11 1052 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 11 330 43 2085 697 6414 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 323 6738 1105 1817 553 829 13 9211 315 806 2244 2355 323 41627 8170 11 537 825 315 1105 374 7402 1189 576 1852 35678 879 5036 279 9759 1083 8788 279 5036 315 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 1521 537 470 21000 311 9237 13 14626 582 646 23803 429 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 11 323 1231 4264 3060 311 16072 5159 13 151645" + } + }, + "workload":"audio-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", + "files":[ + { + "role":"weights", + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1613.298, + "audio_s":11, + "encode_ms":539.08199999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":3867.069, + "audio_s":33, + "encode_ms":1454.5329999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":39523.110000000001, + "audio_s":198.734375, + "encode_ms":8382.3619999999992, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":57844.894999999997, + "audio_s":273.28724999999997, + "encode_ms":11260.309999999999, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U.S. patent number two million forty six thousand, three hundred forty three, U.S. patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered five hundred one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":154362.98499999999, + "audio_s":546.57449999999994, + "encode_ms":22696.587, + "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + } + }, + "workload":"audio-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1482.549, + "audio_s":11, + "encode_ms":373.14299999999997, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":3284.0320000000002, + "audio_s":33, + "encode_ms":948.82799999999997, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":34666.864999999998, + "audio_s":198.734375, + "encode_ms":5720.2619999999997, + "text":"my fellow americans this day has brought terrible news and great sadness to our country at nine o'clock this morning mission control in houston lost contact with our space shuttle columbia a short time later debris was seen falling from the skies above texas the columbia is lost there are no survivors on board was a crew of seven colonel rick husband lieutenant colonel michael anderson commander laura clark captain david brown commander william mccool doctor kalpana chawla and ilan ramon a colonel in the israeli air force these men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth these astronauts knew the dangers and they faced them willingly knowing they had a high and noble purpose in life because of their courage and daring and idealism we will miss them all the more all americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief you're not alone our entire nation grieves with you and those you loved will always have the respect and gratitude of this country the cause in which they died will continue mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand our journey into space will go on in the skies today we saw destruction and tragedy yet farther than we can see there is comfort and hope in the words of the prophet isaiah lift your eyes and look to the heavens who created all these he who brings out the starry hosts one by one and calls them each by name because of his great power and mighty strength not one of them is missing the same creator who names the stars also knows the names of the seven souls we mourn today the crew of the shuttle columbia did not return safely to earth yet we can pray that all are safely home may god bless the grieving families and may god may god continue to bless america" + }, + "asr:hp0.wav":{ + "ms":53760.669999999998, + "audio_s":273.28724999999997, + "encode_ms":7769.3149999999996, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at www dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":146966.53700000001, + "audio_s":546.57449999999994, + "encode_ms":15417.325000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + } + }, + "workload":"audio-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + } + ], + "arch":"Qwen3-Omni-30B audio", + "size_bytes":32484494336 + }, + { + "gguf":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":66.233999999999995 + }, + "img:pp":{ + "tok_s":3718.4078349713395 + }, + "img:tg":{ + "tok_s":112.79255569132437, + "text":"assistant\nTwo tabby cats are sleeping on a pink blanket with remote controls nearby." + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower qwen3v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":63 + }, + "img:pp":{ + "tok_s":463.27683615819211 + }, + "img:tg":{ + "tok_s":81.300813008130078 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":1088.5599999999999 + }, + "img:pp":{ + "tok_s":250.56570025403508 + }, + "img:tg":{ + "tok_s":56.564818568344442, + "text":"assistant\nTwo tabby cats are sleeping on a pink blanket with remote controls nearby." + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower qwen3v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":1014 + }, + "img:pp":{ + "tok_s":30.834022711889904 + }, + "img:tg":{ + "tok_s":43.402777777777771 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":884.07100000000003 + }, + "img:pp":{ + "tok_s":246.67257668860663 + }, + "img:tg":{ + "tok_s":56.592561850954056, + "text":"assistant\nTwo tabby cats are sleeping on a pink blanket with remote controls nearby." + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower qwen3v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":1934 + }, + "img:pp":{ + "tok_s":28.264166551771684 + }, + "img:tg":{ + "tok_s":46.6618808327351 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + } + ], + "arch":"qwen3v", + "size_bytes":4280406144 + }, + { + "gguf":"Qwen2.5-Omni-3B-Q8_0.gguf", + "runs":[ + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":105.991 + }, + "img:pp":{ + "tok_s":6718.1945667416758 + }, + "img:tg":{ + "tok_s":136.54758062513966, + "text":"Two cats laying on a pink blanket with remotes." + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":118 + }, + "img:pp":{ + "tok_s":829.08163265306121 + }, + "img:tg":{ + "tok_s":81.967213114754088 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":9003.7549999999992 + }, + "img:pp":{ + "tok_s":308.13898264773655 + }, + "img:tg":{ + "tok_s":75.039736951613008, + "text":"Two cats laying on a pink blanket with remotes." + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":2609 + }, + "img:pp":{ + "tok_s":48.435171385991055 + }, + "img:tg":{ + "tok_s":56.451612903225808 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":1534.6610000000001 + }, + "img:pp":{ + "tok_s":301.59530741126548 + }, + "img:tg":{ + "tok_s":75.715859030837009, + "text":"Two cats laying on a pink blanket with remotes." + } + }, + "workload":"image-chat", + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":4286 + }, + "img:pp":{ + "tok_s":44.12163996741787 + }, + "img:tg":{ + "tok_s":63.348416289592762 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + } + ], + "arch":"qwen25v", + "size_bytes":3616087360 } ] \ No newline at end of file diff --git a/modules/dasLLAMA/performance/records/m5.tune.144fd7914ced.json b/modules/dasLLAMA/performance/records/m5.tune.144fd7914ced.json new file mode 100644 index 0000000000..f70bad0b6e --- /dev/null +++ b/modules/dasLLAMA/performance/records/m5.tune.144fd7914ced.json @@ -0,0 +1,2648 @@ +{ + "kernels" : { + "add_inplace" : "vec8_u2", + "cvt_f32_to_f16" : "vec16", + "rope_scaled_neox_tab" : "vec8_u2", + "q51q8_tile_gen" : "mr4", + "softmax" : "vec8_u2", + "mul_inplace" : "vec8_u2", + "quantize_q8_0_bs_into_ptr" : "plain", + "dot_q8kv" : "vec4_u2", + "dot_q8q8" : "vec16", + "quantize_q8kv_row" : "plain", + "axpy_f16" : "vec8_u2", + "q40q8_tile_gen" : "mr8", + "axpy_tq4kv" : "vec8_u2", + "cvt_tq4kv_to_f32" : "vec8_u2", + "axpy" : "vec8_u2", + "dot_q8q8kv" : "vec16", + "dot_mx4q8" : "u2", + "softmax_sink" : "vec8_u2", + "dot_q8q8_laneq4x4" : "u2", + "dot_bf16" : "vec8_u2", + "add_scale_inplace" : "vec8_u2", + "cvt_q8kv_to_f32" : "vec8_u2", + "axpy_q8kv" : "vec8_u2", + "dot_q8q8_f16s" : "vec16", + "q8q8_tile_gen" : "mr8_budget", + "quantize_q8_0_into_ptr" : "plain", + "k4q8_tile_gen" : "mr8", + "k5q8_tile_gen" : "mr8", + "k6q8_tile_gen" : "mr4", + "gemm_f32_uk_4x16" : "u2", + "dot_q51e" : "vec16", + "dot_f16" : "vec8_u2", + "cvt_f16_to_f32" : "vec8_u2", + "dot" : "vec8_u2", + "dot_q8tq4kv" : "vec16", + "scale_inplace" : "plain", + "dot_q4" : "vec4_u4", + "quantize_tq4kv_row" : "plain", + "copy_floats" : "vec8_u2", + "rmsnorm" : "vec8" + }, + "provenance" : { + "validation" : "ok", + "noise_probes" : "start cv 0.31%; mid1 cv 0.10%; mid2 cv 0.57%; end cv 0.09%", + "platform" : "darwin", + "noise_floor_cv_pct" : "0.57", + "engine_sha" : "fa67fe165", + "box" : "darwin|arm64|Mac17,6|25G72|Apple M5 Max", + "written" : "2026-08-31T00:44:42.729Z", + "validation_demoted" : "0", + "mode" : "normal", + "dasllama_version" : "15", + "noise" : "ok", + "binary" : "/Users/borisbatkin/Work/daScript/./bin/daslang", + "arch" : "arm64", + "validation_max_drift_pct" : "0.34" + }, + "race" : { + "cvt_q8kv_to_f32" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 376.28125, + "best_us" : 376.03125 + }, + "vec32" : { + "med_us" : 375.21875, + "best_us" : 374.46875 + }, + "vec32_u4" : { + "med_us" : 376.78125, + "best_us" : 376.5625 + }, + "vec32_u8" : { + "med_us" : 376.40625, + "best_us" : 376.25 + }, + "vec16_u2" : { + "med_us" : 376.15625, + "best_us" : 375.9375 + }, + "vec16_u4" : { + "med_us" : 376.4375, + "best_us" : 375.9375 + }, + "vec16_u8" : { + "med_us" : 376.5, + "best_us" : 375.9375 + }, + "vec4" : { + "med_us" : 375.75, + "best_us" : 375.0625 + }, + "vec8" : { + "med_us" : 375.0625, + "best_us" : 375 + }, + "vec4_u4" : { + "med_us" : 376.65625, + "best_us" : 375.875 + }, + "vec8_u4" : { + "med_us" : 375.6875, + "best_us" : 375.5 + }, + "plain" : { + "med_us" : 375.25, + "best_us" : 374.75 + }, + "u2" : { + "med_us" : 376.4375, + "best_us" : 376.15625 + }, + "u4" : { + "med_us" : 376.28125, + "best_us" : 376.09375 + }, + "u8" : { + "med_us" : 376.09375, + "best_us" : 376.03125 + }, + "vec4_u2" : { + "med_us" : 376.71875, + "best_us" : 376.5 + }, + "vec4_u8" : { + "med_us" : 376.125, + "best_us" : 376.0625 + }, + "vec8_u2" : { + "med_us" : 375.90625, + "best_us" : 375.3125 + }, + "vec8_u8" : { + "med_us" : 376, + "best_us" : 375.4375 + }, + "vec16" : { + "med_us" : 375.21875, + "best_us" : 375 + } + } + }, + "add_inplace" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 336.03125, + "best_us" : 335.40625 + }, + "vec32" : { + "med_us" : 360.375, + "best_us" : 359.46875 + }, + "vec32_u4" : { + "med_us" : 336.03125, + "best_us" : 335.65625 + }, + "vec32_u8" : { + "med_us" : 334.5625, + "best_us" : 333.875 + }, + "vec16_u2" : { + "med_us" : 339.09375, + "best_us" : 338.5 + }, + "vec16_u4" : { + "med_us" : 339.625, + "best_us" : 337.09375 + }, + "vec16_u8" : { + "med_us" : 411.71875, + "best_us" : 409.40625 + }, + "vec4" : { + "med_us" : 361.90625, + "best_us" : 361.5625 + }, + "vec8" : { + "med_us" : 361.78125, + "best_us" : 360.34375 + }, + "vec4_u4" : { + "med_us" : 337.8125, + "best_us" : 336.78125 + }, + "vec8_u4" : { + "med_us" : 335.46875, + "best_us" : 334.625 + }, + "plain" : { + "med_us" : 362.5625, + "best_us" : 361.03125 + }, + "u2" : { + "med_us" : 361.375, + "best_us" : 359.59375 + }, + "u4" : { + "med_us" : 337, + "best_us" : 336.6875 + }, + "u8" : { + "med_us" : 336.9375, + "best_us" : 335.34375 + }, + "vec4_u2" : { + "med_us" : 361.15625, + "best_us" : 359.96875 + }, + "vec4_u8" : { + "med_us" : 336.5625, + "best_us" : 335.84375 + }, + "vec8_u2" : { + "med_us" : 337.40625, + "best_us" : 335.875 + }, + "vec8_u8" : { + "med_us" : 335.9375, + "best_us" : 334.71875 + }, + "vec16" : { + "med_us" : 339.34375, + "best_us" : 338.125 + } + } + }, + "axpy_q8kv" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 395.40625, + "best_us" : 395.375 + }, + "vec32" : { + "med_us" : 393.5, + "best_us" : 393.4375 + }, + "vec32_u4" : { + "med_us" : 395.53125, + "best_us" : 395.21875 + }, + "vec32_u8" : { + "med_us" : 396, + "best_us" : 395.875 + }, + "vec16_u2" : { + "med_us" : 394.75, + "best_us" : 394.75 + }, + "vec16_u4" : { + "med_us" : 394.875, + "best_us" : 394.84375 + }, + "vec16_u8" : { + "med_us" : 395.4375, + "best_us" : 395.40625 + }, + "vec4" : { + "med_us" : 396.625, + "best_us" : 396.09375 + }, + "vec8" : { + "med_us" : 396.71875, + "best_us" : 396.625 + }, + "vec4_u4" : { + "med_us" : 393.46875, + "best_us" : 393.40625 + }, + "vec8_u4" : { + "med_us" : 395.78125, + "best_us" : 395.59375 + }, + "plain" : { + "med_us" : 393.375, + "best_us" : 393.375 + }, + "u2" : { + "med_us" : 395.0625, + "best_us" : 394.875 + }, + "u4" : { + "med_us" : 394.90625, + "best_us" : 394.875 + }, + "u8" : { + "med_us" : 395.375, + "best_us" : 394.875 + }, + "vec4_u2" : { + "med_us" : 393.59375, + "best_us" : 393.4375 + }, + "vec4_u8" : { + "med_us" : 393.4375, + "best_us" : 392.84375 + }, + "vec8_u2" : { + "med_us" : 396.96875, + "best_us" : 396.96875 + }, + "vec8_u8" : { + "med_us" : 396.03125, + "best_us" : 395.875 + }, + "vec16" : { + "med_us" : 393.5625, + "best_us" : 393.40625 + } + } + }, + "cvt_f32_to_f16" : { + "winner" : "vec16", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 6.4042840350037, + "rows" : { + "vec32_u2" : { + "med_us" : 347.25, + "best_us" : 347.125 + }, + "vec32" : { + "med_us" : 347.28125, + "best_us" : 347.15625 + }, + "vec32_u4" : { + "med_us" : 347.21875, + "best_us" : 347 + }, + "vec32_u8" : { + "med_us" : 347.15625, + "best_us" : 346.9375 + }, + "vec16_u2" : { + "med_us" : 336.234375, + "best_us" : 335.71875 + }, + "vec16_u4" : { + "med_us" : 335.4375, + "best_us" : 335.0625 + }, + "vec16_u8" : { + "med_us" : 335.875, + "best_us" : 335.78125 + }, + "vec4" : { + "med_us" : 363.6875, + "best_us" : 363.15625 + }, + "vec8" : { + "med_us" : 358.8125, + "best_us" : 358.75 + }, + "vec4_u4" : { + "med_us" : 363, + "best_us" : 362.78125 + }, + "vec8_u4" : { + "med_us" : 358.5625, + "best_us" : 358.3125 + }, + "plain" : { + "med_us" : 358.84375, + "best_us" : 358.6875 + }, + "u2" : { + "med_us" : 359, + "best_us" : 358.8125 + }, + "u4" : { + "med_us" : 358.65625, + "best_us" : 358.53125 + }, + "u8" : { + "med_us" : 358.5625, + "best_us" : 358.40625 + }, + "vec4_u2" : { + "med_us" : 365.125, + "best_us" : 364.25 + }, + "vec4_u8" : { + "med_us" : 362.53125, + "best_us" : 362.3125 + }, + "vec8_u2" : { + "med_us" : 358.890625, + "best_us" : 358.4375 + }, + "vec8_u8" : { + "med_us" : 358.46875, + "best_us" : 358.34375 + }, + "vec16" : { + "med_us" : 335.90625, + "best_us" : 335.71875 + } + } + }, + "rope_scaled_neox_tab" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.5725343634106776, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 684.7931034482758, + "best_us" : 684 + }, + "vec32" : { + "med_us" : 640.741935483871, + "best_us" : 637.7741935483871 + }, + "vec32_u4" : { + "med_us" : 639.3548387096774, + "best_us" : 638.516129032258 + }, + "vec32_u8" : { + "med_us" : 639.8709677419355, + "best_us" : 639.0322580645161 + }, + "vec16_u2" : { + "med_us" : 383.875, + "best_us" : 373.03125 + }, + "vec16_u4" : { + "med_us" : 375.71875, + "best_us" : 375.4375 + }, + "vec16_u8" : { + "med_us" : 379.5, + "best_us" : 376.75 + }, + "vec4" : { + "med_us" : 397.21875, + "best_us" : 396.46875 + }, + "vec8" : { + "med_us" : 370.15625, + "best_us" : 366.8125 + }, + "vec4_u4" : { + "med_us" : 372.1875, + "best_us" : 368.96875 + }, + "vec8_u4" : { + "med_us" : 370.90625, + "best_us" : 367.0625 + }, + "plain" : { + "med_us" : 396.875, + "best_us" : 395.875 + }, + "u2" : { + "med_us" : 380.4375, + "best_us" : 380 + }, + "u4" : { + "med_us" : 371.78125, + "best_us" : 369.3125 + }, + "u8" : { + "med_us" : 416.84375, + "best_us" : 416.5 + }, + "vec4_u2" : { + "med_us" : 383.34375, + "best_us" : 381.59375 + }, + "vec4_u8" : { + "med_us" : 421.6875, + "best_us" : 420.96875 + }, + "vec8_u2" : { + "med_us" : 373.375, + "best_us" : 369.53125 + }, + "vec8_u8" : { + "med_us" : 404.1875, + "best_us" : 403.375 + }, + "vec16" : { + "med_us" : 369.125, + "best_us" : 365.71875 + } + } + }, + "q51q8_tile_gen" : { + "winner" : "mr4", + "rows" : { + "mr8" : { + "streamed_us" : 579 + }, + "dot_maddubs_width256_mr8" : { + "streamed_us" : 3967 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "streamed_us" : 3929 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "streamed_us" : 3954 + }, + "mr4" : { + "streamed_us" : 594 + }, + "reference" : { + "streamed_us" : 3788 + }, + "mr4_nrsplit2" : { + "streamed_us" : 604 + }, + "dot_vpdpbusd_width256_mr8" : { + "streamed_us" : 3957 + }, + "dot_vpdpbusd_width512_mr16" : { + "streamed_us" : 3919 + }, + "mr8_nrsplit2" : { + "streamed_us" : 605 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "streamed_us" : 3974 + } + } + }, + "softmax" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 3174, + "best_us" : 3172.5 + }, + "vec32" : { + "med_us" : 3172.5, + "best_us" : 3169.5 + }, + "vec32_u4" : { + "med_us" : 3165.6666666666665, + "best_us" : 3164.5 + }, + "vec32_u8" : { + "med_us" : 3168.1666666666665, + "best_us" : 3168 + }, + "vec16_u2" : { + "med_us" : 3181.5, + "best_us" : 3178.6666666666665 + }, + "vec16_u4" : { + "med_us" : 3184.5, + "best_us" : 3181.3333333333335 + }, + "vec16_u8" : { + "med_us" : 4046, + "best_us" : 4037 + }, + "vec4" : { + "med_us" : 3173.6666666666665, + "best_us" : 3169.5 + }, + "vec8" : { + "med_us" : 3172.5, + "best_us" : 3167.5 + }, + "vec4_u4" : { + "med_us" : 3185, + "best_us" : 3174.6666666666665 + }, + "vec8_u4" : { + "med_us" : 3168, + "best_us" : 3166.1666666666665 + }, + "plain" : { + "med_us" : 3172, + "best_us" : 3170.1666666666665 + }, + "u2" : { + "med_us" : 3171.5, + "best_us" : 3168.1666666666665 + }, + "u4" : { + "med_us" : 3168, + "best_us" : 3166 + }, + "u8" : { + "med_us" : 3170, + "best_us" : 3165.3333333333335 + }, + "vec4_u2" : { + "med_us" : 3166.6666666666665, + "best_us" : 3166 + }, + "vec4_u8" : { + "med_us" : 3167.8333333333335, + "best_us" : 3165.3333333333335 + }, + "vec8_u2" : { + "med_us" : 3171.8333333333335, + "best_us" : 3168.6666666666665 + }, + "vec8_u8" : { + "med_us" : 3166.6666666666665, + "best_us" : 3164.6666666666665 + }, + "vec16" : { + "med_us" : 3190.3333333333335, + "best_us" : 3185.3333333333335 + } + } + }, + "q8q8_tile_gen" : { + "winner" : "mr8_budget", + "rows" : { + "kstep1" : { + "tile_us" : 22820, + "gemv_us" : 198, + "hot_us" : 10.125 + }, + "kstep2_nrsplit2" : { + "tile_us" : 24089, + "gemv_us" : 202, + "hot_us" : 10.4375 + }, + "kstep1_nrsplit2" : { + "tile_us" : 24354, + "gemv_us" : 203, + "hot_us" : 10.5 + }, + "reference" : { + "tile_us" : 33404, + "gemv_us" : 203, + "hot_us" : 10.5625 + }, + "kstep4_nrsplit2" : { + "tile_us" : 24306, + "gemv_us" : 202, + "hot_us" : 10.375 + }, + "kstep4_nrsplit2_mr8_gkstep2" : { + "tile_us" : 24070, + "gemv_us" : 199, + "hot_us" : 9.875 + }, + "kstep1_nrsplit2_mr8" : { + "tile_us" : 23204, + "gemv_us" : 200, + "hot_us" : 9.8125 + }, + "kstep2_nrsplit2_mr8" : { + "tile_us" : 22803, + "gemv_us" : 198, + "hot_us" : 9.9375 + }, + "kstep4_nrsplit2_mr8" : { + "tile_us" : 24057, + "gemv_us" : 197, + "hot_us" : 9.8125 + }, + "kstep2_gkstep2" : { + "tile_us" : 23304, + "gemv_us" : 201, + "hot_us" : 9.875 + }, + "kstep2_gkstep4" : { + "tile_us" : 23297, + "gemv_us" : 203, + "hot_us" : 9.5625 + }, + "kstep4_nrsplit2_mr8_gkstep4" : { + "tile_us" : 24042, + "gemv_us" : 196, + "hot_us" : 9.375 + }, + "mr8_budget" : { + "tile_us" : 22151, + "gemv_us" : 197, + "hot_us" : 9.5 + }, + "kstep2" : { + "tile_us" : 23274, + "gemv_us" : 202, + "hot_us" : 10.375 + }, + "kstep4" : { + "tile_us" : 24757, + "gemv_us" : 200, + "hot_us" : 10.4375 + } + } + }, + "mul_inplace" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 338.6875, + "best_us" : 336.90625 + }, + "vec32" : { + "med_us" : 360.5625, + "best_us" : 360.3125 + }, + "vec32_u4" : { + "med_us" : 335.375, + "best_us" : 335.15625 + }, + "vec32_u8" : { + "med_us" : 336.125, + "best_us" : 334.59375 + }, + "vec16_u2" : { + "med_us" : 361.34375, + "best_us" : 360.71875 + }, + "vec16_u4" : { + "med_us" : 337.46875, + "best_us" : 336.625 + }, + "vec16_u8" : { + "med_us" : 337, + "best_us" : 336.375 + }, + "vec4" : { + "med_us" : 362.1875, + "best_us" : 360.28125 + }, + "vec8" : { + "med_us" : 361, + "best_us" : 359.21875 + }, + "vec4_u4" : { + "med_us" : 337.96875, + "best_us" : 337.84375 + }, + "vec8_u4" : { + "med_us" : 336.34375, + "best_us" : 336.1875 + }, + "plain" : { + "med_us" : 362.03125, + "best_us" : 361.75 + }, + "u2" : { + "med_us" : 361.375, + "best_us" : 361.09375 + }, + "u4" : { + "med_us" : 338.125, + "best_us" : 337.90625 + }, + "u8" : { + "med_us" : 337.71875, + "best_us" : 336.59375 + }, + "vec4_u2" : { + "med_us" : 361.8125, + "best_us" : 359.46875 + }, + "vec4_u8" : { + "med_us" : 337.28125, + "best_us" : 336.4375 + }, + "vec8_u2" : { + "med_us" : 336.84375, + "best_us" : 336.65625 + }, + "vec8_u8" : { + "med_us" : 336.15625, + "best_us" : 335.53125 + }, + "vec16" : { + "med_us" : 362.15625, + "best_us" : 360.8125 + } + } + }, + "k4q8_tile_gen" : { + "winner" : "mr8", + "rows" : { + "mr8" : { + "tile_us" : 27962, + "gemv_us" : 169, + "hot_us" : 10.8125 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 467124, + "gemv_us" : 1851, + "hot_us" : 114.9375 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 466864, + "gemv_us" : 1794, + "hot_us" : 114.8125 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 466926, + "gemv_us" : 1845, + "hot_us" : 114.9375 + }, + "mr4" : { + "tile_us" : 30535, + "gemv_us" : 190, + "hot_us" : 11.625 + }, + "reference" : { + "tile_us" : 467207, + "gemv_us" : 1761, + "hot_us" : 114.5 + }, + "mr4_nrsplit2" : { + "tile_us" : 36835, + "gemv_us" : 195, + "hot_us" : 11.875 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 467381, + "gemv_us" : 1843, + "hot_us" : 112.125 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 467146, + "gemv_us" : 1834, + "hot_us" : 114.9375 + }, + "mr8_nrsplit2" : { + "tile_us" : 33446, + "gemv_us" : 179, + "hot_us" : 11.0625 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 466599, + "gemv_us" : 1844, + "hot_us" : 114.875 + } + } + }, + "k5q8_tile_gen" : { + "winner" : "mr8", + "rows" : { + "mr8" : { + "tile_us" : 27280, + "gemv_us" : 435, + "hot_us" : 26.6875 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 223435, + "gemv_us" : 2210, + "hot_us" : 133.375 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 223950, + "gemv_us" : 2228, + "hot_us" : 138.0625 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 223541, + "gemv_us" : 2210, + "hot_us" : 135.9375 + }, + "mr4" : { + "tile_us" : 28106, + "gemv_us" : 435, + "hot_us" : 27.0625 + }, + "reference" : { + "tile_us" : 223162, + "gemv_us" : 2221, + "hot_us" : 136.0625 + }, + "mr4_nrsplit2" : { + "tile_us" : 32652, + "gemv_us" : 419, + "hot_us" : 25.5 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 223926, + "gemv_us" : 2249, + "hot_us" : 131.25 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 223490, + "gemv_us" : 2220, + "hot_us" : 137.8125 + }, + "mr8_nrsplit2" : { + "tile_us" : 29731, + "gemv_us" : 419, + "hot_us" : 26.375 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 223723, + "gemv_us" : 2187, + "hot_us" : 134.875 + } + } + }, + "k6q8_tile_gen" : { + "winner" : "mr4", + "rows" : { + "mr8" : { + "tile_us" : 43123, + "gemv_us" : 337, + "hot_us" : 20.8125 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 199253, + "gemv_us" : 5645, + "hot_us" : 340.1875 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 199122, + "gemv_us" : 5561, + "hot_us" : 338.0625 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 199333, + "gemv_us" : 5659, + "hot_us" : 337.0625 + }, + "mr4" : { + "tile_us" : 37006, + "gemv_us" : 347, + "hot_us" : 21.5 + }, + "reference" : { + "tile_us" : 199439, + "gemv_us" : 5631, + "hot_us" : 348.3125 + }, + "mr4_nrsplit2" : { + "tile_us" : 38444, + "gemv_us" : 347, + "hot_us" : 21.5625 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 199452, + "gemv_us" : 5918, + "hot_us" : 342 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 199331, + "gemv_us" : 5508, + "hot_us" : 347.4375 + }, + "mr8_nrsplit2" : { + "tile_us" : 42625, + "gemv_us" : 341, + "hot_us" : 21.875 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 199106, + "gemv_us" : 5616, + "hot_us" : 342.8125 + } + } + }, + "quantize_q8_0_into_ptr" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 0.5725343634106776, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 2444.5, + "best_us" : 2443.5 + }, + "vec32" : { + "med_us" : 2410.75, + "best_us" : 2407.5 + }, + "vec32_u4" : { + "med_us" : 2449, + "best_us" : 2443.75 + }, + "vec32_u8" : { + "med_us" : 2447.875, + "best_us" : 2445.125 + }, + "vec16_u2" : { + "med_us" : 2414.125, + "best_us" : 2412.875 + }, + "vec16_u4" : { + "med_us" : 2413.75, + "best_us" : 2411.625 + }, + "vec16_u8" : { + "med_us" : 2466.25, + "best_us" : 2464.875 + }, + "vec4" : { + "med_us" : 2409.375, + "best_us" : 2408.375 + }, + "vec8" : { + "med_us" : 2410.375, + "best_us" : 2408.5 + }, + "vec4_u4" : { + "med_us" : 3061.6666666666665, + "best_us" : 3060.3333333333335 + }, + "vec8_u4" : { + "med_us" : 2541.4285714285716, + "best_us" : 2539.285714285714 + }, + "plain" : { + "med_us" : 2409.625, + "best_us" : 2408.375 + }, + "u2" : { + "med_us" : 2414.5, + "best_us" : 2413.75 + }, + "u4" : { + "med_us" : 2413.875, + "best_us" : 2412.5 + }, + "u8" : { + "med_us" : 2416.75, + "best_us" : 2414.75 + }, + "vec4_u2" : { + "med_us" : 3072.3333333333335, + "best_us" : 3070.3333333333335 + }, + "vec4_u8" : { + "med_us" : 3073.1666666666665, + "best_us" : 3071.8333333333335 + }, + "vec8_u2" : { + "med_us" : 2592.4285714285716, + "best_us" : 2591.5714285714284 + }, + "vec8_u8" : { + "med_us" : 2540.714285714286, + "best_us" : 2539.1428571428573 + }, + "vec16" : { + "med_us" : 2409.5, + "best_us" : 2409 + } + } + }, + "dot_q8kv" : { + "winner" : "vec4_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 24.364549748819066, + "rows" : { + "vec32_u2" : { + "med_us" : 1291.5333333333333, + "best_us" : 1290.6 + }, + "vec32" : { + "med_us" : 1924.8, + "best_us" : 1922.3 + }, + "vec32_u4" : { + "med_us" : 1291.3333333333333, + "best_us" : 1290.2 + }, + "vec32_u8" : { + "med_us" : 1290.4666666666667, + "best_us" : 1289.7333333333333 + }, + "vec16_u2" : { + "med_us" : 875.2272727272727, + "best_us" : 874.9090909090909 + }, + "vec16_u4" : { + "med_us" : 875.1818181818181, + "best_us" : 874.9090909090909 + }, + "vec16_u8" : { + "med_us" : 875.0909090909091, + "best_us" : 874.5909090909091 + }, + "vec4" : { + "med_us" : 1923.8, + "best_us" : 1922.5 + }, + "vec8" : { + "med_us" : 1924.4, + "best_us" : 1923.4 + }, + "vec4_u4" : { + "med_us" : 504.3125, + "best_us" : 503.9375 + }, + "vec8_u4" : { + "med_us" : 666.9666666666667, + "best_us" : 666.9333333333333 + }, + "plain" : { + "med_us" : 1925.6, + "best_us" : 1922.9 + }, + "u2" : { + "med_us" : 1227.25, + "best_us" : 1225.3125 + }, + "u4" : { + "med_us" : 1227.875, + "best_us" : 1226.6875 + }, + "u8" : { + "med_us" : 1227.5, + "best_us" : 1227.0625 + }, + "vec4_u2" : { + "med_us" : 504.4375, + "best_us" : 503.6875 + }, + "vec4_u8" : { + "med_us" : 504.484375, + "best_us" : 503.96875 + }, + "vec8_u2" : { + "med_us" : 667.0166666666667, + "best_us" : 666.4666666666667 + }, + "vec8_u8" : { + "med_us" : 667.2666666666667, + "best_us" : 667.1333333333333 + }, + "vec16" : { + "med_us" : 1924.3, + "best_us" : 1922.8 + } + } + }, + "quantize_q8_0_bs_into_ptr" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 0.5725343634106776, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 2391.625, + "best_us" : 2380.125 + }, + "vec32" : { + "med_us" : 2050.222222222222, + "best_us" : 2047.5555555555557 + }, + "vec32_u4" : { + "med_us" : 2388.625, + "best_us" : 2378.25 + }, + "vec32_u8" : { + "med_us" : 2388.75, + "best_us" : 2385.75 + }, + "vec16_u2" : { + "med_us" : 2361.625, + "best_us" : 2350.25 + }, + "vec16_u4" : { + "med_us" : 2364, + "best_us" : 2358 + }, + "vec16_u8" : { + "med_us" : 2351.625, + "best_us" : 2342.25 + }, + "vec4" : { + "med_us" : 2050.4444444444443, + "best_us" : 2047 + }, + "vec8" : { + "med_us" : 2056.777777777778, + "best_us" : 2051.6666666666665 + }, + "vec4_u4" : { + "med_us" : 2524.8571428571427, + "best_us" : 2520.4285714285716 + }, + "vec8_u4" : { + "med_us" : 2176.8888888888887, + "best_us" : 2169.6666666666665 + }, + "plain" : { + "med_us" : 2047.2222222222222, + "best_us" : 2043.888888888889 + }, + "u2" : { + "med_us" : 2363, + "best_us" : 2354.625 + }, + "u4" : { + "med_us" : 2364.25, + "best_us" : 2350.5 + }, + "u8" : { + "med_us" : 2359.5, + "best_us" : 2344 + }, + "vec4_u2" : { + "med_us" : 2561.1428571428573, + "best_us" : 2550.8571428571427 + }, + "vec4_u8" : { + "med_us" : 2521.8571428571427, + "best_us" : 2516 + }, + "vec8_u2" : { + "med_us" : 2168, + "best_us" : 2160.6666666666665 + }, + "vec8_u8" : { + "med_us" : 2177.3333333333335, + "best_us" : 2170.5555555555557 + }, + "vec16" : { + "med_us" : 2051.3333333333335, + "best_us" : 2047.7777777777778 + } + } + }, + "dot_q8q8" : { + "winner" : "vec16", + "fallback" : "vec16", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 583.9375, + "best_us" : 583.5 + }, + "vec32" : { + "med_us" : 575.625, + "best_us" : 574.9375 + }, + "vec32_u4" : { + "med_us" : 584.875, + "best_us" : 584.1875 + }, + "vec32_u8" : { + "med_us" : 585.0625, + "best_us" : 583.75 + }, + "vec16_u2" : { + "med_us" : 581.34375, + "best_us" : 579.625 + }, + "vec16_u4" : { + "med_us" : 580.625, + "best_us" : 580.21875 + }, + "vec16_u8" : { + "med_us" : 589.46875, + "best_us" : 588.875 + }, + "vec4" : { + "med_us" : 576.4375, + "best_us" : 575.96875 + }, + "vec8" : { + "med_us" : 575.6875, + "best_us" : 574.6875 + }, + "vec4_u4" : { + "med_us" : 1943.6, + "best_us" : 1942.2 + }, + "vec8_u4" : { + "med_us" : 770.0769230769231, + "best_us" : 769.9230769230769 + }, + "plain" : { + "med_us" : 576.59375, + "best_us" : 576.09375 + }, + "u2" : { + "med_us" : 581.625, + "best_us" : 580.1875 + }, + "u4" : { + "med_us" : 580.4375, + "best_us" : 579.09375 + }, + "u8" : { + "med_us" : 581.03125, + "best_us" : 580.8125 + }, + "vec4_u2" : { + "med_us" : 1943.5, + "best_us" : 1943.4 + }, + "vec4_u8" : { + "med_us" : 1944.1, + "best_us" : 1943.8 + }, + "vec8_u2" : { + "med_us" : 747.8846153846154, + "best_us" : 747.5 + }, + "vec8_u8" : { + "med_us" : 747.4615384615385, + "best_us" : 747.1153846153846 + }, + "vec16" : { + "med_us" : 576.03125, + "best_us" : 575.21875 + } + } + }, + "gemm_f32_uk_4x16" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 0.5725343634106776, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 539.84375, + "best_us" : 539.5625 + }, + "vec32" : { + "med_us" : 595.3125, + "best_us" : 595.03125 + }, + "vec32_u4" : { + "med_us" : 550.5625, + "best_us" : 549.96875 + }, + "vec32_u8" : { + "med_us" : 547, + "best_us" : 546.15625 + }, + "vec16_u2" : { + "med_us" : 539.6875, + "best_us" : 539.4375 + }, + "vec16_u4" : { + "med_us" : 550.28125, + "best_us" : 549.71875 + }, + "vec16_u8" : { + "med_us" : 547.09375, + "best_us" : 546.84375 + }, + "vec4" : { + "med_us" : 595.28125, + "best_us" : 594.4375 + }, + "vec8" : { + "med_us" : 595.4375, + "best_us" : 595.09375 + }, + "vec4_u4" : { + "med_us" : 551.09375, + "best_us" : 550.53125 + }, + "vec8_u4" : { + "med_us" : 550.8125, + "best_us" : 550.59375 + }, + "plain" : { + "med_us" : 595.125, + "best_us" : 594.96875 + }, + "u2" : { + "med_us" : 540, + "best_us" : 539.84375 + }, + "u4" : { + "med_us" : 550.78125, + "best_us" : 550.40625 + }, + "u8" : { + "med_us" : 546.5, + "best_us" : 546.25 + }, + "vec4_u2" : { + "med_us" : 539.59375, + "best_us" : 539.21875 + }, + "vec4_u8" : { + "med_us" : 546.9375, + "best_us" : 546.5625 + }, + "vec8_u2" : { + "med_us" : 538.59375, + "best_us" : 538.34375 + }, + "vec8_u8" : { + "med_us" : 547.25, + "best_us" : 546.90625 + }, + "vec16" : { + "med_us" : 595.53125, + "best_us" : 595.40625 + } + } + }, + "quantize_q8kv_row" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1206.3125, + "best_us" : 1205.6875 + }, + "vec32" : { + "med_us" : 1176.5294117647059, + "best_us" : 1175.5882352941176 + }, + "vec32_u4" : { + "med_us" : 1204.0625, + "best_us" : 1203.5625 + }, + "vec32_u8" : { + "med_us" : 1203.6875, + "best_us" : 1203 + }, + "vec16_u2" : { + "med_us" : 1172.9411764705883, + "best_us" : 1171.7058823529412 + }, + "vec16_u4" : { + "med_us" : 1176.625, + "best_us" : 1175.75 + }, + "vec16_u8" : { + "med_us" : 1177.0625, + "best_us" : 1175.125 + }, + "vec4" : { + "med_us" : 1169.7058823529412, + "best_us" : 1168.9411764705883 + }, + "vec8" : { + "med_us" : 1169.764705882353, + "best_us" : 1169.4117647058824 + }, + "vec4_u4" : { + "med_us" : 1500.3846153846155, + "best_us" : 1500.076923076923 + }, + "vec8_u4" : { + "med_us" : 1236.1875, + "best_us" : 1234.9375 + }, + "plain" : { + "med_us" : 1181.5625, + "best_us" : 1180.5625 + }, + "u2" : { + "med_us" : 1177.1176470588234, + "best_us" : 1176.9411764705883 + }, + "u4" : { + "med_us" : 1177.0625, + "best_us" : 1176.125 + }, + "u8" : { + "med_us" : 1176.5625, + "best_us" : 1176.3125 + }, + "vec4_u2" : { + "med_us" : 1500.923076923077, + "best_us" : 1499.076923076923 + }, + "vec4_u8" : { + "med_us" : 1500.076923076923, + "best_us" : 1499.2307692307693 + }, + "vec8_u2" : { + "med_us" : 1232.5, + "best_us" : 1231.875 + }, + "vec8_u8" : { + "med_us" : 1232.1875, + "best_us" : 1231.875 + }, + "vec16" : { + "med_us" : 1176.764705882353, + "best_us" : 1176.1176470588234 + } + } + }, + "dot_f16" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 283.6875, + "best_us" : 283.28125 + }, + "vec32" : { + "med_us" : 284.96875, + "best_us" : 284.21875 + }, + "vec32_u4" : { + "med_us" : 283.78125, + "best_us" : 283.65625 + }, + "vec32_u8" : { + "med_us" : 285.375, + "best_us" : 284.96875 + }, + "vec16_u2" : { + "med_us" : 268.90625, + "best_us" : 268.4375 + }, + "vec16_u4" : { + "med_us" : 268.75, + "best_us" : 268.46875 + }, + "vec16_u8" : { + "med_us" : 269.9375, + "best_us" : 269.71875 + }, + "vec4" : { + "med_us" : 420.84375, + "best_us" : 419.40625 + }, + "vec8" : { + "med_us" : 257.25, + "best_us" : 256.96875 + }, + "vec4_u4" : { + "med_us" : 415.96875, + "best_us" : 414.9375 + }, + "vec8_u4" : { + "med_us" : 260.03125, + "best_us" : 258.71875 + }, + "plain" : { + "med_us" : 3924.8, + "best_us" : 3894.8 + }, + "u2" : { + "med_us" : 3917.5, + "best_us" : 3900.25 + }, + "u4" : { + "med_us" : 3970, + "best_us" : 3927.5 + }, + "u8" : { + "med_us" : 3941.8, + "best_us" : 3919 + }, + "vec4_u2" : { + "med_us" : 420.5, + "best_us" : 419.875 + }, + "vec4_u8" : { + "med_us" : 417, + "best_us" : 416.75 + }, + "vec8_u2" : { + "med_us" : 260.15625, + "best_us" : 259.90625 + }, + "vec8_u8" : { + "med_us" : 260.75, + "best_us" : 260.0625 + }, + "vec16" : { + "med_us" : 269.1875, + "best_us" : 268.1875 + } + } + }, + "axpy_f16" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 285.84375, + "best_us" : 285.28125 + }, + "vec32" : { + "med_us" : 300.5, + "best_us" : 296.21875 + }, + "vec32_u4" : { + "med_us" : 285.25, + "best_us" : 285.0625 + }, + "vec32_u8" : { + "med_us" : 285.28125, + "best_us" : 285.09375 + }, + "vec16_u2" : { + "med_us" : 301.34375, + "best_us" : 301.0625 + }, + "vec16_u4" : { + "med_us" : 288.21875, + "best_us" : 287.28125 + }, + "vec16_u8" : { + "med_us" : 288.1875, + "best_us" : 287.1875 + }, + "vec4" : { + "med_us" : 300.28125, + "best_us" : 299.875 + }, + "vec8" : { + "med_us" : 301.15625, + "best_us" : 300.5 + }, + "vec4_u4" : { + "med_us" : 288.15625, + "best_us" : 287.4375 + }, + "vec8_u4" : { + "med_us" : 284.71875, + "best_us" : 284.34375 + }, + "plain" : { + "med_us" : 302.28125, + "best_us" : 301.28125 + }, + "u2" : { + "med_us" : 285, + "best_us" : 284.875 + }, + "u4" : { + "med_us" : 284.75, + "best_us" : 284.375 + }, + "u8" : { + "med_us" : 284.5625, + "best_us" : 284.46875 + }, + "vec4_u2" : { + "med_us" : 303.28125, + "best_us" : 301.96875 + }, + "vec4_u8" : { + "med_us" : 287.9375, + "best_us" : 287.34375 + }, + "vec8_u2" : { + "med_us" : 285.25, + "best_us" : 284.8125 + }, + "vec8_u8" : { + "med_us" : 284.46875, + "best_us" : 284.03125 + }, + "vec16" : { + "med_us" : 296.09375, + "best_us" : 295.9375 + } + } + }, + "cvt_f16_to_f32" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 250.75, + "best_us" : 249.25 + }, + "vec32" : { + "med_us" : 251.125, + "best_us" : 250.1875 + }, + "vec32_u4" : { + "med_us" : 252.9375, + "best_us" : 249.46875 + }, + "vec32_u8" : { + "med_us" : 252.625, + "best_us" : 249.625 + }, + "vec16_u2" : { + "med_us" : 250.03125, + "best_us" : 248.125 + }, + "vec16_u4" : { + "med_us" : 251.3125, + "best_us" : 249.46875 + }, + "vec16_u8" : { + "med_us" : 252.71875, + "best_us" : 248.46875 + }, + "vec4" : { + "med_us" : 254.78125, + "best_us" : 249.875 + }, + "vec8" : { + "med_us" : 245.875, + "best_us" : 244.75 + }, + "vec4_u4" : { + "med_us" : 253.03125, + "best_us" : 250.375 + }, + "vec8_u4" : { + "med_us" : 251.5, + "best_us" : 246.875 + }, + "plain" : { + "med_us" : 252.03125, + "best_us" : 246.90625 + }, + "u2" : { + "med_us" : 250.75, + "best_us" : 247.96875 + }, + "u4" : { + "med_us" : 249, + "best_us" : 247.625 + }, + "u8" : { + "med_us" : 250.96875, + "best_us" : 247.15625 + }, + "vec4_u2" : { + "med_us" : 252.40625, + "best_us" : 246.09375 + }, + "vec4_u8" : { + "med_us" : 251.0625, + "best_us" : 249.375 + }, + "vec8_u2" : { + "med_us" : 251.90625, + "best_us" : 248.03125 + }, + "vec8_u8" : { + "med_us" : 251.1875, + "best_us" : 248.1875 + }, + "vec16" : { + "med_us" : 250.0625, + "best_us" : 249.84375 + } + } + }, + "dot" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1636.75, + "best_us" : 1633.0833333333333 + }, + "vec32" : { + "med_us" : 1642.25, + "best_us" : 1634.3333333333333 + }, + "vec32_u4" : { + "med_us" : 1638.3333333333333, + "best_us" : 1630.0833333333333 + }, + "vec32_u8" : { + "med_us" : 1649, + "best_us" : 1647.090909090909 + }, + "vec16_u2" : { + "med_us" : 1629.75, + "best_us" : 1628.5833333333333 + }, + "vec16_u4" : { + "med_us" : 1628.6363636363637, + "best_us" : 1624 + }, + "vec16_u8" : { + "med_us" : 1635.6666666666667, + "best_us" : 1635.1666666666667 + }, + "vec4" : { + "med_us" : 1794.6363636363637, + "best_us" : 1793.5454545454545 + }, + "vec8" : { + "med_us" : 1651.7272727272727, + "best_us" : 1639.909090909091 + }, + "vec4_u4" : { + "med_us" : 1792.3, + "best_us" : 1786.2 + }, + "vec8_u4" : { + "med_us" : 1627.4166666666667, + "best_us" : 1624.6666666666667 + }, + "plain" : { + "med_us" : 15914, + "best_us" : 15837 + }, + "u2" : { + "med_us" : 15865, + "best_us" : 15771 + }, + "u4" : { + "med_us" : 15802, + "best_us" : 15445 + }, + "u8" : { + "med_us" : 15781, + "best_us" : 15660 + }, + "vec4_u2" : { + "med_us" : 1800.7, + "best_us" : 1797.3 + }, + "vec4_u8" : { + "med_us" : 1793.8181818181818, + "best_us" : 1789.3636363636363 + }, + "vec8_u2" : { + "med_us" : 1644.1666666666667, + "best_us" : 1638.9166666666667 + }, + "vec8_u8" : { + "med_us" : 1632.25, + "best_us" : 1629.1666666666667 + }, + "vec16" : { + "med_us" : 1650.5, + "best_us" : 1647 + } + } + }, + "q40q8_tile_gen" : { + "winner" : "mr8", + "rows" : { + "mr8" : { + "tile_us" : 29216, + "gemv_us" : 170, + "hot_us" : 10 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 307461, + "gemv_us" : 1197, + "hot_us" : 75.625 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 307389, + "gemv_us" : 1227, + "hot_us" : 75.875 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 307437, + "gemv_us" : 1181, + "hot_us" : 74.5 + }, + "mr4" : { + "tile_us" : 32791, + "gemv_us" : 177, + "hot_us" : 10.5625 + }, + "reference" : { + "tile_us" : 307575, + "gemv_us" : 1223, + "hot_us" : 74 + }, + "mr4_nrsplit2" : { + "tile_us" : 36660, + "gemv_us" : 205, + "hot_us" : 10.5 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 307379, + "gemv_us" : 1187, + "hot_us" : 74.8125 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 308013, + "gemv_us" : 1220, + "hot_us" : 75.875 + }, + "mr8_nrsplit2" : { + "tile_us" : 33100, + "gemv_us" : 166, + "hot_us" : 10.125 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 308004, + "gemv_us" : 1225, + "hot_us" : 75.875 + } + } + }, + "axpy" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 358.9375, + "best_us" : 352.53125 + }, + "vec32" : { + "med_us" : 360.53125, + "best_us" : 360.40625 + }, + "vec32_u4" : { + "med_us" : 337.71875, + "best_us" : 337.46875 + }, + "vec32_u8" : { + "med_us" : 336.3125, + "best_us" : 336.09375 + }, + "vec16_u2" : { + "med_us" : 361.28125, + "best_us" : 360.875 + }, + "vec16_u4" : { + "med_us" : 347.5, + "best_us" : 337.875 + }, + "vec16_u8" : { + "med_us" : 337.96875, + "best_us" : 337.3125 + }, + "vec4" : { + "med_us" : 362.71875, + "best_us" : 361.625 + }, + "vec8" : { + "med_us" : 361.03125, + "best_us" : 360.5 + }, + "vec4_u4" : { + "med_us" : 338.125, + "best_us" : 337.46875 + }, + "vec8_u4" : { + "med_us" : 337.28125, + "best_us" : 336.8125 + }, + "plain" : { + "med_us" : 362.5625, + "best_us" : 361.84375 + }, + "u2" : { + "med_us" : 361.5, + "best_us" : 360.84375 + }, + "u4" : { + "med_us" : 337.75, + "best_us" : 337.0625 + }, + "u8" : { + "med_us" : 336.46875, + "best_us" : 334.46875 + }, + "vec4_u2" : { + "med_us" : 361.96875, + "best_us" : 361.59375 + }, + "vec4_u8" : { + "med_us" : 337.5625, + "best_us" : 337.03125 + }, + "vec8_u2" : { + "med_us" : 338.125, + "best_us" : 336.96875 + }, + "vec8_u8" : { + "med_us" : 336.25, + "best_us" : 335.78125 + }, + "vec16" : { + "med_us" : 362.59375, + "best_us" : 361.78125 + } + } + }, + "dot_q8q8kv" : { + "winner" : "vec16", + "fallback" : "vec16", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 140.46875, + "best_us" : 140 + }, + "vec32" : { + "med_us" : 128.9375, + "best_us" : 128.8125 + }, + "vec32_u4" : { + "med_us" : 140, + "best_us" : 139.90625 + }, + "vec32_u8" : { + "med_us" : 140.3125, + "best_us" : 139.8125 + }, + "vec16_u2" : { + "med_us" : 139.65625, + "best_us" : 139.4375 + }, + "vec16_u4" : { + "med_us" : 139.6875, + "best_us" : 139.625 + }, + "vec16_u8" : { + "med_us" : 139.84375, + "best_us" : 139.5625 + }, + "vec4" : { + "med_us" : 136.46875, + "best_us" : 136.125 + }, + "vec8" : { + "med_us" : 136.25, + "best_us" : 135.9375 + }, + "vec4_u4" : { + "med_us" : 488.3125, + "best_us" : 488 + }, + "vec8_u4" : { + "med_us" : 194.0625, + "best_us" : 193.96875 + }, + "plain" : { + "med_us" : 136.40625, + "best_us" : 136.03125 + }, + "u2" : { + "med_us" : 139.6875, + "best_us" : 139.65625 + }, + "u4" : { + "med_us" : 139.625, + "best_us" : 139.125 + }, + "u8" : { + "med_us" : 139.5625, + "best_us" : 139.21875 + }, + "vec4_u2" : { + "med_us" : 488.40625, + "best_us" : 488.1875 + }, + "vec4_u8" : { + "med_us" : 488.46875, + "best_us" : 488.0625 + }, + "vec8_u2" : { + "med_us" : 194.875, + "best_us" : 194.625 + }, + "vec8_u8" : { + "med_us" : 194.53125, + "best_us" : 193.875 + }, + "vec16" : { + "med_us" : 128.84375, + "best_us" : 128.8125 + } + } + }, + "dot_mx4q8" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 0.5725343634106776, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 163.5625, + "best_us" : 163.5 + }, + "vec32" : { + "med_us" : 169, + "best_us" : 168.9375 + }, + "vec32_u4" : { + "med_us" : 164.0625, + "best_us" : 163.71875 + }, + "vec32_u8" : { + "med_us" : 164.09375, + "best_us" : 163.875 + }, + "vec16_u2" : { + "med_us" : 163.5625, + "best_us" : 163.53125 + }, + "vec16_u4" : { + "med_us" : 164, + "best_us" : 163.96875 + }, + "vec16_u8" : { + "med_us" : 163.9375, + "best_us" : 163.78125 + }, + "vec4" : { + "med_us" : 164.1875, + "best_us" : 163.53125 + }, + "vec8" : { + "med_us" : 164.15625, + "best_us" : 164.125 + }, + "vec4_u4" : { + "med_us" : 164.03125, + "best_us" : 164 + }, + "vec8_u4" : { + "med_us" : 164.0625, + "best_us" : 164 + }, + "plain" : { + "med_us" : 163.6875, + "best_us" : 163.65625 + }, + "u2" : { + "med_us" : 164, + "best_us" : 163.78125 + }, + "u4" : { + "med_us" : 163.84375, + "best_us" : 163.5625 + }, + "u8" : { + "med_us" : 164.0625, + "best_us" : 163.84375 + }, + "vec4_u2" : { + "med_us" : 163.8125, + "best_us" : 163.6875 + }, + "vec4_u8" : { + "med_us" : 163.9375, + "best_us" : 163.84375 + }, + "vec8_u2" : { + "med_us" : 163.5625, + "best_us" : 163.53125 + }, + "vec8_u8" : { + "med_us" : 164, + "best_us" : 163.71875 + }, + "vec16" : { + "med_us" : 164.21875, + "best_us" : 164.1875 + } + } + }, + "dot_q8q8_laneq4x4" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 0.5725343634106776, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 753.9230769230769, + "best_us" : 751.6153846153846 + }, + "vec32" : { + "med_us" : 755.4230769230769, + "best_us" : 755.3076923076923 + }, + "vec32_u4" : { + "med_us" : 753.5769230769231, + "best_us" : 752.8846153846154 + }, + "vec32_u8" : { + "med_us" : 849.3333333333334, + "best_us" : 847.7083333333334 + }, + "vec16_u2" : { + "med_us" : 751.3076923076923, + "best_us" : 750.7692307692307 + }, + "vec16_u4" : { + "med_us" : 753.5384615384615, + "best_us" : 753.1153846153846 + }, + "vec16_u8" : { + "med_us" : 847.75, + "best_us" : 846.5416666666666 + }, + "vec4" : { + "med_us" : 755.8461538461538, + "best_us" : 755.6538461538462 + }, + "vec8" : { + "med_us" : 756.1153846153846, + "best_us" : 755.8461538461538 + }, + "vec4_u4" : { + "med_us" : 754.0384615384615, + "best_us" : 753.3846153846154 + }, + "vec8_u4" : { + "med_us" : 753.7692307692307, + "best_us" : 753.5 + }, + "plain" : { + "med_us" : 755.3846153846154, + "best_us" : 755.0769230769231 + }, + "u2" : { + "med_us" : 754.5384615384615, + "best_us" : 751.8846153846154 + }, + "u4" : { + "med_us" : 753.8461538461538, + "best_us" : 753.6923076923077 + }, + "u8" : { + "med_us" : 848.9565217391304, + "best_us" : 847.6521739130435 + }, + "vec4_u2" : { + "med_us" : 750.6538461538462, + "best_us" : 750 + }, + "vec4_u8" : { + "med_us" : 848.8260869565217, + "best_us" : 847.4347826086956 + }, + "vec8_u2" : { + "med_us" : 750.8846153846154, + "best_us" : 750.5 + }, + "vec8_u8" : { + "med_us" : 848.1739130434783, + "best_us" : 845.3913043478261 + }, + "vec16" : { + "med_us" : 756.2307692307693, + "best_us" : 755.5384615384615 + } + } + }, + "scale_inplace" : { + "winner" : "plain", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 3.0191458026509572, + "rows" : { + "vec32_u2" : { + "med_us" : 254.3125, + "best_us" : 254.09375 + }, + "vec32" : { + "med_us" : 250.8125, + "best_us" : 249.4375 + }, + "vec32_u4" : { + "med_us" : 252.96875, + "best_us" : 251.53125 + }, + "vec32_u8" : { + "med_us" : 251.59375, + "best_us" : 249.9375 + }, + "vec16_u2" : { + "med_us" : 268.96875, + "best_us" : 268.5 + }, + "vec16_u4" : { + "med_us" : 268, + "best_us" : 267.03125 + }, + "vec16_u8" : { + "med_us" : 268.5, + "best_us" : 266.71875 + }, + "vec4" : { + "med_us" : 247.125, + "best_us" : 246.25 + }, + "vec8" : { + "med_us" : 249.03125, + "best_us" : 248.1875 + }, + "vec4_u4" : { + "med_us" : 249.03125, + "best_us" : 247.84375 + }, + "vec8_u4" : { + "med_us" : 253.34375, + "best_us" : 252.625 + }, + "plain" : { + "med_us" : 246.609375, + "best_us" : 245.75 + }, + "u2" : { + "med_us" : 246.453125, + "best_us" : 245.6875 + }, + "u4" : { + "med_us" : 249.84375, + "best_us" : 246.40625 + }, + "u8" : { + "med_us" : 249.5, + "best_us" : 248.53125 + }, + "vec4_u2" : { + "med_us" : 246.734375, + "best_us" : 245.71875 + }, + "vec4_u8" : { + "med_us" : 248.75, + "best_us" : 248.625 + }, + "vec8_u2" : { + "med_us" : 254.5625, + "best_us" : 248.625 + }, + "vec8_u8" : { + "med_us" : 251.90625, + "best_us" : 249.84375 + }, + "vec16" : { + "med_us" : 270.125, + "best_us" : 268.5 + } + } + }, + "dot_q4" : { + "winner" : "vec4_u4", + "fallback" : "vec4_u4", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1646.8333333333333, + "best_us" : 1638.75 + }, + "vec32" : { + "med_us" : 1987.3333333333333, + "best_us" : 1984.7777777777778 + }, + "vec32_u4" : { + "med_us" : 1580.75, + "best_us" : 1565.1666666666667 + }, + "vec32_u8" : { + "med_us" : 1542.4615384615386, + "best_us" : 1527.1538461538462 + }, + "vec16_u2" : { + "med_us" : 1025, + "best_us" : 1023.2631578947369 + }, + "vec16_u4" : { + "med_us" : 1024.9473684210527, + "best_us" : 1022.2105263157895 + }, + "vec16_u8" : { + "med_us" : 1022.0526315789474, + "best_us" : 1017.421052631579 + }, + "vec4" : { + "med_us" : 1981.5, + "best_us" : 1970.4 + }, + "vec8" : { + "med_us" : 1988.3333333333333, + "best_us" : 1984.111111111111 + }, + "vec4_u4" : { + "med_us" : 824.875, + "best_us" : 817.25 + }, + "vec8_u4" : { + "med_us" : 857.7391304347826, + "best_us" : 854.5652173913044 + }, + "plain" : { + "med_us" : 1986.1, + "best_us" : 1970.7 + }, + "u2" : { + "med_us" : 1035.7894736842106, + "best_us" : 1026.5263157894738 + }, + "u4" : { + "med_us" : 1034.2105263157894, + "best_us" : 1024.842105263158 + }, + "u8" : { + "med_us" : 1034.6842105263158, + "best_us" : 1025.2631578947369 + }, + "vec4_u2" : { + "med_us" : 823.9583333333334, + "best_us" : 816 + }, + "vec4_u8" : { + "med_us" : 824.2083333333334, + "best_us" : 816.6666666666666 + }, + "vec8_u2" : { + "med_us" : 856.0454545454545, + "best_us" : 855.5454545454545 + }, + "vec8_u8" : { + "med_us" : 855.1304347826087, + "best_us" : 854.1739130434783 + }, + "vec16" : { + "med_us" : 1985.8, + "best_us" : 1982.3 + } + } + }, + "copy_floats" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 268.8125, + "best_us" : 268.09375 + }, + "vec32" : { + "med_us" : 268.84375, + "best_us" : 268.25 + }, + "vec32_u4" : { + "med_us" : 268.34375, + "best_us" : 267.96875 + }, + "vec32_u8" : { + "med_us" : 268.75, + "best_us" : 267.90625 + }, + "vec16_u2" : { + "med_us" : 269.125, + "best_us" : 268.375 + }, + "vec16_u4" : { + "med_us" : 269.0625, + "best_us" : 268.40625 + }, + "vec16_u8" : { + "med_us" : 269.5625, + "best_us" : 269 + }, + "vec4" : { + "med_us" : 269.0625, + "best_us" : 268.25 + }, + "vec8" : { + "med_us" : 269.65625, + "best_us" : 268.125 + }, + "vec4_u4" : { + "med_us" : 268.6875, + "best_us" : 267.96875 + }, + "vec8_u4" : { + "med_us" : 269.1875, + "best_us" : 268.46875 + }, + "plain" : { + "med_us" : 270.28125, + "best_us" : 268.09375 + }, + "u2" : { + "med_us" : 269.625, + "best_us" : 268.78125 + }, + "u4" : { + "med_us" : 270.5625, + "best_us" : 268.1875 + }, + "u8" : { + "med_us" : 269.625, + "best_us" : 268.75 + }, + "vec4_u2" : { + "med_us" : 268.90625, + "best_us" : 268.1875 + }, + "vec4_u8" : { + "med_us" : 268.9375, + "best_us" : 268.40625 + }, + "vec8_u2" : { + "med_us" : 268.6875, + "best_us" : 268.09375 + }, + "vec8_u8" : { + "med_us" : 269.65625, + "best_us" : 267.875 + }, + "vec16" : { + "med_us" : 268.90625, + "best_us" : 268.40625 + } + } + }, + "rmsnorm" : { + "winner" : "vec8", + "fallback" : "plain", + "floor_pct" : 0.3108673493023099, + "margin_pct" : 86.0870008446684, + "rows" : { + "vec32_u2" : { + "med_us" : 619.9375, + "best_us" : 619.75 + }, + "vec32" : { + "med_us" : 615.125, + "best_us" : 614.78125 + }, + "vec32_u4" : { + "med_us" : 620.34375, + "best_us" : 619.6875 + }, + "vec32_u8" : { + "med_us" : 622.25, + "best_us" : 622.125 + }, + "vec16_u2" : { + "med_us" : 603.578125, + "best_us" : 601.75 + }, + "vec16_u4" : { + "med_us" : 606.984375, + "best_us" : 605.9375 + }, + "vec16_u8" : { + "med_us" : 612.234375, + "best_us" : 610.75 + }, + "vec4" : { + "med_us" : 687.8620689655172, + "best_us" : 684.6896551724138 + }, + "vec8" : { + "med_us" : 599.125, + "best_us" : 595.375 + }, + "vec4_u4" : { + "med_us" : 694.6785714285714, + "best_us" : 693.7857142857143 + }, + "vec8_u4" : { + "med_us" : 600.328125, + "best_us" : 599.96875 + }, + "plain" : { + "med_us" : 4368.125, + "best_us" : 4313.5 + }, + "u2" : { + "med_us" : 4323.75, + "best_us" : 4271.5 + }, + "u4" : { + "med_us" : 4283.25, + "best_us" : 4260.25 + }, + "u8" : { + "med_us" : 4312.5, + "best_us" : 4276 + }, + "vec4_u2" : { + "med_us" : 694.448275862069, + "best_us" : 688.7931034482758 + }, + "vec4_u8" : { + "med_us" : 694.5, + "best_us" : 693.8928571428571 + }, + "vec8_u2" : { + "med_us" : 599.625, + "best_us" : 598.875 + }, + "vec8_u8" : { + "med_us" : 600.1875, + "best_us" : 598.65625 + }, + "vec16" : { + "med_us" : 602.515625, + "best_us" : 601.40625 + } + } + } + }, + "runtime" : { + "jobque_spin_us" : 30000, + "target_chunk_work" : 1, + "norm_par_threshold" : 256000, + "gemv_lane_cap" : 6, + "matmul_min_chunk_rows" : 16, + "batch_grid_2d" : 0, + "metal_devw_small_panel_mb" : 32, + "team_rank_gate" : -1, + "kv_store_par_threshold" : 256000, + "q8_l2_budget" : 4194304, + "rope_par_threshold" : 100000, + "jobque_join_poll" : 50, + "q8_token_block" : 128, + "requant_par_threshold" : 256000, + "metal_tensor" : "mulmm_bf16,mulmm_q8,moe_mulmm_q8,moe_mulmm_mx4,attn_qkmm,kq_mulmm_k4,kq_mulmm_k5,kq_mulmm_k6,gemmb_q8,gemmb_sk_q8,gemm64b_q8", + "matmul_min_chunk_rows_gemv" : 64, + "attn_par_threshold" : 100000, + "batch_lane_cap" : 0, + "metal_cvt_min_rows" : 256, + "metal_tall_floor" : 64, + "act_par_threshold" : 100000, + "threads" : 18, + "dispatch_worker_limit" : 0, + "q8_batch_chunks_per_job" : 4, + "q8_chunks_per_job" : 2, + "q4_chunks_per_job" : 4 + } +} \ No newline at end of file diff --git a/modules/dasLLAMA/performance/records/m5.tune.3865c28dd577.json b/modules/dasLLAMA/performance/records/m5.tune.3865c28dd577.json new file mode 100644 index 0000000000..c5fa746a4f --- /dev/null +++ b/modules/dasLLAMA/performance/records/m5.tune.3865c28dd577.json @@ -0,0 +1,2648 @@ +{ + "kernels" : { + "add_inplace" : "vec8_u2", + "cvt_f32_to_f16" : "vec16", + "rope_scaled_neox_tab" : "vec8_u2", + "q51q8_tile_gen" : "mr4", + "softmax" : "vec8_u2", + "mul_inplace" : "vec8_u2", + "quantize_q8_0_bs_into_ptr" : "plain", + "dot_q8kv" : "vec4_u2", + "dot_q8q8" : "vec16", + "quantize_q8kv_row" : "plain", + "axpy_f16" : "vec8_u2", + "q40q8_tile_gen" : "mr8", + "axpy_tq4kv" : "vec8_u2", + "cvt_tq4kv_to_f32" : "vec8_u2", + "axpy" : "vec8_u2", + "dot_q8q8kv" : "vec16", + "dot_mx4q8" : "u2", + "softmax_sink" : "vec8_u2", + "dot_q8q8_laneq4x4" : "u2", + "dot_bf16" : "vec8_u2", + "add_scale_inplace" : "vec8_u2", + "cvt_q8kv_to_f32" : "vec8_u2", + "axpy_q8kv" : "vec8_u2", + "dot_q8q8_f16s" : "vec16", + "q8q8_tile_gen" : "mr8_budget", + "quantize_q8_0_into_ptr" : "plain", + "k4q8_tile_gen" : "mr8", + "k5q8_tile_gen" : "mr4", + "k6q8_tile_gen" : "mr4", + "gemm_f32_uk_4x16" : "u2", + "dot_q51e" : "vec16", + "dot_f16" : "vec8_u2", + "cvt_f16_to_f32" : "vec8_u2", + "dot" : "vec8_u2", + "dot_q8tq4kv" : "vec16", + "scale_inplace" : "vec8_u2", + "dot_q4" : "vec4_u4", + "quantize_tq4kv_row" : "plain", + "copy_floats" : "vec8_u2", + "rmsnorm" : "vec8" + }, + "provenance" : { + "validation" : "ok", + "noise_probes" : "start cv 0.26%; mid1 cv 0.24%; mid2 cv 0.17%; end cv 0.37%", + "platform" : "darwin", + "noise_floor_cv_pct" : "0.37", + "engine_sha" : "366669a53", + "box" : "darwin|arm64|Mac17,6|25G72|Apple M5 Max", + "written" : "2026-08-30T11:28:00.117Z", + "validation_demoted" : "0", + "mode" : "normal", + "dasllama_version" : "15", + "noise" : "ok", + "binary" : "/Users/borisbatkin/Work/daScript/./bin/daslang", + "arch" : "arm64", + "validation_max_drift_pct" : "0.36" + }, + "race" : { + "cvt_q8kv_to_f32" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 375.28125, + "best_us" : 374.90625 + }, + "vec32" : { + "med_us" : 374.3125, + "best_us" : 373.8125 + }, + "vec32_u4" : { + "med_us" : 375.5, + "best_us" : 375.125 + }, + "vec32_u8" : { + "med_us" : 375.4375, + "best_us" : 375.0625 + }, + "vec16_u2" : { + "med_us" : 375.3125, + "best_us" : 375 + }, + "vec16_u4" : { + "med_us" : 375.5625, + "best_us" : 375.40625 + }, + "vec16_u8" : { + "med_us" : 375.375, + "best_us" : 374.25 + }, + "vec4" : { + "med_us" : 374.25, + "best_us" : 374.0625 + }, + "vec8" : { + "med_us" : 374.125, + "best_us" : 373.90625 + }, + "vec4_u4" : { + "med_us" : 375.875, + "best_us" : 375.25 + }, + "vec8_u4" : { + "med_us" : 375, + "best_us" : 374.03125 + }, + "plain" : { + "med_us" : 374.40625, + "best_us" : 372.65625 + }, + "u2" : { + "med_us" : 375.65625, + "best_us" : 374.6875 + }, + "u4" : { + "med_us" : 375.21875, + "best_us" : 375 + }, + "u8" : { + "med_us" : 375.34375, + "best_us" : 374.90625 + }, + "vec4_u2" : { + "med_us" : 375.5625, + "best_us" : 375.34375 + }, + "vec4_u8" : { + "med_us" : 375.71875, + "best_us" : 374.96875 + }, + "vec8_u2" : { + "med_us" : 374.78125, + "best_us" : 374.625 + }, + "vec8_u8" : { + "med_us" : 375.09375, + "best_us" : 374.28125 + }, + "vec16" : { + "med_us" : 374.125, + "best_us" : 373.9375 + } + } + }, + "add_inplace" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 333.65625, + "best_us" : 332.53125 + }, + "vec32" : { + "med_us" : 355.34375, + "best_us" : 351.59375 + }, + "vec32_u4" : { + "med_us" : 334.65625, + "best_us" : 331.40625 + }, + "vec32_u8" : { + "med_us" : 332.21875, + "best_us" : 330 + }, + "vec16_u2" : { + "med_us" : 335.09375, + "best_us" : 334.09375 + }, + "vec16_u4" : { + "med_us" : 334.03125, + "best_us" : 332.5625 + }, + "vec16_u8" : { + "med_us" : 1263.3333333333333, + "best_us" : 1261.0666666666666 + }, + "vec4" : { + "med_us" : 360.15625, + "best_us" : 356.1875 + }, + "vec8" : { + "med_us" : 357.59375, + "best_us" : 355.875 + }, + "vec4_u4" : { + "med_us" : 334.3125, + "best_us" : 332.21875 + }, + "vec8_u4" : { + "med_us" : 334.09375, + "best_us" : 331.59375 + }, + "plain" : { + "med_us" : 359.0625, + "best_us" : 357.5625 + }, + "u2" : { + "med_us" : 358.40625, + "best_us" : 356.6875 + }, + "u4" : { + "med_us" : 336.375, + "best_us" : 332.4375 + }, + "u8" : { + "med_us" : 332.78125, + "best_us" : 331.09375 + }, + "vec4_u2" : { + "med_us" : 359.84375, + "best_us" : 357.3125 + }, + "vec4_u8" : { + "med_us" : 334.46875, + "best_us" : 332.75 + }, + "vec8_u2" : { + "med_us" : 337.03125, + "best_us" : 332.71875 + }, + "vec8_u8" : { + "med_us" : 331.8125, + "best_us" : 330.6875 + }, + "vec16" : { + "med_us" : 335.25, + "best_us" : 333.28125 + } + } + }, + "axpy_q8kv" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 395.8125, + "best_us" : 395.46875 + }, + "vec32" : { + "med_us" : 393.25, + "best_us" : 393.15625 + }, + "vec32_u4" : { + "med_us" : 395.5, + "best_us" : 395 + }, + "vec32_u8" : { + "med_us" : 395.09375, + "best_us" : 394.96875 + }, + "vec16_u2" : { + "med_us" : 394.90625, + "best_us" : 394.6875 + }, + "vec16_u4" : { + "med_us" : 394.84375, + "best_us" : 394.0625 + }, + "vec16_u8" : { + "med_us" : 394.96875, + "best_us" : 394.8125 + }, + "vec4" : { + "med_us" : 393.40625, + "best_us" : 393.25 + }, + "vec8" : { + "med_us" : 393.53125, + "best_us" : 393.375 + }, + "vec4_u4" : { + "med_us" : 393.375, + "best_us" : 392.96875 + }, + "vec8_u4" : { + "med_us" : 396.15625, + "best_us" : 395.21875 + }, + "plain" : { + "med_us" : 393.5625, + "best_us" : 393.34375 + }, + "u2" : { + "med_us" : 394.625, + "best_us" : 394.25 + }, + "u4" : { + "med_us" : 395.46875, + "best_us" : 394.6875 + }, + "u8" : { + "med_us" : 394.90625, + "best_us" : 394.53125 + }, + "vec4_u2" : { + "med_us" : 393.375, + "best_us" : 393.28125 + }, + "vec4_u8" : { + "med_us" : 393.40625, + "best_us" : 393.3125 + }, + "vec8_u2" : { + "med_us" : 394.96875, + "best_us" : 394.8125 + }, + "vec8_u8" : { + "med_us" : 395.28125, + "best_us" : 395.1875 + }, + "vec16" : { + "med_us" : 393.46875, + "best_us" : 393.4375 + } + } + }, + "cvt_f32_to_f16" : { + "winner" : "vec16", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 6.357753941025752, + "rows" : { + "vec32_u2" : { + "med_us" : 347, + "best_us" : 346.6875 + }, + "vec32" : { + "med_us" : 347.34375, + "best_us" : 346.71875 + }, + "vec32_u4" : { + "med_us" : 347, + "best_us" : 346.78125 + }, + "vec32_u8" : { + "med_us" : 347.71875, + "best_us" : 346.625 + }, + "vec16_u2" : { + "med_us" : 336.046875, + "best_us" : 335.125 + }, + "vec16_u4" : { + "med_us" : 336.9375, + "best_us" : 333.4375 + }, + "vec16_u8" : { + "med_us" : 335.953125, + "best_us" : 335.5 + }, + "vec4" : { + "med_us" : 363.125, + "best_us" : 363.03125 + }, + "vec8" : { + "med_us" : 358.78125, + "best_us" : 358.15625 + }, + "vec4_u4" : { + "med_us" : 363.3125, + "best_us" : 362.96875 + }, + "vec8_u4" : { + "med_us" : 359.03125, + "best_us" : 357.5 + }, + "plain" : { + "med_us" : 358.65625, + "best_us" : 358.4375 + }, + "u2" : { + "med_us" : 358.78125, + "best_us" : 358.5 + }, + "u4" : { + "med_us" : 358.53125, + "best_us" : 358.28125 + }, + "u8" : { + "med_us" : 358.6875, + "best_us" : 358.5625 + }, + "vec4_u2" : { + "med_us" : 364.59375, + "best_us" : 363.125 + }, + "vec4_u8" : { + "med_us" : 362.25, + "best_us" : 361.71875 + }, + "vec8_u2" : { + "med_us" : 358.578125, + "best_us" : 358.15625 + }, + "vec8_u8" : { + "med_us" : 358.375, + "best_us" : 358.34375 + }, + "vec16" : { + "med_us" : 335.71875, + "best_us" : 335.375 + } + } + }, + "rope_scaled_neox_tab" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 683.448275862069, + "best_us" : 681.5862068965517 + }, + "vec32" : { + "med_us" : 638.5806451612904, + "best_us" : 636.7096774193549 + }, + "vec32_u4" : { + "med_us" : 638, + "best_us" : 636.9677419354839 + }, + "vec32_u8" : { + "med_us" : 639.1612903225806, + "best_us" : 637.6451612903226 + }, + "vec16_u2" : { + "med_us" : 381.71875, + "best_us" : 377.875 + }, + "vec16_u4" : { + "med_us" : 375.6875, + "best_us" : 374.125 + }, + "vec16_u8" : { + "med_us" : 374.71875, + "best_us" : 373.90625 + }, + "vec4" : { + "med_us" : 394.5, + "best_us" : 394.15625 + }, + "vec8" : { + "med_us" : 373.5, + "best_us" : 370.375 + }, + "vec4_u4" : { + "med_us" : 371.8125, + "best_us" : 369.78125 + }, + "vec8_u4" : { + "med_us" : 370.875, + "best_us" : 367.9375 + }, + "plain" : { + "med_us" : 405.78125, + "best_us" : 404.65625 + }, + "u2" : { + "med_us" : 382.15625, + "best_us" : 380.875 + }, + "u4" : { + "med_us" : 372.28125, + "best_us" : 368.75 + }, + "u8" : { + "med_us" : 419.625, + "best_us" : 418.28125 + }, + "vec4_u2" : { + "med_us" : 380.625, + "best_us" : 379.78125 + }, + "vec4_u8" : { + "med_us" : 416.5, + "best_us" : 415.59375 + }, + "vec8_u2" : { + "med_us" : 373.9375, + "best_us" : 368.625 + }, + "vec8_u8" : { + "med_us" : 402.78125, + "best_us" : 401.34375 + }, + "vec16" : { + "med_us" : 368.78125, + "best_us" : 367.15625 + } + } + }, + "q51q8_tile_gen" : { + "winner" : "mr4", + "rows" : { + "mr8" : { + "streamed_us" : 571 + }, + "dot_maddubs_width256_mr8" : { + "streamed_us" : 3914 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "streamed_us" : 3950 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "streamed_us" : 4003 + }, + "mr4" : { + "streamed_us" : 568 + }, + "reference" : { + "streamed_us" : 3780 + }, + "mr4_nrsplit2" : { + "streamed_us" : 598 + }, + "dot_vpdpbusd_width256_mr8" : { + "streamed_us" : 3931 + }, + "dot_vpdpbusd_width512_mr16" : { + "streamed_us" : 3986 + }, + "mr8_nrsplit2" : { + "streamed_us" : 599 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "streamed_us" : 3924 + } + } + }, + "softmax" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 3150, + "best_us" : 3149.6666666666665 + }, + "vec32" : { + "med_us" : 3160.8333333333335, + "best_us" : 3157.1666666666665 + }, + "vec32_u4" : { + "med_us" : 3160.1666666666665, + "best_us" : 3158.1666666666665 + }, + "vec32_u8" : { + "med_us" : 3155.6666666666665, + "best_us" : 3154 + }, + "vec16_u2" : { + "med_us" : 3171.8333333333335, + "best_us" : 3169.1666666666665 + }, + "vec16_u4" : { + "med_us" : 3160.5, + "best_us" : 3158.8333333333335 + }, + "vec16_u8" : { + "med_us" : 3176.3333333333335, + "best_us" : 3173 + }, + "vec4" : { + "med_us" : 3150.5, + "best_us" : 3149 + }, + "vec8" : { + "med_us" : 3151, + "best_us" : 3150 + }, + "vec4_u4" : { + "med_us" : 3155.8333333333335, + "best_us" : 3144.6666666666665 + }, + "vec8_u4" : { + "med_us" : 3159.1666666666665, + "best_us" : 3158.6666666666665 + }, + "plain" : { + "med_us" : 3149.6666666666665, + "best_us" : 3148 + }, + "u2" : { + "med_us" : 3154.1666666666665, + "best_us" : 3150.3333333333335 + }, + "u4" : { + "med_us" : 3157.3333333333335, + "best_us" : 3154 + }, + "u8" : { + "med_us" : 3154.6666666666665, + "best_us" : 3152.3333333333335 + }, + "vec4_u2" : { + "med_us" : 3155.3333333333335, + "best_us" : 3154.8333333333335 + }, + "vec4_u8" : { + "med_us" : 3158, + "best_us" : 3154.8333333333335 + }, + "vec8_u2" : { + "med_us" : 3150.1666666666665, + "best_us" : 3150.1666666666665 + }, + "vec8_u8" : { + "med_us" : 3145.8333333333335, + "best_us" : 3144.8333333333335 + }, + "vec16" : { + "med_us" : 3167.6666666666665, + "best_us" : 3164.8333333333335 + } + } + }, + "q8q8_tile_gen" : { + "winner" : "mr8_budget", + "rows" : { + "kstep1" : { + "tile_us" : 22786, + "gemv_us" : 197, + "hot_us" : 9.9375 + }, + "kstep2_nrsplit2" : { + "tile_us" : 24061, + "gemv_us" : 198, + "hot_us" : 10.3125 + }, + "kstep1_nrsplit2" : { + "tile_us" : 24274, + "gemv_us" : 198, + "hot_us" : 10.375 + }, + "reference" : { + "tile_us" : 33344, + "gemv_us" : 198, + "hot_us" : 10.1875 + }, + "kstep4_nrsplit2" : { + "tile_us" : 24253, + "gemv_us" : 196, + "hot_us" : 10.1875 + }, + "kstep4_nrsplit2_mr8_gkstep2" : { + "tile_us" : 23989, + "gemv_us" : 189, + "hot_us" : 9.3125 + }, + "kstep1_nrsplit2_mr8" : { + "tile_us" : 23068, + "gemv_us" : 187, + "hot_us" : 9.5 + }, + "kstep2_nrsplit2_mr8" : { + "tile_us" : 22723, + "gemv_us" : 195, + "hot_us" : 9.4375 + }, + "kstep4_nrsplit2_mr8" : { + "tile_us" : 24022, + "gemv_us" : 193, + "hot_us" : 9.875 + }, + "kstep2_gkstep2" : { + "tile_us" : 23233, + "gemv_us" : 196, + "hot_us" : 10.0625 + }, + "kstep2_gkstep4" : { + "tile_us" : 23204, + "gemv_us" : 192, + "hot_us" : 9.625 + }, + "kstep4_nrsplit2_mr8_gkstep4" : { + "tile_us" : 23982, + "gemv_us" : 191, + "hot_us" : 9.5 + }, + "mr8_budget" : { + "tile_us" : 22047, + "gemv_us" : 191, + "hot_us" : 9.4375 + }, + "kstep2" : { + "tile_us" : 23167, + "gemv_us" : 197, + "hot_us" : 10.4375 + }, + "kstep4" : { + "tile_us" : 24633, + "gemv_us" : 197, + "hot_us" : 10.1875 + } + } + }, + "mul_inplace" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 356.9375, + "best_us" : 351.5 + }, + "vec32" : { + "med_us" : 354.0625, + "best_us" : 353.8125 + }, + "vec32_u4" : { + "med_us" : 332.46875, + "best_us" : 332.3125 + }, + "vec32_u8" : { + "med_us" : 335.75, + "best_us" : 334.46875 + }, + "vec16_u2" : { + "med_us" : 358.625, + "best_us" : 358.3125 + }, + "vec16_u4" : { + "med_us" : 338.15625, + "best_us" : 337.21875 + }, + "vec16_u8" : { + "med_us" : 334.6875, + "best_us" : 334.5625 + }, + "vec4" : { + "med_us" : 361.09375, + "best_us" : 358.3125 + }, + "vec8" : { + "med_us" : 358.3125, + "best_us" : 355.28125 + }, + "vec4_u4" : { + "med_us" : 334.21875, + "best_us" : 333.84375 + }, + "vec8_u4" : { + "med_us" : 332.625, + "best_us" : 332.59375 + }, + "plain" : { + "med_us" : 360.03125, + "best_us" : 358.84375 + }, + "u2" : { + "med_us" : 358.5625, + "best_us" : 357.875 + }, + "u4" : { + "med_us" : 335.5, + "best_us" : 334.4375 + }, + "u8" : { + "med_us" : 333.1875, + "best_us" : 332.125 + }, + "vec4_u2" : { + "med_us" : 357.90625, + "best_us" : 356.875 + }, + "vec4_u8" : { + "med_us" : 335.15625, + "best_us" : 332.75 + }, + "vec8_u2" : { + "med_us" : 335.40625, + "best_us" : 334.28125 + }, + "vec8_u8" : { + "med_us" : 336.34375, + "best_us" : 332.15625 + }, + "vec16" : { + "med_us" : 358.375, + "best_us" : 357.71875 + } + } + }, + "k4q8_tile_gen" : { + "winner" : "mr8", + "rows" : { + "mr8" : { + "tile_us" : 27875, + "gemv_us" : 186, + "hot_us" : 10.625 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 464634, + "gemv_us" : 1777, + "hot_us" : 108.5625 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 466248, + "gemv_us" : 1794, + "hot_us" : 115.1875 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 465547, + "gemv_us" : 1767, + "hot_us" : 111.75 + }, + "mr4" : { + "tile_us" : 30466, + "gemv_us" : 189, + "hot_us" : 11.25 + }, + "reference" : { + "tile_us" : 466365, + "gemv_us" : 1829, + "hot_us" : 114.75 + }, + "mr4_nrsplit2" : { + "tile_us" : 36705, + "gemv_us" : 190, + "hot_us" : 11.8125 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 465672, + "gemv_us" : 1863, + "hot_us" : 108.6875 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 466390, + "gemv_us" : 1768, + "hot_us" : 114.0625 + }, + "mr8_nrsplit2" : { + "tile_us" : 33312, + "gemv_us" : 178, + "hot_us" : 10.625 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 466002, + "gemv_us" : 1745, + "hot_us" : 110.8125 + } + } + }, + "k5q8_tile_gen" : { + "winner" : "mr4", + "rows" : { + "mr8" : { + "tile_us" : 57216, + "gemv_us" : 421, + "hot_us" : 26.5 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 220973, + "gemv_us" : 2096, + "hot_us" : 129.8125 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 221539, + "gemv_us" : 2156, + "hot_us" : 137.75 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 221387, + "gemv_us" : 2212, + "hot_us" : 137.9375 + }, + "mr4" : { + "tile_us" : 28053, + "gemv_us" : 409, + "hot_us" : 26 + }, + "reference" : { + "tile_us" : 221280, + "gemv_us" : 2150, + "hot_us" : 136.75 + }, + "mr4_nrsplit2" : { + "tile_us" : 32410, + "gemv_us" : 417, + "hot_us" : 26.5 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 221668, + "gemv_us" : 2137, + "hot_us" : 130.9375 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 221618, + "gemv_us" : 2104, + "hot_us" : 131.75 + }, + "mr8_nrsplit2" : { + "tile_us" : 82479, + "gemv_us" : 412, + "hot_us" : 25.75 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 221278, + "gemv_us" : 2191, + "hot_us" : 136.125 + } + } + }, + "k6q8_tile_gen" : { + "winner" : "mr4", + "rows" : { + "mr8" : { + "tile_us" : 71676, + "gemv_us" : 344, + "hot_us" : 22.125 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 197956, + "gemv_us" : 5607, + "hot_us" : 339.3125 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 198471, + "gemv_us" : 5567, + "hot_us" : 338.5625 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 198342, + "gemv_us" : 5658, + "hot_us" : 334.375 + }, + "mr4" : { + "tile_us" : 36726, + "gemv_us" : 346, + "hot_us" : 21.5625 + }, + "reference" : { + "tile_us" : 198472, + "gemv_us" : 5413, + "hot_us" : 346.5 + }, + "mr4_nrsplit2" : { + "tile_us" : 38379, + "gemv_us" : 334, + "hot_us" : 20.9375 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 198304, + "gemv_us" : 5606, + "hot_us" : 337.9375 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 198176, + "gemv_us" : 5451, + "hot_us" : 341.3125 + }, + "mr8_nrsplit2" : { + "tile_us" : 97735, + "gemv_us" : 337, + "hot_us" : 21.5625 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 198347, + "gemv_us" : 5410, + "hot_us" : 344.1875 + } + } + }, + "quantize_q8_0_into_ptr" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 2438.5, + "best_us" : 2436.75 + }, + "vec32" : { + "med_us" : 2402.625, + "best_us" : 2398.875 + }, + "vec32_u4" : { + "med_us" : 2436.875, + "best_us" : 2435.875 + }, + "vec32_u8" : { + "med_us" : 2437.5, + "best_us" : 2434.25 + }, + "vec16_u2" : { + "med_us" : 2408.25, + "best_us" : 2402.25 + }, + "vec16_u4" : { + "med_us" : 2407.375, + "best_us" : 2404.5 + }, + "vec16_u8" : { + "med_us" : 2405.875, + "best_us" : 2403.75 + }, + "vec4" : { + "med_us" : 2402.375, + "best_us" : 2399.75 + }, + "vec8" : { + "med_us" : 2404.875, + "best_us" : 2398.625 + }, + "vec4_u4" : { + "med_us" : 3065.3333333333335, + "best_us" : 3062.8333333333335 + }, + "vec8_u4" : { + "med_us" : 2535.1428571428573, + "best_us" : 2531.285714285714 + }, + "plain" : { + "med_us" : 2402, + "best_us" : 2400.75 + }, + "u2" : { + "med_us" : 2455.75, + "best_us" : 2455.5 + }, + "u4" : { + "med_us" : 2407, + "best_us" : 2405.125 + }, + "u8" : { + "med_us" : 2407.125, + "best_us" : 2402.125 + }, + "vec4_u2" : { + "med_us" : 3063.3333333333335, + "best_us" : 3061.6666666666665 + }, + "vec4_u8" : { + "med_us" : 3058.1666666666665, + "best_us" : 3052.5 + }, + "vec8_u2" : { + "med_us" : 2532.1428571428573, + "best_us" : 2530.714285714286 + }, + "vec8_u8" : { + "med_us" : 2532.4285714285716, + "best_us" : 2529.714285714286 + }, + "vec16" : { + "med_us" : 2401.375, + "best_us" : 2400.5 + } + } + }, + "dot_q8kv" : { + "winner" : "vec4_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 24.360734803198504, + "rows" : { + "vec32_u2" : { + "med_us" : 1288.5333333333333, + "best_us" : 1287.8666666666666 + }, + "vec32" : { + "med_us" : 1920.8, + "best_us" : 1918.7 + }, + "vec32_u4" : { + "med_us" : 1288.3333333333333, + "best_us" : 1287.5333333333333 + }, + "vec32_u8" : { + "med_us" : 1287.6666666666667, + "best_us" : 1285.2666666666667 + }, + "vec16_u2" : { + "med_us" : 874.2727272727273, + "best_us" : 872.9545454545455 + }, + "vec16_u4" : { + "med_us" : 873.7727272727273, + "best_us" : 873.2727272727273 + }, + "vec16_u8" : { + "med_us" : 874.3181818181819, + "best_us" : 873.0909090909091 + }, + "vec4" : { + "med_us" : 1921, + "best_us" : 1918.3 + }, + "vec8" : { + "med_us" : 1922.5, + "best_us" : 1920.9 + }, + "vec4_u4" : { + "med_us" : 503.84375, + "best_us" : 503.3125 + }, + "vec8_u4" : { + "med_us" : 666.4666666666667, + "best_us" : 665.5 + }, + "plain" : { + "med_us" : 1920.6, + "best_us" : 1918.8 + }, + "u2" : { + "med_us" : 1226.0625, + "best_us" : 1223.3125 + }, + "u4" : { + "med_us" : 1225.5, + "best_us" : 1222.6875 + }, + "u8" : { + "med_us" : 1225.4375, + "best_us" : 1224.625 + }, + "vec4_u2" : { + "med_us" : 503.953125, + "best_us" : 502.4375 + }, + "vec4_u8" : { + "med_us" : 503.6875, + "best_us" : 502.96875 + }, + "vec8_u2" : { + "med_us" : 666.2586206896551, + "best_us" : 665.3103448275862 + }, + "vec8_u8" : { + "med_us" : 666.9655172413793, + "best_us" : 666.4827586206897 + }, + "vec16" : { + "med_us" : 1922.2, + "best_us" : 1919.6 + } + } + }, + "quantize_q8_0_bs_into_ptr" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 2351.125, + "best_us" : 2338.75 + }, + "vec32" : { + "med_us" : 2032.5555555555557, + "best_us" : 2022 + }, + "vec32_u4" : { + "med_us" : 2351.25, + "best_us" : 2343.5 + }, + "vec32_u8" : { + "med_us" : 2347.125, + "best_us" : 2338 + }, + "vec16_u2" : { + "med_us" : 2330.125, + "best_us" : 2329.875 + }, + "vec16_u4" : { + "med_us" : 2327.625, + "best_us" : 2316.875 + }, + "vec16_u8" : { + "med_us" : 2319.625, + "best_us" : 2308.375 + }, + "vec4" : { + "med_us" : 2090.8888888888887, + "best_us" : 2082 + }, + "vec8" : { + "med_us" : 2044, + "best_us" : 2031.111111111111 + }, + "vec4_u4" : { + "med_us" : 2492.8571428571427, + "best_us" : 2477.8571428571427 + }, + "vec8_u4" : { + "med_us" : 2139.4444444444443, + "best_us" : 2134.777777777778 + }, + "plain" : { + "med_us" : 2033.2, + "best_us" : 2030.2 + }, + "u2" : { + "med_us" : 2329.75, + "best_us" : 2316.125 + }, + "u4" : { + "med_us" : 2323.125, + "best_us" : 2303.375 + }, + "u8" : { + "med_us" : 2322.5, + "best_us" : 2314.125 + }, + "vec4_u2" : { + "med_us" : 2503, + "best_us" : 2483.8571428571427 + }, + "vec4_u8" : { + "med_us" : 2498.8571428571427, + "best_us" : 2495.714285714286 + }, + "vec8_u2" : { + "med_us" : 2134.222222222222, + "best_us" : 2126.777777777778 + }, + "vec8_u8" : { + "med_us" : 2146.3333333333335, + "best_us" : 2131.1111111111113 + }, + "vec16" : { + "med_us" : 2043.4444444444443, + "best_us" : 2022.4444444444443 + } + } + }, + "dot_q8q8" : { + "winner" : "vec16", + "fallback" : "vec16", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 582.84375, + "best_us" : 582.21875 + }, + "vec32" : { + "med_us" : 575.3125, + "best_us" : 574.75 + }, + "vec32_u4" : { + "med_us" : 583.625, + "best_us" : 582.125 + }, + "vec32_u8" : { + "med_us" : 584.0625, + "best_us" : 583.03125 + }, + "vec16_u2" : { + "med_us" : 579.9375, + "best_us" : 579.0625 + }, + "vec16_u4" : { + "med_us" : 578.875, + "best_us" : 577.84375 + }, + "vec16_u8" : { + "med_us" : 582.09375, + "best_us" : 581.0625 + }, + "vec4" : { + "med_us" : 575, + "best_us" : 573.90625 + }, + "vec8" : { + "med_us" : 575.09375, + "best_us" : 574.78125 + }, + "vec4_u4" : { + "med_us" : 1942.1, + "best_us" : 1941.6 + }, + "vec8_u4" : { + "med_us" : 747.5384615384615, + "best_us" : 747.1538461538462 + }, + "plain" : { + "med_us" : 575.125, + "best_us" : 574.90625 + }, + "u2" : { + "med_us" : 580, + "best_us" : 578.8125 + }, + "u4" : { + "med_us" : 588.6875, + "best_us" : 585.125 + }, + "u8" : { + "med_us" : 580.84375, + "best_us" : 579.875 + }, + "vec4_u2" : { + "med_us" : 1944.4, + "best_us" : 1941.5 + }, + "vec4_u8" : { + "med_us" : 1942.8, + "best_us" : 1940.6 + }, + "vec8_u2" : { + "med_us" : 746.6153846153846, + "best_us" : 746.4615384615385 + }, + "vec8_u8" : { + "med_us" : 748.36, + "best_us" : 747.12 + }, + "vec16" : { + "med_us" : 575.3125, + "best_us" : 574.96875 + } + } + }, + "gemm_f32_uk_4x16" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 539.125, + "best_us" : 538.15625 + }, + "vec32" : { + "med_us" : 595.0625, + "best_us" : 594.125 + }, + "vec32_u4" : { + "med_us" : 550.90625, + "best_us" : 549.46875 + }, + "vec32_u8" : { + "med_us" : 545.84375, + "best_us" : 544.75 + }, + "vec16_u2" : { + "med_us" : 538.53125, + "best_us" : 538.25 + }, + "vec16_u4" : { + "med_us" : 549, + "best_us" : 548.46875 + }, + "vec16_u8" : { + "med_us" : 545.78125, + "best_us" : 545.21875 + }, + "vec4" : { + "med_us" : 595.1875, + "best_us" : 593.90625 + }, + "vec8" : { + "med_us" : 594.71875, + "best_us" : 593.71875 + }, + "vec4_u4" : { + "med_us" : 550.125, + "best_us" : 548.3125 + }, + "vec8_u4" : { + "med_us" : 549.875, + "best_us" : 549.21875 + }, + "plain" : { + "med_us" : 594.875, + "best_us" : 594.0625 + }, + "u2" : { + "med_us" : 538.71875, + "best_us" : 538.3125 + }, + "u4" : { + "med_us" : 550.84375, + "best_us" : 549.0625 + }, + "u8" : { + "med_us" : 545.5625, + "best_us" : 545 + }, + "vec4_u2" : { + "med_us" : 539.78125, + "best_us" : 538.09375 + }, + "vec4_u8" : { + "med_us" : 545.65625, + "best_us" : 545.03125 + }, + "vec8_u2" : { + "med_us" : 538.71875, + "best_us" : 538.34375 + }, + "vec8_u8" : { + "med_us" : 545.9375, + "best_us" : 545.09375 + }, + "vec16" : { + "med_us" : 595.15625, + "best_us" : 594.75 + } + } + }, + "quantize_q8kv_row" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1199.5625, + "best_us" : 1197 + }, + "vec32" : { + "med_us" : 1173, + "best_us" : 1169.7058823529412 + }, + "vec32_u4" : { + "med_us" : 1199.75, + "best_us" : 1196.375 + }, + "vec32_u8" : { + "med_us" : 1194.5, + "best_us" : 1188.125 + }, + "vec16_u2" : { + "med_us" : 1171.6470588235295, + "best_us" : 1170.6470588235295 + }, + "vec16_u4" : { + "med_us" : 1174.4375, + "best_us" : 1170.9375 + }, + "vec16_u8" : { + "med_us" : 1170.0588235294117, + "best_us" : 1169.0588235294117 + }, + "vec4" : { + "med_us" : 1171.5294117647059, + "best_us" : 1169.3529411764705 + }, + "vec8" : { + "med_us" : 1171.375, + "best_us" : 1170.4375 + }, + "vec4_u4" : { + "med_us" : 1497.923076923077, + "best_us" : 1493.8461538461538 + }, + "vec8_u4" : { + "med_us" : 1226.125, + "best_us" : 1224.0625 + }, + "plain" : { + "med_us" : 1171.9411764705883, + "best_us" : 1169 + }, + "u2" : { + "med_us" : 1174.25, + "best_us" : 1172.4375 + }, + "u4" : { + "med_us" : 1168.9411764705883, + "best_us" : 1165.8235294117646 + }, + "u8" : { + "med_us" : 1174.25, + "best_us" : 1171.5625 + }, + "vec4_u2" : { + "med_us" : 1495, + "best_us" : 1491.8461538461538 + }, + "vec4_u8" : { + "med_us" : 1492.8461538461538, + "best_us" : 1489.4615384615386 + }, + "vec8_u2" : { + "med_us" : 1233.625, + "best_us" : 1231.0625 + }, + "vec8_u8" : { + "med_us" : 1231.1875, + "best_us" : 1229.625 + }, + "vec16" : { + "med_us" : 1173.764705882353, + "best_us" : 1172.0588235294117 + } + } + }, + "dot_f16" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 284.09375, + "best_us" : 283.125 + }, + "vec32" : { + "med_us" : 284.125, + "best_us" : 283.59375 + }, + "vec32_u4" : { + "med_us" : 283.78125, + "best_us" : 282.8125 + }, + "vec32_u8" : { + "med_us" : 285.34375, + "best_us" : 284.53125 + }, + "vec16_u2" : { + "med_us" : 268.59375, + "best_us" : 268.46875 + }, + "vec16_u4" : { + "med_us" : 268.65625, + "best_us" : 268.5 + }, + "vec16_u8" : { + "med_us" : 270.03125, + "best_us" : 269.65625 + }, + "vec4" : { + "med_us" : 419.40625, + "best_us" : 418.21875 + }, + "vec8" : { + "med_us" : 257.46875, + "best_us" : 257.21875 + }, + "vec4_u4" : { + "med_us" : 415.65625, + "best_us" : 414.84375 + }, + "vec8_u4" : { + "med_us" : 260.40625, + "best_us" : 259.75 + }, + "plain" : { + "med_us" : 3881, + "best_us" : 3814 + }, + "u2" : { + "med_us" : 3828.6, + "best_us" : 3802 + }, + "u4" : { + "med_us" : 3867.6, + "best_us" : 3829.6 + }, + "u8" : { + "med_us" : 3879, + "best_us" : 3857.6 + }, + "vec4_u2" : { + "med_us" : 417.75, + "best_us" : 416.46875 + }, + "vec4_u8" : { + "med_us" : 416.53125, + "best_us" : 415.96875 + }, + "vec8_u2" : { + "med_us" : 259.84375, + "best_us" : 259.375 + }, + "vec8_u8" : { + "med_us" : 260.9375, + "best_us" : 260.0625 + }, + "vec16" : { + "med_us" : 268.9375, + "best_us" : 267.625 + } + } + }, + "axpy_f16" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 284.9375, + "best_us" : 283.9375 + }, + "vec32" : { + "med_us" : 299.71875, + "best_us" : 296.6875 + }, + "vec32_u4" : { + "med_us" : 285.03125, + "best_us" : 284.15625 + }, + "vec32_u8" : { + "med_us" : 284.65625, + "best_us" : 284.59375 + }, + "vec16_u2" : { + "med_us" : 300.625, + "best_us" : 300.0625 + }, + "vec16_u4" : { + "med_us" : 287.8125, + "best_us" : 286.875 + }, + "vec16_u8" : { + "med_us" : 289.34375, + "best_us" : 286.34375 + }, + "vec4" : { + "med_us" : 299.9375, + "best_us" : 299.71875 + }, + "vec8" : { + "med_us" : 302.21875, + "best_us" : 301.03125 + }, + "vec4_u4" : { + "med_us" : 287.6875, + "best_us" : 286.71875 + }, + "vec8_u4" : { + "med_us" : 284.5, + "best_us" : 283.65625 + }, + "plain" : { + "med_us" : 301, + "best_us" : 300.9375 + }, + "u2" : { + "med_us" : 284.46875, + "best_us" : 283.21875 + }, + "u4" : { + "med_us" : 284.96875, + "best_us" : 284.59375 + }, + "u8" : { + "med_us" : 283.53125, + "best_us" : 283.4375 + }, + "vec4_u2" : { + "med_us" : 300.8125, + "best_us" : 300.375 + }, + "vec4_u8" : { + "med_us" : 288.90625, + "best_us" : 288.0625 + }, + "vec8_u2" : { + "med_us" : 284.46875, + "best_us" : 283.90625 + }, + "vec8_u8" : { + "med_us" : 284.4375, + "best_us" : 283.46875 + }, + "vec16" : { + "med_us" : 297.65625, + "best_us" : 297.09375 + } + } + }, + "cvt_f16_to_f32" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 248.25, + "best_us" : 244.53125 + }, + "vec32" : { + "med_us" : 250.28125, + "best_us" : 247.75 + }, + "vec32_u4" : { + "med_us" : 245.5625, + "best_us" : 243.65625 + }, + "vec32_u8" : { + "med_us" : 246.71875, + "best_us" : 245.75 + }, + "vec16_u2" : { + "med_us" : 244.75, + "best_us" : 242.53125 + }, + "vec16_u4" : { + "med_us" : 246.40625, + "best_us" : 245.03125 + }, + "vec16_u8" : { + "med_us" : 246.09375, + "best_us" : 245.90625 + }, + "vec4" : { + "med_us" : 249.90625, + "best_us" : 244 + }, + "vec8" : { + "med_us" : 247.65625, + "best_us" : 241.0625 + }, + "vec4_u4" : { + "med_us" : 250.25, + "best_us" : 248.375 + }, + "vec8_u4" : { + "med_us" : 246.3125, + "best_us" : 244.5 + }, + "plain" : { + "med_us" : 248.1875, + "best_us" : 243.28125 + }, + "u2" : { + "med_us" : 251.40625, + "best_us" : 246.21875 + }, + "u4" : { + "med_us" : 246.03125, + "best_us" : 243.5 + }, + "u8" : { + "med_us" : 243.6875, + "best_us" : 242 + }, + "vec4_u2" : { + "med_us" : 247.78125, + "best_us" : 246.21875 + }, + "vec4_u8" : { + "med_us" : 248.0625, + "best_us" : 245.375 + }, + "vec8_u2" : { + "med_us" : 244.53125, + "best_us" : 243.875 + }, + "vec8_u8" : { + "med_us" : 246.65625, + "best_us" : 245.09375 + }, + "vec16" : { + "med_us" : 248.5, + "best_us" : 247.75 + } + } + }, + "dot" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1630.75, + "best_us" : 1616.9166666666667 + }, + "vec32" : { + "med_us" : 1631.8333333333333, + "best_us" : 1627 + }, + "vec32_u4" : { + "med_us" : 1627.1666666666667, + "best_us" : 1625.75 + }, + "vec32_u8" : { + "med_us" : 1639.1818181818182, + "best_us" : 1636.5454545454545 + }, + "vec16_u2" : { + "med_us" : 1621.9166666666667, + "best_us" : 1614.75 + }, + "vec16_u4" : { + "med_us" : 1619, + "best_us" : 1616.8333333333333 + }, + "vec16_u8" : { + "med_us" : 1620.8333333333333, + "best_us" : 1620.1666666666667 + }, + "vec4" : { + "med_us" : 1785.1818181818182, + "best_us" : 1776.6363636363637 + }, + "vec8" : { + "med_us" : 1646.1666666666667, + "best_us" : 1635.1666666666667 + }, + "vec4_u4" : { + "med_us" : 1781.6363636363637, + "best_us" : 1776.5454545454545 + }, + "vec8_u4" : { + "med_us" : 1618.5833333333333, + "best_us" : 1617.8333333333333 + }, + "plain" : { + "med_us" : 15797, + "best_us" : 15434 + }, + "u2" : { + "med_us" : 15721, + "best_us" : 15443 + }, + "u4" : { + "med_us" : 15359, + "best_us" : 15267 + }, + "u8" : { + "med_us" : 15543, + "best_us" : 15339 + }, + "vec4_u2" : { + "med_us" : 1779.6363636363637, + "best_us" : 1774.6363636363637 + }, + "vec4_u8" : { + "med_us" : 1775.3636363636363, + "best_us" : 1773.6363636363637 + }, + "vec8_u2" : { + "med_us" : 1631.3333333333333, + "best_us" : 1625.8333333333333 + }, + "vec8_u8" : { + "med_us" : 1624.5, + "best_us" : 1615.0833333333333 + }, + "vec16" : { + "med_us" : 1636.9166666666667, + "best_us" : 1632.1666666666667 + } + } + }, + "q40q8_tile_gen" : { + "winner" : "mr8", + "rows" : { + "mr8" : { + "tile_us" : 29125, + "gemv_us" : 163, + "hot_us" : 10.25 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 306235, + "gemv_us" : 1206, + "hot_us" : 75.875 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 305956, + "gemv_us" : 1186, + "hot_us" : 75 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 306232, + "gemv_us" : 1162, + "hot_us" : 73.75 + }, + "mr4" : { + "tile_us" : 32744, + "gemv_us" : 176, + "hot_us" : 10.5625 + }, + "reference" : { + "tile_us" : 306482, + "gemv_us" : 1195, + "hot_us" : 75.6875 + }, + "mr4_nrsplit2" : { + "tile_us" : 36511, + "gemv_us" : 177, + "hot_us" : 11 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 306264, + "gemv_us" : 1199, + "hot_us" : 72 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 305949, + "gemv_us" : 1157, + "hot_us" : 73.4375 + }, + "mr8_nrsplit2" : { + "tile_us" : 33010, + "gemv_us" : 163, + "hot_us" : 9.6875 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 306149, + "gemv_us" : 1213, + "hot_us" : 76 + } + } + }, + "axpy" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 336.84375, + "best_us" : 332.9375 + }, + "vec32" : { + "med_us" : 361.15625, + "best_us" : 357.78125 + }, + "vec32_u4" : { + "med_us" : 338.09375, + "best_us" : 334.59375 + }, + "vec32_u8" : { + "med_us" : 334.21875, + "best_us" : 333.53125 + }, + "vec16_u2" : { + "med_us" : 361.65625, + "best_us" : 358.84375 + }, + "vec16_u4" : { + "med_us" : 338.625, + "best_us" : 336.21875 + }, + "vec16_u8" : { + "med_us" : 335.59375, + "best_us" : 334.3125 + }, + "vec4" : { + "med_us" : 361.125, + "best_us" : 359.25 + }, + "vec8" : { + "med_us" : 361.25, + "best_us" : 359.21875 + }, + "vec4_u4" : { + "med_us" : 337.5, + "best_us" : 335.78125 + }, + "vec8_u4" : { + "med_us" : 336.65625, + "best_us" : 333.96875 + }, + "plain" : { + "med_us" : 361.15625, + "best_us" : 360.3125 + }, + "u2" : { + "med_us" : 359.96875, + "best_us" : 359.375 + }, + "u4" : { + "med_us" : 338.25, + "best_us" : 335.625 + }, + "u8" : { + "med_us" : 335.71875, + "best_us" : 334.28125 + }, + "vec4_u2" : { + "med_us" : 361.71875, + "best_us" : 359.03125 + }, + "vec4_u8" : { + "med_us" : 335.15625, + "best_us" : 334.21875 + }, + "vec8_u2" : { + "med_us" : 335.75, + "best_us" : 335.15625 + }, + "vec8_u8" : { + "med_us" : 335.59375, + "best_us" : 335.09375 + }, + "vec16" : { + "med_us" : 360.65625, + "best_us" : 359.78125 + } + } + }, + "dot_q8q8kv" : { + "winner" : "vec16", + "fallback" : "vec16", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 139.90625, + "best_us" : 139.78125 + }, + "vec32" : { + "med_us" : 128.90625, + "best_us" : 128.8125 + }, + "vec32_u4" : { + "med_us" : 140.46875, + "best_us" : 139.9375 + }, + "vec32_u8" : { + "med_us" : 140.15625, + "best_us" : 140.03125 + }, + "vec16_u2" : { + "med_us" : 140, + "best_us" : 139.3125 + }, + "vec16_u4" : { + "med_us" : 139.625, + "best_us" : 139.34375 + }, + "vec16_u8" : { + "med_us" : 139.71875, + "best_us" : 139.625 + }, + "vec4" : { + "med_us" : 136.15625, + "best_us" : 136.09375 + }, + "vec8" : { + "med_us" : 136.1875, + "best_us" : 136.125 + }, + "vec4_u4" : { + "med_us" : 487.71875, + "best_us" : 487.21875 + }, + "vec8_u4" : { + "med_us" : 194.5, + "best_us" : 194.28125 + }, + "plain" : { + "med_us" : 136.4375, + "best_us" : 136.125 + }, + "u2" : { + "med_us" : 139.6875, + "best_us" : 139.625 + }, + "u4" : { + "med_us" : 139.96875, + "best_us" : 139.5 + }, + "u8" : { + "med_us" : 139.625, + "best_us" : 139.15625 + }, + "vec4_u2" : { + "med_us" : 488.09375, + "best_us" : 487.84375 + }, + "vec4_u8" : { + "med_us" : 488.09375, + "best_us" : 487.53125 + }, + "vec8_u2" : { + "med_us" : 194.3125, + "best_us" : 193.5 + }, + "vec8_u8" : { + "med_us" : 194.21875, + "best_us" : 193.6875 + }, + "vec16" : { + "med_us" : 129.03125, + "best_us" : 128.875 + } + } + }, + "dot_mx4q8" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 163.6875, + "best_us" : 163.59375 + }, + "vec32" : { + "med_us" : 164.21875, + "best_us" : 163.78125 + }, + "vec32_u4" : { + "med_us" : 164.0625, + "best_us" : 163.84375 + }, + "vec32_u8" : { + "med_us" : 164.09375, + "best_us" : 163.90625 + }, + "vec16_u2" : { + "med_us" : 163.65625, + "best_us" : 163.25 + }, + "vec16_u4" : { + "med_us" : 163.96875, + "best_us" : 163.71875 + }, + "vec16_u8" : { + "med_us" : 164.0625, + "best_us" : 163.9375 + }, + "vec4" : { + "med_us" : 163.5625, + "best_us" : 163.28125 + }, + "vec8" : { + "med_us" : 164.84375, + "best_us" : 163.78125 + }, + "vec4_u4" : { + "med_us" : 163.90625, + "best_us" : 163.625 + }, + "vec8_u4" : { + "med_us" : 164.0625, + "best_us" : 163.875 + }, + "plain" : { + "med_us" : 187.03125, + "best_us" : 186.4375 + }, + "u2" : { + "med_us" : 163.875, + "best_us" : 163.53125 + }, + "u4" : { + "med_us" : 164, + "best_us" : 163.75 + }, + "u8" : { + "med_us" : 164.15625, + "best_us" : 163.71875 + }, + "vec4_u2" : { + "med_us" : 164.3125, + "best_us" : 163.78125 + }, + "vec4_u8" : { + "med_us" : 164, + "best_us" : 163.625 + }, + "vec8_u2" : { + "med_us" : 163.90625, + "best_us" : 163.375 + }, + "vec8_u8" : { + "med_us" : 164.53125, + "best_us" : 163.875 + }, + "vec16" : { + "med_us" : 164.1875, + "best_us" : 163.8125 + } + } + }, + "dot_q8q8_laneq4x4" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 751.6538461538462, + "best_us" : 750 + }, + "vec32" : { + "med_us" : 756.1538461538462, + "best_us" : 753.1923076923077 + }, + "vec32_u4" : { + "med_us" : 752.9615384615385, + "best_us" : 752.1923076923077 + }, + "vec32_u8" : { + "med_us" : 846, + "best_us" : 842 + }, + "vec16_u2" : { + "med_us" : 750.6153846153846, + "best_us" : 749.6923076923077 + }, + "vec16_u4" : { + "med_us" : 752.28, + "best_us" : 750.72 + }, + "vec16_u8" : { + "med_us" : 844.8260869565217, + "best_us" : 842.5217391304348 + }, + "vec4" : { + "med_us" : 755.1538461538462, + "best_us" : 754.4615384615385 + }, + "vec8" : { + "med_us" : 754.7307692307693, + "best_us" : 754.0769230769231 + }, + "vec4_u4" : { + "med_us" : 753.7307692307693, + "best_us" : 751.2307692307693 + }, + "vec8_u4" : { + "med_us" : 752.2307692307693, + "best_us" : 751.5769230769231 + }, + "plain" : { + "med_us" : 753.8148148148148, + "best_us" : 753.4814814814815 + }, + "u2" : { + "med_us" : 749.5384615384615, + "best_us" : 748.6923076923077 + }, + "u4" : { + "med_us" : 752.4814814814815, + "best_us" : 751.7037037037037 + }, + "u8" : { + "med_us" : 845.9166666666666, + "best_us" : 842 + }, + "vec4_u2" : { + "med_us" : 749.6923076923077, + "best_us" : 747.8461538461538 + }, + "vec4_u8" : { + "med_us" : 845.7826086956521, + "best_us" : 843.9130434782609 + }, + "vec8_u2" : { + "med_us" : 748.5, + "best_us" : 748.2692307692307 + }, + "vec8_u8" : { + "med_us" : 846.5652173913044, + "best_us" : 846.2608695652174 + }, + "vec16" : { + "med_us" : 754.5384615384615, + "best_us" : 754.0769230769231 + } + } + }, + "scale_inplace" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 251.1875, + "best_us" : 249.5 + }, + "vec32" : { + "med_us" : 247.25, + "best_us" : 245.75 + }, + "vec32_u4" : { + "med_us" : 253.0625, + "best_us" : 247.625 + }, + "vec32_u8" : { + "med_us" : 250.125, + "best_us" : 248.71875 + }, + "vec16_u2" : { + "med_us" : 270.09375, + "best_us" : 265.875 + }, + "vec16_u4" : { + "med_us" : 268.75, + "best_us" : 264.40625 + }, + "vec16_u8" : { + "med_us" : 1146.4117647058824, + "best_us" : 1146.1764705882354 + }, + "vec4" : { + "med_us" : 245.625, + "best_us" : 245.40625 + }, + "vec8" : { + "med_us" : 249.59375, + "best_us" : 244.75 + }, + "vec4_u4" : { + "med_us" : 249.21875, + "best_us" : 244.25 + }, + "vec8_u4" : { + "med_us" : 253.875, + "best_us" : 250.90625 + }, + "plain" : { + "med_us" : 246.84375, + "best_us" : 244.21875 + }, + "u2" : { + "med_us" : 245.84375, + "best_us" : 244.3125 + }, + "u4" : { + "med_us" : 247, + "best_us" : 246.21875 + }, + "u8" : { + "med_us" : 246.53125, + "best_us" : 245.09375 + }, + "vec4_u2" : { + "med_us" : 245.8125, + "best_us" : 244.5625 + }, + "vec4_u8" : { + "med_us" : 247.96875, + "best_us" : 245.6875 + }, + "vec8_u2" : { + "med_us" : 251.28125, + "best_us" : 247.25 + }, + "vec8_u8" : { + "med_us" : 250.875, + "best_us" : 247.84375 + }, + "vec16" : { + "med_us" : 268.28125, + "best_us" : 265.0625 + } + } + }, + "dot_q4" : { + "winner" : "vec4_u4", + "fallback" : "vec4_u4", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1627, + "best_us" : 1621.8333333333333 + }, + "vec32" : { + "med_us" : 1968.6, + "best_us" : 1963.2 + }, + "vec32_u4" : { + "med_us" : 1557.25, + "best_us" : 1548.1666666666667 + }, + "vec32_u8" : { + "med_us" : 1519.5384615384614, + "best_us" : 1512.2307692307693 + }, + "vec16_u2" : { + "med_us" : 1012.3684210526316, + "best_us" : 1010.421052631579 + }, + "vec16_u4" : { + "med_us" : 1014.8947368421053, + "best_us" : 1014.3684210526316 + }, + "vec16_u8" : { + "med_us" : 1013.6842105263158, + "best_us" : 1010.9473684210526 + }, + "vec4" : { + "med_us" : 1968.1, + "best_us" : 1965.6 + }, + "vec8" : { + "med_us" : 1970.3, + "best_us" : 1968.7 + }, + "vec4_u4" : { + "med_us" : 815.7083333333334, + "best_us" : 813.9583333333334 + }, + "vec8_u4" : { + "med_us" : 848.304347826087, + "best_us" : 847.304347826087 + }, + "plain" : { + "med_us" : 1968.6, + "best_us" : 1967.7 + }, + "u2" : { + "med_us" : 1023.7894736842105, + "best_us" : 1021.3157894736842 + }, + "u4" : { + "med_us" : 1023.4736842105264, + "best_us" : 1023 + }, + "u8" : { + "med_us" : 1023.6315789473684, + "best_us" : 1021.1052631578947 + }, + "vec4_u2" : { + "med_us" : 814.9583333333334, + "best_us" : 814 + }, + "vec4_u8" : { + "med_us" : 815.4166666666666, + "best_us" : 813.875 + }, + "vec8_u2" : { + "med_us" : 847.0869565217391, + "best_us" : 846.1739130434783 + }, + "vec8_u8" : { + "med_us" : 847.8695652173913, + "best_us" : 846.2608695652174 + }, + "vec16" : { + "med_us" : 1966.9, + "best_us" : 1965.9 + } + } + }, + "copy_floats" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 265, + "best_us" : 264.1875 + }, + "vec32" : { + "med_us" : 348.375, + "best_us" : 264.84375 + }, + "vec32_u4" : { + "med_us" : 266.46875, + "best_us" : 264.5 + }, + "vec32_u8" : { + "med_us" : 268.6875, + "best_us" : 266.03125 + }, + "vec16_u2" : { + "med_us" : 561.625, + "best_us" : 265.1875 + }, + "vec16_u4" : { + "med_us" : 562.15625, + "best_us" : 266.34375 + }, + "vec16_u8" : { + "med_us" : 562.15625, + "best_us" : 263.59375 + }, + "vec4" : { + "med_us" : 266.375, + "best_us" : 264.25 + }, + "vec8" : { + "med_us" : 268.3125, + "best_us" : 264.5 + }, + "vec4_u4" : { + "med_us" : 266.96875, + "best_us" : 263.78125 + }, + "vec8_u4" : { + "med_us" : 267, + "best_us" : 265.71875 + }, + "plain" : { + "med_us" : 270.0625, + "best_us" : 264.875 + }, + "u2" : { + "med_us" : 290.46875, + "best_us" : 265.0625 + }, + "u4" : { + "med_us" : 273.53125, + "best_us" : 262.96875 + }, + "u8" : { + "med_us" : 270.03125, + "best_us" : 263.75 + }, + "vec4_u2" : { + "med_us" : 267.71875, + "best_us" : 263.75 + }, + "vec4_u8" : { + "med_us" : 268.78125, + "best_us" : 265.125 + }, + "vec8_u2" : { + "med_us" : 268.28125, + "best_us" : 264.59375 + }, + "vec8_u8" : { + "med_us" : 279.625, + "best_us" : 264.21875 + }, + "vec16" : { + "med_us" : 563.71875, + "best_us" : 265.03125 + } + } + }, + "rmsnorm" : { + "winner" : "vec8", + "fallback" : "plain", + "floor_pct" : 0.2562158682043463, + "margin_pct" : 85.9326900307838, + "rows" : { + "vec32_u2" : { + "med_us" : 617.78125, + "best_us" : 617.03125 + }, + "vec32" : { + "med_us" : 613.75, + "best_us" : 613.59375 + }, + "vec32_u4" : { + "med_us" : 618.03125, + "best_us" : 617.59375 + }, + "vec32_u8" : { + "med_us" : 621.71875, + "best_us" : 621.0625 + }, + "vec16_u2" : { + "med_us" : 602.21875, + "best_us" : 600.90625 + }, + "vec16_u4" : { + "med_us" : 604.46875, + "best_us" : 603.375 + }, + "vec16_u8" : { + "med_us" : 612.984375, + "best_us" : 610.84375 + }, + "vec4" : { + "med_us" : 686.3448275862069, + "best_us" : 684.7241379310345 + }, + "vec8" : { + "med_us" : 594.21875, + "best_us" : 593.03125 + }, + "vec4_u4" : { + "med_us" : 690.1428571428571, + "best_us" : 690 + }, + "vec8_u4" : { + "med_us" : 598.328125, + "best_us" : 597.1875 + }, + "plain" : { + "med_us" : 4231.125, + "best_us" : 4177.75 + }, + "u2" : { + "med_us" : 4216.5, + "best_us" : 4185.5 + }, + "u4" : { + "med_us" : 4179, + "best_us" : 4166.75 + }, + "u8" : { + "med_us" : 4178.75, + "best_us" : 4172.25 + }, + "vec4_u2" : { + "med_us" : 687.3571428571429, + "best_us" : 685.3571428571429 + }, + "vec4_u8" : { + "med_us" : 693.1071428571429, + "best_us" : 691.8571428571429 + }, + "vec8_u2" : { + "med_us" : 597.921875, + "best_us" : 597.1875 + }, + "vec8_u8" : { + "med_us" : 598.359375, + "best_us" : 596.71875 + }, + "vec16" : { + "med_us" : 600.34375, + "best_us" : 599.375 + } + } + } + }, + "runtime" : { + "jobque_spin_us" : 30000, + "target_chunk_work" : 1, + "norm_par_threshold" : 256000, + "gemv_lane_cap" : 6, + "matmul_min_chunk_rows" : 16, + "batch_grid_2d" : 0, + "metal_devw_small_panel_mb" : 32, + "team_rank_gate" : -1, + "kv_store_par_threshold" : 256000, + "q8_l2_budget" : 4194304, + "rope_par_threshold" : 100000, + "jobque_join_poll" : 50, + "q8_token_block" : 128, + "requant_par_threshold" : 256000, + "metal_tensor" : "mulmm_bf16,mulmm_q8,moe_mulmm_q8,attn_qkmm,kq_mulmm_k4,kq_mulmm_k5,kq_mulmm_k6,gemmb_q8,gemmb_sk_q8,gemm64b_q8", + "matmul_min_chunk_rows_gemv" : 64, + "attn_par_threshold" : 100000, + "batch_lane_cap" : 0, + "metal_cvt_min_rows" : 256, + "metal_tall_floor" : 64, + "act_par_threshold" : 100000, + "threads" : 18, + "dispatch_worker_limit" : 0, + "q8_batch_chunks_per_job" : 4, + "q8_chunks_per_job" : 2, + "q4_chunks_per_job" : 4 + } +} \ No newline at end of file diff --git a/modules/dasLLAMA/release_remint_plan.md b/modules/dasLLAMA/release_remint_plan.md index 3dad8ce77e..f072f116d2 100644 --- a/modules/dasLLAMA/release_remint_plan.md +++ b/modules/dasLLAMA/release_remint_plan.md @@ -110,6 +110,17 @@ from slice B minted here. Parity pregate per row; predictions logged before each process per box, cv>3% void; `gen_site_records` closes it. Full board on one pin = one provenance (the v14/fallback-stamp taint is not per-cell diagnosable). +## Post-sweep ruling (Boris, 2026-08-30) + +The two-tier stop rule: a FAIL (crash/refusal/no-measure) stops the sweep for an immediate +fix — it poisons every cell after it; a PERFORMANCE red lets the sweep finish, then fix and +re-profile ONLY the red cells (`-o` narrowing) — no full re-sweep, the board is then good; +more sweeps follow after the coming arcs. +Red #1: gpt-oss-20b (mxfp4 MoE) das metal pp halved vs the pre-merge row (3989 -> 2047) +while every k-quant MoE gained +6-7%; window = the master merge (first post-merge perf +pass); suspect = the ffn_moe_prefill_grouped seam x the 32-row split on the Metal mx4 +path (per-expert-bias staging pays per region where k-quant's cnt/basep walk does not). + ## Slice E — M4 over ssh Canary rows re-mint (Q8_0 decoder artifact) + the Efficiency-tier gate proof: live-lane diff --git a/site/files/dasllama/bench_records.json b/site/files/dasllama/bench_records.json index 888234c47d..59668738b9 100644 --- a/site/files/dasllama/bench_records.json +++ b/site/files/dasllama/bench_records.json @@ -503,7 +503,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", @@ -518,23 +518,24 @@ }, "tests":{ "pp512":{ - "tok_s":3201.3003848974017, - "stddev":5.6111979484558105 + "tok_s":3417.9313900026973, + "stddev":7.5922303199768066 }, "tg128":{ - "tok_s":127.311408165347, - "stddev":0.40768790245056152 + "tok_s":127.08095638626337, + "stddev":0.34214609861373901 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -550,7 +551,7 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", @@ -565,12 +566,12 @@ }, "tests":{ "pp512":{ - "tok_s":3183.6708789999998, - "stddev":19.433194 + "tok_s":3183.6694309999998, + "stddev":18.630693000000001 }, "tg128":{ - "tok_s":95.600543000000002, - "stddev":0.52021399999999995 + "tok_s":95.593917000000005, + "stddev":0.51324599999999998 } }, "source":"official", @@ -585,6 +586,184 @@ } ] }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":245.67426193467696, + "stddev":1.5736089944839478 + }, + "tg128":{ + "tok_s":59.45895060962151, + "stddev":0.1826636791229248 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":153.45827, + "stddev":2.5598679999999998 + }, + "tg128":{ + "tok_s":49.663220000000003, + "stddev":0.287603 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":261.949666310331, + "stddev":1.8196882009506226 + }, + "tg128":{ + "tok_s":59.451622478787542, + "stddev":0.6035768985748291 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":155.070379, + "stddev":2.7505120000000001 + }, + "tg128":{ + "tok_s":49.314608999999997, + "stddev":0.35692000000000002 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", + "sha256":"0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", + "bytes":22663387424 + } + ] + }, { "engine":"das", "backend":"cpu", @@ -1266,7 +1445,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", @@ -1281,23 +1460,24 @@ }, "tests":{ "pp512":{ - "tok_s":888.29681098337915, - "stddev":4.535797119140625 + "tok_s":903.96579393769446, + "stddev":11.548336982727051 }, "tg128":{ - "tok_s":27.423391866797225, - "stddev":0.11130748689174652 + "tok_s":27.354472188144605, + "stddev":0.32067328691482544 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -1313,7 +1493,7 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", @@ -1328,12 +1508,12 @@ }, "tests":{ "pp512":{ - "tok_s":739.10453299999995, - "stddev":0.48830800000000002 + "tok_s":739.04172000000005, + "stddev":0.21932099999999999 }, "tg128":{ - "tok_s":27.332798, - "stddev":0.96453999999999995 + "tok_s":27.355868999999998, + "stddev":0.78283499999999995 } }, "source":"official", @@ -1352,39 +1532,41 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":31.646678956909845, - "stddev":0.17428097128868103 + "tok_s":27.133710667765286, + "stddev":0.096862562000751495 }, "tg128":{ - "tok_s":3.2631037332393733, - "stddev":0.0028334532398730516 + "tok_s":11.2224724820445, + "stddev":0.20752125978469849 } }, "source":"official", - "sha":"37a2c1662", + "sha":"fa67fe165", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -1398,34 +1580,33 @@ "engine":"llama.cpp", "backend":"cpu", "flavor":"clean-cpu", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":23.248176000000001, - "stddev":0.082831000000000002 + "tok_s":24.825526, + "stddev":0.091939999999999994 }, "tg128":{ - "tok_s":3.004594, - "stddev":0.014777999999999999 + "tok_s":8.0158430000000003, + "stddev":0.0077320000000000002 } }, "source":"official", - "sha":"ebd048fc5", + "sha":"6fdd0ac89", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -1439,37 +1620,42 @@ { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":38.791913305025275, - "stddev":0.19599516689777374 + "tok_s":27.555078336651963, + "stddev":0.19137175381183624 }, "tg128":{ - "tok_s":3.4941462980390483, - "stddev":0.00069125596201047301 + "tok_s":11.21845621581156, + "stddev":0.13397875428199768 } }, "source":"official", - "sha":"7e02c2451", + "sha":"fa67fe165", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -1482,16 +1668,188 @@ { "engine":"llama.cpp", "backend":"cpu", - "flavor":"clean-cpu", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":24.906431000000001, + "stddev":0.098793000000000006 + }, + "tg128":{ + "tok_s":8.0361039999999999, + "stddev":0.0080549999999999997 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":31.646678956909845, + "stddev":0.17428097128868103 + }, + "tg128":{ + "tok_s":3.2631037332393733, + "stddev":0.0028334532398730516 + } + }, + "source":"official", + "sha":"37a2c1662", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":23.248176000000001, + "stddev":0.082831000000000002 + }, + "tg128":{ + "tok_s":3.004594, + "stddev":0.014777999999999999 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "pp512":{ + "tok_s":38.791913305025275, + "stddev":0.19599516689777374 + }, + "tg128":{ + "tok_s":3.4941462980390483, + "stddev":0.00069125596201047301 + } + }, + "source":"official", + "sha":"7e02c2451", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "files":[ + { + "role":"weights", + "name":"Qwen3.6-27B-MTP-Q4_K_M.gguf", + "sha256":"a7cbd3ecc0e3f9b333edee61ae66bc87ed713c5d49587a8355814722ed329e0f", + "bytes":17106773120 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/Qwen3.6-27B-MTP-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, "ram_gb":62, "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", "smt":"on" @@ -2584,7 +2942,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", @@ -2599,23 +2957,24 @@ }, "tests":{ "pp512":{ - "tok_s":1938.9908117881037, - "stddev":3.0214979648590088 + "tok_s":2076.9566842879863, + "stddev":1.2408003807067871 }, "tg128":{ - "tok_s":63.761391280043405, - "stddev":2.6959183216094971 + "tok_s":63.680067553550863, + "stddev":2.6998429298400879 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -2631,7 +2990,7 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", @@ -2646,12 +3005,12 @@ }, "tests":{ "pp512":{ - "tok_s":1703.5040280000001, - "stddev":1.5609329999999999 + "tok_s":1692.12301, + "stddev":3.1238350000000001 }, "tg128":{ - "tok_s":60.580466000000001, - "stddev":0.22184499999999999 + "tok_s":60.614342999999998, + "stddev":0.31201600000000002 } }, "source":"official", @@ -2672,7 +3031,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", @@ -2687,26 +3046,27 @@ }, "tests":{ "img:enc":{ - "ms":7.1980000000000004 + "ms":7.1399999999999997 }, "img:pp":{ - "tok_s":1284.7225081736351 + "tok_s":1336.8869387860038 }, "img:tg":{ - "tok_s":65.699831751300422, + "tok_s":65.407989443719273, "text":"Two tabby cats are lying on a pink surface, with one cat on the left and the other on the right." } }, "workload":"image-chat", "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -2732,39 +3092,41 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":70.207003056096113, - "stddev":0.25786811113357544 + "tok_s":62.674170617578874, + "stddev":0.96139603853225708 }, "tg128":{ - "tok_s":7.301398548790532, - "stddev":0.009024646133184433 + "tok_s":26.61922102088197, + "stddev":0.27557656168937683 } }, "source":"official", - "sha":"37a2c1662", + "sha":"fa67fe165", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -2778,34 +3140,33 @@ "engine":"llama.cpp", "backend":"cpu", "flavor":"clean-cpu", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\gemma-4-12B-it-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":59.069308999999997, - "stddev":0.26938099999999998 + "tok_s":57.410412999999998, + "stddev":1.00617 }, "tg128":{ - "tok_s":6.7950109999999997, - "stddev":0.016497000000000001 + "tok_s":18.097662, + "stddev":0.036975000000000001 } }, "source":"official", - "sha":"ebd048fc5", + "sha":"6fdd0ac89", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -2819,37 +3180,42 @@ { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" - }, - "tests":{ - "pp512":{ - "tok_s":87.140647337851092, - "stddev":0.10298765450716019 + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":63.095818781317931, + "stddev":1.0578408241271973 }, "tg128":{ - "tok_s":7.8158251825107117, - "stddev":0.0017359517514705658 + "tok_s":26.77336700838493, + "stddev":0.22380563616752625 } }, "source":"official", - "sha":"7e02c2451", + "sha":"fa67fe165", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -2862,32 +3228,34 @@ { "engine":"llama.cpp", "backend":"cpu", - "flavor":"clean-cpu", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":41.941240000000001, - "stddev":0.021569999999999999 + "tok_s":57.511476000000002, + "stddev":0.94918599999999997 }, "tg128":{ - "tok_s":7.5086190000000004, - "stddev":0.0039329999999999999 + "tok_s":18.055194, + "stddev":0.039898999999999997 } }, "source":"official", - "sha":"ebd048fc5", + "sha":"6fdd0ac89", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -2897,335 +3265,289 @@ "bytes":7381382944 } ] - } - ], - "arch":"gemma4", - "quant":"q8", - "params_b":11.907350576000001, - "active_b":11.906580480000001, - "size_bytes":7381382944 - }, - { - "gguf":"gemma-4-E4B-it-Q8_0.gguf", - "runs":[ + }, { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":218.96438423900494, - "stddev":2.0331292152404785 + "img:enc":{ + "ms":95 }, - "tg128":{ - "tok_s":22.165345146306123, - "stddev":0.018541594967246056 + "img:pp":{ + "tok_s":836.40189374013664 + }, + "img:tg":{ + "tok_s":53.235734486774248 } }, + "workload":"image-chat", "source":"official", - "sha":"cd10a67a4", - "version":"0.6.4", - "dasllama_version":5, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"llama.cpp", + "engine":"das", "backend":"cpu", - "flavor":"clean-cpu", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":120.54863400000001, - "stddev":1.243153 + "img:enc":{ + "ms":47.008000000000003 }, - "tg128":{ - "tok_s":20.274649, - "stddev":0.053168 + "img:pp":{ + "tok_s":66.211364501625781 + }, + "img:tg":{ + "tok_s":26.538236984148597, + "text":"Two tabby cats are lying on a pink surface, with one cat on the left and the other on the right." } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"llama.cpp", "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":198.68788699999999, - "stddev":2.8011499999999998 + "img:enc":{ + "ms":183 }, - "tg128":{ - "tok_s":20.200565000000001, - "stddev":0.049085999999999998 + "img:pp":{ + "tok_s":61.095100864553316 + }, + "img:tg":{ + "tok_s":21.036024191427821 } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048f", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":911.47997099999998, - "stddev":3.891991 + "img:enc":{ + "ms":12.656000000000001 }, - "tg128":{ - "tok_s":52.877133000000001, - "stddev":0.121401 - } - }, - "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats", - "files":[ - { - "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 - } - ] - }, - { - "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":981.10735629017802, - "stddev":1.9796314239501953 + "img:pp":{ + "tok_s":66.518620096810182 }, - "tg128":{ - "tok_s":52.770026613217077, - "stddev":0.10024738311767578 + "img:tg":{ + "tok_s":26.745476671257972, + "text":"Two tabby cats are lying on a pink surface, with one cat on the left and one on the right." } }, + "workload":"image-chat", "source":"official", - "sha":"cd10a67a4", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":5, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":229.74539443578274, - "stddev":0.64958512783050537 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 }, - "tg128":{ - "tok_s":22.149308649428683, - "stddev":0.006412864662706852 - } - }, - "source":"official", - "sha":"cd10a67a4", - "version":"0.6.4", - "dasllama_version":5, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "files":[ { - "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 + "role":"mmproj", + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-21", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-12B-it-Q4_K_M.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-12B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "img:enc":{ - "ms":92.066000000000003 + "ms":196 }, "img:pp":{ - "tok_s":706.10600642737518 + "tok_s":60.516099566110981 }, "img:tg":{ - "tok_s":51.289777626757875, - "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" + "tok_s":18.234657245427091 } }, "workload":"image-chat", "source":"official", - "sha":"b59eae7ec", - "version":"0.6.4", - "dasllama_version":7, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", - "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", - "env":"DASLLAMA_BOX=m1", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E4B-it-BF16.gguf", - "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", - "bytes":991552256 + "name":"mmproj-gemma-4-12B-it-BF16.gguf", + "sha256":"9b1edfa05b634728ca4bfd60b4e6b278e95166c078fa54ae4fa83e680112fd1d", + "bytes":175115616 }, { "role":"image", @@ -3239,73 +3561,190 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-21", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":417.28699999999998 - }, - "img:pp":{ - "tok_s":219.08789216381595 + "pp512":{ + "tok_s":70.207003056096113, + "stddev":0.25786811113357544 }, - "img:tg":{ - "tok_s":21.873447070701133, - "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" + "tg128":{ + "tok_s":7.301398548790532, + "stddev":0.009024646133184433 } }, - "workload":"image-chat", "source":"official", - "sha":"b59eae7ec", + "sha":"37a2c1662", "version":"0.6.4", - "dasllama_version":7, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", - "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", "files":[ { "role":"weights", - "name":"gemma-4-E4B-it-Q8_0.gguf", - "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", - "bytes":8031242688 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E4B-it-BF16.gguf", - "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", - "bytes":991552256 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"accel", - "box":"m1", + "flavor":"clean-cpu", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\gemma-4-12B-it-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":59.069308999999997, + "stddev":0.26938099999999998 + }, + "tg128":{ + "tok_s":6.7950109999999997, + "stddev":0.016497000000000001 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen4", "threads":8, - "date":"2026-08-21", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/gemma-4-12B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "pp512":{ + "tok_s":87.140647337851092, + "stddev":0.10298765450716019 + }, + "tg128":{ + "tok_s":7.8158251825107117, + "stddev":0.0017359517514705658 + } + }, + "source":"official", + "sha":"7e02c2451", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "files":[ + { + "role":"weights", + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/gemma-4-12B-it-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "pp512":{ + "tok_s":41.941240000000001, + "stddev":0.021569999999999999 + }, + "tg128":{ + "tok_s":7.5086190000000004, + "stddev":0.0039329999999999999 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-12B-it-Q4_K_M.gguf", + "sha256":"95d83ba36642b1f385fb906b5962a71763361be3bac930a709945f72d97473f8", + "bytes":7381382944 + } + ] + } + ], + "arch":"gemma4", + "quant":"q8", + "params_b":11.907350576000001, + "active_b":11.906580480000001, + "size_bytes":7381382944 + }, + { + "gguf":"gemma-4-E4B-it-Q8_0.gguf", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-20", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -3318,57 +3757,41 @@ "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":475.10000000000002 - }, - "img:pp":{ - "tok_s":227.43807050871774 + "pp512":{ + "tok_s":218.96438423900494, + "stddev":2.0331292152404785 }, - "img:tg":{ - "tok_s":21.889726398941633, - "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" + "tg128":{ + "tok_s":22.165345146306123, + "stddev":0.018541594967246056 } }, - "workload":"image-chat", "source":"official", - "sha":"b59eae7ec", + "sha":"cd10a67a4", "version":"0.6.4", - "dasllama_version":7, + "dasllama_version":5, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", + "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", "noise":"ok", "parity":"ok", - "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", "files":[ { "role":"weights", "name":"gemma-4-E4B-it-Q8_0.gguf", "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", "bytes":8031242688 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E4B-it-BF16.gguf", - "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", - "bytes":991552256 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 } ] }, { "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", + "backend":"cpu", + "flavor":"clean-cpu", "box":"m1", "threads":8, - "date":"2026-08-21", - "cmd":"/Users/borisbatkin/Work/llama.cpp/build/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 99", + "date":"2026-08-20", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -3381,49 +3804,35 @@ "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":134 - }, - "img:pp":{ - "tok_s":662.5 + "pp512":{ + "tok_s":120.54863400000001, + "stddev":1.243153 }, - "img:tg":{ - "tok_s":47.562425683709876 + "tg128":{ + "tok_s":20.274649, + "stddev":0.053168 } }, - "workload":"image-chat", "source":"official", - "versions":"llama.cpp @ 98c4764b6 + mtmd-timing.patch@8026b1bd", - "exec_fmt":"native gguf formats", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", "name":"gemma-4-E4B-it-Q8_0.gguf", "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", "bytes":8031242688 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E4B-it-BF16.gguf", - "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", - "bytes":991552256 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 } ] }, { "engine":"llama.cpp", "backend":"cpu", - "flavor":"clean-cpu", + "flavor":"stock", "box":"m1", "threads":8, - "date":"2026-08-21", - "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 0 --no-mmproj-offload", + "date":"2026-08-20", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -3436,19 +3845,17 @@ "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":19951 - }, - "img:pp":{ - "tok_s":158.76185721417872 + "pp512":{ + "tok_s":198.68788699999999, + "stddev":2.8011499999999998 }, - "img:tg":{ - "tok_s":20.239074062361649 + "tg128":{ + "tok_s":20.200565000000001, + "stddev":0.049085999999999998 } }, - "workload":"image-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "sha":"ebd048f", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -3456,29 +3863,17 @@ "name":"gemma-4-E4B-it-Q8_0.gguf", "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", "bytes":8031242688 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E4B-it-BF16.gguf", - "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", - "bytes":991552256 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 } ] }, { "engine":"llama.cpp", - "backend":"cpu", + "backend":"metal", "flavor":"stock", "box":"m1", "threads":8, - "date":"2026-08-21", - "cmd":"/Users/borisbatkin/Work/llama.cpp/build/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 0 --no-mmproj-offload --no-op-offload", + "date":"2026-08-20", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -3491,38 +3886,24 @@ "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":19955 - }, - "img:pp":{ - "tok_s":158.65096787068438 + "pp512":{ + "tok_s":911.47997099999998, + "stddev":3.891991 }, - "img:tg":{ - "tok_s":20.023778236656032 + "tg128":{ + "tok_s":52.877133000000001, + "stddev":0.121401 } }, - "workload":"image-chat", "source":"official", - "versions":"llama.cpp @ 98c4764b6 + mtmd-timing.patch@8026b1bd", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"ebd048f", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", "name":"gemma-4-E4B-it-Q8_0.gguf", "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", "bytes":8031242688 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E4B-it-BF16.gguf", - "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", - "bytes":991552256 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 } ] }, @@ -3530,230 +3911,282 @@ "engine":"das", "backend":"metal", "flavor":"tuned", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json --ngl 99", + "box":"m1", + "threads":8, + "date":"2026-08-20", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", "hardware":{ - "cpu":"Apple M3", + "cpu":"Apple M1 Max", "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":292.79426500629523, - "stddev":6.5493507385253906 + "tok_s":981.10735629017802, + "stddev":1.9796314239501953 }, "tg128":{ - "tok_s":15.354024790266644, - "stddev":0.88078784942626953 + "tok_s":52.770026613217077, + "stddev":0.10024738311767578 } }, "source":"official", + "sha":"cd10a67a4", "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob" + "dasllama_version":5, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] }, { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-20", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ - "cpu":"Apple M3", + "cpu":"Apple M1 Max", "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":84.608683927594484, - "stddev":1.5926010608673096 + "tok_s":229.74539443578274, + "stddev":0.64958512783050537 }, "tg128":{ - "tok_s":13.397975409053112, - "stddev":0.31448334455490112 + "tok_s":22.149308649428683, + "stddev":0.006412864662706852 } }, "source":"official", + "sha":"cd10a67a4", "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)" + "dasllama_version":5, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] }, { "engine":"das", - "backend":"cpu", - "flavor":"accel", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json --accel", + "backend":"metal", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", "hardware":{ - "cpu":"Apple M3", + "cpu":"Apple M1 Max", "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":84.456365830897226, - "stddev":1.3959729671478271 + "img:enc":{ + "ms":92.066000000000003 }, - "tg128":{ - "tok_s":13.218078331498578, - "stddev":0.10669740289449692 + "img:pp":{ + "tok_s":706.10600642737518 + }, + "img:tg":{ + "tok_s":51.289777626757875, + "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" } }, + "workload":"image-chat", "source":"official", + "sha":"b59eae7ec", "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)" - }, - { - "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 99 -t 4 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M3", - "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" - }, - "tests":{ - "pp512":{ - "tok_s":275.61049500000001, - "stddev":1.3684400000000001 + "dasllama_version":7, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m1", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 }, - "tg128":{ - "tok_s":15.687388, - "stddev":0.39765800000000001 + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } - }, - "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats" + ] }, { - "engine":"llama.cpp", + "engine":"das", "backend":"cpu", - "flavor":"clean-cpu", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 0 -t 4 -p 512 -n 128 -r 5 -o json", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ - "cpu":"Apple M3", + "cpu":"Apple M1 Max", "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":64.515848000000005, - "stddev":0.87568599999999996 + "img:enc":{ + "ms":417.28699999999998 }, - "tg128":{ - "tok_s":11.345897000000001, - "stddev":0.30775400000000003 + "img:pp":{ + "tok_s":219.08789216381595 + }, + "img:tg":{ + "tok_s":21.873447070701133, + "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack" - }, - { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"stock", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 0 -nopo 1 -t 4 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M3", - "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" - }, - "tests":{ - "pp512":{ - "tok_s":90.621729000000002, - "stddev":2.0014129999999999 + "sha":"b59eae7ec", + "version":"0.6.4", + "dasllama_version":7, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 }, - "tg128":{ - "tok_s":11.300974999999999, - "stddev":0.303452 + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } - }, - "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack" + ] }, { "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", + "backend":"cpu", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":769.73635209942074, - "stddev":0.6532178521156311 + "img:enc":{ + "ms":475.10000000000002 }, - "tg128":{ - "tok_s":45.390357926696431, - "stddev":0.030675075948238373 + "img:pp":{ + "tok_s":227.43807050871774 + }, + "img:tg":{ + "tok_s":21.889726398941633, + "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" } }, + "workload":"image-chat", "source":"official", - "sha":"0c8200a72", + "sha":"b59eae7ec", "version":"0.6.4", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", - "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "dasllama_version":7, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1", "files":[ { "role":"weights", "name":"gemma-4-E4B-it-Q8_0.gguf", "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, @@ -3761,32 +4194,35 @@ "engine":"llama.cpp", "backend":"metal", "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"/Users/borisbatkin/Work/llama.cpp/build/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 99", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":784.83747600000004, - "stddev":0.25218400000000002 + "img:enc":{ + "ms":134 }, - "tg128":{ - "tok_s":42.621054000000001, - "stddev":0.13528299999999999 + "img:pp":{ + "tok_s":662.5 + }, + "img:tg":{ + "tok_s":47.562425683709876 } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048fc5", + "versions":"llama.cpp @ 98c4764b6 + mtmd-timing.patch@8026b1bd", "exec_fmt":"native gguf formats", "files":[ { @@ -3794,81 +4230,109 @@ "name":"gemma-4-E4B-it-Q8_0.gguf", "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "flavor":"clean-cpu", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 0 --no-mmproj-offload", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":299.4339466886513, - "stddev":5.9425230026245117 + "img:enc":{ + "ms":19951 }, - "tg128":{ - "tok_s":43.02972534845911, - "stddev":0.23665608465671539 + "img:pp":{ + "tok_s":158.76185721417872 + }, + "img:tg":{ + "tok_s":20.239074062361649 } }, + "workload":"image-chat", "source":"official", - "sha":"0c8200a72", - "version":"0.6.4", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", "name":"gemma-4-E4B-it-Q8_0.gguf", "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"llama.cpp", "backend":"cpu", - "flavor":"clean-cpu", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"/Users/borisbatkin/Work/llama.cpp/build/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 0 --no-mmproj-offload --no-op-offload", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":190.78782699999999, - "stddev":2.3031160000000002 + "img:enc":{ + "ms":19955 }, - "tg128":{ - "tok_s":38.186261999999999, - "stddev":0.135745 + "img:pp":{ + "tok_s":158.65096787068438 + }, + "img:tg":{ + "tok_s":20.023778236656032 } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048fc5", + "versions":"llama.cpp @ 98c4764b6 + mtmd-timing.patch@8026b1bd", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -3876,17 +4340,218 @@ "name":"gemma-4-E4B-it-Q8_0.gguf", "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json --ngl 99", + "hardware":{ + "cpu":"Apple M3", + "arch":"arm64", + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" + }, + "tests":{ + "pp512":{ + "tok_s":292.79426500629523, + "stddev":6.5493507385253906 + }, + "tg128":{ + "tok_s":15.354024790266644, + "stddev":0.88078784942626953 + } + }, + "source":"official", + "version":"0.6.4", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob" + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json", + "hardware":{ + "cpu":"Apple M3", + "arch":"arm64", + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" + }, + "tests":{ + "pp512":{ + "tok_s":84.608683927594484, + "stddev":1.5926010608673096 + }, + "tg128":{ + "tok_s":13.397975409053112, + "stddev":0.31448334455490112 + } + }, + "source":"official", + "version":"0.6.4", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)" + }, { "engine":"das", "backend":"cpu", "flavor":"accel", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json --accel", + "hardware":{ + "cpu":"Apple M3", + "arch":"arm64", + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" + }, + "tests":{ + "pp512":{ + "tok_s":84.456365830897226, + "stddev":1.3959729671478271 + }, + "tg128":{ + "tok_s":13.218078331498578, + "stddev":0.10669740289449692 + } + }, + "source":"official", + "version":"0.6.4", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)" + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 99 -t 4 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M3", + "arch":"arm64", + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" + }, + "tests":{ + "pp512":{ + "tok_s":275.61049500000001, + "stddev":1.3684400000000001 + }, + "tg128":{ + "tok_s":15.687388, + "stddev":0.39765800000000001 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats" + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 0 -t 4 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M3", + "arch":"arm64", + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" + }, + "tests":{ + "pp512":{ + "tok_s":64.515848000000005, + "stddev":0.87568599999999996 + }, + "tg128":{ + "tok_s":11.345897000000001, + "stddev":0.30775400000000003 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack" + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/irinabatkina/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 0 -nopo 1 -t 4 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M3", + "arch":"arm64", + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" + }, + "tests":{ + "pp512":{ + "tok_s":90.621729000000002, + "stddev":2.0014129999999999 + }, + "tg128":{ + "tok_s":11.300974999999999, + "stddev":0.303452 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack" + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -3899,18 +4564,18 @@ }, "tests":{ "pp512":{ - "tok_s":300.85082685026777, - "stddev":4.0876131057739258 + "tok_s":769.73635209942074, + "stddev":0.6532178521156311 }, "tg128":{ - "tok_s":43.065160760152352, - "stddev":0.14640940725803375 + "tok_s":45.390357926696431, + "stddev":0.030675075948238373 } }, "source":"official", "sha":"0c8200a72", "version":"0.6.4", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { @@ -3923,12 +4588,12 @@ }, { "engine":"llama.cpp", - "backend":"cpu", + "backend":"metal", "flavor":"stock", "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -3941,17 +4606,17 @@ }, "tests":{ "pp512":{ - "tok_s":268.87892900000003, - "stddev":8.1619060000000001 + "tok_s":784.83747600000004, + "stddev":0.25218400000000002 }, "tg128":{ - "tok_s":38.217838999999998, - "stddev":0.10563 + "tok_s":42.621054000000001, + "stddev":0.13528299999999999 } }, "source":"official", "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", @@ -3963,42 +4628,207 @@ }, { "engine":"das", - "backend":"metal", + "backend":"cpu", "flavor":"tuned", - "box":"m5", - "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", "hardware":{ - "cpu":"Apple M5 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" - }, - "tests":{ + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" + }, + "tests":{ + "pp512":{ + "tok_s":299.4339466886513, + "stddev":5.9425230026245117 + }, + "tg128":{ + "tok_s":43.02972534845911, + "stddev":0.23665608465671539 + } + }, + "source":"official", + "sha":"0c8200a72", + "version":"0.6.4", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" + }, + "tests":{ + "pp512":{ + "tok_s":190.78782699999999, + "stddev":2.3031160000000002 + }, + "tg128":{ + "tok_s":38.186261999999999, + "stddev":0.135745 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" + }, + "tests":{ + "pp512":{ + "tok_s":300.85082685026777, + "stddev":4.0876131057739258 + }, + "tg128":{ + "tok_s":43.065160760152352, + "stddev":0.14640940725803375 + } + }, + "source":"official", + "sha":"0c8200a72", + "version":"0.6.4", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-E4B-it-Q8_0.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" + }, + "tests":{ + "pp512":{ + "tok_s":268.87892900000003, + "stddev":8.1619060000000001 + }, + "tg128":{ + "tok_s":38.217838999999998, + "stddev":0.10563 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ "pp512":{ - "tok_s":5123.0211944582243, - "stddev":21.226161956787109 + "tok_s":5303.174039443662, + "stddev":19.52574348449707 }, "tg128":{ - "tok_s":90.197186400189821, - "stddev":0.03762681782245636 + "tok_s":90.100203074466052, + "stddev":0.069310650229454041 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -4014,7 +4844,7 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", @@ -4029,12 +4859,12 @@ }, "tests":{ "pp512":{ - "tok_s":4331.2716979999996, - "stddev":7.9024109999999999 + "tok_s":4338.5063479999999, + "stddev":21.033147 }, "tg128":{ - "tok_s":81.157066999999998, - "stddev":0.26690799999999998 + "tok_s":81.212394000000003, + "stddev":0.18665499999999999 } }, "source":"official", @@ -4055,7 +4885,7 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", + "date":"2026-08-30", "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", @@ -4070,26 +4900,27 @@ }, "tests":{ "img:enc":{ - "ms":38.402000000000001 + "ms":38.494 }, "img:pp":{ - "tok_s":1764.6859198425357 + "tok_s":3450.2587694077056 }, "img:tg":{ - "tok_s":88.326299431675466, + "tok_s":88.112034451805471, "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" } }, "workload":"image-chat", "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -4115,39 +4946,41 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":154.69728224713188, - "stddev":0.4113745391368866 + "tok_s":194.16679749428474, + "stddev":7.7699780464172363 }, "tg128":{ - "tok_s":10.89732208476909, - "stddev":0.032356433570384979 + "tok_s":53.53051305896588, + "stddev":0.35575971007347107 } }, "source":"official", - "sha":"37a2c1662", + "sha":"fa67fe165", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -4161,34 +4994,33 @@ "engine":"llama.cpp", "backend":"cpu", "flavor":"clean-cpu", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\gemma-4-E4B-it-Q8_0.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":111.94057599999999, - "stddev":1.4339820000000001 + "tok_s":137.888566, + "stddev":1.390531 }, "tg128":{ - "tok_s":10.343683, - "stddev":0.109653 + "tok_s":38.570664999999998, + "stddev":0.44691700000000001 } }, "source":"official", - "sha":"ebd048fc5", + "sha":"6fdd0ac89", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -4202,37 +5034,42 @@ { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" - }, - "tests":{ - "pp512":{ - "tok_s":249.22408999517774, - "stddev":2.3579139709472656 + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":199.11424037782649, + "stddev":7.9429254531860352 }, "tg128":{ - "tok_s":11.910514080132453, - "stddev":0.0021174459252506495 + "tok_s":53.452705191704084, + "stddev":0.16458022594451904 } }, "source":"official", - "sha":"7e02c2451", + "sha":"fa67fe165", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", @@ -4245,32 +5082,34 @@ { "engine":"llama.cpp", "backend":"cpu", - "flavor":"clean-cpu", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":97.311848999999995, - "stddev":0.13253699999999999 + "tok_s":197.969393, + "stddev":2.0859160000000001 }, "tg128":{ - "tok_s":11.142232999999999, - "stddev":0.0055160000000000001 + "tok_s":38.383338999999999, + "stddev":0.36993700000000002 } }, "source":"official", - "sha":"ebd048fc5", + "sha":"6fdd0ac89", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { @@ -4280,180 +5119,240 @@ "bytes":8031242688 } ] - } - ], - "arch":"gemma4", - "quant":"q8", - "params_b":7.5180692899999997, - "active_b":4.5888307199999998, - "size_bytes":8031242688 - }, - { - "gguf":"gpt-oss-20b-mxfp4.gguf", - "runs":[ + }, { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":208.05408876613802, - "stddev":0.32735583186149597 + "img:enc":{ + "ms":68 }, - "tg128":{ - "tok_s":41.20003209758481, - "stddev":0.057818345725536346 + "img:pp":{ + "tok_s":1533.2690453230475 + }, + "img:tg":{ + "tok_s":74.557315936626281 } }, + "workload":"image-chat", "source":"official", - "sha":"7605e8476", - "version":"0.6.4", - "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"llama.cpp", + "engine":"das", "backend":"cpu", - "flavor":"clean-cpu", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":121.029444, - "stddev":0.66226799999999997 + "img:enc":{ + "ms":437.154 }, - "tg128":{ - "tok_s":42.705545999999998, - "stddev":0.186637 + "img:pp":{ + "tok_s":215.11900493670538 + }, + "img:tg":{ + "tok_s":52.402147177980616, + "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":1032.9780236497108, - "stddev":1.7200174331665039 + "img:enc":{ + "ms":13566 }, - "tg128":{ - "tok_s":88.922860071070133, - "stddev":0.070478878915309906 + "img:pp":{ + "tok_s":185.35789228258352 + }, + "img:tg":{ + "tok_s":36.052275799909872 } }, + "workload":"image-chat", "source":"official", - "sha":"7605e8476", - "version":"0.6.4", - "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", - "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":1035.9240950000001, - "stddev":3.2972060000000001 + "img:enc":{ + "ms":481.916 }, - "tg128":{ - "tok_s":84.445203000000006, - "stddev":0.028757000000000001 + "img:pp":{ + "tok_s":220.67404604448845 + }, + "img:tg":{ + "tok_s":52.579777488954136, + "text":"The user wants a one-sentence description of the provided image.\nThe image contains two cats lying on a pink surface.\n\nPlan: Describe the main subjects" } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, @@ -4461,244 +5360,271 @@ "engine":"llama.cpp", "backend":"cpu", "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E4B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E4B-it-BF16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":120.200401, - "stddev":0.11577800000000001 + "img:enc":{ + "ms":13544 }, - "tg128":{ - "tok_s":42.591012999999997, - "stddev":0.11673600000000001 + "img:pp":{ + "tok_s":172.05930094145648 + }, + "img:tg":{ + "tok_s":38.540286643381911 } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048f", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E4B-it-BF16.gguf", + "sha256":"f77995e4b6a569ab8f0d1bfdb7e8da4a0fa5b9e6f309b9bf3bdb76164d75e29f", + "bytes":991552256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":208.04402682771166, - "stddev":0.33332249522209167 + "tok_s":154.69728224713188, + "stddev":0.4113745391368866 }, "tg128":{ - "tok_s":41.567848426062653, - "stddev":0.16755180060863495 + "tok_s":10.89732208476909, + "stddev":0.032356433570384979 } }, "source":"official", - "sha":"7605e8476", + "sha":"37a2c1662", "version":"0.6.4", - "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", "files":[ { "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"tuned", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json", + "flavor":"clean-cpu", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\gemma-4-E4B-it-Q8_0.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M3", - "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":74.602090557434138, - "stddev":13.963406562805176 + "tok_s":111.94057599999999, + "stddev":1.4339820000000001 }, "tg128":{ - "tok_s":20.780198219575535, - "stddev":1.0819443464279175 + "tok_s":10.343683, + "stddev":0.109653 } }, "source":"official", - "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)" + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] }, { "engine":"das", "backend":"cpu", - "flavor":"accel", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json --accel", + "flavor":"tuned", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/gemma-4-E4B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", "hardware":{ - "cpu":"Apple M3", - "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" }, "tests":{ "pp512":{ - "tok_s":87.286046075953166, - "stddev":1.563582181930542 + "tok_s":249.22408999517774, + "stddev":2.3579139709472656 }, "tg128":{ - "tok_s":24.927380506005022, - "stddev":0.24361743032932281 + "tok_s":11.910514080132453, + "stddev":0.0021174459252506495 } }, "source":"official", + "sha":"7e02c2451", "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)" + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 + } + ] }, { "engine":"llama.cpp", "backend":"cpu", "flavor":"clean-cpu", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/irinabatkina/models/gpt-oss-20b-mxfp4.gguf\" -ngl 0 -t 4 -p 512 -n 128 -r 5 -o json", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/gemma-4-E4B-it-Q8_0.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M3", - "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" }, "tests":{ "pp512":{ - "tok_s":51.539298000000002, - "stddev":2.2384590000000002 + "tok_s":97.311848999999995, + "stddev":0.13253699999999999 }, "tg128":{ - "tok_s":20.245643000000001, - "stddev":2.353748 + "tok_s":11.142232999999999, + "stddev":0.0055160000000000001 } }, "source":"official", "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack" - }, - { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"stock", - "box":"m3air", - "threads":4, - "date":"2026-07-26", - "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/irinabatkina/models/gpt-oss-20b-mxfp4.gguf\" -ngl 0 -nopo 1 -t 4 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M3", - "arch":"arm64", - "os":"macOS 26.4.1", - "perf_cores":4, - "total_cores":8, - "ram_gb":16, - "gpu":"Apple M3 (10-core)" - }, - "tests":{ - "pp512":{ - "tok_s":51.101740999999997, - "stddev":1.3099419999999999 - }, - "tg128":{ - "tok_s":21.541964, - "stddev":2.0518269999999998 + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E4B-it-Q8_0.gguf", + "sha256":"34be82b17b4942d389b9b527170c4b058027abdd32531fda063d3d97dd8ce80a", + "bytes":8031242688 } - }, - "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack" - }, + ] + } + ], + "arch":"gemma4", + "quant":"q8", + "params_b":7.5180692899999997, + "active_b":4.5888307199999998, + "size_bytes":8031242688 + }, + { + "gguf":"gpt-oss-20b-mxfp4.gguf", + "runs":[ { "engine":"das", - "backend":"metal", + "backend":"cpu", "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", + "box":"m1", + "threads":8, + "date":"2026-08-02", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":853.35457013259804, - "stddev":1.879311203956604 + "tok_s":208.05408876613802, + "stddev":0.32735583186149597 }, "tg128":{ - "tok_s":78.685836148369944, - "stddev":0.02718779630959034 + "tok_s":41.20003209758481, + "stddev":0.057818345725536346 } }, "source":"official", - "sha":"0c8200a72", + "sha":"7605e8476", "version":"0.6.4", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", - "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", @@ -4710,35 +5636,35 @@ }, { "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gpt-oss-20b-mxfp4.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m1", + "threads":8, + "date":"2026-08-02", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":862.95585100000005, - "stddev":1.4129849999999999 + "tok_s":121.029444, + "stddev":0.66226799999999997 }, "tg128":{ - "tok_s":73.440715999999995, - "stddev":0.041075 + "tok_s":42.705545999999998, + "stddev":0.186637 } }, "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", @@ -4750,37 +5676,38 @@ }, { "engine":"das", - "backend":"cpu", + "backend":"metal", "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "box":"m1", + "threads":8, + "date":"2026-08-02", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":301.46624889618516, - "stddev":4.8974809646606445 + "tok_s":1032.9780236497108, + "stddev":1.7200174331665039 }, "tg128":{ - "tok_s":79.18316736086436, - "stddev":0.26260232925415039 + "tok_s":88.922860071070133, + "stddev":0.070478878915309906 } }, "source":"official", - "sha":"0c8200a72", + "sha":"7605e8476", "version":"0.6.4", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", @@ -4792,35 +5719,35 @@ }, { "engine":"llama.cpp", - "backend":"cpu", - "flavor":"clean-cpu", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/gpt-oss-20b-mxfp4.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "backend":"metal", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-02", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":165.34557000000001, - "stddev":4.1060670000000004 + "tok_s":1035.9240950000001, + "stddev":3.2972060000000001 }, "tg128":{ - "tok_s":76.649055000000004, - "stddev":1.1097129999999999 + "tok_s":84.445203000000006, + "stddev":0.028757000000000001 } }, "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"ebd048f", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", @@ -4831,38 +5758,36 @@ ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-02", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":295.29600556592857, - "stddev":5.6546406745910645 + "tok_s":120.200401, + "stddev":0.11577800000000001 }, "tg128":{ - "tok_s":78.18960428446178, - "stddev":0.37497448921203613 + "tok_s":42.591012999999997, + "stddev":0.11673600000000001 } }, "source":"official", - "sha":"0c8200a72", - "version":"0.6.4", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", @@ -4873,36 +5798,39 @@ ] }, { - "engine":"llama.cpp", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gpt-oss-20b-mxfp4.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-02", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":163.595258, - "stddev":3.630258 + "tok_s":208.04402682771166, + "stddev":0.33332249522209167 }, "tg128":{ - "tok_s":76.19932, - "stddev":1.078441 + "tok_s":41.567848426062653, + "stddev":0.16755180060863495 } }, "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"7605e8476", + "version":"0.6.4", + "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", @@ -4914,214 +5842,163 @@ }, { "engine":"das", - "backend":"metal", + "backend":"cpu", "flavor":"tuned", - "box":"m5", - "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json", "hardware":{ - "cpu":"Apple M5 Max", + "cpu":"Apple M3", "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" }, "tests":{ "pp512":{ - "tok_s":3989.4203630795723, - "stddev":18.226713180541992 + "tok_s":74.602090557434138, + "stddev":13.963406562805176 }, "tg128":{ - "tok_s":163.21584485670596, - "stddev":0.13277889788150787 + "tok_s":20.780198219575535, + "stddev":1.0819443464279175 } }, "source":"official", - "sha":"667d4c1d5", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", - "files":[ - { - "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 - } - ] + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)" }, { - "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", - "box":"m5", - "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/irinabatkina/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 4 -o json --json-path modules/dasLLAMA/performance/records/_cell_m3air.json --accel", "hardware":{ - "cpu":"Apple M5 Max", + "cpu":"Apple M3", "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" }, "tests":{ "pp512":{ - "tok_s":3475.262072, - "stddev":8.8958180000000002 + "tok_s":87.286046075953166, + "stddev":1.563582181930542 }, "tg128":{ - "tok_s":147.511551, - "stddev":0.410717 + "tok_s":24.927380506005022, + "stddev":0.24361743032932281 } }, "source":"official", - "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", - "files":[ - { - "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 - } - ] + "version":"0.6.4", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_gemv_gen=mr4 (manifest)", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)" }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "flavor":"clean-cpu", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/irinabatkina/models/gpt-oss-20b-mxfp4.gguf\" -ngl 0 -t 4 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", - "remote_desktop":"off" + "cpu":"Apple M3", + "arch":"arm64", + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" }, "tests":{ "pp512":{ - "tok_s":198.74889806868953, - "stddev":1.2373650074005127 + "tok_s":51.539298000000002, + "stddev":2.2384590000000002 }, "tg128":{ - "tok_s":21.116826819638096, - "stddev":0.014298847876489162 + "tok_s":20.245643000000001, + "stddev":2.353748 } }, "source":"official", - "sha":"37a2c1662", - "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", - "files":[ - { - "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 - } - ] + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack" }, { "engine":"llama.cpp", "backend":"cpu", - "flavor":"clean-cpu", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\gpt-oss-20b-mxfp4.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "flavor":"stock", + "box":"m3air", + "threads":4, + "date":"2026-07-26", + "cmd":"\"/Users/irinabatkina/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/irinabatkina/models/gpt-oss-20b-mxfp4.gguf\" -ngl 0 -nopo 1 -t 4 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", - "remote_desktop":"off" + "cpu":"Apple M3", + "arch":"arm64", + "os":"macOS 26.4.1", + "perf_cores":4, + "total_cores":8, + "ram_gb":16, + "gpu":"Apple M3 (10-core)" }, "tests":{ "pp512":{ - "tok_s":129.75144299999999, - "stddev":0.78622499999999995 + "tok_s":51.101740999999997, + "stddev":1.3099419999999999 }, "tg128":{ - "tok_s":20.700060000000001, - "stddev":0.063592999999999997 + "tok_s":21.541964, + "stddev":2.0518269999999998 } }, "source":"official", "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack", - "files":[ - { - "role":"weights", - "name":"gpt-oss-20b-mxfp4.gguf", - "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", - "bytes":12109566560 - } - ] + "exec_fmt":"native gguf formats; cpu runtime layout repack" }, { "engine":"das", - "backend":"cpu", + "backend":"metal", "flavor":"tuned", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" }, "tests":{ "pp512":{ - "tok_s":229.34258636119904, - "stddev":4.1471676826477051 + "tok_s":853.35457013259804, + "stddev":1.879311203956604 }, "tg128":{ - "tok_s":23.040888326889924, - "stddev":0.0053026177920401096 + "tok_s":78.685836148369944, + "stddev":0.02718779630959034 } }, "source":"official", - "sha":"7e02c2451", + "sha":"0c8200a72", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", + "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", @@ -5133,34 +6010,35 @@ }, { "engine":"llama.cpp", - "backend":"cpu", - "flavor":"clean-cpu", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "backend":"metal", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gpt-oss-20b-mxfp4.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" }, "tests":{ "pp512":{ - "tok_s":85.172394999999995, - "stddev":0.29173700000000002 + "tok_s":862.95585100000005, + "stddev":1.4129849999999999 }, "tg128":{ - "tok_s":22.493794000000001, - "stddev":0.024126000000000002 + "tok_s":73.440715999999995, + "stddev":0.041075 } }, "source":"official", "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", @@ -5169,57 +6047,46 @@ "bytes":12109566560 } ] - } - ], - "arch":"gpt-oss", - "quant":"q8", - "params_b":20.914757183999999, - "active_b":4.1862758400000004, - "size_bytes":12109566560 - }, - { - "gguf":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "runs":[ + }, { "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, + "perf_cores":10, + "total_cores":14, "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" }, "tests":{ "pp512":{ - "tok_s":211.98454574608917, - "stddev":4.6506032943725586 + "tok_s":301.46624889618516, + "stddev":4.8974809646606445 }, "tg128":{ - "tok_s":48.104148138395558, - "stddev":0.49066537618637085 + "tok_s":79.18316736086436, + "stddev":0.26260232925415039 } }, "source":"official", - "sha":"7605e8476", + "sha":"0c8200a72", "version":"0.6.4", - "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, @@ -5227,596 +6094,445 @@ "engine":"llama.cpp", "backend":"cpu", "flavor":"clean-cpu", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/gpt-oss-20b-mxfp4.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, + "perf_cores":10, + "total_cores":14, "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" }, "tests":{ "pp512":{ - "tok_s":137.90283099999999, - "stddev":0.15882599999999999 + "tok_s":165.34557000000001, + "stddev":4.1060670000000004 }, "tg128":{ - "tok_s":46.490020000000001, - "stddev":0.188914 + "tok_s":76.649055000000004, + "stddev":1.1097129999999999 } }, "source":"official", - "sha":"ebd048f", + "sha":"ebd048fc5", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, + "perf_cores":10, + "total_cores":14, "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" }, "tests":{ "pp512":{ - "tok_s":847.93069782280509, - "stddev":21.823587417602539 + "tok_s":295.29600556592857, + "stddev":5.6546406745910645 }, "tg128":{ - "tok_s":89.527510177511658, - "stddev":1.8800439834594727 + "tok_s":78.18960428446178, + "stddev":0.37497448921203613 } }, "source":"official", - "sha":"7605e8476", + "sha":"0c8200a72", "version":"0.6.4", - "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", - "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { "engine":"llama.cpp", - "backend":"metal", + "backend":"cpu", "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gpt-oss-20b-mxfp4.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, + "perf_cores":10, + "total_cores":14, "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" }, "tests":{ "pp512":{ - "tok_s":846.74490600000001, - "stddev":4.0971989999999998 + "tok_s":163.595258, + "stddev":3.630258 }, "tg128":{ - "tok_s":76.258438999999996, - "stddev":0.29283399999999998 + "tok_s":76.19932, + "stddev":1.078441 } }, "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":135.318251, - "stddev":0.068266999999999994 + "tok_s":3995.0863487375218, + "stddev":12.267148971557617 }, "tg128":{ - "tok_s":47.170144999999998, - "stddev":0.41250900000000001 + "tok_s":162.71038660356945, + "stddev":0.08905307948589325 } }, "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { - "engine":"das", - "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":214.9126583062986, - "stddev":0.88831567764282227 + "tok_s":3476.5869210000001, + "stddev":10.988268 }, "tg128":{ - "tok_s":48.078842077141623, - "stddev":0.022483339533209801 + "tok_s":148.974492, + "stddev":1.0746880000000001 } }, "source":"official", - "sha":"7605e8476", - "version":"0.6.4", - "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { "engine":"das", - "backend":"metal", + "backend":"cpu", "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":771.1447715849157, - "stddev":22.693405151367188 + "tok_s":192.31173263635884, + "stddev":4.6414732933044434 }, "tg128":{ - "tok_s":86.089372247037176, - "stddev":0.39612856507301331 + "tok_s":67.333461682215813, + "stddev":0.18527121841907501 } }, "source":"official", - "sha":"0c8200a72", + "sha":"fa67fe165", "version":"0.6.4", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", - "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":781.516254, - "stddev":3.9118369999999998 + "tok_s":116.08498299999999, + "stddev":2.007914 }, "tg128":{ - "tok_s":77.205284000000006, - "stddev":0.218079 + "tok_s":61.880426, + "stddev":0.32918399999999998 } }, "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":316.15677638732893, - "stddev":4.1853594779968262 + "tok_s":208.6934986643252, + "stddev":3.3410212993621826 }, "tg128":{ - "tok_s":88.36084815551736, - "stddev":0.44669952988624573 + "tok_s":67.4999621091535, + "stddev":0.20230530202388763 } }, "source":"official", - "sha":"0c8200a72", + "sha":"fa67fe165", "version":"0.6.4", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", - "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { "engine":"llama.cpp", "backend":"cpu", - "flavor":"clean-cpu", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":183.61563599999999, - "stddev":5.3077059999999996 + "tok_s":115.143388, + "stddev":1.820659 }, "tg128":{ - "tok_s":81.839534, - "stddev":0.43915199999999999 + "tok_s":62.010905999999999, + "stddev":0.102575 } }, "source":"official", - "sha":"ebd048fc5", + "sha":"6fdd0ac89", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":273.72525030678599, - "stddev":52.345851898193359 + "tok_s":198.74889806868953, + "stddev":1.2373650074005127 }, "tg128":{ - "tok_s":87.947067684644566, - "stddev":0.28124231100082397 + "tok_s":21.116826819638096, + "stddev":0.014298847876489162 } }, "source":"official", - "sha":"0c8200a72", + "sha":"37a2c1662", "version":"0.6.4", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", - "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, { "engine":"llama.cpp", "backend":"cpu", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11" - }, - "tests":{ - "pp512":{ - "tok_s":176.65355700000001, - "stddev":5.2921110000000002 - }, - "tg128":{ - "tok_s":78.900824, - "stddev":0.83397200000000005 - } - }, - "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack", - "files":[ - { - "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 - } - ] - }, - { - "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m5", - "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", - "hardware":{ - "cpu":"Apple M5 Max", - "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":3506.8078045084162, - "stddev":19.61585807800293 - }, - "tg128":{ - "tok_s":165.24557967328658, - "stddev":0.11801531910896301 - } - }, - "source":"official", - "sha":"667d4c1d5", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", - "files":[ - { - "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 - } - ] - }, - { - "engine":"llama.cpp", - "backend":"metal", - "flavor":"stock", - "box":"m5", - "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M5 Max", - "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":3425.5220340000001, - "stddev":13.952795 - }, - "tg128":{ - "tok_s":136.43157400000001, - "stddev":0.83255500000000005 - } - }, - "source":"official", - "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", - "files":[ - { - "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", - "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":199.86452245215111, - "stddev":5.3417439460754395 - }, - "tg128":{ - "tok_s":24.794994967352114, - "stddev":0.030465314164757729 - } - }, - "source":"official", - "sha":"37a2c1662", - "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", - "files":[ - { - "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 - } - ] - }, - { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"clean-cpu", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "flavor":"clean-cpu", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\gpt-oss-20b-mxfp4.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", "arch":"AMD64", @@ -5831,12 +6547,12 @@ }, "tests":{ "pp512":{ - "tok_s":132.35418000000001, - "stddev":0.85982199999999998 + "tok_s":129.75144299999999, + "stddev":0.78622499999999995 }, "tg128":{ - "tok_s":22.080724, - "stddev":0.074316999999999994 + "tok_s":20.700060000000001, + "stddev":0.063592999999999997 } }, "source":"official", @@ -5845,9 +6561,9 @@ "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, @@ -5858,7 +6574,7 @@ "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/gpt-oss-20b-mxfp4.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -5870,12 +6586,12 @@ }, "tests":{ "pp512":{ - "tok_s":250.40732658093543, - "stddev":1.4496427774429321 + "tok_s":229.34258636119904, + "stddev":4.1471676826477051 }, "tg128":{ - "tok_s":28.975268851017983, - "stddev":0.0014476769138127565 + "tok_s":23.040888326889924, + "stddev":0.0053026177920401096 } }, "source":"official", @@ -5883,14 +6599,14 @@ "version":"0.6.4", "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar x64-gen (repacked)", + "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] }, @@ -5901,7 +6617,7 @@ "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/gpt-oss-20b-mxfp4.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -5913,12 +6629,12 @@ }, "tests":{ "pp512":{ - "tok_s":110.53892, - "stddev":0.109884 + "tok_s":85.172394999999995, + "stddev":0.29173700000000002 }, "tg128":{ - "tok_s":28.133455000000001, - "stddev":0.065265000000000004 + "tok_s":22.493794000000001, + "stddev":0.024126000000000002 } }, "source":"official", @@ -5927,21 +6643,21 @@ "files":[ { "role":"weights", - "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", - "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", - "bytes":18556686752 + "name":"gpt-oss-20b-mxfp4.gguf", + "sha256":"be37a636aca0fc1aae0d32325f82f6b4d21495f06823b5fbc1898ae0303e9935", + "bytes":12109566560 } ] } ], - "arch":"qwen3moe", + "arch":"gpt-oss", "quant":"q8", - "params_b":30.532122623999999, - "active_b":3.3528217599999999, - "size_bytes":18556686752 + "params_b":20.914757183999999, + "active_b":4.1862758400000004, + "size_bytes":12109566560 }, { - "gguf":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "gguf":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", "runs":[ { "engine":"das", @@ -5950,7 +6666,7 @@ "box":"m1", "threads":8, "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -5963,29 +6679,28 @@ }, "tests":{ "pp512":{ - "tok_s":33.677321299855137, - "stddev":0.14516520500183105 + "tok_s":211.98454574608917, + "stddev":4.6506032943725586 }, "tg128":{ - "tok_s":8.2900339852316751, - "stddev":0.0029765234794467688 + "tok_s":48.104148138395558, + "stddev":0.49066537618637085 } }, "source":"official", "sha":"7605e8476", "version":"0.6.4", "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } - ], - "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." + ] }, { "engine":"llama.cpp", @@ -5994,7 +6709,7 @@ "box":"m1", "threads":8, "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6007,12 +6722,12 @@ }, "tests":{ "pp512":{ - "tok_s":31.950744, - "stddev":0.39331899999999997 + "tok_s":137.90283099999999, + "stddev":0.15882599999999999 }, "tg128":{ - "tok_s":8.236008, - "stddev":0.023486 + "tok_s":46.490020000000001, + "stddev":0.188914 } }, "source":"official", @@ -6021,12 +6736,11 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } - ], - "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." + ] }, { "engine":"das", @@ -6035,7 +6749,7 @@ "box":"m1", "threads":8, "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6048,29 +6762,28 @@ }, "tests":{ "pp512":{ - "tok_s":131.87409739515221, - "stddev":1.3104180097579956 + "tok_s":847.93069782280509, + "stddev":21.823587417602539 }, "tg128":{ - "tok_s":20.51820763367876, - "stddev":0.0033356640487909317 + "tok_s":89.527510177511658, + "stddev":1.8800439834594727 } }, "source":"official", "sha":"7605e8476", "version":"0.6.4", "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } - ], - "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." + ] }, { "engine":"llama.cpp", @@ -6079,7 +6792,7 @@ "box":"m1", "threads":8, "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6092,12 +6805,12 @@ }, "tests":{ "pp512":{ - "tok_s":128.20487700000001, - "stddev":0.124081 + "tok_s":846.74490600000001, + "stddev":4.0971989999999998 }, "tg128":{ - "tok_s":16.850774999999999, - "stddev":0.0056059999999999999 + "tok_s":76.258438999999996, + "stddev":0.29283399999999998 } }, "source":"official", @@ -6106,12 +6819,11 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } - ], - "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." + ] }, { "engine":"llama.cpp", @@ -6120,7 +6832,7 @@ "box":"m1", "threads":8, "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6133,12 +6845,12 @@ }, "tests":{ "pp512":{ - "tok_s":31.966107999999998, - "stddev":0.39652199999999999 + "tok_s":135.318251, + "stddev":0.068266999999999994 }, "tg128":{ - "tok_s":8.2615219999999994, - "stddev":0.003833 + "tok_s":47.170144999999998, + "stddev":0.41250900000000001 } }, "source":"official", @@ -6147,12 +6859,11 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } - ], - "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." + ] }, { "engine":"das", @@ -6161,7 +6872,7 @@ "box":"m1", "threads":8, "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6174,29 +6885,28 @@ }, "tests":{ "pp512":{ - "tok_s":33.763704504413269, - "stddev":0.19322448968887329 + "tok_s":214.9126583062986, + "stddev":0.88831567764282227 }, "tg128":{ - "tok_s":8.2925749880741204, - "stddev":0.0049322908744215965 + "tok_s":48.078842077141623, + "stddev":0.022483339533209801 } }, "source":"official", "sha":"7605e8476", "version":"0.6.4", "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } - ], - "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." + ] }, { "engine":"das", @@ -6205,7 +6915,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -6218,25 +6928,25 @@ }, "tests":{ "pp512":{ - "tok_s":141.22852652621066, - "stddev":3.1514089107513428 + "tok_s":771.1447715849157, + "stddev":22.693405151367188 }, "tg128":{ - "tok_s":17.328784966162594, - "stddev":0.029357310384511948 + "tok_s":86.089372247037176, + "stddev":0.39612856507301331 } }, "source":"official", "sha":"0c8200a72", "version":"0.6.4", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6247,7 +6957,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -6260,12 +6970,12 @@ }, "tests":{ "pp512":{ - "tok_s":143.17946599999999, - "stddev":3.1050249999999999 + "tok_s":781.516254, + "stddev":3.9118369999999998 }, "tg128":{ - "tok_s":17.275572, - "stddev":0.065172999999999995 + "tok_s":77.205284000000006, + "stddev":0.218079 } }, "source":"official", @@ -6274,9 +6984,9 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6287,7 +6997,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -6300,25 +7010,25 @@ }, "tests":{ "pp512":{ - "tok_s":46.990761284479746, - "stddev":0.33455997705459595 + "tok_s":316.15677638732893, + "stddev":4.1853594779968262 }, "tg128":{ - "tok_s":15.776330930273948, - "stddev":0.072981312870979309 + "tok_s":88.36084815551736, + "stddev":0.44669952988624573 } }, "source":"official", "sha":"0c8200a72", "version":"0.6.4", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6329,7 +7039,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -6342,12 +7052,12 @@ }, "tests":{ "pp512":{ - "tok_s":42.281440000000003, - "stddev":0.431477 + "tok_s":183.61563599999999, + "stddev":5.3077059999999996 }, "tg128":{ - "tok_s":15.255198999999999, - "stddev":0.079006999999999994 + "tok_s":81.839534, + "stddev":0.43915199999999999 } }, "source":"official", @@ -6356,9 +7066,9 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6369,7 +7079,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -6382,25 +7092,25 @@ }, "tests":{ "pp512":{ - "tok_s":47.813140994838264, - "stddev":0.53288590908050537 + "tok_s":273.72525030678599, + "stddev":52.345851898193359 }, "tg128":{ - "tok_s":15.789660055227539, - "stddev":0.038597960025072098 + "tok_s":87.947067684644566, + "stddev":0.28124231100082397 } }, "source":"official", "sha":"0c8200a72", "version":"0.6.4", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6411,7 +7121,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -6424,12 +7134,12 @@ }, "tests":{ "pp512":{ - "tok_s":42.406858, - "stddev":0.52212000000000003 + "tok_s":176.65355700000001, + "stddev":5.2921110000000002 }, "tg128":{ - "tok_s":15.140986, - "stddev":0.021749000000000001 + "tok_s":78.900824, + "stddev":0.83397200000000005 } }, "source":"official", @@ -6438,9 +7148,9 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6450,8 +7160,8 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -6465,29 +7175,30 @@ }, "tests":{ "pp512":{ - "tok_s":1107.5193206908937, - "stddev":1.1255176067352295 + "tok_s":3752.852130141313, + "stddev":18.3709716796875 }, "tg128":{ - "tok_s":38.298495651945146, - "stddev":0.053260661661624908 + "tok_s":165.710207762376, + "stddev":0.26651418209075928 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6497,8 +7208,8 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -6512,12 +7223,12 @@ }, "tests":{ "pp512":{ - "tok_s":991.28601000000003, - "stddev":0.77159100000000003 + "tok_s":3422.407815, + "stddev":13.920318999999999 }, "tg128":{ - "tok_s":36.653257000000004, - "stddev":1.1031610000000001 + "tok_s":137.013116, + "stddev":0.53181900000000004 } }, "source":"official", @@ -6526,9 +7237,9 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6536,45 +7247,47 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":36.698381560576024, - "stddev":0.59186089038848877 + "tok_s":211.46727853027505, + "stddev":1.4345347881317139 }, "tg128":{ - "tok_s":4.0502721995610997, - "stddev":0.0046671126037836075 + "tok_s":83.851186093189384, + "stddev":0.50246566534042358 } }, "source":"official", - "sha":"37a2c1662", + "sha":"fa67fe165", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar x64-gen (repacked)", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6582,30 +7295,206 @@ "engine":"llama.cpp", "backend":"cpu", "flavor":"clean-cpu", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "pp512":{ - "tok_s":31.366949000000002, - "stddev":0.098086999999999994 + "tok_s":132.42653999999999, + "stddev":2.9284650000000001 }, "tg128":{ - "tok_s":4.1928710000000002, - "stddev":0.014083999999999999 + "tok_s":66.830782999999997, + "stddev":0.74842500000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":223.29478650085298, + "stddev":1.6116943359375 + }, + "tg128":{ + "tok_s":85.222070270588702, + "stddev":1.4714652299880981 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":132.261968, + "stddev":2.3802629999999998 + }, + "tg128":{ + "tok_s":66.229983000000004, + "stddev":0.23175899999999999 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":199.86452245215111, + "stddev":5.3417439460754395 + }, + "tg128":{ + "tok_s":24.794994967352114, + "stddev":0.030465314164757729 + } + }, + "source":"official", + "sha":"37a2c1662", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "files":[ + { + "role":"weights", + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":132.35418000000001, + "stddev":0.85982199999999998 + }, + "tg128":{ + "tok_s":22.080724, + "stddev":0.074316999999999994 } }, "source":"official", @@ -6614,9 +7503,9 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6627,7 +7516,7 @@ "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -6639,12 +7528,12 @@ }, "tests":{ "pp512":{ - "tok_s":44.632541444240289, - "stddev":0.066027708351612091 + "tok_s":250.40732658093543, + "stddev":1.4496427774429321 }, "tg128":{ - "tok_s":4.2027792715105026, - "stddev":0.0018332317704334855 + "tok_s":28.975268851017983, + "stddev":0.0014476769138127565 } }, "source":"official", @@ -6652,14 +7541,14 @@ "version":"0.6.4", "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar x64-gen (repacked)", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar x64-gen (repacked)", "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] }, @@ -6670,7 +7559,7 @@ "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -6682,12 +7571,12 @@ }, "tests":{ "pp512":{ - "tok_s":21.800127, - "stddev":0.015179 + "tok_s":110.53892, + "stddev":0.109884 }, "tg128":{ - "tok_s":4.2537229999999999, - "stddev":0.004679 + "tok_s":28.133455000000001, + "stddev":0.065265000000000004 } }, "source":"official", @@ -6696,21 +7585,21 @@ "files":[ { "role":"weights", - "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", - "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", - "bytes":14333910592 + "name":"Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf", + "sha256":"6c997b8af17debdfb01d890214400ccbab00db6acc0ba8da5de1cc906c4774d0", + "bytes":18556686752 } ] } ], - "arch":"llama", + "arch":"qwen3moe", "quant":"q8", - "params_b":23.5724032, - "active_b":23.571988480000002, - "size_bytes":14333910592 + "params_b":30.532122623999999, + "active_b":3.3528217599999999, + "size_bytes":18556686752 }, { - "gguf":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "gguf":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", "runs":[ { "engine":"das", @@ -6718,8 +7607,8 @@ "flavor":"tuned", "box":"m1", "threads":8, - "date":"2026-08-09", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "date":"2026-08-02", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6728,43 +7617,42 @@ "total_cores":10, "ram_gb":64, "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":180.61014758785933, - "stddev":0.33970364928245544 + "tok_s":33.677321299855137, + "stddev":0.14516520500183105 }, "tg128":{ - "tok_s":29.717089667356891, - "stddev":0.031801827251911163 + "tok_s":8.2900339852316751, + "stddev":0.0029765234794467688 } }, "source":"official", - "sha":"b94000afb", + "sha":"7605e8476", "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"7ea3e612949702dde5f240c3c7e719acde62bba91a604b4a57eb963ebf801832", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1", + "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } - ] + ], + "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." }, { - "engine":"das", - "backend":"metal", - "flavor":"tuned", + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", "box":"m1", "threads":8, "date":"2026-08-02", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6777,37 +7665,35 @@ }, "tests":{ "pp512":{ - "tok_s":922.58565409238395, - "stddev":2.3088579177856445 + "tok_s":31.950744, + "stddev":0.39331899999999997 }, "tg128":{ - "tok_s":61.16639818028483, - "stddev":2.648909330368042 + "tok_s":8.236008, + "stddev":0.023486 } }, "source":"official", - "sha":"7605e8476", - "version":"0.6.4", - "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", - "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } - ] + ], + "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." }, { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"clean-cpu", + "engine":"das", + "backend":"metal", + "flavor":"tuned", "box":"m1", "threads":8, - "date":"2026-08-09", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-02", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6816,39 +7702,42 @@ "total_cores":10, "ram_gb":64, "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":122.656886, - "stddev":0.15293200000000001 + "tok_s":131.87409739515221, + "stddev":1.3104180097579956 }, "tg128":{ - "tok_s":27.878176, - "stddev":0.16439500000000001 + "tok_s":20.51820763367876, + "stddev":0.0033356640487909317 } }, "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"7605e8476", + "version":"0.6.4", + "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } - ] + ], + "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." }, { "engine":"llama.cpp", - "backend":"cpu", + "backend":"metal", "flavor":"stock", "box":"m1", "threads":8, - "date":"2026-08-09", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-02", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6857,39 +7746,39 @@ "total_cores":10, "ram_gb":64, "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":118.16583900000001, - "stddev":0.075454999999999994 + "tok_s":128.20487700000001, + "stddev":0.124081 }, "tg128":{ - "tok_s":27.706074000000001, - "stddev":0.102841 + "tok_s":16.850774999999999, + "stddev":0.0056059999999999999 } }, "source":"official", "sha":"ebd048f", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } - ] + ], + "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." }, { "engine":"llama.cpp", - "backend":"metal", + "backend":"cpu", "flavor":"stock", "box":"m1", "threads":8, "date":"2026-08-02", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6902,25 +7791,26 @@ }, "tests":{ "pp512":{ - "tok_s":822.17674499999998, - "stddev":3.4716049999999998 + "tok_s":31.966107999999998, + "stddev":0.39652199999999999 }, "tg128":{ - "tok_s":60.740510999999998, - "stddev":0.062274999999999997 + "tok_s":8.2615219999999994, + "stddev":0.003833 } }, "source":"official", "sha":"ebd048f", - "exec_fmt":"native gguf formats", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } - ] + ], + "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." }, { "engine":"das", @@ -6928,8 +7818,8 @@ "flavor":"accel", "box":"m1", "threads":8, - "date":"2026-08-09", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "date":"2026-08-02", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -6938,34 +7828,33 @@ "total_cores":10, "ram_gb":64, "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" + "model_id":"MacBookPro18,2" }, "tests":{ "pp512":{ - "tok_s":180.0972096537717, - "stddev":0.28450745344161987 + "tok_s":33.763704504413269, + "stddev":0.19322448968887329 }, "tg128":{ - "tok_s":29.619742054289748, - "stddev":0.039347972720861435 + "tok_s":8.2925749880741204, + "stddev":0.0049322908744215965 } }, "source":"official", - "sha":"b94000afb", + "sha":"7605e8476", "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"7ea3e612949702dde5f240c3c7e719acde62bba91a604b4a57eb963ebf801832", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1", + "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } - ] + ], + "comment":"This cell is measured LAST in the m1 sweep and both of its engines read low: against the stored 2026-07-28 pair, das metal tg128 re-measures 20.6 against 16.92 and llama.cpp metal tg128 re-measures 16.87 against 13.48 - about +21% and +25%, on an unchanged llama.cpp binary. That is the board-tail thermal under-read the rig documents (-6.5% to -34%), not a code change; the same board showed gemma-4-26B at -18.7% as the final cell and -0.7% on a settled solo re-run. The pair is left as recorded because both sides are depressed together and their ratio is therefore still meaningful (1.26x); correcting one side alone would publish a wrong ratio. Both engines get re-measured together at the end of the refactor." }, { "engine":"das", @@ -6974,7 +7863,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -6987,25 +7876,25 @@ }, "tests":{ "pp512":{ - "tok_s":778.1839895774508, - "stddev":2.7419164180755615 + "tok_s":141.22852652621066, + "stddev":3.1514089107513428 }, "tg128":{ - "tok_s":56.407133246504586, - "stddev":2.2774906158447266 + "tok_s":17.328784966162594, + "stddev":0.029357310384511948 } }, "source":"official", "sha":"0c8200a72", "version":"0.6.4", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7016,7 +7905,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -7029,12 +7918,12 @@ }, "tests":{ "pp512":{ - "tok_s":732.15132900000003, - "stddev":2.9064399999999999 + "tok_s":143.17946599999999, + "stddev":3.1050249999999999 }, "tg128":{ - "tok_s":54.206606000000001, - "stddev":0.070000000000000007 + "tok_s":17.275572, + "stddev":0.065172999999999995 } }, "source":"official", @@ -7043,9 +7932,9 @@ "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7056,7 +7945,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -7069,25 +7958,25 @@ }, "tests":{ "pp512":{ - "tok_s":200.59530919615545, - "stddev":4.6304492950439453 + "tok_s":46.990761284479746, + "stddev":0.33455997705459595 }, "tg128":{ - "tok_s":56.238765165682125, - "stddev":0.14479008316993713 + "tok_s":15.776330930273948, + "stddev":0.072981312870979309 } }, "source":"official", "sha":"0c8200a72", "version":"0.6.4", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7098,7 +7987,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -7111,12 +8000,12 @@ }, "tests":{ "pp512":{ - "tok_s":158.92280600000001, - "stddev":5.5529130000000002 + "tok_s":42.281440000000003, + "stddev":0.431477 }, "tg128":{ - "tok_s":48.621957000000002, - "stddev":0.181064 + "tok_s":15.255198999999999, + "stddev":0.079006999999999994 } }, "source":"official", @@ -7125,9 +8014,9 @@ "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7138,7 +8027,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -7151,25 +8040,25 @@ }, "tests":{ "pp512":{ - "tok_s":203.12538903881901, - "stddev":2.8999459743499756 + "tok_s":47.813140994838264, + "stddev":0.53288590908050537 }, "tg128":{ - "tok_s":56.558797656300953, - "stddev":0.19011507928371429 + "tok_s":15.789660055227539, + "stddev":0.038597960025072098 } }, "source":"official", "sha":"0c8200a72", "version":"0.6.4", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7180,7 +8069,7 @@ "box":"m4", "threads":10, "date":"2026-07-29", - "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -7193,12 +8082,12 @@ }, "tests":{ "pp512":{ - "tok_s":161.74495400000001, - "stddev":3.9709829999999999 + "tok_s":42.406858, + "stddev":0.52212000000000003 }, "tg128":{ - "tok_s":48.408723000000002, - "stddev":0.168628 + "tok_s":15.140986, + "stddev":0.021749000000000001 } }, "source":"official", @@ -7207,9 +8096,9 @@ "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7219,8 +8108,8 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -7234,29 +8123,30 @@ }, "tests":{ "pp512":{ - "tok_s":3648.4381650295713, - "stddev":15.327509880065918 + "tok_s":1163.7076712350488, + "stddev":1.7116338014602661 }, "tg128":{ - "tok_s":118.26094767794341, - "stddev":5.0962691307067871 + "tok_s":38.282019019075705, + "stddev":0.062324531376361847 } }, "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7266,8 +8156,8 @@ "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -7281,12 +8171,12 @@ }, "tests":{ "pp512":{ - "tok_s":3469.808806, - "stddev":11.919931 + "tok_s":990.93720900000005, + "stddev":0.50080800000000003 }, "tg128":{ - "tok_s":99.490211000000002, - "stddev":0.274507 + "tok_s":36.567248999999997, + "stddev":1.0317350000000001 } }, "source":"official", @@ -7295,9 +8185,187 @@ "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":30.703344970653472, + "stddev":0.090231791138648987 + }, + "tg128":{ + "tok_s":14.40670651563874, + "stddev":0.23729783296585083 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":29.691369999999999, + "stddev":0.19892499999999999 + }, + "tg128":{ + "tok_s":10.019841, + "stddev":0.0096570000000000007 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":31.183978511807652, + "stddev":0.23365247249603271 + }, + "tg128":{ + "tok_s":14.623987603331802, + "stddev":0.34035509824752808 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":29.629745, + "stddev":0.183921 + }, + "tg128":{ + "tok_s":10.018668, + "stddev":0.015122999999999999 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7307,8 +8375,8 @@ "flavor":"tuned", "box":"zen2", "threads":16, - "date":"2026-08-05", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", "hardware":{ "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", "arch":"AMD64", @@ -7323,27 +8391,27 @@ }, "tests":{ "pp512":{ - "tok_s":153.84, - "stddev":6.3700000000000001 + "tok_s":36.698381560576024, + "stddev":0.59186089038848877 }, "tg128":{ - "tok_s":13.65, - "stddev":0.39000000000000001 + "tok_s":4.0502721995610997, + "stddev":0.0046671126037836075 } }, "source":"official", - "sha":"082aef90c", + "sha":"37a2c1662", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep4_nrsplit2 (manifest); q51q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest); q51q8_gemv_gen=dot_maddubs_width256_mr8 (manifest)", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar x64-gen (repacked)", "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7354,7 +8422,7 @@ "box":"zen2", "threads":16, "date":"2026-08-04", - "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", "arch":"AMD64", @@ -7369,12 +8437,12 @@ }, "tests":{ "pp512":{ - "tok_s":105.703536, - "stddev":0.54314099999999998 + "tok_s":31.366949000000002, + "stddev":0.098086999999999994 }, "tg128":{ - "tok_s":13.670206, - "stddev":0.015298000000000001 + "tok_s":4.1928710000000002, + "stddev":0.014083999999999999 } }, "source":"official", @@ -7383,9 +8451,9 @@ "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7396,7 +8464,7 @@ "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -7408,12 +8476,12 @@ }, "tests":{ "pp512":{ - "tok_s":81.47924461827256, - "stddev":2.0518887042999268 + "tok_s":44.632541444240289, + "stddev":0.066027708351612091 }, "tg128":{ - "tok_s":15.152850930177454, - "stddev":0.0096137737855315208 + "tok_s":4.2027792715105026, + "stddev":0.0018332317704334855 } }, "source":"official", @@ -7421,14 +8489,14 @@ "version":"0.6.4", "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar x64-gen (repacked)", "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] }, @@ -7439,7 +8507,7 @@ "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -7451,12 +8519,12 @@ }, "tests":{ "pp512":{ - "tok_s":83.005002000000005, - "stddev":0.12174 + "tok_s":21.800127, + "stddev":0.015179 }, "tg128":{ - "tok_s":15.406338999999999, - "stddev":0.031175999999999999 + "tok_s":4.2537229999999999, + "stddev":0.004679 } }, "source":"official", @@ -7465,21 +8533,21 @@ "files":[ { "role":"weights", - "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", - "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", - "bytes":16947541728 + "name":"Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf", + "sha256":"6d670773c3908584349d41a5048d1472226b593c881fd394e8ac196c802e81e2", + "bytes":14333910592 } ] } ], - "arch":"gemma4", + "arch":"llama", "quant":"q8", - "params_b":25.233142046000001, - "active_b":3.2865648639999998, - "size_bytes":16947541728 + "params_b":23.5724032, + "active_b":23.571988480000002, + "size_bytes":14333910592 }, { - "gguf":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "gguf":"gemma-4-26B-A4B-it-Q4_K_M.gguf", "runs":[ { "engine":"das", @@ -7487,8 +8555,8 @@ "flavor":"tuned", "box":"m1", "threads":8, - "date":"2026-08-03", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "date":"2026-08-09", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -7497,89 +8565,43 @@ "total_cores":10, "ram_gb":64, "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":182.73400000000001, - "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":454.57400000000001, - "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":4369.5609999999997, - "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." - }, - "asr:hp0.wav":{ - "ms":7291.5929999999998, - "audio_s":273.28724999999997, - "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + "pp512":{ + "tok_s":180.61014758785933, + "stddev":0.33970364928245544 }, - "asr:hp0x2.wav":{ - "ms":23478.431, - "audio_s":546.57449999999994, - "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + "tg128":{ + "tok_s":29.717089667356891, + "stddev":0.031801827251911163 } }, - "workload":"asr", "source":"official", - "sha":"db50a7da2", + "sha":"b94000afb", "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_gemv_gen=mr4 (manifest)", - "tune_sha":"bf42018efa628277924359a4e145892127c0b36b258a3bcb11996856eac641e9", - "exec_fmt":"q8", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"7ea3e612949702dde5f240c3c7e719acde62bba91a604b4a57eb963ebf801832", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", - "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", - "bytes":2471664028 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 } ] }, { - "engine":"parakeet-cli", - "backend":"cpu", - "flavor":"stock", + "engine":"das", + "backend":"metal", + "flavor":"tuned", "box":"m1", "threads":8, - "date":"2026-08-03", - "cmd":"../whisper.cpp/build/bin/parakeet-cli -m ../whisper.cpp/models/ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -ng", + "date":"2026-08-02", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -7591,73 +8613,38 @@ "model_id":"MacBookPro18,2" }, "tests":{ - "asr:jfk.wav":{ - "ms":238.63 - }, - "asr:jfk3.wav":{ - "ms":680.63999999999987 - }, - "asr:gb1.wav":{ - "ms":7296.2700000000004 - }, - "asr:hp0.wav":{ - "ms":12250.01 + "pp512":{ + "tok_s":922.58565409238395, + "stddev":2.3088579177856445 }, - "asr:hp0x2.wav":{ - "ms":43841.969999999994 + "tg128":{ + "tok_s":61.16639818028483, + "stddev":2.648909330368042 } }, - "workload":"asr", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"7605e8476", + "version":"0.6.4", + "tune_sha":"145736219c515a76bc38c3da1f9d40e0e1ef3044990d2e55a0543493607d4ca6", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m1 DASLLAMA_MODELS_DIR=/Users/borisbatkin/Work/llama.cpp/models", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", - "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", - "bytes":658909748 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 } ] }, { - "engine":"onnx", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"stock", + "flavor":"clean-cpu", "box":"m1", "threads":8, - "date":"2026-08-03", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "date":"2026-08-09", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -7666,239 +8653,165 @@ "total_cores":10, "ram_gb":64, "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":506.49799999999999, - "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":905.05499999999995, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":7110.8050000000003, - "audio_s":198.73400000000001 + "pp512":{ + "tok_s":122.656886, + "stddev":0.15293200000000001 }, - "asr:hp0.wav":{ - "ms":11457.540999999999, - "audio_s":273.28699999999998 + "tg128":{ + "tok_s":27.878176, + "stddev":0.16439500000000001 } }, - "workload":"asr", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-09", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":113.339, - "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":282.84699999999998, - "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":2710.2919999999999, - "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." - }, - "asr:hp0.wav":{ - "ms":4725.7640000000001, - "audio_s":273.28724999999997, - "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + "pp512":{ + "tok_s":118.16583900000001, + "stddev":0.075454999999999994 }, - "asr:hp0x2.wav":{ - "ms":15369.812, - "audio_s":546.57449999999994, - "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + "tg128":{ + "tok_s":27.706074000000001, + "stddev":0.102841 } }, - "workload":"asr", "source":"official", - "sha":"965e57877", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", - "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", - "bytes":2471664028 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-02", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" + }, + "tests":{ + "pp512":{ + "tok_s":822.17674499999998, + "stddev":3.4716049999999998 }, + "tg128":{ + "tok_s":60.740510999999998, + "stddev":0.062274999999999997 + } + }, + "source":"official", + "sha":"ebd048f", + "exec_fmt":"native gguf formats", + "files":[ { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 } ] }, { - "engine":"parakeet-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"../whisper.cpp/build/bin/parakeet-cli -m /Users/dasbox/models/ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -ng", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-09", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":158.07000000000002 - }, - "asr:jfk3.wav":{ - "ms":445.72000000000003 - }, - "asr:gb1.wav":{ - "ms":4492.4799999999996 - }, - "asr:hp0.wav":{ - "ms":7522.2600000000002 + "pp512":{ + "tok_s":180.0972096537717, + "stddev":0.28450745344161987 }, - "asr:hp0x2.wav":{ - "ms":26372.219999999998 + "tg128":{ + "tok_s":29.619742054289748, + "stddev":0.039347972720861435 } }, - "workload":"asr", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"b94000afb", + "version":"0.6.4", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"7ea3e612949702dde5f240c3c7e719acde62bba91a604b4a57eb963ebf801832", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", - "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", - "bytes":658909748 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 } ] }, { - "engine":"onnx", - "backend":"cpu", - "flavor":"stock", + "engine":"das", + "backend":"metal", + "flavor":"tuned", "box":"m4", "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "date":"2026-07-29", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -7907,66 +8820,40 @@ "total_cores":14, "ram_gb":64, "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", - "remote_desktop":"off" + "model_id":"Mac16,11" }, "tests":{ - "asr:jfk.wav":{ - "ms":404.69999999999999, - "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":712.61400000000003, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":4834.7330000000002, - "audio_s":198.73400000000001 + "pp512":{ + "tok_s":778.1839895774508, + "stddev":2.7419164180755615 }, - "asr:hp0.wav":{ - "ms":8212.2759999999998, - "audio_s":273.28699999999998 + "tg128":{ + "tok_s":56.407133246504586, + "stddev":2.2774906158447266 } }, - "workload":"asr", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "sha":"0c8200a72", + "version":"0.6.4", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", + "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 } ] }, { - "engine":"das", - "backend":"cpu", - "flavor":"accel", + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", "box":"m4", "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "date":"2026-07-29", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf\" -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -7975,52 +8862,6326 @@ "total_cores":14, "ram_gb":64, "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", - "remote_desktop":"off" + "model_id":"Mac16,11" }, "tests":{ - "asr:jfk.wav":{ - "ms":115.553, - "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "pp512":{ + "tok_s":732.15132900000003, + "stddev":2.9064399999999999 }, - "asr:jfk3.wav":{ + "tg128":{ + "tok_s":54.206606000000001, + "stddev":0.070000000000000007 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" + }, + "tests":{ + "pp512":{ + "tok_s":200.59530919615545, + "stddev":4.6304492950439453 + }, + "tg128":{ + "tok_s":56.238765165682125, + "stddev":0.14479008316993713 + } + }, + "source":"official", + "sha":"0c8200a72", + "version":"0.6.4", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf\" -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" + }, + "tests":{ + "pp512":{ + "tok_s":158.92280600000001, + "stddev":5.5529130000000002 + }, + "tg128":{ + "tok_s":48.621957000000002, + "stddev":0.181064 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"bin/daslang -jit modules/dasLLAMA/benchmarks/lcpp_bench.das -- -m /Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" + }, + "tests":{ + "pp512":{ + "tok_s":203.12538903881901, + "stddev":2.8999459743499756 + }, + "tg128":{ + "tok_s":56.558797656300953, + "stddev":0.19011507928371429 + } + }, + "source":"official", + "sha":"0c8200a72", + "version":"0.6.4", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DAS_TUNE_MANIFEST=modules/dasLLAMA/performance/m4.tune.json DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-07-29", + "cmd":"\"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench\" -m \"/Users/dasbox/models/gemma-4-26B-A4B-it-Q4_K_M.gguf\" -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11" + }, + "tests":{ + "pp512":{ + "tok_s":161.74495400000001, + "stddev":3.9709829999999999 + }, + "tg128":{ + "tok_s":48.408723000000002, + "stddev":0.168628 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3868.4198142873938, + "stddev":16.014259338378906 + }, + "tg128":{ + "tok_s":118.10740587520641, + "stddev":5.1168985366821289 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":3476.3057269999999, + "stddev":17.166998 + }, + "tg128":{ + "tok_s":99.504733999999999, + "stddev":0.25623099999999999 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":204.66464442081215, + "stddev":2.2271018028259277 + }, + "tg128":{ + "tok_s":56.295989893220131, + "stddev":0.64074355363845825 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":121.94652499999999, + "stddev":2.1746210000000001 + }, + "tg128":{ + "tok_s":46.571576999999998, + "stddev":0.50411799999999996 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":215.26013442737548, + "stddev":3.4267158508300781 + }, + "tg128":{ + "tok_s":56.175344815312918, + "stddev":0.32794713973999023 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":118.780635, + "stddev":2.2828900000000001 + }, + "tg128":{ + "tok_s":45.717309999999998, + "stddev":0.32566200000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-05", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m D:\\work\\llama.cpp\\models\\gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 16 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":153.84, + "stddev":6.3700000000000001 + }, + "tg128":{ + "tok_s":13.65, + "stddev":0.39000000000000001 + } + }, + "source":"official", + "sha":"082aef90c", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep4_nrsplit2 (manifest); q51q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest); q51q8_gemv_gen=dot_maddubs_width256_mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"D:\\Work\\llama.cpp-ref-ebd048f\\build-clean-cpu\\bin\\Release\\llama-bench.exe -m D:\\work\\llama.cpp\\models\\gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -t 16 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":105.703536, + "stddev":0.54314099999999998 + }, + "tg128":{ + "tok_s":13.670206, + "stddev":0.015298000000000001 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- -m /home/boris/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "pp512":{ + "tok_s":81.47924461827256, + "stddev":2.0518887042999268 + }, + "tg128":{ + "tok_s":15.152850930177454, + "stddev":0.0096137737855315208 + } + }, + "source":"official", + "sha":"7e02c2451", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar x64-gen (repacked)", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"/home/boris/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /home/boris/models/gemma-4-26B-A4B-it-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "pp512":{ + "tok_s":83.005002000000005, + "stddev":0.12174 + }, + "tg128":{ + "tok_s":15.406338999999999, + "stddev":0.031175999999999999 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-26B-A4B-it-Q4_K_M.gguf", + "sha256":"f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", + "bytes":16947541728 + } + ] + } + ], + "arch":"gemma4", + "quant":"q8", + "params_b":25.233142046000001, + "active_b":3.2865648639999998, + "size_bytes":16947541728 + }, + { + "gguf":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-03", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":182.73400000000001, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":454.57400000000001, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4369.5609999999997, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7291.5929999999998, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":23478.431, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"db50a7da2", + "version":"0.6.4", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_gemv_gen=mr4 (manifest)", + "tune_sha":"bf42018efa628277924359a4e145892127c0b36b258a3bcb11996856eac641e9", + "exec_fmt":"q8", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-03", + "cmd":"../whisper.cpp/build/bin/parakeet-cli -m ../whisper.cpp/models/ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -ng", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":238.63 + }, + "asr:jfk3.wav":{ + "ms":680.63999999999987 + }, + "asr:gb1.wav":{ + "ms":7296.2700000000004 + }, + "asr:hp0.wav":{ + "ms":12250.01 + }, + "asr:hp0x2.wav":{ + "ms":43841.969999999994 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", + "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", + "bytes":658909748 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-03", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":506.49799999999999, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":905.05499999999995, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":7110.8050000000003, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":11457.540999999999, + "audio_s":273.28699999999998 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":113.339, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":282.84699999999998, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":2710.2919999999999, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":4725.7640000000001, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":15369.812, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"965e57877", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"../whisper.cpp/build/bin/parakeet-cli -m /Users/dasbox/models/ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -ng", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":158.07000000000002 + }, + "asr:jfk3.wav":{ + "ms":445.72000000000003 + }, + "asr:gb1.wav":{ + "ms":4492.4799999999996 + }, + "asr:hp0.wav":{ + "ms":7522.2600000000002 + }, + "asr:hp0x2.wav":{ + "ms":26372.219999999998 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", + "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", + "bytes":658909748 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":404.69999999999999, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":712.61400000000003, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":4834.7330000000002, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":8212.2759999999998, + "audio_s":273.28699999999998 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":115.553, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ "ms":284.392, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":2721.027, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":4835.1700000000001, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":15670.759, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"965e57877", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":146.80199999999999, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":456.37299999999999, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4372.0659999999998, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7318.1199999999999, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":25779.294000000002, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":148.95500000000001, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":454.815, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4336.6459999999997, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7238.0379999999996, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":25523.428, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/parakeet-cli -m ../whisper.cpp/models/ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -ng", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":160.37 + }, + "asr:jfk3.wav":{ + "ms":476.83000000000004 + }, + "asr:gb1.wav":{ + "ms":5468.0200000000004 + }, + "asr:hp0.wav":{ + "ms":9247.1200000000008 + }, + "asr:hp0x2.wav":{ + "ms":31106.959999999999 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", + "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", + "bytes":658909748 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":341.28500000000003, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":733.25099999999998, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":5044.2799999999997, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":7746.7969999999996, + "audio_s":273.28699999999998 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":299.15899999999999, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":828.99699999999996, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":6638.4809999999998, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":9959.7540000000008, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":30565.546999999999, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Super Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"37a2c1662", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"D:\\Work\\whisper.cpp\\build\\bin\\Release\\parakeet-cli.exe -m D:\\Work\\whisper.cpp\\models\\ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 16 -ng", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":478.46000000000004 + }, + "asr:jfk3.wav":{ + "ms":1377.97 + }, + "asr:gb1.wav":{ + "ms":13866.57 + }, + "asr:hp0.wav":{ + "ms":22944.91 + }, + "asr:hp0x2.wav":{ + "ms":76769.539999999994 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", + "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", + "bytes":658909748 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"zen2", + "threads":16, + "date":"2026-07-29", + "cmd":"modules\\dasLLAMA\\benchmarks\\asr\\.venv-onnx\\Scripts\\python.exe modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 16 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"Parsec Virtual Display Adapter", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"AMD Ryzen™ Balanced", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":625.28999999999996, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":2009.4459999999999, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":15153.222, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":25262.514999999999, + "audio_s":273.28699999999998 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":171.209, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":435.55900000000003, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":5536.5100000000002, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":10037.581, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + }, + "asr:hp0x2.wav":{ + "ms":36938.343000000001, + "audio_s":546.57449999999994, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive Supa drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive Supa drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + } + }, + "workload":"asr", + "source":"official", + "sha":"7e02c2451", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", + "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", + "bytes":2471664028 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"/home/boris/whisper.cpp/build/bin/parakeet-cli -m /home/boris/models/ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -ng", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":487.69 + }, + "asr:jfk3.wav":{ + "ms":1610.77 + }, + "asr:gb1.wav":{ + "ms":16564.84 + }, + "asr:hp0.wav":{ + "ms":26981.780000000002 + }, + "asr:hp0x2.wav":{ + "ms":90030.01999999999 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", + "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", + "bytes":658909748 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":418.392, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":1138.752, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":11266.878000000001, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":18176.378000000001, + "audio_s":273.28699999999998 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + } + ] + } + ], + "arch":"Parakeet-TDT v2", + "size_bytes":2471664028 + }, + { + "gguf":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-03", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":198.73599999999999, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":489.935, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4485.1530000000002, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7511.5649999999996, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":24033.816999999999, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." + }, + "asr:librispeech25":{ + "ms":4059.6249999999995, + "audio_s":215.91506250000006 + } + }, + "workload":"asr", + "source":"official", + "sha":"db50a7da2", + "version":"0.6.4", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_gemv_gen=mr4 (manifest)", + "tune_sha":"bf42018efa628277924359a4e145892127c0b36b258a3bcb11996856eac641e9", + "exec_fmt":"q8", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-03", + "cmd":"../whisper.cpp/build/bin/parakeet-cli -m ../whisper.cpp/models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -t 8 -ng modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":243.89999999999998 + }, + "asr:jfk3.wav":{ + "ms":706.23000000000002 + }, + "asr:gb1.wav":{ + "ms":7278.8199999999997 + }, + "asr:hp0.wav":{ + "ms":12273.030000000001 + }, + "asr:hp0x2.wav":{ + "ms":44887.120000000003 + }, + "asr:librispeech25":{ + "ms":5154.3699999999999 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", + "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", + "bytes":668757119 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-03", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":458.50200000000001, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":909.63699999999994, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":7057.2849999999999, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":11420.093999999999, + "audio_s":273.28699999999998 + }, + "asr:librispeech25":{ + "ms":9861.8950000000004, + "audio_s":215.91500000000005 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":117.684, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":299.03500000000003, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":2842.3330000000001, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":4988.9350000000004, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":16547.940999999999, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." + }, + "asr:librispeech25":{ + "ms":2629.3359999999998, + "audio_s":215.91506250000006 + } + }, + "workload":"asr", + "source":"official", + "sha":"965e57877", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"../whisper.cpp/build/bin/parakeet-cli -m /Users/dasbox/models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -t 10 -ng modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":157.81 + }, + "asr:jfk3.wav":{ + "ms":455.90000000000003 + }, + "asr:gb1.wav":{ + "ms":4527.1599999999999 + }, + "asr:hp0.wav":{ + "ms":7559.3800000000001 + }, + "asr:hp0x2.wav":{ + "ms":26655.540000000001 + }, + "asr:librispeech25":{ + "ms":3471.54 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", + "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", + "bytes":668757119 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":425.35599999999999, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":703.70299999999997, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":4804.0860000000002, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":8231.4860000000008, + "audio_s":273.28699999999998 + }, + "asr:librispeech25":{ + "ms":9540.9770000000008, + "audio_s":215.91500000000005 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":118.04000000000001, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":298.24299999999999, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":2808.3620000000001, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":4926.1700000000001, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":16042.200999999999, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." + }, + "asr:librispeech25":{ + "ms":2625.9430000000002, + "audio_s":215.91506250000006 + } + }, + "workload":"asr", + "source":"official", + "sha":"965e57877", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":156.066, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":488.05399999999997, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4508.3599999999997, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7450.7749999999996, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":25803.580000000002, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." + }, + "asr:librispeech25":{ + "ms":3507.5410000000002, + "audio_s":215.91506250000006 + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":156.566, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":473.95699999999999, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":4379.6679999999997, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":7325.3249999999998, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":25813.549999999999, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." + }, + "asr:librispeech25":{ + "ms":3473.3289999999997, + "audio_s":215.91506250000006 + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/parakeet-cli -m ../whisper.cpp/models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -t 6 -ng modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":163.73999999999995 + }, + "asr:jfk3.wav":{ + "ms":490.97000000000003 + }, + "asr:gb1.wav":{ + "ms":5488.3099999999995 + }, + "asr:hp0.wav":{ + "ms":9341.2799999999988 + }, + "asr:hp0x2.wav":{ + "ms":31341.75 + }, + "asr:librispeech25":{ + "ms":3636.5900000000001 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", + "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", + "bytes":668757119 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":347.24700000000001, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":734.53499999999997, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":5025.799, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":7770.2340000000004, + "audio_s":273.28699999999998 + }, + "asr:librispeech25":{ + "ms":6875.7159999999994, + "audio_s":215.91500000000005 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":323.60300000000001, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":856.61900000000003, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":6682.1689999999999, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":10495.947, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":31685.063999999998, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dotnu dot org slash copy left slash FDL dot HTML." + } + }, + "workload":"asr", + "source":"official", + "sha":"37a2c1662", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"zen2", + "threads":16, + "date":"2026-08-04", + "cmd":"D:\\Work\\whisper.cpp\\build\\bin\\Release\\parakeet-cli.exe -m D:\\Work\\whisper.cpp\\models\\ggml-parakeet-tdt-0.6b-v3-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 16 -ng", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":422.76999999999998 + }, + "asr:jfk3.wav":{ + "ms":1402.47 + }, + "asr:gb1.wav":{ + "ms":13892.73 + }, + "asr:hp0.wav":{ + "ms":23051.68 + }, + "asr:hp0x2.wav":{ + "ms":76742.110000000001 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", + "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", + "bytes":668757119 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"zen2", + "threads":16, + "date":"2026-07-29", + "cmd":"modules\\dasLLAMA\\benchmarks\\asr\\.venv-onnx\\Scripts\\python.exe modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 16 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "hardware":{ + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"Parsec Virtual Display Adapter", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"AMD Ryzen™ Balanced", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":483.52199999999999, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":1585.971, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":14779.536, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":24405.284, + "audio_s":273.28699999999998 + }, + "asr:librispeech25":{ + "ms":9790.0899999999983, + "audio_s":215.91500000000005 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"01_1089-134686-0000.wav", + "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", + "bytes":333998 + }, + { + "role":"clip", + "name":"02_1089-134686-0001.wav", + "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", + "bytes":104878 + }, + { + "role":"clip", + "name":"03_1089-134686-0002.wav", + "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", + "bytes":212078 + }, + { + "role":"clip", + "name":"04_1089-134686-0003.wav", + "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", + "bytes":85838 + }, + { + "role":"clip", + "name":"05_1089-134686-0004.wav", + "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", + "bytes":166960 + }, + { + "role":"clip", + "name":"06_1089-134686-0005.wav", + "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", + "bytes":308398 + }, + { + "role":"clip", + "name":"07_1089-134686-0006.wav", + "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", + "bytes":337838 + }, + { + "role":"clip", + "name":"08_1089-134686-0007.wav", + "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", + "bytes":136878 + }, + { + "role":"clip", + "name":"09_1089-134686-0008.wav", + "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", + "bytes":215438 + }, + { + "role":"clip", + "name":"10_1089-134686-0009.wav", + "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", + "bytes":338478 + }, + { + "role":"clip", + "name":"11_1089-134686-0010.wav", + "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", + "bytes":141038 + }, + { + "role":"clip", + "name":"12_1089-134686-0011.wav", + "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", + "bytes":398318 + }, + { + "role":"clip", + "name":"13_1089-134686-0012.wav", + "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", + "bytes":372558 + }, + { + "role":"clip", + "name":"14_1089-134686-0013.wav", + "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", + "bytes":253358 + }, + { + "role":"clip", + "name":"15_1089-134686-0014.wav", + "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", + "bytes":71278 + }, + { + "role":"clip", + "name":"16_1089-134686-0015.wav", + "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", + "bytes":186158 + }, + { + "role":"clip", + "name":"17_1089-134686-0016.wav", + "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", + "bytes":113358 + }, + { + "role":"clip", + "name":"18_1089-134686-0017.wav", + "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", + "bytes":283918 + }, + { + "role":"clip", + "name":"19_1089-134686-0018.wav", + "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", + "bytes":503118 + }, + { + "role":"clip", + "name":"20_1089-134686-0019.wav", + "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", + "bytes":444718 + }, + { + "role":"clip", + "name":"21_1089-134686-0020.wav", + "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", + "bytes":537358 + }, + { + "role":"clip", + "name":"22_1089-134686-0021.wav", + "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", + "bytes":209678 + }, + { + "role":"clip", + "name":"23_1089-134686-0022.wav", + "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", + "bytes":357678 + }, + { + "role":"clip", + "name":"24_1089-134686-0023.wav", + "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", + "bytes":424878 + }, + { + "role":"clip", + "name":"25_1089-134686-0024.wav", + "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", + "bytes":373038 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":186.65899999999999, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":491.98200000000003, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":5781.0529999999999, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and make out may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":10502.608, + "audio_s":273.28724999999997, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.Wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + }, + "asr:hp0x2.wav":{ + "ms":37697.311999999998, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML." + } + }, + "workload":"asr", + "source":"official", + "sha":"7e02c2451", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"q8", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", + "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", + "bytes":2508463079 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"parakeet-cli", + "backend":"cpu", + "flavor":"stock", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"/home/boris/whisper.cpp/build/bin/parakeet-cli -m /home/boris/models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -ng", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":490.84000000000003 + }, + "asr:jfk3.wav":{ + "ms":1621.8900000000001 + }, + "asr:gb1.wav":{ + "ms":16583.459999999999 + }, + "asr:hp0.wav":{ + "ms":27048.41 + }, + "asr:hp0x2.wav":{ + "ms":90034.360000000001 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", + "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", + "bytes":668757119 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":388.84800000000001, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":1123.9290000000001, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":11239.645, + "audio_s":198.73400000000001 + }, + "asr:hp0.wav":{ + "ms":18175.059000000001, + "audio_s":273.28699999999998 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + } + ] + } + ], + "arch":"Parakeet-TDT v3", + "size_bytes":2508463079 + }, + { + "gguf":"ggml-tiny.bin", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":86.340000000000003, + "audio_s":11, + "encode_ms":54.674999999999997, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":197.25800000000001, + "audio_s":33, + "encode_ms":109.279, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":1011.276, + "audio_s":198.734375, + "encode_ms":434.935, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":1260.029, + "audio_s":273.28724999999997, + "encode_ms":603.93399999999997, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":2516.8180000000002, + "audio_s":546.57449999999994, + "encode_ms":1214.7670000000001, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"bda14853a", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "noise":"ok", + "exec_fmt":"q8/q8", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1 -nf -ng", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":107.77 + }, + "asr:jfk3.wav":{ + "ms":257.95000000000005 + }, + "asr:gb1.wav":{ + "ms":1472.9399999999998 + }, + "asr:hp0.wav":{ + "ms":1957.8500000000001 + }, + "asr:hp0x2.wav":{ + "ms":4017.4000000000001 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":416.28300000000002, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":86.403000000000006, + "audio_s":11, + "encode_ms":54.835000000000001, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":197.21000000000001, + "audio_s":33, + "encode_ms":109.056, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":1002.949, + "audio_s":198.734375, + "encode_ms":439.82499999999999, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":1246.6610000000001, + "audio_s":273.28724999999997, + "encode_ms":596.89700000000005, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":2509.9670000000001, + "audio_s":546.57449999999994, + "encode_ms":1195.905, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"8a2281a7f", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "noise":"ok", + "exec_fmt":"q8/q8", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 1", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":58.539999999999999, + "audio_s":11, + "encode_ms":37.493000000000002, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":148.56299999999999, + "audio_s":33, + "encode_ms":61.232999999999997, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":805.85900000000004, + "audio_s":198.734375, + "encode_ms":210.084, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":1006.9400000000001, + "audio_s":273.28724999999997, + "encode_ms":305.56799999999998, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million, 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Infobox, part of this series on screw drive types. Slotted, commonly, erroneously flat head. Phillips, cross head. Positrive, superdrive. Torx. Hex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the Gnue-Free Documentation License. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible non-profit charity. This sound file and all texts in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.8x. TML" + }, + "asr:hp0x2.wav":{ + "ms":1940.0250000000001, + "audio_s":546.57449999999994, + "encode_ms":625.57799999999997, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million, 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Infobox, part of this series on screw drive types. Slotted, commonly, erroneously flat head. Phillips, cross head. Positrive, superdrive. Torx. Hex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the Gnue-Free Documentation License. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible non-profit charity. This sound file and all texts in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.8x. TML. Henry F Phillips from Wikipedia, the free encyclopedia at E N dot Wikipedia dot org Henry F Phillips from Wikipedia the free and cyclopedia Henry F Phillips 1890 to 1958 a US businessman from Portland Oregon as the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in itself centering property, useful on automated production lines that use powered screw drivers. Phillips Major contribution was in driving the cross-head concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. In the info box, part of the series on screw drive types. Slaughted, commonly, erroneously flat head. Crossehead, Positrive, Superdrive, Torx, Hex, Allen, Robertson, Tri-Wing, Torx-Set, Spannerhead, triple square, xzn. Others, polydrive, spline drive, double hex. Many images are accompanied this info box. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. A US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.html." + } + }, + "workload":"asr", + "source":"official", + "sha":"da8ed204d", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "noise":"ok", + "exec_fmt":"f32/q8", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"metal", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":86.140000000000001 + }, + "asr:jfk3.wav":{ + "ms":178.84999999999999 + }, + "asr:gb1.wav":{ + "ms":1037.1700000000001 + }, + "asr:hp0.wav":{ + "ms":1207.25 + }, + "asr:hp0x2.wav":{ + "ms":2418.6300000000001 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":52.262999999999998, + "audio_s":11, + "encode_ms":33.433999999999997, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":119.905, + "audio_s":33, + "encode_ms":66.992000000000004, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":612.15599999999995, + "audio_s":198.734375, + "encode_ms":271.53699999999998, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":777.38300000000004, + "audio_s":273.28724999999997, + "encode_ms":377.69999999999999, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":1564.6489999999999, + "audio_s":546.57449999999994, + "encode_ms":756.81200000000001, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m /Users/dasbox/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -bs 1 -bo 1 -nf -ng", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":71.280000000000001 + }, + "asr:jfk3.wav":{ + "ms":171.71000000000001 + }, + "asr:gb1.wav":{ + "ms":931.70000000000005 + }, + "asr:hp0.wav":{ + "ms":1242.47 + }, + "asr:hp0x2.wav":{ + "ms":2449.6100000000001 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":425.56900000000002, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":52.685000000000002, + "audio_s":11, + "encode_ms":33.255000000000003, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":120.25, + "audio_s":33, + "encode_ms":66.814999999999998, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":612.66499999999996, + "audio_s":198.734375, + "encode_ms":272.07900000000001, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":779.72400000000005, + "audio_s":273.28724999999997, + "encode_ms":377.71800000000002, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":1564.2850000000001, + "audio_s":546.57449999999994, + "encode_ms":757.39400000000001, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 1", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":44.554000000000002, + "audio_s":11, + "encode_ms":23.259, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":108.26600000000001, + "audio_s":33, + "encode_ms":56.192, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":562.38999999999999, + "audio_s":198.734375, + "encode_ms":191.14500000000001, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":696.45399999999995, + "audio_s":273.28724999999997, + "encode_ms":266.94900000000001, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia, at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":1431.2629999999999, + "audio_s":546.57449999999994, + "encode_ms":533.30600000000004, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia, at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In the info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"metal", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m /Users/dasbox/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -bs 1 -bo 1", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":59.86999999999999 + }, + "asr:jfk3.wav":{ + "ms":124.71000000000001 + }, + "asr:gb1.wav":{ + "ms":692.42999999999995 + }, + "asr:hp0.wav":{ + "ms":804.06999999999994 + }, + "asr:hp0x2.wav":{ + "ms":1612.8499999999999 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ + { + "role":"weights", + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":64.829999999999998, + "audio_s":11, + "encode_ms":44.901000000000003, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":144.654, + "audio_s":33, + "encode_ms":89.942999999999998, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":2721.027, + "ms":705.41499999999996, "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + "encode_ms":364.47399999999999, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" }, "asr:hp0.wav":{ - "ms":4835.1700000000001, + "ms":915.20500000000004, "audio_s":273.28724999999997, - "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + "encode_ms":512.48500000000001, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." }, "asr:hp0x2.wav":{ - "ms":15670.759, + "ms":1862.3230000000001, "audio_s":546.57449999999994, - "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Supa Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + "encode_ms":1052.23, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" } }, "workload":"asr", "source":"official", - "sha":"965e57877", + "sha":"82e45e0a3", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", - "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", - "bytes":2471664028 + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 }, { "role":"clip", @@ -8057,64 +15218,170 @@ { "engine":"das", "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":63.965000000000003, + "audio_s":11, + "encode_ms":44.777000000000001, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":142.483, + "audio_s":33, + "encode_ms":89.864999999999995, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":694.24099999999999, + "audio_s":198.734375, + "encode_ms":359.411, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + }, + "asr:hp0.wav":{ + "ms":882.49400000000003, + "audio_s":273.28724999999997, + "encode_ms":502.34199999999998, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + }, + "asr:hp0x2.wav":{ + "ms":1803.672, + "audio_s":546.57449999999994, + "encode_ms":1035.5329999999999, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"metal", "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":299.15899999999999, + "ms":38.155000000000001, "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":18.172999999999998, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":828.99699999999996, + "ms":85.828000000000003, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + "encode_ms":34.006, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":6638.4809999999998, + "ms":465.02699999999999, "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + "encode_ms":173.75899999999999, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our Space Shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. our no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McHool, Dr. Kultner Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly. knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. in the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens, who created all these, he who brings out the story hosts one by one, and calls them each by name, because of his great power and mighty strength, not one of them is missing. The same creator who names the stars, also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families. and make out what may God continue to bless America." }, "asr:hp0.wav":{ - "ms":9959.7540000000008, + "ms":559.66700000000003, "audio_s":273.28724999999997, - "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + "encode_ms":189.321, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia, at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents, 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the positive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-Wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A US registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." }, "asr:hp0x2.wav":{ - "ms":30565.546999999999, + "ms":1132.8199999999999, "audio_s":546.57449999999994, - "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive Super Drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive SuperDrive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html" + "encode_ms":427.30000000000001, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia, at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents, 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the positive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-Wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A US registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple mild slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In the info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" } }, "workload":"asr", "source":"official", - "sha":"37a2c1662", + "sha":"82e45e0a3", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"q8", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", - "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", - "bytes":2471664028 + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 }, { "role":"clip", @@ -8149,40 +15416,39 @@ ] }, { - "engine":"parakeet-cli", + "engine":"whisper-cli", "backend":"cpu", "flavor":"stock", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"D:\\Work\\whisper.cpp\\build\\bin\\Release\\parakeet-cli.exe -m D:\\Work\\whisper.cpp\\models\\ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 16 -ng", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -bs 1 -bo 1 -nf -ng", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":478.46000000000004 + "ms":73.63000000000001 }, "asr:jfk3.wav":{ - "ms":1377.97 + "ms":174.89999999999998 }, "asr:gb1.wav":{ - "ms":13866.57 + "ms":891.55000000000007 }, "asr:hp0.wav":{ - "ms":22944.91 + "ms":1237.3499999999999 }, "asr:hp0x2.wav":{ - "ms":76769.539999999994 + "ms":2467.3600000000001 } }, "workload":"asr", @@ -8192,9 +15458,9 @@ "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", - "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", - "bytes":658909748 + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 }, { "role":"clip", @@ -8229,46 +15495,52 @@ ] }, { - "engine":"onnx", - "backend":"cpu", + "engine":"whisper-cli", + "backend":"metal", "flavor":"stock", - "box":"zen2", - "threads":16, - "date":"2026-07-29", - "cmd":"modules\\dasLLAMA\\benchmarks\\asr\\.venv-onnx\\Scripts\\python.exe modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 16 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -bs 1 -bo 1", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"Parsec Virtual Display Adapter", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"AMD Ryzen™ Balanced", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":625.28999999999996, - "audio_s":11 + "ms":45.450000000000003 }, "asr:jfk3.wav":{ - "ms":2009.4459999999999, - "audio_s":33 + "ms":90.420000000000002 }, "asr:gb1.wav":{ - "ms":15153.222, - "audio_s":198.73400000000001 + "ms":506.19999999999999 }, "asr:hp0.wav":{ - "ms":25262.514999999999, - "audio_s":273.28699999999998 + "ms":582.32999999999993 + }, + "asr:hp0x2.wav":{ + "ms":1159.47 } }, "workload":"asr", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", "files":[ + { + "role":"weights", + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 + }, { "role":"clip", "name":"jfk.wav", @@ -8292,6 +15564,50 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":284.61500000000001, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 } ] }, @@ -8299,60 +15615,68 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"zen4", - "threads":8, + "box":"zen2", + "threads":16, "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-parakeet-tdt-0.6b-v2-f32.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-tiny.bin -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":171.209, + "ms":134.542, "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":77.266000000000005, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":435.55900000000003, + "ms":326.74900000000002, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you. Ask what you can do for your country." + "encode_ms":156.297, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":5536.5100000000002, + "ms":1692.521, "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + "encode_ms":651.90599999999995, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our Space Shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" }, "asr:hp0.wav":{ - "ms":10037.581, + "ms":2016.4159999999999, "audio_s":273.28724999999997, - "text":"Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia Henry F. Phillips 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips Crosshead Pausadrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + "encode_ms":871.32299999999998, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in itself centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the positrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, Philips screw head. The following is an info box which accompanies this article. In the info box, part of the series on screw drive types. Slotted, commonly, erroneously, flat head. Phillips, cross head. Pause a drive, super drive. Torx. Hex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the Gnou-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.8x. TML" }, "asr:hp0x2.wav":{ - "ms":36938.343000000001, + "ms":4512.2349999999997, "audio_s":546.57449999999994, - "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia. org Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive Supa drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at www dot gnu dot org slash copyleft slash fdl dot html Henry F Phillips from Wikipedia the free encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self centering property useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936 US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pausa Drive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips screw head. The following is an info box which accompanies this article InfoBox part of the series on screw drive types slotted commonly erroneously flathead Phillips crosshead Pausadrive Supa drive Torques Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many images accompanied this info box. This page was last modified on the 9th of April two thousand eight at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered five hundred one C three tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html" + "encode_ms":1828.3689999999999, + "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in itself centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the positrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, Philips screw head. The following is an info box which accompanies this article. In the info box, part of the series on screw drive types. Slotted, commonly, erroneously, flat head. Phillips, cross head. Pause a drive, super drive. Torx. Hex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the Gnou-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.8x. TML. Henry F Phillips from Wikipedia, the free encyclopedia, at E N dot Wikipedia dot org Henry F Phillips from Wikipedia the free and cyclopedia Henry F Phillips 1890 to 1958 a US businessman from Portland Oregon as the honor of having the Philips head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips major contribution was in driving the cross head concept forward forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,840, it was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. distinct from the simple mild slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the positrive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. In a info box, part of this series on and screw drive types. Slotted, commonly, erroneously, flat head. Phillips, cross head. Pause a drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.hp TML" } }, "workload":"asr", "source":"official", - "sha":"7e02c2451", + "sha":"37a2c1662", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"q8", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", + "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-f32.bin", - "sha256":"9dde716823d0dfe587cb7396a7cc251708c30a8475f6fccc8af36ee769fcd808", - "bytes":2471664028 + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 }, { "role":"clip", @@ -8387,37 +15711,40 @@ ] }, { - "engine":"parakeet-cli", + "engine":"whisper-cli", "backend":"cpu", "flavor":"stock", - "box":"zen4", - "threads":8, + "box":"zen2", + "threads":16, "date":"2026-08-04", - "cmd":"/home/boris/whisper.cpp/build/bin/parakeet-cli -m /home/boris/models/ggml-parakeet-tdt-0.6b-v2-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -ng", + "cmd":"D:\\Work\\whisper.cpp\\build\\bin\\Release\\whisper-cli.exe -m D:\\Work\\whisper.cpp\\models\\ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 16 -bs 1 -bo 1 -nf -ng", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":487.69 + "ms":163 }, "asr:jfk3.wav":{ - "ms":1610.77 + "ms":354.32999999999998 }, "asr:gb1.wav":{ - "ms":16564.84 + "ms":1995.71 }, "asr:hp0.wav":{ - "ms":26981.780000000002 + "ms":2509.6199999999999 }, "asr:hp0x2.wav":{ - "ms":90030.01999999999 + "ms":5490.0699999999997 } }, "workload":"asr", @@ -8427,9 +15754,9 @@ "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v2-q8_0.bin", - "sha256":"e6e008e2456cef5037dbb15f0e3f6c211cc4b6819316014323301d04e799257b", - "bytes":658909748 + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 }, { "role":"clip", @@ -8467,137 +15794,102 @@ "engine":"onnx", "backend":"cpu", "flavor":"stock", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant v2-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "box":"zen2", + "threads":16, + "date":"2026-07-29", + "cmd":"modules\\dasLLAMA\\benchmarks\\asr\\.venv-onnx\\Scripts\\python.exe modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --threads 16 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"Parsec Virtual Display Adapter", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"AMD Ryzen™ Balanced", "smt":"on" }, "tests":{ "asr:jfk.wav":{ - "ms":418.392, + "ms":573.23199999999997, "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":1138.752, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":11266.878000000001, - "audio_s":198.73400000000001 - }, - "asr:hp0.wav":{ - "ms":18176.378000000001, - "audio_s":273.28699999999998 } }, "workload":"asr", "source":"official", "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", "files":[ { "role":"clip", "name":"jfk.wav", "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 } ] - } - ], - "arch":"Parakeet-TDT v2", - "size_bytes":2471664028 - }, - { - "gguf":"ggml-parakeet-tdt-0.6b-v3-f32.bin", - "runs":[ + }, { "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"m1", + "box":"zen4", "threads":8, - "date":"2026-08-03", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-tiny.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" }, "tests":{ "asr:jfk.wav":{ - "ms":198.73599999999999, + "ms":94.736000000000004, "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":59.701000000000001, + "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":489.935, + "ms":218.77799999999999, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":120.57299999999999, + "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":4485.1530000000002, + "ms":1115.691, "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + "encode_ms":483.19299999999998, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. The words of the prophet Isaiah, lift your eyes and look to the heavens who created all these. He who brings out the story hosts one by one and calls them each by name because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" }, "asr:hp0.wav":{ - "ms":7511.5649999999996, + "ms":1398.5340000000001, "audio_s":273.28724999999997, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + "encode_ms":664.89999999999998, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-Wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A US registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." }, "asr:hp0x2.wav":{ - "ms":24033.816999999999, + "ms":2806.681, "audio_s":546.57449999999994, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." - }, - "asr:librispeech25":{ - "ms":4059.6249999999995, - "audio_s":215.91506250000006 + "encode_ms":1332.9079999999999, + "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-Wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A US registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949 Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" } }, "workload":"asr", "source":"official", - "sha":"db50a7da2", + "sha":"7e02c2451", "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_gemv_gen=mr4 (manifest)", - "tune_sha":"bf42018efa628277924359a4e145892127c0b36b258a3bcb11996856eac641e9", - "exec_fmt":"q8", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", - "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", - "bytes":2508463079 + "name":"ggml-tiny.bin", + "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", + "bytes":77691713 }, { "role":"clip", @@ -8628,195 +15920,41 @@ "name":"hp0x2.wav", "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", "bytes":17490462 - }, - { - "role":"clip", - "name":"01_1089-134686-0000.wav", - "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", - "bytes":333998 - }, - { - "role":"clip", - "name":"02_1089-134686-0001.wav", - "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", - "bytes":104878 - }, - { - "role":"clip", - "name":"03_1089-134686-0002.wav", - "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", - "bytes":212078 - }, - { - "role":"clip", - "name":"04_1089-134686-0003.wav", - "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", - "bytes":85838 - }, - { - "role":"clip", - "name":"05_1089-134686-0004.wav", - "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", - "bytes":166960 - }, - { - "role":"clip", - "name":"06_1089-134686-0005.wav", - "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", - "bytes":308398 - }, - { - "role":"clip", - "name":"07_1089-134686-0006.wav", - "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", - "bytes":337838 - }, - { - "role":"clip", - "name":"08_1089-134686-0007.wav", - "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", - "bytes":136878 - }, - { - "role":"clip", - "name":"09_1089-134686-0008.wav", - "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", - "bytes":215438 - }, - { - "role":"clip", - "name":"10_1089-134686-0009.wav", - "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", - "bytes":338478 - }, - { - "role":"clip", - "name":"11_1089-134686-0010.wav", - "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", - "bytes":141038 - }, - { - "role":"clip", - "name":"12_1089-134686-0011.wav", - "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", - "bytes":398318 - }, - { - "role":"clip", - "name":"13_1089-134686-0012.wav", - "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", - "bytes":372558 - }, - { - "role":"clip", - "name":"14_1089-134686-0013.wav", - "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", - "bytes":253358 - }, - { - "role":"clip", - "name":"15_1089-134686-0014.wav", - "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", - "bytes":71278 - }, - { - "role":"clip", - "name":"16_1089-134686-0015.wav", - "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", - "bytes":186158 - }, - { - "role":"clip", - "name":"17_1089-134686-0016.wav", - "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", - "bytes":113358 - }, - { - "role":"clip", - "name":"18_1089-134686-0017.wav", - "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", - "bytes":283918 - }, - { - "role":"clip", - "name":"19_1089-134686-0018.wav", - "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", - "bytes":503118 - }, - { - "role":"clip", - "name":"20_1089-134686-0019.wav", - "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", - "bytes":444718 - }, - { - "role":"clip", - "name":"21_1089-134686-0020.wav", - "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", - "bytes":537358 - }, - { - "role":"clip", - "name":"22_1089-134686-0021.wav", - "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", - "bytes":209678 - }, - { - "role":"clip", - "name":"23_1089-134686-0022.wav", - "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", - "bytes":357678 - }, - { - "role":"clip", - "name":"24_1089-134686-0023.wav", - "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", - "bytes":424878 - }, - { - "role":"clip", - "name":"25_1089-134686-0024.wav", - "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", - "bytes":373038 } ] }, { - "engine":"parakeet-cli", + "engine":"whisper-cli", "backend":"cpu", "flavor":"stock", - "box":"m1", + "box":"zen4", "threads":8, - "date":"2026-08-03", - "cmd":"../whisper.cpp/build/bin/parakeet-cli -m ../whisper.cpp/models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -t 8 -ng modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "date":"2026-08-04", + "cmd":"/home/boris/whisper.cpp/build/bin/whisper-cli -m /home/boris/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1 -nf -ng", "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" }, "tests":{ "asr:jfk.wav":{ - "ms":243.89999999999998 + "ms":179.71000000000001 }, "asr:jfk3.wav":{ - "ms":706.23000000000002 + "ms":389.50999999999999 }, "asr:gb1.wav":{ - "ms":7278.8199999999997 + "ms":2017.8000000000002 }, "asr:hp0.wav":{ - "ms":12273.030000000001 + "ms":2659.2200000000003 }, "asr:hp0x2.wav":{ - "ms":44887.120000000003 - }, - "asr:librispeech25":{ - "ms":5154.3699999999999 + "ms":5751.6400000000003 } }, "workload":"asr", @@ -8826,9 +15964,9 @@ "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", - "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", - "bytes":668757119 + "name":"ggml-tiny-q8_0.bin", + "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", + "bytes":43537433 }, { "role":"clip", @@ -8859,167 +15997,159 @@ "name":"hp0x2.wav", "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", "bytes":17490462 - }, - { - "role":"clip", - "name":"01_1089-134686-0000.wav", - "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", - "bytes":333998 - }, - { - "role":"clip", - "name":"02_1089-134686-0001.wav", - "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", - "bytes":104878 - }, - { - "role":"clip", - "name":"03_1089-134686-0002.wav", - "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", - "bytes":212078 - }, - { - "role":"clip", - "name":"04_1089-134686-0003.wav", - "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", - "bytes":85838 - }, - { - "role":"clip", - "name":"05_1089-134686-0004.wav", - "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", - "bytes":166960 - }, - { - "role":"clip", - "name":"06_1089-134686-0005.wav", - "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", - "bytes":308398 - }, - { - "role":"clip", - "name":"07_1089-134686-0006.wav", - "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", - "bytes":337838 - }, - { - "role":"clip", - "name":"08_1089-134686-0007.wav", - "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", - "bytes":136878 - }, - { - "role":"clip", - "name":"09_1089-134686-0008.wav", - "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", - "bytes":215438 - }, - { - "role":"clip", - "name":"10_1089-134686-0009.wav", - "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", - "bytes":338478 - }, - { - "role":"clip", - "name":"11_1089-134686-0010.wav", - "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", - "bytes":141038 - }, - { - "role":"clip", - "name":"12_1089-134686-0011.wav", - "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", - "bytes":398318 - }, - { - "role":"clip", - "name":"13_1089-134686-0012.wav", - "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", - "bytes":372558 - }, - { - "role":"clip", - "name":"14_1089-134686-0013.wav", - "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", - "bytes":253358 - }, - { - "role":"clip", - "name":"15_1089-134686-0014.wav", - "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", - "bytes":71278 - }, + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"zen4", + "threads":8, + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":309.61399999999998, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ { "role":"clip", - "name":"16_1089-134686-0015.wav", - "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", - "bytes":186158 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + } + ] + } + ], + "arch":"Whisper tiny", + "size_bytes":77691713 + }, + { + "gguf":"ggml-large-v3-turbo.bin", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":2011.0429999999999, + "audio_s":11, + "encode_ms":1870.116, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - { - "role":"clip", - "name":"17_1089-134686-0016.wav", - "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", - "bytes":113358 + "asr:jfk3.wav":{ + "ms":4037.7579999999998, + "audio_s":33, + "encode_ms":3739.5790000000002, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - { - "role":"clip", - "name":"18_1089-134686-0017.wav", - "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", - "bytes":283918 + "asr:gb1.wav":{ + "ms":17076.377, + "audio_s":198.734375, + "encode_ms":15214.129999999999, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, - { - "role":"clip", - "name":"19_1089-134686-0018.wav", - "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", - "bytes":503118 + "asr:hp0.wav":{ + "ms":24711.436000000002, + "audio_s":273.28724999999997, + "encode_ms":22417.581999999999, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, - { - "role":"clip", - "name":"20_1089-134686-0019.wav", - "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", - "bytes":444718 + "asr:hp0x2.wav":{ + "ms":47526.917999999998, + "audio_s":546.57449999999994, + "encode_ms":43105.561999999998, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + } + }, + "workload":"asr", + "source":"official", + "sha":"b6450c2a5", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "noise":"ok", + "exec_fmt":"q8/q8", + "files":[ + { + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", - "name":"21_1089-134686-0020.wav", - "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", - "bytes":537358 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"22_1089-134686-0021.wav", - "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", - "bytes":209678 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"23_1089-134686-0022.wav", - "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", - "bytes":357678 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"24_1089-134686-0023.wav", - "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", - "bytes":424878 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"25_1089-134686-0024.wav", - "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", - "bytes":373038 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"onnx", + "engine":"whisper-cli", "backend":"cpu", "flavor":"stock", "box":"m1", "threads":8, - "date":"2026-08-03", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "date":"2026-08-17", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1 -nf -ng", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -9028,35 +16158,37 @@ "total_cores":10, "ram_gb":64, "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2" + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":458.50200000000001, - "audio_s":11 + "ms":2168.3899999999999 }, "asr:jfk3.wav":{ - "ms":909.63699999999994, - "audio_s":33 + "ms":4524.21 }, "asr:gb1.wav":{ - "ms":7057.2849999999999, - "audio_s":198.73400000000001 + "ms":23534.080000000002 }, "asr:hp0.wav":{ - "ms":11420.093999999999, - "audio_s":273.28699999999998 + "ms":35360.610000000001 }, - "asr:librispeech25":{ - "ms":9861.8950000000004, - "audio_s":215.91500000000005 + "asr:hp0x2.wav":{ + "ms":62224.209999999999 } }, "workload":"asr", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", "files":[ + { + "role":"weights", + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 + }, { "role":"clip", "name":"jfk.wav", @@ -9083,222 +16215,215 @@ }, { "role":"clip", - "name":"01_1089-134686-0000.wav", - "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", - "bytes":333998 - }, - { - "role":"clip", - "name":"02_1089-134686-0001.wav", - "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", - "bytes":104878 - }, - { - "role":"clip", - "name":"03_1089-134686-0002.wav", - "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", - "bytes":212078 - }, - { - "role":"clip", - "name":"04_1089-134686-0003.wav", - "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", - "bytes":85838 - }, - { - "role":"clip", - "name":"05_1089-134686-0004.wav", - "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", - "bytes":166960 - }, - { - "role":"clip", - "name":"06_1089-134686-0005.wav", - "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", - "bytes":308398 - }, - { - "role":"clip", - "name":"07_1089-134686-0006.wav", - "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", - "bytes":337838 - }, - { - "role":"clip", - "name":"08_1089-134686-0007.wav", - "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", - "bytes":136878 - }, - { - "role":"clip", - "name":"09_1089-134686-0008.wav", - "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", - "bytes":215438 - }, - { - "role":"clip", - "name":"10_1089-134686-0009.wav", - "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", - "bytes":338478 - }, - { - "role":"clip", - "name":"11_1089-134686-0010.wav", - "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", - "bytes":141038 - }, - { - "role":"clip", - "name":"12_1089-134686-0011.wav", - "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", - "bytes":398318 - }, - { - "role":"clip", - "name":"13_1089-134686-0012.wav", - "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", - "bytes":372558 - }, - { - "role":"clip", - "name":"14_1089-134686-0013.wav", - "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", - "bytes":253358 - }, - { - "role":"clip", - "name":"15_1089-134686-0014.wav", - "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", - "bytes":71278 - }, + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":2314.6849999999999, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ { "role":"clip", - "name":"16_1089-134686-0015.wav", - "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", - "bytes":186158 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1986.9839999999999, + "audio_s":11, + "encode_ms":1856.4169999999999, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - { - "role":"clip", - "name":"17_1089-134686-0016.wav", - "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", - "bytes":113358 + "asr:jfk3.wav":{ + "ms":4074.7510000000002, + "audio_s":33, + "encode_ms":3707.741, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - { - "role":"clip", - "name":"18_1089-134686-0017.wav", - "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", - "bytes":283918 + "asr:gb1.wav":{ + "ms":16819.155999999999, + "audio_s":198.734375, + "encode_ms":15091.91, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, - { - "role":"clip", - "name":"19_1089-134686-0018.wav", - "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", - "bytes":503118 + "asr:hp0.wav":{ + "ms":24600.642, + "audio_s":273.28724999999997, + "encode_ms":22278.062999999998, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, + "asr:hp0x2.wav":{ + "ms":47319.283000000003, + "audio_s":546.57449999999994, + "encode_ms":42837.938999999998, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + } + }, + "workload":"asr", + "source":"official", + "sha":"b6450c2a5", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "noise":"ok", + "exec_fmt":"q8/q8", + "files":[ { - "role":"clip", - "name":"20_1089-134686-0019.wav", - "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", - "bytes":444718 + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", - "name":"21_1089-134686-0020.wav", - "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", - "bytes":537358 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"22_1089-134686-0021.wav", - "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", - "bytes":209678 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"23_1089-134686-0022.wav", - "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", - "bytes":357678 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"24_1089-134686-0023.wav", - "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", - "bytes":424878 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"25_1089-134686-0024.wav", - "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", - "bytes":373038 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { "engine":"das", - "backend":"cpu", + "backend":"metal", "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 1", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":117.684, + "ms":436.60599999999999, "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":371.964, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":299.03500000000003, + "ms":924.55600000000004, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":744.09799999999996, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":2842.3330000000001, + "ms":4046.7890000000002, "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + "encode_ms":2980.3029999999999, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, "asr:hp0.wav":{ - "ms":4988.9350000000004, + "ms":5838.5460000000003, "audio_s":273.28724999999997, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + "encode_ms":4480.067, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, "asr:hp0x2.wav":{ - "ms":16547.940999999999, + "ms":11247.213, "audio_s":546.57449999999994, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." - }, - "asr:librispeech25":{ - "ms":2629.3359999999998, - "audio_s":215.91506250000006 + "encode_ms":8555.6970000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" } }, "workload":"asr", "source":"official", - "sha":"965e57877", + "sha":"572b5dd69", "version":"0.6.4", "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", "noise":"ok", - "exec_fmt":"q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "exec_fmt":"f32/q8", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", - "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", - "bytes":2508463079 + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", @@ -9329,167 +16454,96 @@ "name":"hp0x2.wav", "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"metal", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":465.70999999999998 }, - { - "role":"clip", - "name":"01_1089-134686-0000.wav", - "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", - "bytes":333998 - }, - { - "role":"clip", - "name":"02_1089-134686-0001.wav", - "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", - "bytes":104878 - }, - { - "role":"clip", - "name":"03_1089-134686-0002.wav", - "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", - "bytes":212078 - }, - { - "role":"clip", - "name":"04_1089-134686-0003.wav", - "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", - "bytes":85838 - }, - { - "role":"clip", - "name":"05_1089-134686-0004.wav", - "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", - "bytes":166960 - }, - { - "role":"clip", - "name":"06_1089-134686-0005.wav", - "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", - "bytes":308398 - }, - { - "role":"clip", - "name":"07_1089-134686-0006.wav", - "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", - "bytes":337838 - }, - { - "role":"clip", - "name":"08_1089-134686-0007.wav", - "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", - "bytes":136878 - }, - { - "role":"clip", - "name":"09_1089-134686-0008.wav", - "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", - "bytes":215438 - }, - { - "role":"clip", - "name":"10_1089-134686-0009.wav", - "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", - "bytes":338478 - }, - { - "role":"clip", - "name":"11_1089-134686-0010.wav", - "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", - "bytes":141038 - }, - { - "role":"clip", - "name":"12_1089-134686-0011.wav", - "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", - "bytes":398318 - }, - { - "role":"clip", - "name":"13_1089-134686-0012.wav", - "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", - "bytes":372558 - }, - { - "role":"clip", - "name":"14_1089-134686-0013.wav", - "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", - "bytes":253358 - }, - { - "role":"clip", - "name":"15_1089-134686-0014.wav", - "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", - "bytes":71278 - }, - { - "role":"clip", - "name":"16_1089-134686-0015.wav", - "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", - "bytes":186158 - }, - { - "role":"clip", - "name":"17_1089-134686-0016.wav", - "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", - "bytes":113358 + "asr:jfk3.wav":{ + "ms":967.90000000000009 }, - { - "role":"clip", - "name":"18_1089-134686-0017.wav", - "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", - "bytes":283918 + "asr:gb1.wav":{ + "ms":5542.9400000000005 }, - { - "role":"clip", - "name":"19_1089-134686-0018.wav", - "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", - "bytes":503118 + "asr:hp0.wav":{ + "ms":6578.6500000000005 }, + "asr:hp0x2.wav":{ + "ms":15219.25 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ { - "role":"clip", - "name":"20_1089-134686-0019.wav", - "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", - "bytes":444718 + "role":"weights", + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 }, { "role":"clip", - "name":"21_1089-134686-0020.wav", - "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", - "bytes":537358 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"22_1089-134686-0021.wav", - "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", - "bytes":209678 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"23_1089-134686-0022.wav", - "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", - "bytes":357678 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"24_1089-134686-0023.wav", - "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", - "bytes":424878 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"25_1089-134686-0024.wav", - "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", - "bytes":373038 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"parakeet-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", + "flavor":"tuned", "box":"m4", "threads":10, "date":"2026-08-18", - "cmd":"../whisper.cpp/build/bin/parakeet-cli -m /Users/dasbox/models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -t 10 -ng modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -9503,34 +16557,52 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":157.81 + "ms":1222.7619999999999, + "audio_s":11, + "encode_ms":1159.5820000000001, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":455.90000000000003 + "ms":2524.6930000000002, + "audio_s":33, + "encode_ms":2344, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":4527.1599999999999 + "ms":10828.123, + "audio_s":198.734375, + "encode_ms":10426.184999999999, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, "asr:hp0.wav":{ - "ms":7559.3800000000001 + "ms":17101.677, + "audio_s":273.28724999999997, + "encode_ms":15611.078, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, "asr:hp0x2.wav":{ - "ms":26655.540000000001 - }, - "asr:librispeech25":{ - "ms":3471.54 + "ms":32671.159, + "audio_s":546.57449999999994, + "encode_ms":29833.032999999999, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" } }, "workload":"asr", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", - "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", - "bytes":668757119 + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", @@ -9561,167 +16633,234 @@ "name":"hp0x2.wav", "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m /Users/dasbox/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -bs 1 -bo 1 -nf -ng", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1459.5700000000002 }, - { - "role":"clip", - "name":"01_1089-134686-0000.wav", - "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", - "bytes":333998 - }, - { - "role":"clip", - "name":"02_1089-134686-0001.wav", - "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", - "bytes":104878 - }, - { - "role":"clip", - "name":"03_1089-134686-0002.wav", - "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", - "bytes":212078 - }, - { - "role":"clip", - "name":"04_1089-134686-0003.wav", - "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", - "bytes":85838 - }, - { - "role":"clip", - "name":"05_1089-134686-0004.wav", - "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", - "bytes":166960 - }, - { - "role":"clip", - "name":"06_1089-134686-0005.wav", - "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", - "bytes":308398 - }, - { - "role":"clip", - "name":"07_1089-134686-0006.wav", - "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", - "bytes":337838 + "asr:jfk3.wav":{ + "ms":3089.8700000000003 }, - { - "role":"clip", - "name":"08_1089-134686-0007.wav", - "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", - "bytes":136878 + "asr:gb1.wav":{ + "ms":18348.880000000001 }, - { - "role":"clip", - "name":"09_1089-134686-0008.wav", - "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", - "bytes":215438 + "asr:hp0.wav":{ + "ms":22620.959999999999 }, + "asr:hp0x2.wav":{ + "ms":44298.449999999997 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ { - "role":"clip", - "name":"10_1089-134686-0009.wav", - "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", - "bytes":338478 + "role":"weights", + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 }, { "role":"clip", - "name":"11_1089-134686-0010.wav", - "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", - "bytes":141038 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"12_1089-134686-0011.wav", - "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", - "bytes":398318 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"13_1089-134686-0012.wav", - "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", - "bytes":372558 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"14_1089-134686-0013.wav", - "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", - "bytes":253358 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"15_1089-134686-0014.wav", - "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", - "bytes":71278 - }, + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1672.547, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ { "role":"clip", - "name":"16_1089-134686-0015.wav", - "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", - "bytes":186158 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1210.941, + "audio_s":11, + "encode_ms":1161.633, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - { - "role":"clip", - "name":"17_1089-134686-0016.wav", - "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", - "bytes":113358 + "asr:jfk3.wav":{ + "ms":2490.7730000000001, + "audio_s":33, + "encode_ms":2314.2310000000002, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - { - "role":"clip", - "name":"18_1089-134686-0017.wav", - "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", - "bytes":283918 + "asr:gb1.wav":{ + "ms":10571.959000000001, + "audio_s":198.734375, + "encode_ms":10325.154, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, - { - "role":"clip", - "name":"19_1089-134686-0018.wav", - "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", - "bytes":503118 + "asr:hp0.wav":{ + "ms":16928.131000000001, + "audio_s":273.28724999999997, + "encode_ms":15483.763000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, + "asr:hp0x2.wav":{ + "ms":32418.422999999999, + "audio_s":546.57449999999994, + "encode_ms":29621.988000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + } + }, + "workload":"asr", + "source":"official", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ { - "role":"clip", - "name":"20_1089-134686-0019.wav", - "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", - "bytes":444718 + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", - "name":"21_1089-134686-0020.wav", - "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", - "bytes":537358 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"22_1089-134686-0021.wav", - "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", - "bytes":209678 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"23_1089-134686-0022.wav", - "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", - "bytes":357678 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"24_1089-134686-0023.wav", - "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", - "bytes":424878 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"25_1089-134686-0024.wav", - "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", - "bytes":373038 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"onnx", - "backend":"cpu", - "flavor":"stock", + "engine":"das", + "backend":"metal", + "flavor":"tuned", "box":"m4", "threads":10, "date":"2026-08-18", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 1", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -9735,31 +16874,53 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":425.35599999999999, - "audio_s":11 + "ms":590.15300000000002, + "audio_s":11, + "encode_ms":528.23800000000006, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":703.70299999999997, - "audio_s":33 + "ms":1227.7550000000001, + "audio_s":33, + "encode_ms":1056.913, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":4804.0860000000002, - "audio_s":198.73400000000001 + "ms":5235.4650000000001, + "audio_s":198.734375, + "encode_ms":4226.7380000000003, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, "asr:hp0.wav":{ - "ms":8231.4860000000008, - "audio_s":273.28699999999998 + "ms":7546.1040000000003, + "audio_s":273.28724999999997, + "encode_ms":6344.4799999999996, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, - "asr:librispeech25":{ - "ms":9540.9770000000008, - "audio_s":215.91500000000005 + "asr:hp0x2.wav":{ + "ms":14542.629000000001, + "audio_s":546.57449999999994, + "encode_ms":12441.449000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" } }, "workload":"asr", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ + { + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 + }, { "role":"clip", "name":"jfk.wav", @@ -9786,222 +16947,358 @@ }, { "role":"clip", - "name":"01_1089-134686-0000.wav", - "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", - "bytes":333998 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"metal", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m /Users/dasbox/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -bs 1 -bo 1", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":517.59000000000003 }, - { - "role":"clip", - "name":"02_1089-134686-0001.wav", - "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", - "bytes":104878 + "asr:jfk3.wav":{ + "ms":1051.1800000000001 }, - { - "role":"clip", - "name":"03_1089-134686-0002.wav", - "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", - "bytes":212078 + "asr:gb1.wav":{ + "ms":5950.2799999999997 }, - { - "role":"clip", - "name":"04_1089-134686-0003.wav", - "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", - "bytes":85838 + "asr:hp0.wav":{ + "ms":7059.5999999999995 }, + "asr:hp0x2.wav":{ + "ms":16086.139999999999 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ { - "role":"clip", - "name":"05_1089-134686-0004.wav", - "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", - "bytes":166960 + "role":"weights", + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 }, { "role":"clip", - "name":"06_1089-134686-0005.wav", - "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", - "bytes":308398 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"07_1089-134686-0006.wav", - "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", - "bytes":337838 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"08_1089-134686-0007.wav", - "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", - "bytes":136878 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"09_1089-134686-0008.wav", - "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", - "bytes":215438 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"10_1089-134686-0009.wav", - "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", - "bytes":338478 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1800.991, + "audio_s":11, + "encode_ms":1739.1610000000001, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - { - "role":"clip", - "name":"11_1089-134686-0010.wav", - "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", - "bytes":141038 + "asr:jfk3.wav":{ + "ms":3776.6260000000002, + "audio_s":33, + "encode_ms":3583.2869999999998, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - { - "role":"clip", - "name":"12_1089-134686-0011.wav", - "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", - "bytes":398318 + "asr:gb1.wav":{ + "ms":16202.16, + "audio_s":198.734375, + "encode_ms":14732.120000000001, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, - { - "role":"clip", - "name":"13_1089-134686-0012.wav", - "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", - "bytes":372558 + "asr:hp0.wav":{ + "ms":23945.755000000001, + "audio_s":273.28724999999997, + "encode_ms":22221.735000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, + "asr:hp0x2.wav":{ + "ms":46396.821000000004, + "audio_s":546.57449999999994, + "encode_ms":42966.232000000004, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ { - "role":"clip", - "name":"14_1089-134686-0013.wav", - "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", - "bytes":253358 + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", - "name":"15_1089-134686-0014.wav", - "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", - "bytes":71278 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"16_1089-134686-0015.wav", - "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", - "bytes":186158 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"17_1089-134686-0016.wav", - "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", - "bytes":113358 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"18_1089-134686-0017.wav", - "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", - "bytes":283918 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"19_1089-134686-0018.wav", - "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", - "bytes":503118 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1786.702, + "audio_s":11, + "encode_ms":1719.971, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":3747.1410000000001, + "audio_s":33, + "encode_ms":3562.0059999999999, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":16040.489, + "audio_s":198.734375, + "encode_ms":14674.227000000001, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, + "asr:hp0.wav":{ + "ms":23787.959999999999, + "audio_s":273.28724999999997, + "encode_ms":22094.458999999999, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + }, + "asr:hp0x2.wav":{ + "ms":46194.288999999997, + "audio_s":546.57449999999994, + "encode_ms":42629.678, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + } + }, + "workload":"asr", + "source":"official", + "sha":"82e45e0a3", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", + "files":[ { - "role":"clip", - "name":"20_1089-134686-0019.wav", - "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", - "bytes":444718 + "role":"weights", + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", - "name":"21_1089-134686-0020.wav", - "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", - "bytes":537358 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"22_1089-134686-0021.wav", - "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", - "bytes":209678 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"23_1089-134686-0022.wav", - "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", - "bytes":357678 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"24_1089-134686-0023.wav", - "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", - "bytes":424878 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"25_1089-134686-0024.wav", - "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", - "bytes":373038 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { "engine":"das", - "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":118.04000000000001, + "ms":139.619, "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":100.297, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":298.24299999999999, + "ms":312.37, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":199.87100000000001, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":2808.3620000000001, + "ms":1469.9100000000001, "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + "encode_ms":799.71400000000006, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, "asr:hp0.wav":{ - "ms":4926.1700000000001, + "ms":1994.0809999999999, "audio_s":273.28724999999997, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + "encode_ms":1210.9110000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, "asr:hp0x2.wav":{ - "ms":16042.200999999999, + "ms":3856.6889999999999, "audio_s":546.57449999999994, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty it was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copy left slash FDL dot HTML." - }, - "asr:librispeech25":{ - "ms":2625.9430000000002, - "audio_s":215.91506250000006 + "encode_ms":2302.0590000000002, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward, to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" } }, "workload":"asr", "source":"official", - "sha":"965e57877", + "sha":"82e45e0a3", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", - "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", - "bytes":2508463079 + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", @@ -10032,156 +17329,202 @@ "name":"hp0x2.wav", "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -bs 1 -bo 1 -nf -ng", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":2099.0099999999998 }, - { - "role":"clip", - "name":"01_1089-134686-0000.wav", - "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", - "bytes":333998 - }, - { - "role":"clip", - "name":"02_1089-134686-0001.wav", - "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", - "bytes":104878 - }, - { - "role":"clip", - "name":"03_1089-134686-0002.wav", - "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", - "bytes":212078 - }, - { - "role":"clip", - "name":"04_1089-134686-0003.wav", - "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", - "bytes":85838 - }, - { - "role":"clip", - "name":"05_1089-134686-0004.wav", - "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", - "bytes":166960 - }, - { - "role":"clip", - "name":"06_1089-134686-0005.wav", - "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", - "bytes":308398 - }, - { - "role":"clip", - "name":"07_1089-134686-0006.wav", - "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", - "bytes":337838 + "asr:jfk3.wav":{ + "ms":4347.2600000000002 }, - { - "role":"clip", - "name":"08_1089-134686-0007.wav", - "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", - "bytes":136878 + "asr:gb1.wav":{ + "ms":22231.329999999998 }, - { - "role":"clip", - "name":"09_1089-134686-0008.wav", - "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", - "bytes":215438 + "asr:hp0.wav":{ + "ms":28286.689999999999 }, + "asr:hp0x2.wav":{ + "ms":61249.5 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ { - "role":"clip", - "name":"10_1089-134686-0009.wav", - "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", - "bytes":338478 + "role":"weights", + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 }, { "role":"clip", - "name":"11_1089-134686-0010.wav", - "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", - "bytes":141038 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"12_1089-134686-0011.wav", - "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", - "bytes":398318 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"13_1089-134686-0012.wav", - "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", - "bytes":372558 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"14_1089-134686-0013.wav", - "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", - "bytes":253358 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"15_1089-134686-0014.wav", - "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", - "bytes":71278 + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"whisper-cli", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 6 -bs 1 -bo 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":153.00000000000003 }, - { - "role":"clip", - "name":"16_1089-134686-0015.wav", - "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", - "bytes":186158 + "asr:jfk3.wav":{ + "ms":324.18000000000001 }, - { - "role":"clip", - "name":"17_1089-134686-0016.wav", - "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", - "bytes":113358 + "asr:gb1.wav":{ + "ms":1852.29 }, - { - "role":"clip", - "name":"18_1089-134686-0017.wav", - "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", - "bytes":283918 + "asr:hp0.wav":{ + "ms":2699.04 }, + "asr:hp0x2.wav":{ + "ms":5178.1599999999999 + } + }, + "workload":"asr", + "source":"official", + "versions":"whisper.cpp @ 6fc7c33b4", + "exec_fmt":"q8_0", + "files":[ { - "role":"clip", - "name":"19_1089-134686-0018.wav", - "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", - "bytes":503118 + "role":"weights", + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 }, { "role":"clip", - "name":"20_1089-134686-0019.wav", - "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", - "bytes":444718 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 }, { "role":"clip", - "name":"21_1089-134686-0020.wav", - "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", - "bytes":537358 + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 }, { "role":"clip", - "name":"22_1089-134686-0021.wav", - "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", - "bytes":209678 + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 }, { "role":"clip", - "name":"23_1089-134686-0022.wav", - "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", - "bytes":357678 + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, { "role":"clip", - "name":"24_1089-134686-0023.wav", - "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", - "bytes":424878 - }, + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 + } + ] + }, + { + "engine":"onnx", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1864.722, + "audio_s":11 + } + }, + "workload":"asr", + "source":"official", + "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "exec_fmt":"int8", + "files":[ { "role":"clip", - "name":"25_1089-134686-0024.wav", - "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", - "bytes":373038 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 } ] }, @@ -10192,7 +17535,7 @@ "box":"zen2", "threads":16, "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", "hardware":{ "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", "arch":"AMD64", @@ -10207,29 +17550,34 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":323.60300000000001, + "ms":2818.8389999999999, "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":2642.922, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":856.61900000000003, + "ms":5672.317, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":5113.393, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":6682.1689999999999, + "ms":23827.450000000001, "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and make out may God continue to bless America." + "encode_ms":20603.682000000001, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, "asr:hp0.wav":{ - "ms":10495.947, + "ms":35059.360000000001, "audio_s":273.28724999999997, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + "encode_ms":30994.123, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips eighteen ninety to nineteen fifty eight a u s businessman from portland oregon has the honor of having the phillips head screw and screw driver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html" }, "asr:hp0x2.wav":{ - "ms":31685.063999999998, + "ms":67337.782000000007, "audio_s":546.57449999999994, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dotnu dot org slash copy left slash FDL dot HTML." + "encode_ms":59630.137999999999, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips eighteen ninety to nineteen fifty eight a u s businessman from portland oregon has the honor of having the phillips head screw and screw driver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" } }, "workload":"asr", @@ -10238,14 +17586,14 @@ "version":"0.6.4", "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"q8", + "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", - "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", - "bytes":2508463079 + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", @@ -10280,13 +17628,13 @@ ] }, { - "engine":"parakeet-cli", + "engine":"whisper-cli", "backend":"cpu", "flavor":"stock", "box":"zen2", "threads":16, "date":"2026-08-04", - "cmd":"D:\\Work\\whisper.cpp\\build\\bin\\Release\\parakeet-cli.exe -m D:\\Work\\whisper.cpp\\models\\ggml-parakeet-tdt-0.6b-v3-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 16 -ng", + "cmd":"D:\\Work\\whisper.cpp\\build\\bin\\Release\\whisper-cli.exe -m D:\\Work\\whisper.cpp\\models\\ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 16 -bs 1 -bo 1 -nf -ng", "hardware":{ "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", "arch":"AMD64", @@ -10301,19 +17649,19 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":422.76999999999998 + "ms":4136.4200000000001 }, "asr:jfk3.wav":{ - "ms":1402.47 + "ms":8442.2800000000007 }, "asr:gb1.wav":{ - "ms":13892.73 + "ms":43546.010000000002 }, "asr:hp0.wav":{ - "ms":23051.68 + "ms":62255.449999999997 }, "asr:hp0x2.wav":{ - "ms":76742.110000000001 + "ms":136323.72999999998 } }, "workload":"asr", @@ -10323,9 +17671,9 @@ "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", - "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", - "bytes":668757119 + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 }, { "role":"clip", @@ -10366,7 +17714,7 @@ "box":"zen2", "threads":16, "date":"2026-07-29", - "cmd":"modules\\dasLLAMA\\benchmarks\\asr\\.venv-onnx\\Scripts\\python.exe modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 16 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/01_1089-134686-0000.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/02_1089-134686-0001.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/03_1089-134686-0002.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/04_1089-134686-0003.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/05_1089-134686-0004.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/06_1089-134686-0005.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/07_1089-134686-0006.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/08_1089-134686-0007.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/09_1089-134686-0008.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/10_1089-134686-0009.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/11_1089-134686-0010.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/12_1089-134686-0011.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/13_1089-134686-0012.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/14_1089-134686-0013.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/15_1089-134686-0014.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/16_1089-134686-0015.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/17_1089-134686-0016.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/18_1089-134686-0017.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/19_1089-134686-0018.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/20_1089-134686-0019.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/21_1089-134686-0020.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/22_1089-134686-0021.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/23_1089-134686-0022.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/24_1089-134686-0023.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/librispeech/25_1089-134686-0024.wav", + "cmd":"modules\\dasLLAMA\\benchmarks\\asr\\.venv-onnx\\Scripts\\python.exe modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --threads 16 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", "hardware":{ "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", "arch":"AMD64", @@ -10380,24 +17728,8 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":483.52199999999999, + "ms":3272.922, "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":1585.971, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":14779.536, - "audio_s":198.73400000000001 - }, - "asr:hp0.wav":{ - "ms":24405.284, - "audio_s":273.28699999999998 - }, - "asr:librispeech25":{ - "ms":9790.0899999999983, - "audio_s":215.91500000000005 } }, "workload":"asr", @@ -10409,174 +17741,6 @@ "name":"jfk.wav", "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"01_1089-134686-0000.wav", - "sha256":"8b6780c5a57ce806f959df2d4af9b0cc5ecf326653e774307e0cdafc17020131", - "bytes":333998 - }, - { - "role":"clip", - "name":"02_1089-134686-0001.wav", - "sha256":"beb48de8d3215702545c435a253ce3e9bb2543bf5953d9af6b2124a518abb19f", - "bytes":104878 - }, - { - "role":"clip", - "name":"03_1089-134686-0002.wav", - "sha256":"728272a8282fda5bdc35041438c535aa0e1c9828bd7421b1b52f7ee8501326db", - "bytes":212078 - }, - { - "role":"clip", - "name":"04_1089-134686-0003.wav", - "sha256":"1e0c7e05fe2dcdaab84a62dbd55b77ecea49b6d61e67976d81b777774142cf00", - "bytes":85838 - }, - { - "role":"clip", - "name":"05_1089-134686-0004.wav", - "sha256":"7b7e08e556074f56dfb60afdad5e4c1325cb796d42d7303a562f581c43790e60", - "bytes":166960 - }, - { - "role":"clip", - "name":"06_1089-134686-0005.wav", - "sha256":"bee1410747626920beea646c3e3d28f6e79bf237db298297266db829bfd94ce0", - "bytes":308398 - }, - { - "role":"clip", - "name":"07_1089-134686-0006.wav", - "sha256":"050f134bc6881aad69043f786f8ff8ffdd2f644f11bc6eae21fc073629456a34", - "bytes":337838 - }, - { - "role":"clip", - "name":"08_1089-134686-0007.wav", - "sha256":"4faafa6e3cfd555a723dd32dc36e59a470efe5d213f4eb1ae101d02b762357b7", - "bytes":136878 - }, - { - "role":"clip", - "name":"09_1089-134686-0008.wav", - "sha256":"a453827a6a96d516da3c439a21a25fef88a921e15833a15a00dd78c0fc89e7ec", - "bytes":215438 - }, - { - "role":"clip", - "name":"10_1089-134686-0009.wav", - "sha256":"e719ca339735283c807291ee8dc58c1e237d0fcd27047646edcfe39098c46df9", - "bytes":338478 - }, - { - "role":"clip", - "name":"11_1089-134686-0010.wav", - "sha256":"fc3cf644b9ab5cb29002f75ef57bf5b54432a9709663335d0380a3e4dd743201", - "bytes":141038 - }, - { - "role":"clip", - "name":"12_1089-134686-0011.wav", - "sha256":"e6327e6ca63b88361d25be53cbfd80e0221e9207b23ff925175df64719c39c7a", - "bytes":398318 - }, - { - "role":"clip", - "name":"13_1089-134686-0012.wav", - "sha256":"0ea79e7eb288ba997a2976cfa3a6004c8cc733f81a0fc668dc8183719e9a1ea2", - "bytes":372558 - }, - { - "role":"clip", - "name":"14_1089-134686-0013.wav", - "sha256":"0ccfed467edce983d47d99fc85a30e688f5ea16baf8942390ef44d342ec77b4e", - "bytes":253358 - }, - { - "role":"clip", - "name":"15_1089-134686-0014.wav", - "sha256":"4d014f1b31177b0c2672bc6de972c59dca2ac7ca5cbc3c15d7b02d9cb581a326", - "bytes":71278 - }, - { - "role":"clip", - "name":"16_1089-134686-0015.wav", - "sha256":"0b4ca0a62c95ce681c25f15d5f8c0fccaeae51a0eb45ba842441563e967e6a80", - "bytes":186158 - }, - { - "role":"clip", - "name":"17_1089-134686-0016.wav", - "sha256":"e2b05cc66b4790c04acd29a917f580c16996e4a448c4a308950556589990fca7", - "bytes":113358 - }, - { - "role":"clip", - "name":"18_1089-134686-0017.wav", - "sha256":"2537c2436aff852d0894a1ce4ac0c69aebe79164edf4ac4441c3cd754eeff0f0", - "bytes":283918 - }, - { - "role":"clip", - "name":"19_1089-134686-0018.wav", - "sha256":"04f59e5e7f11cb85e53eadbe48d148cdaaedbb671fb82d9509436b5ef3cd7c37", - "bytes":503118 - }, - { - "role":"clip", - "name":"20_1089-134686-0019.wav", - "sha256":"937657fd79fb7f36d987da7a9edcdd06cd2b06f33e9677e83fb4433b9de9c50b", - "bytes":444718 - }, - { - "role":"clip", - "name":"21_1089-134686-0020.wav", - "sha256":"556430efcb9c3d1f7b8a654ae9569a5513a3416745b6eebe44bebbf4827f16b4", - "bytes":537358 - }, - { - "role":"clip", - "name":"22_1089-134686-0021.wav", - "sha256":"79da6d406d31b3cead5eaf1a43e90cb2f63a59b592ed19dc337e7c824bdd91a2", - "bytes":209678 - }, - { - "role":"clip", - "name":"23_1089-134686-0022.wav", - "sha256":"e30eebff7f649764c417cd20e1acfa051e776deaf9b756250cff84b0dfe32241", - "bytes":357678 - }, - { - "role":"clip", - "name":"24_1089-134686-0023.wav", - "sha256":"c9aeaea8227f91ed5f64a6361278938aa88d167cda8abf864e5af396e3aa64a3", - "bytes":424878 - }, - { - "role":"clip", - "name":"25_1089-134686-0024.wav", - "sha256":"13548d66136b15506bae6d079cbcf7191235c8cbecd9e22332142bff446acafa", - "bytes":373038 } ] }, @@ -10587,7 +17751,7 @@ "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-parakeet-tdt-0.6b-v3-f32.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -10599,29 +17763,34 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":186.65899999999999, + "ms":2082.1280000000002, "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":1913.4590000000001, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":491.98200000000003, + "ms":4303.0370000000003, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":3818.3629999999998, + "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":5781.0529999999999, + "ms":18019.529999999999, "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and make out may God continue to bless America." + "encode_ms":15173.722, + "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." }, "asr:hp0.wav":{ - "ms":10502.608, + "ms":26161.437000000002, "audio_s":273.28724999999997, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN.Wikipedia.org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight, a US businessman from Portland, Oregon, has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three, US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pause drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PauseDrive SupaDrive Torx Hex Allen Robertson Triwing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five oh one C three Tax Deductible Nonprofit Charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot gnu dot org slash copyleft slash fdl dot html." + "encode_ms":22804.490000000002, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" }, "asr:hp0x2.wav":{ - "ms":37697.311999999998, + "ms":50451.252, "audio_s":546.57449999999994, - "text":"Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot Wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead PausaDrive SuperDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All Text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML Henry F Phillips from Wikipedia the Free Encyclopedia at EN dot wikipedia dot org Henry F Phillips from Wikipedia the Free Encyclopedia Henry F Phillips eighteen ninety to nineteen fifty eight a US businessman from Portland, Oregon has the honor of having the Phillips Head Screw and Screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in nineteen thirty six, US patent number two million forty six thousand three hundred forty three US patents two million forty six thousand eight hundred thirty seven to two million forty six thousand eight hundred forty. It was so widely copied that by nineteen forty nine Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the pausa drive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article caption Phillips Screw Head. The following is an info box which accompanies this article Info Box Part of the Series on Screw Drive Types Slotted Commonly Erroneously Flathead Phillips Crosshead Pausa Drive SupaDrive Torx Hex Allen Robertson Tri Wing Torqueset Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many Images accompanied this info box This page was last modified on the ninth of April two thousand eight at seventeen oh four All text is available under the terms of the GNU Free Documentation License See Copyrights for details Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated a US registered five hundred one C three tax deductible nonprofit charity This sound file and all text in the article are licensed under the GNU Free Documentation License available at WWW dot GNU dot org slash copyleft slash FDL dot HTML." + "encode_ms":43815.328000000001, + "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" } }, "workload":"asr", @@ -10630,14 +17799,14 @@ "version":"0.6.4", "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"q8", + "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-f32.bin", - "sha256":"b17956ca991a7f084c978a8a9d4c9785864260b6dd9b72f884344759d913ae7f", - "bytes":2508463079 + "name":"ggml-large-v3-turbo.bin", + "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", + "bytes":1624555275 }, { "role":"clip", @@ -10672,13 +17841,13 @@ ] }, { - "engine":"parakeet-cli", + "engine":"whisper-cli", "backend":"cpu", "flavor":"stock", "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"/home/boris/whisper.cpp/build/bin/parakeet-cli -m /home/boris/models/ggml-parakeet-tdt-0.6b-v3-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -ng", + "cmd":"/home/boris/whisper.cpp/build/bin/whisper-cli -m /home/boris/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1 -nf -ng", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -10690,19 +17859,19 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":490.84000000000003 + "ms":6091.8299999999999 }, "asr:jfk3.wav":{ - "ms":1621.8900000000001 + "ms":12359.26 }, "asr:gb1.wav":{ - "ms":16583.459999999999 + "ms":63593.879999999997 }, "asr:hp0.wav":{ - "ms":27048.41 + "ms":91003.410000000003 }, "asr:hp0x2.wav":{ - "ms":90034.360000000001 + "ms":225174.07000000001 } }, "workload":"asr", @@ -10712,9 +17881,9 @@ "files":[ { "role":"weights", - "name":"ggml-parakeet-tdt-0.6b-v3-q8_0.bin", - "sha256":"4d64e9e96c2792186d072fde0034df0ad670cf680a2f53069052ead827fd600e", - "bytes":668757119 + "name":"ggml-large-v3-turbo-q8_0.bin", + "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", + "bytes":874188075 }, { "role":"clip", @@ -10755,7 +17924,7 @@ "box":"zen4", "threads":8, "date":"2026-08-04", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", "hardware":{ "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", "arch":"x86_64", @@ -10767,20 +17936,8 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":388.84800000000001, + "ms":2482.5210000000002, "audio_s":11 - }, - "asr:jfk3.wav":{ - "ms":1123.9290000000001, - "audio_s":33 - }, - "asr:gb1.wav":{ - "ms":11239.645, - "audio_s":198.73400000000001 - }, - "asr:hp0.wav":{ - "ms":18175.059000000001, - "audio_s":273.28699999999998 } }, "workload":"asr", @@ -10793,33 +17950,15 @@ "name":"jfk.wav", "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 } ] } ], - "arch":"Parakeet-TDT v3", - "size_bytes":2508463079 + "arch":"Whisper large-v3-turbo", + "size_bytes":1624555275 }, { - "gguf":"ggml-tiny.bin", + "gguf":"gemma-4-E2B-it-Q8_0.gguf", "runs":[ { "engine":"das", @@ -10827,8 +17966,8 @@ "flavor":"tuned", "box":"m1", "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "date":"2026-08-19", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -10842,51 +17981,51 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":86.340000000000003, + "ms":1582.3910000000001, "audio_s":11, - "encode_ms":54.674999999999997, - "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "encode_ms":336.40899999999999, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":197.25800000000001, + "ms":4290.4769999999999, "audio_s":33, - "encode_ms":109.279, - "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "encode_ms":1134.1030000000001, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" }, "asr:gb1.wav":{ - "ms":1011.276, + "ms":30730.791000000001, "audio_s":198.734375, - "encode_ms":434.935, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + "encode_ms":5777.875, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Husband and Captain Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's will, idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." }, "asr:hp0.wav":{ - "ms":1260.029, + "ms":42024.910000000003, "audio_s":273.28724999999997, - "encode_ms":603.93399999999997, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." - }, - "asr:hp0x2.wav":{ - "ms":2516.8180000000002, - "audio_s":546.57449999999994, - "encode_ms":1214.7670000000001, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + "encode_ms":8003.4780000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American tool company. The Phillips uses port bonds of US to devise American screw. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American tool company. The Phillips uses port bonds of US to devise American screw. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "sha":"bda14853a", + "sha":"1f9c36c8c", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "dasllama_version":5, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"b13fa031bf352e2dbaa6cd45bed2f671c19778e4ad99037958e399f0895115a3", "noise":"ok", "exec_fmt":"q8/q8", "files":[ { "role":"weights", - "name":"ggml-tiny.bin", - "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", - "bytes":77691713 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -10911,23 +18050,137 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 + } + ] + }, + { + "engine":"llama-mtmd-cli", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-19", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":10856.700000000001, + "encode_ms":10250, + "text":"0.00.002.693 I common_init_result: fitting params to device memory ... 0.00.002.698 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.394.588 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.717.140 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.720.088 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.727.508 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.03.555.923 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.03.601.627 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.03.871.589 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.03.871.647 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.03.871.857 W WARN: This is an experimental CLI for testing multimodal capability. 0.03.871.861 W For normal use cases, please use the standard llama-cli 0.03.911.963 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 3) 0.13.320.562 I mtmd batch encoding done in 9408 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" + }, + "asr:jfk3.wav":{ + "ms":32567.700000000001, + "encode_ms":30752.799999999999, + "text":"0.00.002.705 I common_init_result: fitting params to device memory ... 0.00.002.711 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.386.614 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.709.151 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.712.157 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.719.632 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.03.552.780 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.03.598.616 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.03.867.936 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.03.868.007 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.03.868.236 W WARN: This is an experimental CLI for testing multimodal capability. 0.03.868.238 W For normal use cases, please use the standard llama-cli 0.03.917.351 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.29.551.257 I mtmd batch encoding done in 25634 ms 0.31.591.355 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.34.195.849 I mtmd batch encoding done in 2604 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" + }, + "asr:gb1.wav":{ + "ms":199122.89999999999, + "encode_ms":186566.5, + "text":"0.00.002.711 I common_init_result: fitting params to device memory ... 0.00.002.719 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.392.436 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.722.790 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.725.808 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.733.411 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.03.566.951 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.03.613.063 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.03.883.901 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.03.883.969 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.03.884.208 W WARN: This is an experimental CLI for testing multimodal capability. 0.03.884.209 W For normal use cases, please use the standard llama-cli 0.04.009.695 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 9) 0.29.640.810 I mtmd batch encoding done in 25631 ms 0.31.753.252 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 9) 0.57.359.370 I mtmd batch encoding done in 25606 ms 0.59.593.505 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 9) 1.25.190.660 I mtmd batch encoding done in 25597 ms 1.27.622.943 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 9) 1.53.167.372 I mtmd batch encoding done in 25545 ms 1.55.682.842 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 9) 2.21.252.229 I mtmd batch encoding done in 25570 ms 2.23.966.896 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 9) 2.49.589.272 I mtmd batch encoding done in 25623 ms 2.52.458.579 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 9) 3.08.436.803 I mtmd batch encoding done in 15978 ms My fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As far as we can see, there is comfort and hope in the words of the prophet Isaiah. Lift your eyes and look to the heavens, who created space. He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the Shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America.DASLLAMA_IDS: 4754 12339 14522 236764 672 1719 815 6111 21832 4668 532 1822 55882 531 1023 2891 236761 2640 236743 236819 236787 236771 236771 672 5597 236764 9017 2256 528 21912 5745 3662 607 1023 2557 51320 18693 236761 562 2822 990 3209 236764 37061 691 3472 14773 699 506 55748 2787 9539 236761 669 18693 563 5745 236761 2085 659 951 43732 236761 2154 3905 691 496 13919 529 6819 236787 44221 26839 89702 236764 41523 44221 8972 19864 236764 43224 94816 18093 236764 22359 6822 9833 236764 43224 8966 16376 1209 236764 3587 236761 751 19321 1789 34525 2149 236764 532 98134 121873 236764 496 105721 528 506 33722 5661 15150 236761 3143 1758 532 3607 12718 1822 4652 528 506 2509 531 784 27069 528 614 3911 1056 2557 10224 815 2229 531 4483 4180 15668 236761 1030 563 3735 531 29346 506 39793 529 4301 684 35305 532 506 18502 529 67112 506 48621 11661 529 506 10824 236761 3143 101195 7261 506 39793 532 901 17175 1091 95826 236764 14111 901 1053 496 1494 532 29417 5708 528 1972 236761 8468 529 910 23648 532 63485 532 184291 236764 692 795 4305 1091 784 506 919 236761 2343 14522 3124 659 6972 618 1388 529 506 7965 529 1239 1758 532 3607 1015 735 1010 2238 672 11059 10932 532 32717 236761 1599 236789 500 711 7057 236761 5137 4251 7097 66031 2061 607 611 236761 1452 1724 611 9312 795 2462 735 506 2833 532 36637 529 672 2891 236761 669 4400 528 837 901 8390 795 4102 236761 192411 563 5378 1131 506 29151 6998 1023 1902 684 506 18014 529 17324 532 506 86508 531 3050 236761 5137 9338 1131 2557 795 817 580 236761 799 506 55748 3124 236764 692 5004 21404 532 40578 236761 1773 2793 618 692 740 1460 236764 993 563 5931 532 4614 528 506 4171 529 506 59918 81034 236761 79493 822 6114 532 1385 531 506 80958 236764 1015 4464 2557 236761 1293 1015 12076 855 506 129196 20472 886 684 886 532 9139 1091 1546 684 1463 236761 8468 529 914 1822 2066 532 45478 6332 236764 711 886 529 1091 563 9724 236761 669 1638 33797 1015 5618 506 8197 992 10077 506 5618 529 506 6819 39690 692 92377 3124 236761 669 13919 529 506 114357 18693 1602 711 994 21236 531 10824 236761 16961 692 740 14098 600 784 659 21236 2033 236761 3353 3803 14321 506 112792 7965 532 1149 3803 1149 3803 4102 531 14321 5711 236761 106" + } + }, + "workload":"audio-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", + "exec_fmt":"bf16/q8_0", + "files":[ + { + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-20", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":1947.8267083121839, + "stddev":5.2698860168457031 + }, + "tg128":{ + "tok_s":96.186670660259409, + "stddev":0.65781205892562866 + } + }, + "source":"official", + "sha":"cd10a67a4", + "version":"0.6.4", + "dasllama_version":5, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "files":[ + { + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, { - "engine":"whisper-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", + "flavor":"tuned", "box":"m1", "threads":8, - "date":"2026-08-17", - "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1 -nf -ng", + "date":"2026-08-20", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -10940,73 +18193,41 @@ "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":107.77 - }, - "asr:jfk3.wav":{ - "ms":257.95000000000005 - }, - "asr:gb1.wav":{ - "ms":1472.9399999999998 - }, - "asr:hp0.wav":{ - "ms":1957.8500000000001 + "pp512":{ + "tok_s":427.33937716903711, + "stddev":4.3431744575500488 }, - "asr:hp0x2.wav":{ - "ms":4017.4000000000001 + "tg128":{ + "tok_s":43.600298532821839, + "stddev":0.054628435522317886 } }, - "workload":"asr", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"cd10a67a4", + "version":"0.6.4", + "dasllama_version":5, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", "files":[ { "role":"weights", - "name":"ggml-tiny-q8_0.bin", - "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", - "bytes":43537433 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, { - "engine":"onnx", + "engine":"das", "backend":"cpu", - "flavor":"stock", + "flavor":"accel", "box":"m1", "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "date":"2026-08-20", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -11019,21 +18240,30 @@ "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":416.28300000000002, - "audio_s":11 + "pp512":{ + "tok_s":449.92644083960158, + "stddev":3.9499580860137939 + }, + "tg128":{ + "tok_s":43.560661170705991, + "stddev":0.09648982435464859 } }, - "workload":"asr", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "sha":"cd10a67a4", + "version":"0.6.4", + "dasllama_version":5, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", "files":[ { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, @@ -11043,8 +18273,8 @@ "flavor":"accel", "box":"m1", "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "date":"2026-08-19", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -11058,51 +18288,51 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":86.403000000000006, + "ms":1564.2629999999999, "audio_s":11, - "encode_ms":54.835000000000001, - "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "encode_ms":325.48200000000003, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":197.21000000000001, + "ms":4241.6620000000003, "audio_s":33, - "encode_ms":109.056, - "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "encode_ms":966.19399999999996, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" }, "asr:gb1.wav":{ - "ms":1002.949, + "ms":29630.029999999999, "audio_s":198.734375, - "encode_ms":439.82499999999999, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + "encode_ms":6265.634, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Husband and Captain Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's will, idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." }, "asr:hp0.wav":{ - "ms":1246.6610000000001, + "ms":38693.896000000001, "audio_s":273.28724999999997, - "encode_ms":596.89700000000005, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." - }, - "asr:hp0x2.wav":{ - "ms":2509.9670000000001, - "audio_s":546.57449999999994, - "encode_ms":1195.905, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + "encode_ms":7994.6610000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to Milise F. Phillips Century property, 340 feet on automated production lines, 2 million powered screw drives. Henry F. Phillips, 1890-1958 was an US businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia. Although he received patents for the design. The American screw company. The Phillips uses port bonds of US to devise an American screw. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "sha":"8a2281a7f", + "sha":"1f9c36c8c", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "dasllama_version":5, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"b13fa031bf352e2dbaa6cd45bed2f671c19778e4ad99037958e399f0895115a3", "noise":"ok", "exec_fmt":"q8/q8", "files":[ { "role":"weights", - "name":"ggml-tiny.bin", - "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", - "bytes":77691713 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -11127,23 +18357,99 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-20", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":1747.974324, + "stddev":3.6447440000000002 }, + "tg128":{ + "tok_s":85.985833999999997, + "stddev":0.70113499999999995 + } + }, + "source":"official", + "sha":"ebd048f", + "exec_fmt":"native gguf formats", + "files":[ { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, { - "engine":"das", - "backend":"metal", - "flavor":"tuned", + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m1", + "threads":8, + "date":"2026-08-20", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":242.20238800000001, + "stddev":2.2900200000000002 + }, + "tg128":{ + "tok_s":39.158079000000001, + "stddev":0.313556 + } + }, + "source":"official", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", "box":"m1", "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 1", + "date":"2026-08-20", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -11156,93 +18462,35 @@ "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":58.539999999999999, - "audio_s":11, - "encode_ms":37.493000000000002, - "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":148.56299999999999, - "audio_s":33, - "encode_ms":61.232999999999997, - "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":805.85900000000004, - "audio_s":198.734375, - "encode_ms":210.084, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" - }, - "asr:hp0.wav":{ - "ms":1006.9400000000001, - "audio_s":273.28724999999997, - "encode_ms":305.56799999999998, - "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million, 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Infobox, part of this series on screw drive types. Slotted, commonly, erroneously flat head. Phillips, cross head. Positrive, superdrive. Torx. Hex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the Gnue-Free Documentation License. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible non-profit charity. This sound file and all texts in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.8x. TML" + "pp512":{ + "tok_s":392.22936299999998, + "stddev":9.6444489999999998 }, - "asr:hp0x2.wav":{ - "ms":1940.0250000000001, - "audio_s":546.57449999999994, - "encode_ms":625.57799999999997, - "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million, 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Infobox, part of this series on screw drive types. Slotted, commonly, erroneously flat head. Phillips, cross head. Positrive, superdrive. Torx. Hex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the Gnue-Free Documentation License. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible non-profit charity. This sound file and all texts in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.8x. TML. Henry F Phillips from Wikipedia, the free encyclopedia at E N dot Wikipedia dot org Henry F Phillips from Wikipedia the free and cyclopedia Henry F Phillips 1890 to 1958 a US businessman from Portland Oregon as the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in itself centering property, useful on automated production lines that use powered screw drivers. Phillips Major contribution was in driving the cross-head concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. In the info box, part of the series on screw drive types. Slaughted, commonly, erroneously flat head. Crossehead, Positrive, Superdrive, Torx, Hex, Allen, Robertson, Tri-Wing, Torx-Set, Spannerhead, triple square, xzn. Others, polydrive, spline drive, double hex. Many images are accompanied this info box. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. A US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.html." + "tg128":{ + "tok_s":39.050325000000001, + "stddev":0.38299499999999997 } }, - "workload":"asr", "source":"official", - "sha":"da8ed204d", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", - "noise":"ok", - "exec_fmt":"f32/q8", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"ggml-tiny.bin", - "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", - "bytes":77691713 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, { - "engine":"whisper-cli", + "engine":"das", "backend":"metal", - "flavor":"stock", + "flavor":"tuned", "box":"m1", "threads":8, - "date":"2026-08-17", - "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1", + "date":"2026-08-21", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", "hardware":{ "cpu":"Apple M1 Max", "arch":"arm64", @@ -11255,62 +18503,46 @@ "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":86.140000000000001 - }, - "asr:jfk3.wav":{ - "ms":178.84999999999999 - }, - "asr:gb1.wav":{ - "ms":1037.1700000000001 + "img:enc":{ + "ms":91.099999999999994 }, - "asr:hp0.wav":{ - "ms":1207.25 + "img:pp":{ + "tok_s":1399.6177966785992 }, - "asr:hp0x2.wav":{ - "ms":2418.6300000000001 + "img:tg":{ + "tok_s":92.822356573988699, + "text":": This is an image of two tabby cats lying on a pink surface." } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"b59eae7ec", + "version":"0.6.4", + "dasllama_version":7, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m1", "files":[ { "role":"weights", - "name":"ggml-tiny-q8_0.bin", - "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", - "bytes":43537433 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, @@ -11318,427 +18550,301 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":52.262999999999998, - "audio_s":11, - "encode_ms":33.433999999999997, - "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":119.905, - "audio_s":33, - "encode_ms":66.992000000000004, - "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":612.15599999999995, - "audio_s":198.734375, - "encode_ms":271.53699999999998, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + "img:enc":{ + "ms":420.45400000000001 }, - "asr:hp0.wav":{ - "ms":777.38300000000004, - "audio_s":273.28724999999997, - "encode_ms":377.69999999999999, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + "img:pp":{ + "tok_s":408.11307871611814 }, - "asr:hp0x2.wav":{ - "ms":1564.6489999999999, - "audio_s":546.57449999999994, - "encode_ms":756.81200000000001, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + "img:tg":{ + "tok_s":42.84392244678785, + "text":": This is an image of two tabby cats lying on a pink surface." } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "sha":"aef0840b8", + "sha":"b59eae7ec", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":7, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "parity":"ok", + "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1", "files":[ { "role":"weights", - "name":"ggml-tiny.bin", - "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", - "bytes":77691713 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"whisper-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"../whisper.cpp/build/bin/whisper-cli -m /Users/dasbox/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -bs 1 -bo 1 -nf -ng", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":71.280000000000001 - }, - "asr:jfk3.wav":{ - "ms":171.71000000000001 - }, - "asr:gb1.wav":{ - "ms":931.70000000000005 + "img:enc":{ + "ms":498.50599999999997 }, - "asr:hp0.wav":{ - "ms":1242.47 + "img:pp":{ + "tok_s":425.93158883403959 }, - "asr:hp0x2.wav":{ - "ms":2449.6100000000001 + "img:tg":{ + "tok_s":43.098122933085854, + "text":": This is an image of two tabby cats lying on a pink surface." } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"b59eae7ec", + "version":"0.6.4", + "dasllama_version":7, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1", "files":[ { "role":"weights", - "name":"ggml-tiny-q8_0.bin", - "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", - "bytes":43537433 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"onnx", - "backend":"cpu", + "engine":"llama.cpp", + "backend":"metal", "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"/Users/borisbatkin/Work/llama.cpp/build/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 99", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":425.56900000000002, - "audio_s":11 + "img:enc":{ + "ms":116 + }, + "img:pp":{ + "tok_s":1109.5603628750871 + }, + "img:tg":{ + "tok_s":73.988439306358387 } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "versions":"llama.cpp @ 98c4764b6 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", "files":[ { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "flavor":"clean-cpu", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 0 --no-mmproj-offload", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":52.685000000000002, - "audio_s":11, - "encode_ms":33.255000000000003, - "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":120.25, - "audio_s":33, - "encode_ms":66.814999999999998, - "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":612.66499999999996, - "audio_s":198.734375, - "encode_ms":272.07900000000001, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + "img:enc":{ + "ms":19931 }, - "asr:hp0.wav":{ - "ms":779.72400000000005, - "audio_s":273.28724999999997, - "encode_ms":377.71800000000002, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + "img:pp":{ + "tok_s":304.94821634062055 }, - "asr:hp0x2.wav":{ - "ms":1564.2850000000001, - "audio_s":546.57449999999994, - "encode_ms":757.39400000000001, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used power to screw drivers. Phillips Major contribution was in driving the crosshead concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2 million 46,343 US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + "img:tg":{ + "tok_s":38.512456372608014 } }, - "workload":"asr", - "source":"official", - "sha":"aef0840b8", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", - "files":[ - { - "role":"weights", - "name":"ggml-tiny.bin", - "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", - "bytes":77691713 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-tiny.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 1", + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"/Users/borisbatkin/Work/llama.cpp/build/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 0 --no-mmproj-offload --no-op-offload", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":44.554000000000002, - "audio_s":11, - "encode_ms":23.259, - "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":108.26600000000001, - "audio_s":33, - "encode_ms":56.192, - "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":562.38999999999999, - "audio_s":198.734375, - "encode_ms":191.14500000000001, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + "img:enc":{ + "ms":19956 }, - "asr:hp0.wav":{ - "ms":696.45399999999995, - "audio_s":273.28724999999997, - "encode_ms":266.94900000000001, - "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia, at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + "img:pp":{ + "tok_s":305.94573792572595 }, - "asr:hp0x2.wav":{ - "ms":1431.2629999999999, - "audio_s":546.57449999999994, - "encode_ms":533.30600000000004, - "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia, at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompanied this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A U.S. registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847 840. It was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In the info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + "img:tg":{ + "tok_s":37.995725480883401 } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "sha":"aef0840b8", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"f32/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "versions":"llama.cpp @ 98c4764b6 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"ggml-tiny.bin", - "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", - "bytes":77691713 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"whisper-cli", - "backend":"metal", + "engine":"llama-mtmd-cli", + "backend":"cpu", "flavor":"stock", "box":"m4", "threads":10, "date":"2026-08-18", - "cmd":"../whisper.cpp/build/bin/whisper-cli -m /Users/dasbox/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -bs 1 -bo 1", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/dasbox/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/dasbox/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 10", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -11752,31 +18858,37 @@ }, "tests":{ "asr:jfk.wav":{ - "ms":59.86999999999999 + "ms":5153.1000000000004, + "encode_ms":4825.3000000000002, + "text":"0.00.006.549 I common_init_result: fitting params to device memory ... 0.00.006.562 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.292.537 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.513.812 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.515.758 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.520.895 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.332.051 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.371.743 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.713.910 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.713.976 I main: loading model: /Users/dasbox/models/gemma-4-E2B-it-Q8_0.gguf 0.01.714.152 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.714.153 W For normal use cases, please use the standard llama-cli 0.01.737.423 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 3) 0.06.058.930 I mtmd batch encoding done in 4321 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" }, "asr:jfk3.wav":{ - "ms":124.71000000000001 + "ms":15541, + "encode_ms":14556.4, + "text":"0.00.001.838 I common_init_result: fitting params to device memory ... 0.00.001.839 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.271.968 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.495.767 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.497.700 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.502.787 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.316.045 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.350.878 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.542.285 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.542.339 I main: loading model: /Users/dasbox/models/gemma-4-E2B-it-Q8_0.gguf 0.01.542.529 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.542.530 W For normal use cases, please use the standard llama-cli 0.01.571.226 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.13.319.088 I mtmd batch encoding done in 11747 ms 0.14.665.869 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.15.847.125 I mtmd batch encoding done in 1182 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 107 106" }, "asr:gb1.wav":{ - "ms":692.42999999999995 - }, - "asr:hp0.wav":{ - "ms":804.06999999999994 - }, - "asr:hp0x2.wav":{ - "ms":1612.8499999999999 + "ms":97757.399999999994, + "encode_ms":90936.199999999997, + "text":"0.00.001.869 I common_init_result: fitting params to device memory ... 0.00.001.873 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.269.263 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.491.684 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.493.625 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.498.744 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.308.828 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.343.416 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.536.749 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.536.804 I main: loading model: /Users/dasbox/models/gemma-4-E2B-it-Q8_0.gguf 0.01.536.998 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.536.999 W For normal use cases, please use the standard llama-cli 0.01.617.874 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 9) 0.13.373.535 I mtmd batch encoding done in 11756 ms 0.14.768.194 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 9) 0.26.490.731 I mtmd batch encoding done in 11723 ms 0.28.113.466 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 9) 0.39.832.294 I mtmd batch encoding done in 11719 ms 0.41.652.906 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 9) 0.53.367.265 I mtmd batch encoding done in 11714 ms 0.55.388.132 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 9) 1.07.103.504 I mtmd batch encoding done in 11716 ms 1.09.327.791 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 9) 1.21.048.908 I mtmd batch encoding done in 11721 ms 1.23.460.015 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 9) 1.30.790.898 I mtmd batch encoding done in 7331 ms My fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As far as we can see, there is comfort and hope in the words of the prophet Isaiah. Lift your eyes and look to the heavens, who created space. He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the Shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America.DASLLAMA_IDS: 4754 12339 14522 236764 672 1719 815 6111 21832 4668 532 1822 55882 531 1023 2891 236761 2640 236743 236819 236787 236771 236771 672 5597 236764 23865 9463 528 21912 5745 3662 607 1023 2557 51320 18693 236761 562 2822 990 3209 236764 37061 691 3472 14773 699 506 55748 2787 9539 236761 669 18693 563 5745 236761 2085 659 951 43732 236761 2154 3905 691 496 13919 529 6819 236787 44221 26839 89702 236764 41523 44221 8972 19864 236764 43224 94816 18093 236764 22359 6822 9833 236764 43224 8966 16376 1209 236764 3587 236761 751 19321 1789 34525 2149 236764 532 98134 121873 236764 496 105721 528 506 33722 5661 15150 236761 3143 1758 532 3607 12718 1822 4652 528 506 2509 531 784 27069 528 614 3911 1056 2557 10224 815 2229 531 4483 4180 15668 236761 1030 563 3735 531 29346 506 39793 529 4301 684 35305 532 506 18502 529 67112 506 48621 11661 529 506 10824 236761 3143 101195 7261 506 39793 532 901 17175 1091 95826 236764 14111 901 1053 496 1494 532 29417 5708 528 1972 236761 8468 529 910 23648 532 63485 532 184291 236764 692 795 4305 1091 784 506 919 236761 2343 14522 3124 659 6972 618 1388 529 506 7965 529 1239 1758 532 3607 1015 735 1010 2238 672 11059 10932 532 32717 236761 1599 236789 500 711 7057 236761 5137 4251 7097 66031 2061 607 611 236761 1452 1724 611 9312 795 2462 735 506 2833 532 36637 529 672 2891 236761 669 4400 528 837 901 8390 795 4102 236761 192411 563 5378 1131 506 29151 6998 1023 1902 684 506 18014 529 17324 532 506 86508 531 3050 236761 5137 9338 1131 2557 795 817 580 236761 799 506 55748 3124 236764 692 5004 21404 532 40578 236761 1773 2793 618 692 740 1460 236764 993 563 5931 532 4614 528 506 4171 529 506 59918 81034 236761 79493 822 6114 532 1385 531 506 80958 236764 1015 4464 2557 236761 1293 1015 12076 855 506 129196 20472 886 684 886 532 9139 1091 1546 684 1463 236761 8468 529 914 1822 2066 532 45478 6332 236764 711 886 529 1091 563 9724 236761 669 1638 33797 1015 5618 506 8197 992 10077 506 5618 529 506 6819 39690 692 92377 3124 236761 669 13919 529 506 114357 18693 1602 711 994 21236 531 10824 236761 16961 692 740 14098 600 784 659 21236 2033 236761 3353 3803 14321 506 112792 7965 532 1149 3803 1149 3803 4102 531 14321 5711 236761 106" } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"ggml-tiny-q8_0.bin", - "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", - "bytes":43537433 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -11795,18 +18907,6 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, @@ -11814,68 +18914,69 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-tiny.bin -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":134.542, + "ms":988.92499999999995, "audio_s":11, - "encode_ms":77.266000000000005, - "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "encode_ms":258.96100000000001, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":326.74900000000002, + "ms":2786.3339999999998, "audio_s":33, - "encode_ms":156.297, - "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "encode_ms":776.02599999999995, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" }, "asr:gb1.wav":{ - "ms":1692.521, + "ms":20875.822, "audio_s":198.734375, - "encode_ms":651.90599999999995, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our Space Shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens who created all these, He who brings out the story hosts one by one and calls them each by name, because of His great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" + "encode_ms":4922.6779999999999, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Husband and Captain Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's will, idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." }, "asr:hp0.wav":{ - "ms":2016.4159999999999, + "ms":30017.942999999999, "audio_s":273.28724999999997, - "encode_ms":871.32299999999998, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in itself centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the positrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, Philips screw head. The following is an info box which accompanies this article. In the info box, part of the series on screw drive types. Slotted, commonly, erroneously, flat head. Phillips, cross head. Pause a drive, super drive. Torx. Hex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the Gnou-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.8x. TML" - }, - "asr:hp0x2.wav":{ - "ms":4512.2349999999997, - "audio_s":546.57449999999994, - "encode_ms":1828.3689999999999, - "text":" Henry F. Phillips from Wikipedia, the free encyclopedia at EN. Wikipedia.org. Henry F. Phillips from Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in itself centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents $2,046,837 to $2,046,840. It was so widely copied that by 1949 Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept, since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the positrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, Philips screw head. The following is an info box which accompanies this article. In the info box, part of the series on screw drive types. Slotted, commonly, erroneously, flat head. Phillips, cross head. Pause a drive, super drive. Torx. Hex Allen Robertson Tri-wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex many images accompanied this info box. This page was last modified on the 9th of April 2008 at 1704. All text is available under the terms of the Gnou-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.8x. TML. Henry F Phillips from Wikipedia, the free encyclopedia, at E N dot Wikipedia dot org Henry F Phillips from Wikipedia the free and cyclopedia Henry F Phillips 1890 to 1958 a US businessman from Portland Oregon as the honor of having the Philips head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips major contribution was in driving the cross head concept forward forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,840, it was so widely copied that by 1949, Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. distinct from the simple mild slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the positrive screw which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. In a info box, part of this series on and screw drive types. Slotted, commonly, erroneously, flat head. Phillips, cross head. Pause a drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hacks, Many images accompanied this infobox. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.hp TML" + "encode_ms":6666.1120000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American tool company. The Phillips uses port bonds of US to devise American screw. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American tool company. The Phillips uses port bonds of US to devise American screw. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "sha":"37a2c1662", + "sha":"aef0840b8", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"ggml-tiny.bin", - "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", - "bytes":77691713 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -11900,62 +19001,76 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"whisper-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"zen2", - "threads":16, - "date":"2026-08-04", - "cmd":"D:\\Work\\whisper.cpp\\build\\bin\\Release\\whisper-cli.exe -m D:\\Work\\whisper.cpp\\models\\ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 16 -bs 1 -bo 1 -nf -ng", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":163 + "ms":977.48500000000001, + "audio_s":11, + "encode_ms":257.70699999999999, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":354.32999999999998 + "ms":2761.2869999999998, + "audio_s":33, + "encode_ms":774.31500000000005, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" }, "asr:gb1.wav":{ - "ms":1995.71 + "ms":20219.628000000001, + "audio_s":198.734375, + "encode_ms":4938.6130000000003, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Husband and Captain Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's will, idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." }, "asr:hp0.wav":{ - "ms":2509.6199999999999 - }, - "asr:hp0x2.wav":{ - "ms":5490.0699999999997 + "ms":28237.998, + "audio_s":273.28724999999997, + "encode_ms":6562.1819999999998, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to Milise F. Phillips Century property, 340 feet on automated production lines, 2 million powered screw drives. Henry F. Phillips, 1890-1958 was an US businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia. Although he received patents for the design. The American screw company. The Phillips uses port bonds of US to devise an American screw. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"ggml-tiny-q8_0.bin", - "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", - "bytes":43537433 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -11980,728 +19095,587 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"onnx", - "backend":"cpu", - "flavor":"stock", - "box":"zen2", - "threads":16, - "date":"2026-07-29", - "cmd":"modules\\dasLLAMA\\benchmarks\\asr\\.venv-onnx\\Scripts\\python.exe modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --threads 16 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"Parsec Virtual Display Adapter", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"AMD Ryzen™ Balanced", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":573.23199999999997, - "audio_s":11 + "pp512":{ + "tok_s":9074.3052485156186, + "stddev":45.637462615966797 + }, + "tg128":{ + "tok_s":161.29051694478639, + "stddev":0.29714569449424744 } }, - "workload":"asr", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-tiny.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":94.736000000000004, - "audio_s":11, - "encode_ms":59.701000000000001, - "text":" And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":218.77799999999999, - "audio_s":33, - "encode_ms":120.57299999999999, - "text":" And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":1115.691, - "audio_s":198.734375, - "encode_ms":483.19299999999998, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control and Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. And board was a crew of seven, Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Cooltna Chavla, and Elon Ramon, a Colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock in grief. You're not alone. Our entire nation agrees with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Man kind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As farther than we can see, there is comfort and hope. The words of the prophet Isaiah, lift your eyes and look to the heavens who created all these. He who brings out the story hosts one by one and calls them each by name because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America. [BLANK_AUDIO]" - }, - "asr:hp0.wav":{ - "ms":1398.5340000000001, - "audio_s":273.28724999999997, - "encode_ms":664.89999999999998, - "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-Wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A US registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html." + "pp512":{ + "tok_s":7413.405377, + "stddev":19.497814000000002 }, - "asr:hp0x2.wav":{ - "ms":2806.681, - "audio_s":546.57449999999994, - "encode_ms":1332.9079999999999, - "text":" Henry F. Phillips from Wikipedia, the Free Encyclopedia at EN.Wikipedia.org. Henry F. Phillips from Wikipedia, the Free Encyclopedia. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips-head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that used powered screwdrivers. Phillips major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343,000 U.S. patents 2,046,837 to 2,046,840. It was so widely copied that by 1949, Philips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw as distinct from the simple milled slot of a slotted type screw. The Philips screw company and the American screw company went on to devise the Pawsadrive screw, which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article, caption, \"Philips screw head.\" The following is an info box which accompanies this article. Info box part of the series on screw drive types. Slotted commonly erroneously flat head. Phillips cross head. Positrive Super Drive. Torx. Alex Allen Robertson Tri-Wing Torxet Spannerhead Triple Square XZN Others Polydrive Spline Drive Double Hex Many images accompany this info box This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the GNU-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wiki media foundation incorporated. A US registered 501 C3 tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation license. Available at www.gnu.org/copyleft/fdl.html. Henry F Phillips from Wikipedia, the free The Korean Cyclopedia at EN. Wikipedia.org Henry F. Phillips From Wikipedia, the Korean Cyclopedia Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Philips' head screw and screwdriver named after him. The importance of the cross head screw design lies in its self-centering property, useful on automated production lines that use powered screw drivers. Philips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, US patent number 2,046,343, US patents 2,046,837 to 2,046,847, 840. It was so widely copied that by 1949 Phillips lost his patent. The American screw company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American screw company went on to devise the Pawsadrive screw which differs from the Philips in that it is designed to accommodate greater torque than the Philips. An image accompanied this article caption \"Philips Screwhead\". The following is an info box which accompanies this article. In a info box part of the series on screw drive types. Slaughted, commonly, erroneously, flat head. Phillips, cross head. Paws of Drive, Super Drive. Torx, Hex, Allen, Robertson, Tri-wing, Torxet, Spannerhead, Triple Square, XZN, Others, Polydrive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on 9 April 2008 at 1704. All text is available under the terms of the Gnue-free documentation license. See Copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Inc. a US registered 501c3 tax deductible nonprofit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License. Available at www.gnu.org/copyleft/fdl.a THTML" + "tg128":{ + "tok_s":137.04832500000001, + "stddev":0.14505699999999999 } }, - "workload":"asr", "source":"official", - "sha":"7e02c2451", - "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", "files":[ { - "role":"weights", - "name":"ggml-tiny.bin", - "sha256":"be07e048e1e599ad46341c8d2a135645097a538221678b7acdd1b1919c6e1b21", - "bytes":77691713 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, { - "engine":"whisper-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"/home/boris/whisper.cpp/build/bin/whisper-cli -m /home/boris/models/ggml-tiny-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1 -nf -ng", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":179.71000000000001 - }, - "asr:jfk3.wav":{ - "ms":389.50999999999999 - }, - "asr:gb1.wav":{ - "ms":2017.8000000000002 - }, - "asr:hp0.wav":{ - "ms":2659.2200000000003 + "pp512":{ + "tok_s":418.36604479578892, + "stddev":8.9013547897338867 }, - "asr:hp0x2.wav":{ - "ms":5751.6400000000003 + "tg128":{ + "tok_s":102.92598495358818, + "stddev":0.51493358612060547 } }, - "workload":"asr", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-tiny-q8_0.bin", - "sha256":"c2085835d3f50733e2ff6e4b41ae8a2b8d8110461e18821b09a15c40c42d1cca", - "bytes":43537433 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, { - "engine":"onnx", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"stock", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-tiny-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":309.61399999999998, - "audio_s":11 + "pp512":{ + "tok_s":281.425792, + "stddev":1.3423130000000001 + }, + "tg128":{ + "tok_s":73.950760000000002, + "stddev":0.93118800000000002 } }, - "workload":"asr", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] - } - ], - "arch":"Whisper tiny", - "size_bytes":77691713 - }, - { - "gguf":"ggml-large-v3-turbo.bin", - "runs":[ + }, { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":2011.0429999999999, - "audio_s":11, - "encode_ms":1870.116, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":4037.7579999999998, - "audio_s":33, - "encode_ms":3739.5790000000002, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":17076.377, - "audio_s":198.734375, - "encode_ms":15214.129999999999, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." - }, - "asr:hp0.wav":{ - "ms":24711.436000000002, - "audio_s":273.28724999999997, - "encode_ms":22417.581999999999, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "pp512":{ + "tok_s":419.52594596689579, + "stddev":3.7739033699035645 }, - "asr:hp0x2.wav":{ - "ms":47526.917999999998, - "audio_s":546.57449999999994, - "encode_ms":43105.561999999998, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "tg128":{ + "tok_s":102.48935453708089, + "stddev":0.36666584014892578 } }, - "workload":"asr", "source":"official", - "sha":"b6450c2a5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"q8/q8", + "parity":"ok", + "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo.bin", - "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", - "bytes":1624555275 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":396.91589599999998, + "stddev":4.7512590000000001 }, + "tg128":{ + "tok_s":72.762850999999998, + "stddev":0.89491100000000001 + } + }, + "source":"official", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 } ] }, { - "engine":"whisper-cli", - "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1 -nf -ng", + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":2168.3899999999999 - }, - "asr:jfk3.wav":{ - "ms":4524.21 - }, - "asr:gb1.wav":{ - "ms":23534.080000000002 + "img:enc":{ + "ms":37.649999999999999 }, - "asr:hp0.wav":{ - "ms":35360.610000000001 + "img:pp":{ + "tok_s":5796.2398751579103 }, - "asr:hp0x2.wav":{ - "ms":62224.209999999999 + "img:tg":{ + "tok_s":155.08524518977265, + "text":": This is an image of two tabby cats lying on a pink surface." } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo-q8_0.bin", - "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", - "bytes":874188075 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"onnx", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":2314.6849999999999, - "audio_s":11 + "img:enc":{ + "ms":438.13799999999998 + }, + "img:pp":{ + "tok_s":394.60903351141332 + }, + "img:tg":{ + "tok_s":98.218319680986895, + "text":": This is an image of two tabby cats lying on a pink surface." } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":1986.9839999999999, - "audio_s":11, - "encode_ms":1856.4169999999999, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":4074.7510000000002, - "audio_s":33, - "encode_ms":3707.741, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":16819.155999999999, - "audio_s":198.734375, - "encode_ms":15091.91, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." + "img:enc":{ + "ms":13547 }, - "asr:hp0.wav":{ - "ms":24600.642, - "audio_s":273.28724999999997, - "encode_ms":22278.062999999998, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "img:pp":{ + "tok_s":369.42379182156168 }, - "asr:hp0x2.wav":{ - "ms":47319.283000000003, - "audio_s":546.57449999999994, - "encode_ms":42837.938999999998, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "img:tg":{ + "tok_s":64.06406406406407 } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "sha":"b6450c2a5", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", - "noise":"ok", - "exec_fmt":"q8/q8", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { - "role":"weights", - "name":"ggml-large-v3-turbo.bin", - "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", - "bytes":1624555275 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 1", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":436.60599999999999, - "audio_s":11, - "encode_ms":371.964, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":924.55600000000004, - "audio_s":33, - "encode_ms":744.09799999999996, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":4046.7890000000002, - "audio_s":198.734375, - "encode_ms":2980.3029999999999, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." + "img:enc":{ + "ms":466.53399999999999 }, - "asr:hp0.wav":{ - "ms":5838.5460000000003, - "audio_s":273.28724999999997, - "encode_ms":4480.067, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "img:pp":{ + "tok_s":400.91902977594793 }, - "asr:hp0x2.wav":{ - "ms":11247.213, - "audio_s":546.57449999999994, - "encode_ms":8555.6970000000001, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "img:tg":{ + "tok_s":98.976582140665514, + "text":": This is an image of two tabby cats lying on a pink surface." } }, - "workload":"asr", + "workload":"image-chat", "source":"official", - "sha":"572b5dd69", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"f32/q8", + "parity":"ok", + "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo.bin", - "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", - "bytes":1624555275 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"whisper-cli", + "engine":"das", "backend":"metal", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"../whisper.cpp/build/bin/whisper-cli -m ../whisper.cpp/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":465.70999999999998 + "ms":229.541, + "audio_s":11, + "encode_ms":34.915999999999997, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":967.90000000000009 + "ms":618.63599999999997, + "audio_s":33, + "encode_ms":97.418999999999997, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country" }, "asr:gb1.wav":{ - "ms":5542.9400000000005 + "ms":4241.6840000000002, + "audio_s":198.734375, + "encode_ms":542.18299999999999, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, lift your eyes and look to the heavens, who created space, he who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America." }, "asr:hp0.wav":{ - "ms":6578.6500000000005 - }, - "asr:hp0x2.wav":{ - "ms":15219.25 + "ms":5431.3490000000002, + "audio_s":273.28724999999997, + "encode_ms":792.80399999999997, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number 2,46343, US patents 2,46837 to 2,46840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American Screw Company went on to devise the Pozidrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption: Phillips screw head. The following is an infobox which accompanies this article. Infobox: Part of the series on screw drive types. Slotted, commonly erroneously flathead, Phillips, crosshead, Pozidrive, superdrive, torques, hex, Allen, Robertson, triwing, torque set, spanner head, triple square, XZN, others, polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the 9th of April, 2008 at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered 501(c)3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/copyleft/fdl.html." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo-q8_0.bin", - "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", - "bytes":874188075 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -12726,82 +19700,61 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"das", + "engine":"llama-mtmd-cli", "backend":"cpu", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 6", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":1222.7619999999999, - "audio_s":11, - "encode_ms":1159.5820000000001, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "ms":7665.6000000000004, + "encode_ms":7293.6000000000004, + "text":"0.00.001.911 I common_init_result: fitting params to device memory ... 0.00.001.912 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.244.841 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 131072 MiB of total host memory 0.00.439.014 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.440.937 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.446.072 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.726.254 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.766.479 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.934.431 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.934.480 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.01.934.637 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.934.638 W For normal use cases, please use the standard llama-cli 0.01.962.985 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 3) 0.08.432.179 I mtmd batch encoding done in 6469 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" }, "asr:jfk3.wav":{ - "ms":2524.6930000000002, - "audio_s":33, - "encode_ms":2344, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "ms":22981.5, + "encode_ms":21865.599999999999, + "text":"0.00.001.811 I common_init_result: fitting params to device memory ... 0.00.001.815 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.244.264 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 131072 MiB of total host memory 0.00.441.386 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.443.350 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.448.614 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.727.787 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.768.148 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.935.732 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.935.779 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.01.935.936 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.935.937 W For normal use cases, please use the standard llama-cli 0.01.971.339 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.19.596.135 I mtmd batch encoding done in 17624 ms 0.21.672.069 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.23.466.215 I mtmd batch encoding done in 1795 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" }, "asr:gb1.wav":{ - "ms":10828.123, - "audio_s":198.734375, - "encode_ms":10426.184999999999, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." - }, - "asr:hp0.wav":{ - "ms":17101.677, - "audio_s":273.28724999999997, - "encode_ms":15611.078, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" - }, - "asr:hp0x2.wav":{ - "ms":32671.159, - "audio_s":546.57449999999994, - "encode_ms":29833.032999999999, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "ms":142898.70000000001, + "encode_ms":134845, + "text":"0.00.001.770 I common_init_result: fitting params to device memory ... 0.00.001.774 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.240.580 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 131072 MiB of total host memory 0.00.434.527 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.436.386 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.441.357 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.714.417 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.755.141 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.923.490 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.923.539 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.01.923.689 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.923.689 W For normal use cases, please use the standard llama-cli 0.02.004.292 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 9) 0.19.621.280 I mtmd batch encoding done in 17617 ms 0.21.674.324 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 9) 0.39.280.594 I mtmd batch encoding done in 17607 ms 0.41.623.704 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 9) 0.59.330.519 I mtmd batch encoding done in 17707 ms 1.01.882.612 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 9) 1.19.483.455 I mtmd batch encoding done in 17601 ms 1.22.243.872 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 9) 1.39.859.879 I mtmd batch encoding done in 17616 ms 1.42.834.122 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 9) 2.00.447.647 I mtmd batch encoding done in 17614 ms 2.03.627.301 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 9) 2.14.634.052 I mtmd batch encoding done in 11007 ms My fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As far as we can see, there is comfort and hope in the words of the prophet Isaiah. Lift your eyes and look to the heavens, who created space. He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the Shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America.DASLLAMA_IDS: 4754 12339 14522 236764 672 1719 815 6111 21832 4668 532 1822 55882 531 1023 2891 236761 2640 236743 236819 236787 236771 236771 672 5597 236764 9017 2256 528 21912 5745 3662 607 1023 2557 51320 18693 236761 562 2822 990 3209 236764 37061 691 3472 14773 699 506 55748 2787 9539 236761 669 18693 563 5745 236761 2085 659 951 43732 236761 2154 3905 691 496 13919 529 6819 236787 44221 26839 89702 236764 41523 44221 8972 19864 236764 43224 94816 18093 236764 22359 6822 9833 236764 43224 8966 16376 1209 236764 3587 236761 751 19321 1789 34525 2149 236764 532 98134 121873 236764 496 105721 528 506 33722 5661 15150 236761 3143 1758 532 3607 12718 1822 4652 528 506 2509 531 784 27069 528 614 3911 1056 2557 10224 815 2229 531 4483 4180 15668 236761 1030 563 3735 531 29346 506 39793 529 4301 684 35305 532 506 18502 529 67112 506 48621 11661 529 506 10824 236761 3143 101195 7261 506 39793 532 901 17175 1091 95826 236764 14111 901 1053 496 1494 532 29417 5708 528 1972 236761 8468 529 910 23648 532 63485 532 184291 236764 692 795 4305 1091 784 506 919 236761 2343 14522 3124 659 6972 618 1388 529 506 7965 529 1239 1758 532 3607 1015 735 1010 2238 672 11059 10932 532 32717 236761 1599 236789 500 711 7057 236761 5137 4251 7097 66031 2061 607 611 236761 1452 1724 611 9312 795 2462 735 506 2833 532 36637 529 672 2891 236761 669 4400 528 837 901 8390 795 4102 236761 192411 563 5378 1131 506 29151 6998 1023 1902 684 506 18014 529 17324 532 506 86508 531 3050 236761 5137 9338 1131 2557 795 817 580 236761 799 506 55748 3124 236764 692 5004 21404 532 40578 236761 1773 2793 618 692 740 1460 236764 993 563 5931 532 4614 528 506 4171 529 506 59918 81034 236761 79493 822 6114 532 1385 531 506 80958 236764 1015 4464 2557 236761 1293 1015 12076 855 506 129196 20472 886 684 886 532 9139 1091 1546 684 1463 236761 8468 529 914 1822 2066 532 45478 6332 236764 711 886 529 1091 563 9724 236761 669 1638 33797 1015 5618 506 8197 992 10077 506 5618 529 506 6819 39690 692 92377 3124 236761 669 13919 529 506 114357 18693 1602 711 994 21236 531 10824 236761 16961 692 740 14098 600 784 659 21236 2033 236761 3353 3803 14321 506 112792 7965 532 1149 3803 1149 3803 4102 531 14321 5711 236761 106" } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "sha":"aef0840b8", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo.bin", - "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", - "bytes":1624555275 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -12820,67 +19773,61 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"whisper-cli", - "backend":"cpu", + "engine":"llama-mtmd-cli", + "backend":"metal", "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"../whisper.cpp/build/bin/whisper-cli -m /Users/dasbox/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -bs 1 -bo 1 -nf -ng", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-metal/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 99 -t 6", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":1459.5700000000002 + "ms":291.60000000000002, + "encode_ms":98.5, + "text":"0.00.022.839 I common_init_result: fitting params to device memory ... 0.00.022.842 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.457.218 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.459.031 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.463.963 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.00.616.707 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.640.223 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.00.831.501 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.831.546 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.00.831.705 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.831.706 W For normal use cases, please use the standard llama-cli 0.00.836.914 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 3) 0.00.875.673 I mtmd batch encoding done in 39 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" }, "asr:jfk3.wav":{ - "ms":3089.8700000000003 + "ms":721.39999999999998, + "encode_ms":212.59999999999999, + "text":"0.00.027.886 I common_init_result: fitting params to device memory ... 0.00.027.890 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.468.945 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.470.789 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.476.235 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.00.632.073 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.656.004 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.00.848.742 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.848.789 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.00.848.951 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.848.951 W For normal use cases, please use the standard llama-cli 0.00.860.453 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.00.912.833 I mtmd batch encoding done in 52 ms 0.00.979.798 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.01.027.521 I mtmd batch encoding done in 48 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 107 106" }, "asr:gb1.wav":{ - "ms":18348.880000000001 - }, - "asr:hp0.wav":{ - "ms":22620.959999999999 - }, - "asr:hp0x2.wav":{ - "ms":44298.449999999997 + "ms":4274.3000000000002, + "encode_ms":1081.0999999999999, + "text":"0.00.023.642 I common_init_result: fitting params to device memory ... 0.00.023.644 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.463.170 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.465.061 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.470.063 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.00.624.427 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.648.222 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.00.842.829 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.842.877 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.00.843.036 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.843.037 W For normal use cases, please use the standard llama-cli 0.00.899.817 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 9) 0.00.956.606 I mtmd batch encoding done in 57 ms 0.01.023.495 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 9) 0.01.085.254 I mtmd batch encoding done in 62 ms 0.01.159.147 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 9) 0.01.223.969 I mtmd batch encoding done in 65 ms 0.01.302.155 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 9) 0.01.368.919 I mtmd batch encoding done in 66 ms 0.01.451.298 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 9) 0.01.520.715 I mtmd batch encoding done in 69 ms 0.01.607.597 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 9) 0.01.678.850 I mtmd batch encoding done in 71 ms 0.01.770.823 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 9) 0.01.838.313 I mtmd batch encoding done in 68 ms My fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As far as we can see, there is comfort and hope in the words of the prophet Isaiah. Lift your eyes and look to the heavens, who created space. He who brings out the starry hosts one by one and calls them each by name because of his great power and mighty strength. Not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the Shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America.DASLLAMA_IDS: 4754 12339 14522 236764 672 1719 815 6111 21832 4668 532 1822 55882 531 1023 2891 236761 2640 236743 236819 236787 236771 236771 672 5597 236764 9017 2256 528 21912 5745 3662 607 1023 2557 51320 18693 236761 562 2822 990 3209 236764 37061 691 3472 14773 699 506 55748 2787 9539 236761 669 18693 563 5745 236761 2085 659 951 43732 236761 2154 3905 691 496 13919 529 6819 236787 44221 26839 89702 236764 41523 44221 8972 19864 236764 43224 94816 18093 236764 22359 6822 9833 236764 43224 8966 16376 1209 236764 3587 236761 751 19321 1789 34525 2149 236764 532 98134 121873 236764 496 105721 528 506 33722 5661 15150 236761 3143 1758 532 3607 12718 1822 4652 528 506 2509 531 784 27069 528 614 3911 1056 2557 10224 815 2229 531 4483 4180 15668 236761 1030 563 3735 531 29346 506 39793 529 4301 684 35305 532 506 18502 529 67112 506 48621 11661 529 506 10824 236761 3143 101195 7261 506 39793 532 901 17175 1091 95826 236764 14111 901 1053 496 1494 532 29417 5708 528 1972 236761 8468 529 910 23648 532 63485 532 184291 236764 692 795 4305 1091 784 506 919 236761 2343 14522 3124 659 6972 618 1388 529 506 7965 529 1239 1758 532 3607 1015 735 1010 2238 672 11059 10932 532 32717 236761 1599 236789 500 711 7057 236761 5137 4251 7097 66031 2061 607 611 236761 1452 1724 611 9312 795 2462 735 506 2833 532 36637 529 672 2891 236761 669 4400 528 837 901 8390 795 4102 236761 192411 563 5378 1131 506 29151 6998 1023 1902 684 506 18014 529 17324 532 506 86508 531 3050 236761 5137 9338 1131 2557 795 817 580 236761 799 506 55748 3124 236764 692 5004 21404 532 40578 236761 1773 2793 618 692 740 1460 236764 993 563 5931 532 4614 528 506 4171 529 506 59918 81034 236761 79493 822 6114 532 1385 531 506 80958 236764 1015 4464 2557 236761 1293 1015 12076 855 506 129196 20472 886 684 886 532 9139 1091 1546 684 1463 1547 529 914 1822 2066 532 45478 6332 236761 3790 886 529 1091 563 9724 236761 669 1638 33797 1015 5618 506 8197 992 10077 506 5618 529 506 6819 39690 692 92377 3124 236761 669 13919 529 506 114357 18693 1602 711 994 21236 531 10824 236761 16961 692 740 14098 600 784 659 21236 2033 236761 3353 3803 14321 506 112792 7965 532 1149 3803 1149 3803 4102 531 14321 5711 236761 106" } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo-q8_0.bin", - "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", - "bytes":874188075 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -12899,56 +19846,210 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":52 + }, + "img:pp":{ + "tok_s":2362.5557206537892 + }, + "img:tg":{ + "tok_s":122.55840674071236 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", + "files":[ + { + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 }, { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { - "engine":"onnx", + "engine":"llama.cpp", "backend":"cpu", "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "img:enc":{ + "ms":13548 + }, + "img:pp":{ + "tok_s":347.31323722149466 + }, + "img:tg":{ + "tok_s":69.884254203974677 + } + }, + "workload":"image-chat", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":1672.547, - "audio_s":11 + "ms":1197.835, + "audio_s":11, + "encode_ms":253.62200000000001, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:jfk3.wav":{ + "ms":3596.4560000000001, + "audio_s":33, + "encode_ms":716.04499999999996, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:gb1.wav":{ + "ms":28601.455000000002, + "audio_s":198.734375, + "encode_ms":4418.3800000000001, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity, in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created space, he who brings out the starry hosts one by one and calls them each by name, because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":40530.589, + "audio_s":273.28724999999997, + "encode_ms":5921.6099999999997, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number 2,46343, US patents 2,46837 to 2,46840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American Screw Company went on to devise the Pozidrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption: Phillips screw head. The following is an infobox which accompanies this article. Infobox: Part of the series on screw drive types. Slotted, commonly erroneously flathead, Phillips, crosshead, Pozidrive, superdrive, torques, hex, Allen, Robertson, trywing, torque set, spanner head, triple square, XZN, others, polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the 9th of April, 2008 at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered 501(c)3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/copyleft/fdl.html." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ + { + "role":"weights", + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 + }, { "role":"clip", "name":"jfk.wav", "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 } ] }, @@ -12956,69 +20057,69 @@ "engine":"das", "backend":"cpu", "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":1210.941, + "ms":1171.615, "audio_s":11, - "encode_ms":1161.633, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":242.10499999999999, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":2490.7730000000001, + "ms":3506.8780000000002, "audio_s":33, - "encode_ms":2314.2310000000002, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":704.21699999999998, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country" }, "asr:gb1.wav":{ - "ms":10571.959000000001, + "ms":27479.187999999998, "audio_s":198.734375, - "encode_ms":10325.154, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." + "encode_ms":4291.4830000000002, + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity, in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you, and those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created space, he who brings out the starry hosts one by one and calls them each by name, because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God continue to bless America." }, "asr:hp0.wav":{ - "ms":16928.131000000001, + "ms":39693.042000000001, "audio_s":273.28724999999997, - "encode_ms":15483.763000000001, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" - }, - "asr:hp0x2.wav":{ - "ms":32418.422999999999, - "audio_s":546.57449999999994, - "encode_ms":29621.988000000001, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "encode_ms":5884.8800000000001, + "text":"Henry F. Phillips from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips major contribution was in driving the crosshead concept forward to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, US patent number 2,46343, US patents 2,46837 to 2,46840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips screw company and the American Screw Company went on to devise the Pozidrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption: Phillips screw head. The following is an infobox which accompanies this article. Infobox: Part of the series on screw drive types. Slotted, commonly erroneously flathead, Phillips, crosshead, Pozidrive, superdrive, torques, hex, Allen, Robertson, trywing, torque set, spanner head, triple square, XZN, others, polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the 9th of April, 2008 at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a US registered 501(c)3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/copyleft/fdl.html." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "sha":"aef0840b8", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo.bin", - "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", - "bytes":1624555275 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -13043,82 +20144,71 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { "engine":"das", - "backend":"metal", + "backend":"cpu", "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 1", + "box":"zen2", + "threads":16, + "date":"2026-08-05", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":590.15300000000002, + "ms":2861.5819999999999, "audio_s":11, - "encode_ms":528.23800000000006, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":1227.7550000000001, + "ms":7597.442, "audio_s":33, - "encode_ms":1056.913, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" }, "asr:gb1.wav":{ - "ms":5235.4650000000001, + "ms":57372.133000000002, "audio_s":198.734375, - "encode_ms":4226.7380000000003, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens, who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Hudson and Colonel Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia and Elon Ramon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight borders the dangers of travel by rock, Anderson and Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Elon Ramon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's well-idealism, all humanity. There are no survivors. In an age when spaceflight borders the dangers of travel by rock, Anderson and Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Elon Ramon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." }, "asr:hp0.wav":{ - "ms":7546.1040000000003, + "ms":80888.437000000005, "audio_s":273.28724999999997, - "encode_ms":6344.4799999999996, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" - }, - "asr:hp0x2.wav":{ - "ms":14542.629000000001, - "audio_s":546.57449999999994, - "encode_ms":12441.449000000001, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips 1890 to 1958 a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realize F. Phillips centering property from automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American screw company. The Phillips uses port bonds of US to devise an American screw. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American screw company. The Phillips uses port bonds of US to devise an American screw. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "sha":"aef0840b8", + "sha":"a63300c2f", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"f32/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep4_nrsplit2 (manifest); q51q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest)", + "tune_sha":"ca9b861fc16d900abcdd0d0cb04e61840e2ad26cc7ead9e89674130d64f99aa3", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo.bin", - "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", - "bytes":1624555275 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -13143,61 +20233,59 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"whisper-cli", - "backend":"metal", + "engine":"llama-mtmd-cli", + "backend":"cpu", "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"../whisper.cpp/build/bin/whisper-cli -m /Users/dasbox/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 10 -bs 1 -bo 1", + "box":"zen2", + "threads":16, + "date":"2026-08-05", + "cmd":"D:\\Work\\llama.cpp-mtmd-ref\\build-cpu\\bin\\Release\\llama-mtmd-cli.exe -m D:\\work\\llama.cpp\\models\\gemma-4-E2B-it-Q8_0.gguf --mmproj D:\\work\\llama.cpp\\models\\mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 16", "hardware":{ - "cpu":"Apple M4 Pro", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":517.59000000000003 + "ms":3046.3000000000002, + "encode_ms":1824.0999999999999 }, "asr:jfk3.wav":{ - "ms":1051.1800000000001 + "ms":8999.7000000000007, + "encode_ms":5353.3999999999996 }, "asr:gb1.wav":{ - "ms":5950.2799999999997 - }, - "asr:hp0.wav":{ - "ms":7059.5999999999995 - }, - "asr:hp0x2.wav":{ - "ms":16086.139999999999 + "ms":57804, + "encode_ms":33322.800000000003 } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@70af97d3", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo-q8_0.bin", - "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", - "bytes":874188075 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -13216,18 +20304,6 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, @@ -13235,68 +20311,61 @@ "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"zen2", - "threads":16, + "box":"zen4", + "threads":8, "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", - "remote_desktop":"off" + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" }, "tests":{ "asr:jfk.wav":{ - "ms":2818.8389999999999, + "ms":2495.232, "audio_s":11, - "encode_ms":2642.922, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":5672.317, + "ms":6937.3069999999998, "audio_s":33, - "encode_ms":5113.393, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" }, "asr:gb1.wav":{ - "ms":23827.450000000001, + "ms":47726.870000000003, "audio_s":198.734375, - "encode_ms":20603.682000000001, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." - }, - "asr:hp0.wav":{ - "ms":35059.360000000001, - "audio_s":273.28724999999997, - "encode_ms":30994.123, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips eighteen ninety to nineteen fifty eight a u s businessman from portland oregon has the honor of having the phillips head screw and screw driver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html" - }, - "asr:hp0x2.wav":{ - "ms":67337.782000000007, - "audio_s":546.57449999999994, - "encode_ms":59630.137999999999, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips eighteen ninety to nineteen fifty eight a u s businessman from portland oregon has the honor of having the phillips head screw and screw driver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Colonel Rick Husband, Captain Michael Anderson, and Admiral Clark. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to dangers, Colonel Rick Husband and Captain Michael Anderson, and Admiral Clark, navigating the fierce atmosphere near the Earth, lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's well-idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to dangers, Colonel Rick Husband and Captain Michael Anderson, and Admiral Clark, navigating the fierce atmosphere near the Earth, lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas." + }, + "asr:hp0.wav":{ + "ms":115335.697, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips and screw, the free encyclopedia named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has" } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "sha":"37a2c1662", + "sha":"7e02c2451", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep2 (manifest); q51q8_gemv_gen=mr8 (manifest)", - "tune_sha":"fe4d9873989abfef6cdca7eba5a000845d781cf3c4bb7e7673db5d83335e4ece", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo.bin", - "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", - "bytes":1624555275 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -13321,62 +20390,56 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"whisper-cli", + "engine":"llama-mtmd-cli", "backend":"cpu", "flavor":"stock", - "box":"zen2", - "threads":16, + "box":"zen4", + "threads":8, "date":"2026-08-04", - "cmd":"D:\\Work\\whisper.cpp\\build\\bin\\Release\\whisper-cli.exe -m D:\\Work\\whisper.cpp\\models\\ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 16 -bs 1 -bo 1 -nf -ng", + "cmd":"/home/boris/llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /home/boris/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /home/boris/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", - "remote_desktop":"off" + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" }, "tests":{ "asr:jfk.wav":{ - "ms":4136.4200000000001 + "ms":2849.0999999999999, + "encode_ms":1745.8 }, "asr:jfk3.wav":{ - "ms":8442.2800000000007 + "ms":8500.3999999999996, + "encode_ms":5230.3000000000002 }, "asr:gb1.wav":{ - "ms":43546.010000000002 - }, - "asr:hp0.wav":{ - "ms":62255.449999999997 - }, - "asr:hp0x2.wav":{ - "ms":136323.72999999998 + "ms":57821.5, + "encode_ms":35343.099999999999 } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo-q8_0.bin", - "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", - "bytes":874188075 + "name":"gemma-4-E2B-it-Q8_0.gguf", + "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", + "bytes":4967497152 + }, + { + "role":"mmproj", + "name":"mmproj-gemma-4-E2B-it-bf16.gguf", + "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", + "bytes":986833664 }, { "role":"clip", @@ -13395,121 +20458,84 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 - } - ] - }, - { - "engine":"onnx", - "backend":"cpu", - "flavor":"stock", - "box":"zen2", - "threads":16, - "date":"2026-07-29", - "cmd":"modules\\dasLLAMA\\benchmarks\\asr\\.venv-onnx\\Scripts\\python.exe modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --threads 16 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", - "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"Parsec Virtual Display Adapter", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"AMD Ryzen™ Balanced", - "smt":"on" - }, - "tests":{ - "asr:jfk.wav":{ - "ms":3272.922, - "audio_s":11 - } - }, - "workload":"asr", - "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "files":[ - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 } ] - }, + } + ], + "arch":"Gemma-4 E2B audio", + "quant":"q8", + "params_b":4.6474501469999998, + "active_b":2.2476226559999999, + "size_bytes":4967497152 + }, + { + "gguf":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "runs":[ { "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"zen4", + "box":"m1", "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m ggml-large-v3-turbo.bin -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "date":"2026-08-05", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":2082.1280000000002, + "ms":2465.7139999999999, "audio_s":11, - "encode_ms":1913.4590000000001, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":4303.0370000000003, + "ms":5084.5069999999996, "audio_s":33, - "encode_ms":3818.3629999999998, - "text":" And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":18019.529999999999, + "ms":51144.660000000003, "audio_s":198.734375, - "encode_ms":15173.722, - "text":" My fellow Americans, this day has brought terrible news and great sadness to our country. At 9 o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kultna Shavla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when spaceflight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens who created all these. He who brings out the starry hosts one by one and calls them each by name. Because of His great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth, yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America. Thank you." + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." }, "asr:hp0.wav":{ - "ms":26161.437000000002, + "ms":71238.297999999995, "audio_s":273.28724999999997, - "encode_ms":22804.490000000002, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U.S. patent number two million forty six thousand three hundred forty three, U.S. patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox, which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." }, "asr:hp0x2.wav":{ - "ms":50451.252, + "ms":181929.913, "audio_s":546.57449999999994, - "encode_ms":43815.328000000001, - "text":" Henry F. Phillips, from Wikipedia, the Free Encyclopedia, at en.wikipedia.org. Henry F. Phillips, from Wikipedia, the Free Encyclopedia. henry f phillips a u s businessman from portland oregon has the honor of having the phillips head screw and screwdriver named after him the importance of the cross-head screw design lies in its self-centering property useful on automated production lines that use powered screw-drivers philip's major contribution was in driving the cross-head concept forward to the point where it was adopted by screw makers and automobile companies Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex, Allen. Robertson. Tri-wing. Torxet. Spannerhead. Triple square, XZN. Others, poly drive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, Available at www.gnu.org slash copyleft slash fdl.html Henry F. Phillips From Wikipedia, the free encyclopedia at en.wikipedia.org Henry F. Phillips, 1890-1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross-head screw design lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross-head concept forward, to the point where it was adopted by screw-makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent No. 2,046,343, U.S. Patents 2,046,837 to 2,046,840, It was so widely copied that by 1949 Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company went on to devise the PosaDrive screw, which differs from the Phillips in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article. Caption, Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly, erroneously, flathead. Phillips, crosshead. Posa drive, super drive. Torx. Hex Allen, Robertson, Tri-Wing, Torxet, Spannerhead, Triple Square, XZN. Others, Poly Drive, Spline Drive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April, 2008, at 1704. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation, Inc., a U.S. registered 501c3 tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org slash copyleft slash fdl.html" + "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "sha":"7e02c2451", + "sha":"a63300c2f", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"fe8408bf2a4c00d535f1d21276651c1cd5b0c32d03a169c9b1237e62882a1946", "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo.bin", - "sha256":"1fc70f774d38eb169993ac391eea357ef47c88757ef72ee5943879b7e8e2bc69", - "bytes":1624555275 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { "role":"clip", @@ -13544,49 +20570,54 @@ ] }, { - "engine":"whisper-cli", + "engine":"llama-mtmd-cli", "backend":"cpu", "flavor":"stock", - "box":"zen4", + "box":"m1", "threads":8, - "date":"2026-08-04", - "cmd":"/home/boris/whisper.cpp/build/bin/whisper-cli -m /home/boris/models/ggml-large-v3-turbo-q8_0.bin -f modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav -t 8 -bs 1 -bo 1 -nf -ng", + "date":"2026-08-05", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":6091.8299999999999 + "ms":21167.299999999999, + "encode_ms":21038.400000000001 }, "asr:jfk3.wav":{ - "ms":12359.26 - }, - "asr:gb1.wav":{ - "ms":63593.879999999997 - }, - "asr:hp0.wav":{ - "ms":91003.410000000003 + "ms":45273.5, + "encode_ms":45227.5 }, - "asr:hp0x2.wav":{ - "ms":225174.07000000001 + "asr:gb1.wav":{ + "ms":248033.60000000001, + "encode_ms":226682.79999999999 } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"whisper.cpp @ 6fc7c33b4", - "exec_fmt":"q8_0", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"ggml-large-v3-turbo-q8_0.bin", - "sha256":"317eb69c11673c9de1e1f0d459b253999804ec71ac4c23c17ecf5fbe24e259a1", - "bytes":874188075 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { "role":"clip", @@ -13605,130 +20636,157 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"onnx", + "engine":"llama-mtmd-cli", "backend":"cpu", "flavor":"stock", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-onnx/bin/python modules/dasLLAMA/benchmarks/asr/onnx_bench.py --variant whisper-turbo-int8 --out modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt --threads 8 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/hp0x2.wav", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/dasbox/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /Users/dasbox/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 10", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":2482.5210000000002, - "audio_s":11 + "ms":52148.199999999997, + "encode_ms":10325.6, + "text":"0.00.006.081 I common_init_result: fitting params to device memory ... 0.00.006.083 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.126.439 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 65536 MiB of total host memory 0.00.193.805 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.28.301.494 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.29.438.686 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.29.442.015 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.29.442.018 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.29.442.018 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.30.579.079 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.30.579.295 I main: loading model: /Users/dasbox/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.30.579.752 W WARN: This is an experimental CLI for testing multimodal capability. 0.30.579.753 W For normal use cases, please use the standard llama-cli 0.31.271.667 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.35.045.002 I mtmd batch encoding done in 3774 ms 0.38.413.576 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.40.229.501 I mtmd batch encoding done in 1816 ms <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|>DASLLAMA_IDS: 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 151645" + }, + "asr:jfk3.wav":{ + "ms":22666.099999999999, + "encode_ms":22637.599999999999, + "text":"0.00.003.046 I common_init_result: fitting params to device memory ... 0.00.003.050 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.114.187 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 65536 MiB of total host memory 0.00.182.295 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.24.000.355 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.25.104.042 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.25.107.342 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.25.107.343 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.25.107.343 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.26.274.570 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.26.274.615 I main: loading model: /Users/dasbox/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.26.274.952 W WARN: This is an experimental CLI for testing multimodal capability. 0.26.274.953 W For normal use cases, please use the standard llama-cli 0.26.971.224 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.30.748.672 I mtmd batch encoding done in 3778 ms 0.34.915.779 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.38.550.932 I mtmd batch encoding done in 3635 ms 0.39.239.596 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.42.870.428 I mtmd batch encoding done in 3630 ms 0.43.424.666 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.47.065.443 I mtmd batch encoding done in 3640 ms 0.47.606.755 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.48.516.125 I mtmd batch encoding done in 909 ms <|im_start|>DASLLAMA_IDS: 151644 151645" + }, + "asr:gb1.wav":{ + "ms":126126.89999999999, + "encode_ms":114091.3, + "text":"0.00.002.865 I common_init_result: fitting params to device memory ... 0.00.002.869 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.113.670 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 65536 MiB of total host memory 0.00.183.698 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.24.473.658 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.25.753.671 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.25.757.169 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.25.757.177 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.25.757.177 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.26.935.401 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.26.935.511 I main: loading model: /Users/dasbox/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.26.936.703 W WARN: This is an experimental CLI for testing multimodal capability. 0.26.936.704 W For normal use cases, please use the standard llama-cli 0.27.710.026 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.31.487.306 I mtmd batch encoding done in 3777 ms 0.35.730.371 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.39.362.802 I mtmd batch encoding done in 3632 ms 0.40.105.090 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.43.742.445 I mtmd batch encoding done in 3638 ms 0.44.317.956 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.47.954.669 I mtmd batch encoding done in 3637 ms 0.48.530.233 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.52.167.000 I mtmd batch encoding done in 3637 ms 0.52.719.184 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.56.355.799 I mtmd batch encoding done in 3637 ms 0.56.924.135 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 1.00.561.088 I mtmd batch encoding done in 3637 ms 1.01.157.429 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 1.04.795.350 I mtmd batch encoding done in 3637 ms 1.05.415.562 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 1.09.060.582 I mtmd batch encoding done in 3645 ms 1.09.686.142 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 1.13.323.508 I mtmd batch encoding done in 3638 ms 1.13.972.472 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 1.17.613.026 I mtmd batch encoding done in 3640 ms 1.18.280.069 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 1.21.918.821 I mtmd batch encoding done in 3639 ms 1.22.610.964 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 1.26.249.966 I mtmd batch encoding done in 3639 ms 1.26.965.825 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 1.30.604.532 I mtmd batch encoding done in 3639 ms 1.31.347.281 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 1.34.990.432 I mtmd batch encoding done in 3644 ms 1.35.756.662 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 1.39.398.134 I mtmd batch encoding done in 3641 ms 1.40.189.121 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 1.43.829.512 I mtmd batch encoding done in 3641 ms 1.44.645.562 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 1.48.286.218 I mtmd batch encoding done in 3640 ms 1.49.130.801 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 1.52.771.903 I mtmd batch encoding done in 3641 ms 1.53.641.690 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 1.57.283.172 I mtmd batch encoding done in 3641 ms 1.58.186.861 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 2.01.829.485 I mtmd batch encoding done in 3643 ms 2.02.754.895 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 2.06.401.271 I mtmd batch encoding done in 3646 ms 2.07.358.280 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 2.11.001.222 I mtmd batch encoding done in 3643 ms 2.11.984.068 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 2.15.626.982 I mtmd batch encoding done in 3643 ms 2.16.637.644 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 2.19.828.123 I mtmd batch encoding done in 3190 ms <|im_start|>: My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America.DASLLAMA_IDS: 151644 25 3017 12357 8877 11 419 1899 702 7117 17478 3669 323 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 23220 7779 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 25 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 26832 848 64 910 672 4260 11 323 7543 276 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 323 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 11 323 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 315 279 8521 315 1493 2953 323 3198 879 614 1012 2661 419 10968 10755 323 37284 13 1446 2299 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 315 419 3146 13 576 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 7797 1039 1879 553 279 19760 315 18335 323 279 78322 311 3535 13 5633 11618 1119 3550 686 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 11 1052 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 11 330 43 2085 697 6414 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 323 6738 1105 1817 553 829 13 9211 315 806 2244 2355 323 41627 8170 11 537 825 315 1105 374 7402 1189 576 1852 35678 879 5036 279 9759 1083 8788 279 5036 315 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 1521 537 470 21000 311 9237 13 14626 582 646 23803 429 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 11 323 1231 4264 3060 311 16072 5159 13 151645" } }, - "workload":"asr", + "workload":"audio-chat", "source":"official", - "versions":"onnx-asr 0.11.0 / onnxruntime 1.27.0", - "exec_fmt":"int8", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", + "exec_fmt":"bf16/q8_0", "files":[ + { + "role":"weights", + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 + }, { "role":"clip", "name":"jfk.wav", "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 } - ] - } - ], - "arch":"Whisper large-v3-turbo", - "size_bytes":1624555275 - }, - { - "gguf":"gemma-4-E2B-it-Q8_0.gguf", - "runs":[ + ], + "comment":"On jfk.wav the reference's decode phase runs away (41.7 s of generation vs 30 ms on jfk3.wav; reproduced 3x with --temp 0 --reasoning off) - the two engines emit different amounts of text there, so that clip's ratio is a behavior difference, not a speed measurement.", + "void_clips":"jfk.wav" + }, { "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-19", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, + "perf_cores":10, + "total_cores":14, "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":1582.3910000000001, + "ms":1394.5360000000001, "audio_s":11, - "encode_ms":336.40899999999999, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "encode_ms":352.30900000000003, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":4290.4769999999999, + "ms":3001.5909999999999, "audio_s":33, - "encode_ms":1134.1030000000001, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" + "encode_ms":1059.4200000000001, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":30730.791000000001, + "ms":31362.771000000001, "audio_s":198.734375, - "encode_ms":5777.875, - "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Husband and Captain Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's will, idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." + "encode_ms":6724.0450000000001, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." }, "asr:hp0.wav":{ - "ms":42024.910000000003, + "ms":43309.881999999998, "audio_s":273.28724999999997, - "encode_ms":8003.4780000000001, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American tool company. The Phillips uses port bonds of US to devise American screw. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American tool company. The Phillips uses port bonds of US to devise American screw. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia." + "encode_ms":8832.0939999999991, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U.S. patent number two million forty six thousand, three hundred forty three, U.S. patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered five hundred one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":114117.28999999999, + "audio_s":546.57449999999994, + "encode_ms":17676.286, + "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." } }, "workload":"audio-chat", "source":"official", - "sha":"1f9c36c8c", + "sha":"965e57877", "version":"0.6.4", - "dasllama_version":5, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"b13fa031bf352e2dbaa6cd45bed2f671c19778e4ad99037958e399f0895115a3", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", "noise":"ok", "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { "role":"clip", @@ -13753,61 +20811,88 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"llama-mtmd-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-19", - "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, + "perf_cores":10, + "total_cores":14, "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":10856.700000000001, - "encode_ms":10250, - "text":"0.00.002.693 I common_init_result: fitting params to device memory ... 0.00.002.698 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.394.588 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.717.140 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.720.088 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.727.508 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.03.555.923 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.03.601.627 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.03.871.589 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.03.871.647 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.03.871.857 W WARN: This is an experimental CLI for testing multimodal capability. 0.03.871.861 W For normal use cases, please use the standard llama-cli 0.03.911.963 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 3) 0.13.320.562 I mtmd batch encoding done in 9408 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" + "ms":1302.0930000000001, + "audio_s":11, + "encode_ms":270.99099999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":32567.700000000001, - "encode_ms":30752.799999999999, - "text":"0.00.002.705 I common_init_result: fitting params to device memory ... 0.00.002.711 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.386.614 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.709.151 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.712.157 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.719.632 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.03.552.780 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.03.598.616 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.03.867.936 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.03.868.007 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.03.868.236 W WARN: This is an experimental CLI for testing multimodal capability. 0.03.868.238 W For normal use cases, please use the standard llama-cli 0.03.917.351 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.29.551.257 I mtmd batch encoding done in 25634 ms 0.31.591.355 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.34.195.849 I mtmd batch encoding done in 2604 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" + "ms":2667.9920000000002, + "audio_s":33, + "encode_ms":773.10199999999998, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":199122.89999999999, - "encode_ms":186566.5, - "text":"0.00.002.711 I common_init_result: fitting params to device memory ... 0.00.002.719 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.392.436 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.722.790 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.725.808 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.733.411 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.03.566.951 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.03.613.063 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.03.883.901 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.03.883.969 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf 0.03.884.208 W WARN: This is an experimental CLI for testing multimodal capability. 0.03.884.209 W For normal use cases, please use the standard llama-cli 0.04.009.695 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 9) 0.29.640.810 I mtmd batch encoding done in 25631 ms 0.31.753.252 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 9) 0.57.359.370 I mtmd batch encoding done in 25606 ms 0.59.593.505 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 9) 1.25.190.660 I mtmd batch encoding done in 25597 ms 1.27.622.943 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 9) 1.53.167.372 I mtmd batch encoding done in 25545 ms 1.55.682.842 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 9) 2.21.252.229 I mtmd batch encoding done in 25570 ms 2.23.966.896 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 9) 2.49.589.272 I mtmd batch encoding done in 25623 ms 2.52.458.579 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 9) 3.08.436.803 I mtmd batch encoding done in 15978 ms My fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As far as we can see, there is comfort and hope in the words of the prophet Isaiah. Lift your eyes and look to the heavens, who created space. He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the Shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America.DASLLAMA_IDS: 4754 12339 14522 236764 672 1719 815 6111 21832 4668 532 1822 55882 531 1023 2891 236761 2640 236743 236819 236787 236771 236771 672 5597 236764 9017 2256 528 21912 5745 3662 607 1023 2557 51320 18693 236761 562 2822 990 3209 236764 37061 691 3472 14773 699 506 55748 2787 9539 236761 669 18693 563 5745 236761 2085 659 951 43732 236761 2154 3905 691 496 13919 529 6819 236787 44221 26839 89702 236764 41523 44221 8972 19864 236764 43224 94816 18093 236764 22359 6822 9833 236764 43224 8966 16376 1209 236764 3587 236761 751 19321 1789 34525 2149 236764 532 98134 121873 236764 496 105721 528 506 33722 5661 15150 236761 3143 1758 532 3607 12718 1822 4652 528 506 2509 531 784 27069 528 614 3911 1056 2557 10224 815 2229 531 4483 4180 15668 236761 1030 563 3735 531 29346 506 39793 529 4301 684 35305 532 506 18502 529 67112 506 48621 11661 529 506 10824 236761 3143 101195 7261 506 39793 532 901 17175 1091 95826 236764 14111 901 1053 496 1494 532 29417 5708 528 1972 236761 8468 529 910 23648 532 63485 532 184291 236764 692 795 4305 1091 784 506 919 236761 2343 14522 3124 659 6972 618 1388 529 506 7965 529 1239 1758 532 3607 1015 735 1010 2238 672 11059 10932 532 32717 236761 1599 236789 500 711 7057 236761 5137 4251 7097 66031 2061 607 611 236761 1452 1724 611 9312 795 2462 735 506 2833 532 36637 529 672 2891 236761 669 4400 528 837 901 8390 795 4102 236761 192411 563 5378 1131 506 29151 6998 1023 1902 684 506 18014 529 17324 532 506 86508 531 3050 236761 5137 9338 1131 2557 795 817 580 236761 799 506 55748 3124 236764 692 5004 21404 532 40578 236761 1773 2793 618 692 740 1460 236764 993 563 5931 532 4614 528 506 4171 529 506 59918 81034 236761 79493 822 6114 532 1385 531 506 80958 236764 1015 4464 2557 236761 1293 1015 12076 855 506 129196 20472 886 684 886 532 9139 1091 1546 684 1463 236761 8468 529 914 1822 2066 532 45478 6332 236764 711 886 529 1091 563 9724 236761 669 1638 33797 1015 5618 506 8197 992 10077 506 5618 529 506 6819 39690 692 92377 3124 236761 669 13919 529 506 114357 18693 1602 711 994 21236 531 10824 236761 16961 692 740 14098 600 784 659 21236 2033 236761 3353 3803 14321 506 112792 7965 532 1149 3803 1149 3803 4102 531 14321 5711 236761 106" + "ms":26210.597000000002, + "audio_s":198.734375, + "encode_ms":5020.3860000000004, + "text":"my fellow americans this day has brought terrible news and great sadness to our country at nine o'clock this morning mission control in houston lost contact with our space shuttle columbia a short time later debris was seen falling from the skies above texas the columbia is lost there are no survivors on board was a crew of seven colonel rick husband lieutenant colonel michael anderson commander laura clark captain david brown commander william mccool doctor kalpana chawla and ilan ramon a colonel in the israeli air force these men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth these astronauts knew the dangers and they faced them willingly knowing they had a high and noble purpose in life because of their courage and daring and idealism we will miss them all the more all americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief you're not alone our entire nation grieves with you and those you loved will always have the respect and gratitude of this country the cause in which they died will continue mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand our journey into space will go on in the skies today we saw destruction and tragedy yet farther than we can see there is comfort and hope in the words of the prophet isaiah lift your eyes and look to the heavens who created all these he who brings out the starry hosts one by one and calls them each by name because of his great power and mighty strength not one of them is missing the same creator who names the stars also knows the names of the seven souls we mourn today the crew of the shuttle columbia did not return safely to earth yet we can pray that all are safely home may god bless the grieving families and may god may god continue to bless america" + }, + "asr:hp0.wav":{ + "ms":40293.927000000003, + "audio_s":273.28724999999997, + "encode_ms":6622.1189999999997, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at www dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":107645.408, + "audio_s":546.57449999999994, + "encode_ms":13228.153, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." } }, "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", - "exec_fmt":"bf16/q8_0", + "sha":"965e57877", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { "role":"clip", @@ -13826,6 +20911,18 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, @@ -13833,209 +20930,160 @@ "engine":"das", "backend":"metal", "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":1947.8267083121839, - "stddev":5.2698860168457031 + "asr:jfk.wav":{ + "ms":400.86399999999998, + "audio_s":11, + "encode_ms":37.389000000000003, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "tg128":{ - "tok_s":96.186670660259409, - "stddev":0.65781205892562866 + "asr:jfk3.wav":{ + "ms":482.91500000000002, + "audio_s":33, + "encode_ms":99.210999999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":6059.6040000000003, + "audio_s":198.734375, + "encode_ms":545.86900000000003, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":8061.1549999999997, + "audio_s":273.28724999999997, + "encode_ms":799.89300000000003, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U.S. patent number two million forty six thousand, three hundred forty three, U.S. patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered five hundred one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at www dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":21517.165000000001, + "audio_s":546.57449999999994, + "encode_ms":1624.9670000000001, + "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips. From Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." } }, + "workload":"audio-chat", "source":"official", - "sha":"cd10a67a4", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":5, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":427.33937716903711, - "stddev":4.3431744575500488 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, - "tg128":{ - "tok_s":43.600298532821839, - "stddev":0.054628435522317886 - } - }, - "source":"official", - "sha":"cd10a67a4", - "version":"0.6.4", - "dasllama_version":5, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "files":[ { - "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":449.92644083960158, - "stddev":3.9499580860137939 + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, - "tg128":{ - "tok_s":43.560661170705991, - "stddev":0.09648982435464859 - } - }, - "source":"official", - "sha":"cd10a67a4", - "version":"0.6.4", - "dasllama_version":5, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"d38809a51e2c5fed3e2d61860680a64e366c6df015d812c9d2ee8c4175da42d7", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "files":[ { - "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"das", + "engine":"llama-mtmd-cli", "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-19", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 6", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":1564.2629999999999, - "audio_s":11, - "encode_ms":325.48200000000003, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "ms":9293.7999999999993, + "encode_ms":9233.1000000000004, + "text":"0.00.002.177 I common_init_result: fitting params to device memory ... 0.00.002.181 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.097.158 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 131072 MiB of total host memory 0.00.155.606 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.17.100.982 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.17.156.791 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.17.158.621 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.17.158.626 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.17.158.626 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.17.500.835 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.17.500.874 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.17.501.015 W WARN: This is an experimental CLI for testing multimodal capability. 0.17.501.016 W For normal use cases, please use the standard llama-cli 0.17.549.415 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.23.001.102 I mtmd batch encoding done in 5451 ms 0.23.556.025 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.26.296.175 I mtmd batch encoding done in 2740 ms <|im_start|> <|im_start|>DASLLAMA_IDS: 151644 198 151644 151645" }, "asr:jfk3.wav":{ - "ms":4241.6620000000003, - "audio_s":33, - "encode_ms":966.19399999999996, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" + "ms":25946.799999999999, + "encode_ms":25924.900000000001, + "text":"0.00.002.127 I common_init_result: fitting params to device memory ... 0.00.002.131 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.095.702 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 131072 MiB of total host memory 0.00.153.114 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.16.720.520 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.16.776.839 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.16.778.590 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.16.778.592 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.16.778.592 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.17.113.261 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.17.113.303 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.17.113.453 W WARN: This is an experimental CLI for testing multimodal capability. 0.17.113.454 W For normal use cases, please use the standard llama-cli 0.17.165.152 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.22.618.341 I mtmd batch encoding done in 5453 ms 0.23.167.627 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.28.606.348 I mtmd batch encoding done in 5439 ms 0.29.185.104 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.34.623.609 I mtmd batch encoding done in 5438 ms 0.35.225.181 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.40.669.638 I mtmd batch encoding done in 5444 ms 0.41.302.978 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.42.678.531 I mtmd batch encoding done in 1375 ms <|im_start|>DASLLAMA_IDS: 151644 151645" }, "asr:gb1.wav":{ - "ms":29630.029999999999, - "audio_s":198.734375, - "encode_ms":6265.634, - "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Husband and Captain Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's will, idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." - }, - "asr:hp0.wav":{ - "ms":38693.896000000001, - "audio_s":273.28724999999997, - "encode_ms":7994.6610000000001, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to Milise F. Phillips Century property, 340 feet on automated production lines, 2 million powered screw drives. Henry F. Phillips, 1890-1958 was an US businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia. Although he received patents for the design. The American screw company. The Phillips uses port bonds of US to devise an American screw. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia." + "ms":158997.20000000001, + "encode_ms":158932.70000000001, + "text":"0.00.001.723 I common_init_result: fitting params to device memory ... 0.00.001.724 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.096.143 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 131072 MiB of total host memory 0.00.153.735 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.16.660.036 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.16.715.344 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.16.717.140 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.16.717.141 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.16.717.141 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.17.048.534 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.17.048.577 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.17.048.727 W WARN: This is an experimental CLI for testing multimodal capability. 0.17.048.728 W For normal use cases, please use the standard llama-cli 0.17.148.391 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.22.604.076 I mtmd batch encoding done in 5455 ms 0.23.153.764 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.28.594.654 I mtmd batch encoding done in 5441 ms 0.29.177.458 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.34.617.346 I mtmd batch encoding done in 5440 ms 0.35.223.830 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.40.666.086 I mtmd batch encoding done in 5442 ms 0.41.303.240 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.46.743.320 I mtmd batch encoding done in 5440 ms 0.47.415.426 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.52.857.297 I mtmd batch encoding done in 5442 ms 0.53.548.516 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.58.979.845 I mtmd batch encoding done in 5431 ms 0.59.705.884 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 1.05.139.481 I mtmd batch encoding done in 5434 ms 1.05.901.851 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 1.11.335.223 I mtmd batch encoding done in 5433 ms 1.12.148.858 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 1.17.588.603 I mtmd batch encoding done in 5440 ms 1.18.419.304 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 1.23.850.356 I mtmd batch encoding done in 5431 ms 1.24.706.847 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 1.30.141.584 I mtmd batch encoding done in 5435 ms 1.31.039.464 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 1.36.473.950 I mtmd batch encoding done in 5434 ms 1.37.409.484 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 1.42.847.070 I mtmd batch encoding done in 5437 ms 1.43.810.380 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 1.49.242.840 I mtmd batch encoding done in 5432 ms 1.50.241.960 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 1.55.675.210 I mtmd batch encoding done in 5433 ms 1.56.712.691 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 2.02.146.630 I mtmd batch encoding done in 5434 ms 2.03.228.709 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 2.08.661.578 I mtmd batch encoding done in 5433 ms 2.09.763.324 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 2.15.199.211 I mtmd batch encoding done in 5435 ms 2.16.321.763 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 2.21.757.439 I mtmd batch encoding done in 5436 ms 2.22.925.363 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 2.28.363.755 I mtmd batch encoding done in 5438 ms 2.29.578.729 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 2.35.031.688 I mtmd batch encoding done in 5453 ms 2.36.277.589 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 2.41.711.800 I mtmd batch encoding done in 5434 ms 2.42.988.648 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 2.48.425.831 I mtmd batch encoding done in 5437 ms 2.49.735.495 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 2.54.478.050 I mtmd batch encoding done in 4742 ms <|im_start|>:DASLLAMA_IDS: 151644 25 151645" } }, "workload":"audio-chat", "source":"official", - "sha":"1f9c36c8c", - "version":"0.6.4", - "dasllama_version":5, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"b13fa031bf352e2dbaa6cd45bed2f671c19778e4ad99037958e399f0895115a3", - "noise":"ok", - "exec_fmt":"q8/q8", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { "role":"clip", @@ -14054,544 +21102,713 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 } ] }, { - "engine":"llama.cpp", + "engine":"llama-mtmd-cli", "backend":"metal", "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-metal/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 99 -t 6", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":1747.974324, - "stddev":3.6447440000000002 + "asr:jfk.wav":{ + "ms":532.79999999999995, + "encode_ms":203.09999999999999, + "text":"0.00.023.416 I common_init_result: fitting params to device memory ... 0.00.023.419 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.189.423 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.366.540 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.402.075 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.404.030 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.01.404.031 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.01.404.031 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.01.814.542 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.814.583 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.01.814.741 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.814.741 W For normal use cases, please use the standard llama-cli 0.01.822.379 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.01.859.240 I mtmd batch encoding done in 37 ms 0.01.861.717 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.01.945.770 I mtmd batch encoding done in 84 ms <|im_start|>assistant And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.DASLLAMA_IDS: 151644 77091 198 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 151645" }, - "tg128":{ - "tok_s":85.985833999999997, - "stddev":0.70113499999999995 + "asr:jfk3.wav":{ + "ms":562.20000000000005, + "encode_ms":492.19999999999999, + "text":"0.00.023.330 I common_init_result: fitting params to device memory ... 0.00.023.333 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.188.759 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.363.376 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.398.905 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.400.755 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.01.400.756 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.01.400.757 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.01.815.385 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.815.427 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.01.815.581 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.815.582 W For normal use cases, please use the standard llama-cli 0.01.829.394 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.01.868.398 I mtmd batch encoding done in 39 ms 0.01.870.696 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.01.956.515 I mtmd batch encoding done in 86 ms 0.01.957.678 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.02.044.762 I mtmd batch encoding done in 87 ms 0.02.046.807 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.02.134.009 I mtmd batch encoding done in 87 ms 0.02.135.080 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.02.219.079 I mtmd batch encoding done in 84 ms <|im_start|>DASLLAMA_IDS: 151644 151645" + }, + "asr:gb1.wav":{ + "ms":7062.1000000000004, + "encode_ms":2526.5, + "text":"0.00.023.552 I common_init_result: fitting params to device memory ... 0.00.023.556 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.192.660 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.369.737 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.405.481 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.407.439 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.01.407.441 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.01.407.441 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.01.828.249 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.828.290 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.01.828.459 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.828.460 W For normal use cases, please use the standard llama-cli 0.01.889.989 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.01.926.777 I mtmd batch encoding done in 37 ms 0.01.929.288 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.02.016.035 I mtmd batch encoding done in 86 ms 0.02.017.127 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.02.104.522 I mtmd batch encoding done in 88 ms 0.02.106.547 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.02.194.890 I mtmd batch encoding done in 88 ms 0.02.196.139 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.02.285.852 I mtmd batch encoding done in 90 ms 0.02.287.926 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.02.373.318 I mtmd batch encoding done in 86 ms 0.02.374.405 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.02.460.619 I mtmd batch encoding done in 86 ms 0.02.461.672 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 0.02.555.146 I mtmd batch encoding done in 93 ms 0.02.557.189 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 0.02.650.980 I mtmd batch encoding done in 94 ms 0.02.652.020 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 0.02.745.074 I mtmd batch encoding done in 93 ms 0.02.747.060 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 0.02.842.578 I mtmd batch encoding done in 96 ms 0.02.843.609 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 0.02.938.422 I mtmd batch encoding done in 95 ms 0.02.939.457 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 0.03.035.982 I mtmd batch encoding done in 96 ms 0.03.037.942 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 0.03.135.943 I mtmd batch encoding done in 98 ms 0.03.136.994 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 0.03.233.392 I mtmd batch encoding done in 97 ms 0.03.235.495 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 0.03.334.089 I mtmd batch encoding done in 98 ms 0.03.335.152 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 0.03.434.043 I mtmd batch encoding done in 99 ms 0.03.435.088 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 0.03.534.640 I mtmd batch encoding done in 100 ms 0.03.536.636 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 0.03.637.634 I mtmd batch encoding done in 101 ms 0.03.638.672 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 0.03.738.590 I mtmd batch encoding done in 100 ms 0.03.740.567 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 0.03.843.096 I mtmd batch encoding done in 102 ms 0.03.844.166 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 0.03.946.995 I mtmd batch encoding done in 103 ms 0.03.948.073 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 0.04.052.665 I mtmd batch encoding done in 105 ms 0.04.054.709 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 0.04.160.863 I mtmd batch encoding done in 106 ms 0.04.162.003 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 0.04.267.833 I mtmd batch encoding done in 106 ms <|im_start|>: My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America.DASLLAMA_IDS: 151644 25 3017 12357 8877 11 419 1899 702 7117 17478 3669 323 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 23220 7779 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 25 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 26832 848 64 910 672 4260 11 323 7543 276 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 323 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 11 323 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 315 279 8521 315 1493 2953 323 3198 879 614 1012 2661 419 10968 10755 323 37284 13 1446 2299 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 315 419 3146 13 576 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 7797 1039 1879 553 279 19760 315 18335 323 279 78322 311 3535 13 5633 11618 1119 3550 686 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 11 1052 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 11 330 43 2085 697 6414 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 323 6738 1105 1817 553 829 13 9211 315 806 2244 2355 323 41627 8170 11 537 825 315 1105 374 7402 1189 576 1852 35678 879 5036 279 9759 1083 8788 279 5036 315 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 1521 537 470 21000 311 9237 13 14626 582 646 23803 429 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 11 323 1231 4264 3060 311 16072 5159 13 151645" } }, + "workload":"audio-chat", "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - } - ] - }, - { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"clean-cpu", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":242.20238800000001, - "stddev":2.2900200000000002 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, - "tg128":{ - "tok_s":39.158079000000001, - "stddev":0.313556 - } - }, - "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats; cpu runtime layout repack", - "files":[ { - "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - } - ] - }, - { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-20", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":392.22936299999998, - "stddev":9.6444489999999998 + "role":"mmproj", + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, - "tg128":{ - "tok_s":39.050325000000001, - "stddev":0.38299499999999997 - } - }, - "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats; cpu runtime layout repack", - "files":[ { - "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 } ] }, { "engine":"das", - "backend":"metal", + "backend":"cpu", "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-21", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":91.099999999999994 + "asr:jfk.wav":{ + "ms":1613.298, + "audio_s":11, + "encode_ms":539.08199999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "img:pp":{ - "tok_s":1399.6177966785992 + "asr:jfk3.wav":{ + "ms":3867.069, + "audio_s":33, + "encode_ms":1454.5329999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "img:tg":{ - "tok_s":92.822356573988699, - "text":": This is an image of two tabby cats lying on a pink surface." + "asr:gb1.wav":{ + "ms":39523.110000000001, + "audio_s":198.734375, + "encode_ms":8382.3619999999992, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":57844.894999999997, + "audio_s":273.28724999999997, + "encode_ms":11260.309999999999, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U.S. patent number two million forty six thousand, three hundred forty three, U.S. patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered five hundred one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":154362.98499999999, + "audio_s":546.57449999999994, + "encode_ms":22696.587, + "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." } }, - "workload":"image-chat", + "workload":"audio-chat", "source":"official", - "sha":"b59eae7ec", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":7, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", - "env":"DASLLAMA_BOX=m1", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-21", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":420.45400000000001 + "asr:jfk.wav":{ + "ms":1482.549, + "audio_s":11, + "encode_ms":373.14299999999997, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "img:pp":{ - "tok_s":408.11307871611814 + "asr:jfk3.wav":{ + "ms":3284.0320000000002, + "audio_s":33, + "encode_ms":948.82799999999997, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "img:tg":{ - "tok_s":42.84392244678785, - "text":": This is an image of two tabby cats lying on a pink surface." + "asr:gb1.wav":{ + "ms":34666.864999999998, + "audio_s":198.734375, + "encode_ms":5720.2619999999997, + "text":"my fellow americans this day has brought terrible news and great sadness to our country at nine o'clock this morning mission control in houston lost contact with our space shuttle columbia a short time later debris was seen falling from the skies above texas the columbia is lost there are no survivors on board was a crew of seven colonel rick husband lieutenant colonel michael anderson commander laura clark captain david brown commander william mccool doctor kalpana chawla and ilan ramon a colonel in the israeli air force these men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth these astronauts knew the dangers and they faced them willingly knowing they had a high and noble purpose in life because of their courage and daring and idealism we will miss them all the more all americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief you're not alone our entire nation grieves with you and those you loved will always have the respect and gratitude of this country the cause in which they died will continue mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand our journey into space will go on in the skies today we saw destruction and tragedy yet farther than we can see there is comfort and hope in the words of the prophet isaiah lift your eyes and look to the heavens who created all these he who brings out the starry hosts one by one and calls them each by name because of his great power and mighty strength not one of them is missing the same creator who names the stars also knows the names of the seven souls we mourn today the crew of the shuttle columbia did not return safely to earth yet we can pray that all are safely home may god bless the grieving families and may god may god continue to bless america" + }, + "asr:hp0.wav":{ + "ms":53760.669999999998, + "audio_s":273.28724999999997, + "encode_ms":7769.3149999999996, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at www dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":146966.53700000001, + "audio_s":546.57449999999994, + "encode_ms":15417.325000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." } }, - "workload":"image-chat", + "workload":"audio-chat", "source":"official", - "sha":"b59eae7ec", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":7, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-21", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "flavor":"tuned", + "box":"zen2", + "threads":16, + "date":"2026-08-05", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":498.50599999999997 + "asr:jfk.wav":{ + "ms":4167.3230000000003, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "img:pp":{ - "tok_s":425.93158883403959 + "asr:jfk3.wav":{ + "ms":6978.0540000000001, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "img:tg":{ - "tok_s":43.098122933085854, - "text":": This is an image of two tabby cats lying on a pink surface." + "asr:gb1.wav":{ + "ms":69751.832999999999, + "audio_s":198.734375, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":95647.919999999998, + "audio_s":273.28724999999997, + "text":"Henry F Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips. From Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":250960.19500000001, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips. From Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." } }, - "workload":"image-chat", + "workload":"audio-chat", "source":"official", - "sha":"b59eae7ec", + "sha":"a63300c2f", "version":"0.6.4", - "dasllama_version":7, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"c4661c5868f569c025287c3caf3c6ff5aeb4fe984f378ecb131c1e29a1571a91", - "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1", + "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep4_nrsplit2 (manifest); q51q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest)", + "tune_sha":"ca9b861fc16d900abcdd0d0cb04e61840e2ad26cc7ead9e89674130d64f99aa3", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"llama.cpp", - "backend":"metal", + "engine":"llama-mtmd-cli", + "backend":"cpu", "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-21", - "cmd":"/Users/borisbatkin/Work/llama.cpp/build/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 99", + "box":"zen2", + "threads":16, + "date":"2026-08-05", + "cmd":"D:\\Work\\llama.cpp-mtmd-ref\\build-cpu\\bin\\Release\\llama-mtmd-cli.exe -m D:\\work\\llama.cpp\\models\\Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj D:\\work\\llama.cpp\\models\\mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 16", "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", + "arch":"AMD64", + "os":"Microsoft Windows [Version 10.0.26200.8875]", + "total_cores":128, + "ram_gb":256, + "gpu":"NVIDIA GeForce RTX 5060 Ti", + "ram_config":"8×32 GB @ 2666 MT/s", + "power_plan":"High performance", + "smt":"on", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":116 + "asr:jfk.wav":{ + "ms":299664.79999999999, + "encode_ms":6603.3999999999996 }, - "img:pp":{ - "tok_s":1109.5603628750871 + "asr:jfk3.wav":{ + "ms":11336.799999999999, + "encode_ms":11258.299999999999 }, - "img:tg":{ - "tok_s":73.988439306358387 + "asr:gb1.wav":{ + "ms":84854.5, + "encode_ms":47120.5 } }, - "workload":"image-chat", + "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ 98c4764b6 + mtmd-timing.patch@8026b1bd", - "exec_fmt":"native gguf formats", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@70af97d3", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 } - ] + ], + "comment":"Same jfk.wav decode runaway as on the M4 box (the reference generates at length on that clip despite --temp 0 --reasoning off), amplified by CPU-only decode - a behavior difference, not a speed measurement.", + "void_clips":"jfk.wav" }, { - "engine":"llama.cpp", + "engine":"das", "backend":"cpu", - "flavor":"clean-cpu", - "box":"m1", + "flavor":"tuned", + "box":"zen4", "threads":8, - "date":"2026-08-21", - "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 0 --no-mmproj-offload", + "date":"2026-08-04", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" }, "tests":{ - "img:enc":{ - "ms":19931 + "asr:jfk.wav":{ + "ms":3615, + "audio_s":11, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "img:pp":{ - "tok_s":304.94821634062055 + "asr:jfk3.wav":{ + "ms":7012.3609999999999, + "audio_s":33, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, - "img:tg":{ - "tok_s":38.512456372608014 + "asr:gb1.wav":{ + "ms":65548.563999999998, + "audio_s":198.734375, + "text":"my fellow americans this day has brought terrible news and great sadness to our country at nine o'clock this morning mission control in houston lost contact with our space shuttle columbia a short time later debris was seen falling from the skies above texas the columbia is lost there are no survivors on board was a crew of seven colonel rick husband lieutenant colonel michael anderson commander laura clark captain david brown commander william mccool doctor kalpana chawla and ilan ramon a colonel in the israeli air force these men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth these astronauts knew the dangers and they faced them willingly knowing they had a high and noble purpose in life because of their courage and daring and idealism we will miss them all the more all americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief you're not alone our entire nation grieves with you and those you loved will always have the respect and gratitude of this country the cause in which they died will continue mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand our journey into space will go on in the skies today we saw destruction and tragedy yet farther than we can see there is comfort and hope in the words of the prophet isaiah lift your eyes and look to the heavens who created all these he who brings out the starry hosts one by one and calls them each by name because of his great power and mighty strength not one of them is missing the same creator who names the stars also knows the names of the seven souls we mourn today the crew of the shuttle columbia did not return safely to earth yet we can pray that all are safely home may god bless the grieving families and may god may god continue to bless america" + }, + "asr:hp0.wav":{ + "ms":93800.944000000003, + "audio_s":273.28724999999997, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of april two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at www dot g n u dot org slash copyleft slash f d l dot h t m l." + }, + "asr:hp0x2.wav":{ + "ms":261113.886, + "audio_s":546.57449999999994, + "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips. From Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." } }, - "workload":"image-chat", + "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"7e02c2451", + "version":"0.6.4", + "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", + "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"llama.cpp", + "engine":"llama-mtmd-cli", "backend":"cpu", "flavor":"stock", - "box":"m1", + "box":"zen4", "threads":8, - "date":"2026-08-21", - "cmd":"/Users/borisbatkin/Work/llama.cpp/build/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 8 -ngl 0 --no-mmproj-offload --no-op-offload", + "date":"2026-08-04", + "cmd":"/home/boris/llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /home/boris/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /home/boris/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" + "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", + "arch":"x86_64", + "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", + "total_cores":16, + "ram_gb":62, + "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", + "smt":"on" }, "tests":{ - "img:enc":{ - "ms":19956 + "asr:jfk.wav":{ + "ms":266305.20000000001, + "encode_ms":3067.0999999999999 }, - "img:pp":{ - "tok_s":305.94573792572595 + "asr:jfk3.wav":{ + "ms":8061, + "encode_ms":7997.1000000000004 }, - "img:tg":{ - "tok_s":37.995725480883401 + "asr:gb1.wav":{ + "ms":90574.300000000003, + "encode_ms":54331.300000000003 } }, - "workload":"image-chat", + "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ 98c4764b6 + mtmd-timing.patch@8026b1bd", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", + "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", + "bytes":32484494336 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", + "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", + "bytes":2207465568 }, { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 } - ] - }, - { - "engine":"llama-mtmd-cli", - "backend":"cpu", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/dasbox/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/dasbox/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 10", + ], + "comment":"Same jfk.wav decode runaway as on the M4 and zen2 boxes (the reference generates at length on that clip despite --temp 0 --reasoning off; 266 s vs 8 s on jfk3.wav) - a behavior difference, not a speed measurement.", + "void_clips":"jfk.wav" + } + ], + "arch":"Qwen3-Omni-30B audio", + "size_bytes":32484494336 + }, + { + "gguf":"Qwen3-ASR-0.6B-Q8_0.gguf", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":5153.1000000000004, - "encode_ms":4825.3000000000002, - "text":"0.00.006.549 I common_init_result: fitting params to device memory ... 0.00.006.562 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.292.537 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.513.812 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.515.758 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.520.895 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.332.051 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.371.743 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.713.910 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.713.976 I main: loading model: /Users/dasbox/models/gemma-4-E2B-it-Q8_0.gguf 0.01.714.152 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.714.153 W For normal use cases, please use the standard llama-cli 0.01.737.423 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 3) 0.06.058.930 I mtmd batch encoding done in 4321 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country.DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 236761 106" + "ms":885.29100000000005, + "audio_s":11, + "encode_ms":575.37900000000002, + "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":15541, - "encode_ms":14556.4, - "text":"0.00.001.838 I common_init_result: fitting params to device memory ... 0.00.001.839 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.271.968 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.495.767 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.497.700 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.502.787 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.316.045 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.350.878 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.542.285 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.542.339 I main: loading model: /Users/dasbox/models/gemma-4-E2B-it-Q8_0.gguf 0.01.542.529 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.542.530 W For normal use cases, please use the standard llama-cli 0.01.571.226 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.13.319.088 I mtmd batch encoding done in 11747 ms 0.14.665.869 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.15.847.125 I mtmd batch encoding done in 1182 ms And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country DASLLAMA_IDS: 3133 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 532 834 1041 12339 14522 2679 711 1144 822 2891 740 776 573 611 2679 1144 611 740 776 573 822 2891 107 106" + "ms":2641.8670000000002, + "audio_s":33, + "encode_ms":1595.1120000000001, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":97757.399999999994, - "encode_ms":90936.199999999997, - "text":"0.00.001.869 I common_init_result: fitting params to device memory ... 0.00.001.873 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.269.263 I common_params_fit_impl: projected to use 4889 MiB of host memory vs. 65536 MiB of total host memory 0.00.491.684 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.493.625 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.498.744 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.01.308.828 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.343.416 I mtmd_cli_context: chat template example: <|turn>system You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model 0.01.536.749 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.536.804 I main: loading model: /Users/dasbox/models/gemma-4-E2B-it-Q8_0.gguf 0.01.536.998 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.536.999 W For normal use cases, please use the standard llama-cli 0.01.617.874 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 9) 0.13.373.535 I mtmd batch encoding done in 11756 ms 0.14.768.194 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 9) 0.26.490.731 I mtmd batch encoding done in 11723 ms 0.28.113.466 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 9) 0.39.832.294 I mtmd batch encoding done in 11719 ms 0.41.652.906 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 9) 0.53.367.265 I mtmd batch encoding done in 11714 ms 0.55.388.132 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 9) 1.07.103.504 I mtmd batch encoding done in 11716 ms 1.09.327.791 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 9) 1.21.048.908 I mtmd batch encoding done in 11721 ms 1.23.460.015 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 9) 1.30.790.898 I mtmd batch encoding done in 7331 ms My fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kulpna Shawla, and Elaine Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine. It is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce atmosphere of the Earth. These astronauts knew the dangers and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. As far as we can see, there is comfort and hope in the words of the prophet Isaiah. Lift your eyes and look to the heavens, who created space. He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing. The same creator who names the stars also knows the names of the seven souls we mourn today. The crew of the Shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families and may God may God continue to bless America.DASLLAMA_IDS: 4754 12339 14522 236764 672 1719 815 6111 21832 4668 532 1822 55882 531 1023 2891 236761 2640 236743 236819 236787 236771 236771 672 5597 236764 23865 9463 528 21912 5745 3662 607 1023 2557 51320 18693 236761 562 2822 990 3209 236764 37061 691 3472 14773 699 506 55748 2787 9539 236761 669 18693 563 5745 236761 2085 659 951 43732 236761 2154 3905 691 496 13919 529 6819 236787 44221 26839 89702 236764 41523 44221 8972 19864 236764 43224 94816 18093 236764 22359 6822 9833 236764 43224 8966 16376 1209 236764 3587 236761 751 19321 1789 34525 2149 236764 532 98134 121873 236764 496 105721 528 506 33722 5661 15150 236761 3143 1758 532 3607 12718 1822 4652 528 506 2509 531 784 27069 528 614 3911 1056 2557 10224 815 2229 531 4483 4180 15668 236761 1030 563 3735 531 29346 506 39793 529 4301 684 35305 532 506 18502 529 67112 506 48621 11661 529 506 10824 236761 3143 101195 7261 506 39793 532 901 17175 1091 95826 236764 14111 901 1053 496 1494 532 29417 5708 528 1972 236761 8468 529 910 23648 532 63485 532 184291 236764 692 795 4305 1091 784 506 919 236761 2343 14522 3124 659 6972 618 1388 529 506 7965 529 1239 1758 532 3607 1015 735 1010 2238 672 11059 10932 532 32717 236761 1599 236789 500 711 7057 236761 5137 4251 7097 66031 2061 607 611 236761 1452 1724 611 9312 795 2462 735 506 2833 532 36637 529 672 2891 236761 669 4400 528 837 901 8390 795 4102 236761 192411 563 5378 1131 506 29151 6998 1023 1902 684 506 18014 529 17324 532 506 86508 531 3050 236761 5137 9338 1131 2557 795 817 580 236761 799 506 55748 3124 236764 692 5004 21404 532 40578 236761 1773 2793 618 692 740 1460 236764 993 563 5931 532 4614 528 506 4171 529 506 59918 81034 236761 79493 822 6114 532 1385 531 506 80958 236764 1015 4464 2557 236761 1293 1015 12076 855 506 129196 20472 886 684 886 532 9139 1091 1546 684 1463 236761 8468 529 914 1822 2066 532 45478 6332 236764 711 886 529 1091 563 9724 236761 669 1638 33797 1015 5618 506 8197 992 10077 506 5618 529 506 6819 39690 692 92377 3124 236761 669 13919 529 506 114357 18693 1602 711 994 21236 531 10824 236761 16961 692 740 14098 600 784 659 21236 2033 236761 3353 3803 14321 506 112792 7965 532 1149 3803 1149 3803 4102 531 14321 5711 236761 106" + "ms":18886.09, + "audio_s":198.734375, + "encode_ms":9391.3150000000005, + "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":27029.031999999999, + "audio_s":273.28724999999997, + "encode_ms":12883.653, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design, lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward, to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption: Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spannerhead. Triple Square, XZN. Others, Polydrive, Splinedrive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." + }, + "asr:hp0x2.wav":{ + "ms":69347.548999999999, + "audio_s":546.57449999999994, + "encode_ms":25359.042000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" } }, "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", - "exec_fmt":"bf16/q8_0", + "sha":"ef6af462c", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "noise":"ok", + "exec_fmt":"q8/q8", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 }, { "role":"clip", @@ -14610,76 +21827,93 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":988.92499999999995, + "ms":677.21500000000003, "audio_s":11, - "encode_ms":258.96100000000001, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "encode_ms":337.31700000000001, + "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":2786.3339999999998, + "ms":1968.5630000000001, "audio_s":33, - "encode_ms":776.02599999999995, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" + "encode_ms":958.61000000000001, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":20875.822, + "ms":15084.93, "audio_s":198.734375, - "encode_ms":4922.6779999999999, - "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Husband and Captain Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's will, idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." + "encode_ms":5629.7910000000002, + "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." }, "asr:hp0.wav":{ - "ms":30017.942999999999, + "ms":21843.557000000001, "audio_s":273.28724999999997, - "encode_ms":6666.1120000000001, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American tool company. The Phillips uses port bonds of US to devise American screw. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American tool company. The Phillips uses port bonds of US to devise American screw. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia." + "encode_ms":7723.1890000000003, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape, in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flat head. Phillips cross head. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." + }, + "asr:hp0x2.wav":{ + "ms":59070.235000000001, + "audio_s":546.57449999999994, + "encode_ms":15581.647999999999, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" } }, "workload":"audio-chat", "source":"official", - "sha":"aef0840b8", + "sha":"ef6af462c", "version":"0.6.4", "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", "noise":"ok", "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 }, { "role":"clip", @@ -14704,76 +21938,161 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"das", + "engine":"llama-mtmd-cli", "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-ASR-0.6B-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M1 Max", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, + "perf_cores":8, + "total_cores":10, "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":977.48500000000001, - "audio_s":11, - "encode_ms":257.70699999999999, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + "ms":3631, + "encode_ms":3411.3000000000002, + "text":"0.00.002.825 I common_init_result: fitting params to device memory ... 0.00.002.829 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.150.924 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 65536 MiB of total host memory 0.00.246.414 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.381.457 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.530.702 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.627.863 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.627.916 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.01.628.151 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.628.153 W For normal use cases, please use the standard llama-cli 0.01.640.082 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.03.838.627 I mtmd batch encoding done in 2198 ms 0.03.908.815 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.04.981.565 I mtmd batch encoding done in 1072 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 26 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:jfk3.wav":{ + "ms":10218.799999999999, + "encode_ms":9566.5, + "text":"0.00.002.778 I common_init_result: fitting params to device memory ... 0.00.002.783 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.151.295 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 65536 MiB of total host memory 0.00.246.618 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.382.534 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.531.144 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.628.678 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.628.728 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.01.628.986 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.628.987 W For normal use cases, please use the standard llama-cli 0.01.650.672 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.03.855.027 I mtmd batch encoding done in 2205 ms 0.03.924.504 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.06.066.919 I mtmd batch encoding done in 2143 ms 0.06.141.993 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.08.302.970 I mtmd batch encoding done in 2161 ms 0.08.382.558 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.10.518.900 I mtmd batch encoding done in 2137 ms 0.10.604.874 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.11.139.481 I mtmd batch encoding done in 534 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:gb1.wav":{ + "ms":65002.400000000001, + "encode_ms":57179.699999999997, + "text":"0.00.002.778 I common_init_result: fitting params to device memory ... 0.00.002.784 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.150.965 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 65536 MiB of total host memory 0.00.246.505 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.376.286 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.519.070 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.616.380 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.616.431 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.01.616.663 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.616.664 W For normal use cases, please use the standard llama-cli 0.01.715.326 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.03.920.249 I mtmd batch encoding done in 2205 ms 0.03.989.480 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.06.129.445 I mtmd batch encoding done in 2140 ms 0.06.204.261 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.08.345.157 I mtmd batch encoding done in 2141 ms 0.08.456.484 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.10.594.888 I mtmd batch encoding done in 2138 ms 0.10.680.754 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.12.820.107 I mtmd batch encoding done in 2140 ms 0.12.912.022 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.15.064.588 I mtmd batch encoding done in 2152 ms 0.15.161.516 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.17.296.728 I mtmd batch encoding done in 2135 ms 0.17.400.463 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 0.19.552.829 I mtmd batch encoding done in 2152 ms 0.19.662.924 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 0.21.798.724 I mtmd batch encoding done in 2135 ms 0.21.912.233 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 0.24.073.586 I mtmd batch encoding done in 2161 ms 0.24.195.406 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 0.26.331.711 I mtmd batch encoding done in 2136 ms 0.26.456.647 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 0.28.608.969 I mtmd batch encoding done in 2153 ms 0.28.739.760 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 0.30.878.410 I mtmd batch encoding done in 2139 ms 0.31.019.269 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 0.33.155.206 I mtmd batch encoding done in 2136 ms 0.33.333.160 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 0.35.492.949 I mtmd batch encoding done in 2160 ms 0.35.642.193 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 0.37.776.954 I mtmd batch encoding done in 2135 ms 0.37.932.145 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 0.40.084.322 I mtmd batch encoding done in 2152 ms 0.40.244.192 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 0.42.380.933 I mtmd batch encoding done in 2137 ms 0.42.548.164 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 0.44.702.428 I mtmd batch encoding done in 2154 ms 0.44.872.938 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 0.47.007.286 I mtmd batch encoding done in 2134 ms 0.47.184.267 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 0.49.339.683 I mtmd batch encoding done in 2155 ms 0.49.523.933 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 0.51.659.114 I mtmd batch encoding done in 2135 ms 0.51.847.637 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 0.54.001.165 I mtmd batch encoding done in 2154 ms 0.54.196.215 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 0.56.332.282 I mtmd batch encoding done in 2136 ms 0.56.533.995 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 0.58.415.840 I mtmd batch encoding done in 1881 ms language EnglishMy fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America.DASLLAMA_IDS: 11528 6364 151704 5050 12357 8877 13 1096 1899 702 7117 17478 3669 13 758 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 8954 2524 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 13 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 730 12840 2210 1417 402 4260 11 323 68539 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 13 1597 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 13 1597 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 13 4940 279 8521 315 1493 2953 323 3198 11 879 614 1012 2661 419 10968 10755 304 37284 13 1446 525 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 13 4940 419 3146 11 279 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 13 30786 1039 1879 11 553 279 19760 315 18335 13 1597 279 78322 311 3535 13 5633 11618 1119 3550 686 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 11 1052 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 13 52435 697 6414 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 13 1597 6738 1105 1817 553 829 13 9211 315 806 2244 2355 13 1597 41627 8170 11 537 825 315 1105 374 7402 13 576 1852 19919 879 5036 279 9759 13 7281 8788 279 5036 13 4940 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 13 14568 537 470 21000 311 9237 13 14626 582 646 23803 13 2938 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 13 1597 1231 4264 3060 311 16072 5159 13 151645" + } + }, + "workload":"audio-chat", + "source":"official", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", + "exec_fmt":"bf16/q8_0", + "files":[ + { + "role":"weights", + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":103.706, + "audio_s":11, + "encode_ms":21.617000000000001, + "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." }, "asr:jfk3.wav":{ - "ms":2761.2869999999998, + "ms":277.91500000000002, "audio_s":33, - "encode_ms":774.31500000000005, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" + "encode_ms":58.143999999999998, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":20219.628000000001, + "ms":1931.6890000000001, "audio_s":198.734375, - "encode_ms":4938.6130000000003, - "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Husband and Captain Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's will, idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to the dangers of travel by rock, Anderson and great sadness to Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." + "encode_ms":322.76400000000001, + "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." }, "asr:hp0.wav":{ - "ms":28237.998, + "ms":2680.482, "audio_s":273.28724999999997, - "encode_ms":6562.1819999999998, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to Milise F. Phillips Century property, 340 feet on automated production lines, 2 million powered screw drives. Henry F. Phillips, 1890-1958 was an US businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia. Although he received patents for the design. The American screw company. The Phillips uses port bonds of US to devise an American screw. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the honor of naming the free encyclopedia." + "encode_ms":448.30500000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape, in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flat head. Phillips cross head. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." + }, + "asr:hp0x2.wav":{ + "ms":7193.04, + "audio_s":546.57449999999994, + "encode_ms":903.39599999999996, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" } }, "workload":"audio-chat", "source":"official", - "sha":"aef0840b8", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 }, { "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 }, { "role":"clip", @@ -14798,17 +22117,23 @@ "name":"hp0.wav", "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"das", - "backend":"metal", - "flavor":"tuned", + "engine":"llama-mtmd-cli", + "backend":"cpu", + "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-ASR-0.6B-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 6", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -14821,41 +22146,67 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":8692.8377108443274, - "stddev":42.567550659179688 + "asr:jfk.wav":{ + "ms":2587, + "encode_ms":2445, + "text":"0.00.001.879 I common_init_result: fitting params to device memory ... 0.00.001.884 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.096.648 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 131072 MiB of total host memory 0.00.154.379 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.765.049 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.825.981 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.886.461 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.886.493 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.886.666 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.886.666 W For normal use cases, please use the standard llama-cli 0.00.894.447 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.02.439.657 I mtmd batch encoding done in 1545 ms 0.02.514.107 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.03.278.507 I mtmd batch encoding done in 764 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 26 2548 1128 498 646 653 369 697 3146 13 151645" }, - "tg128":{ - "tok_s":161.72247100178595, - "stddev":0.25893470644950867 + "asr:jfk3.wav":{ + "ms":7309.5, + "encode_ms":6876.6999999999998, + "text":"0.00.001.848 I common_init_result: fitting params to device memory ... 0.00.001.849 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.093.653 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 131072 MiB of total host memory 0.00.151.034 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.762.322 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.827.655 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.888.689 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.888.723 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.888.886 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.888.886 W For normal use cases, please use the standard llama-cli 0.00.902.961 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.02.443.465 I mtmd batch encoding done in 1540 ms 0.02.517.845 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.04.025.592 I mtmd batch encoding done in 1507 ms 0.04.107.871 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.05.611.727 I mtmd batch encoding done in 1504 ms 0.05.704.032 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.07.223.052 I mtmd batch encoding done in 1519 ms 0.07.327.381 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.07.717.362 I mtmd batch encoding done in 390 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:gb1.wav":{ + "ms":47657.300000000003, + "encode_ms":42413, + "text":"0.00.001.816 I common_init_result: fitting params to device memory ... 0.00.001.820 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.092.344 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 131072 MiB of total host memory 0.00.149.539 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.761.449 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.823.042 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.884.462 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.884.496 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.884.653 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.884.653 W For normal use cases, please use the standard llama-cli 0.00.947.453 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.02.480.295 I mtmd batch encoding done in 1533 ms 0.02.553.903 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.04.080.836 I mtmd batch encoding done in 1527 ms 0.04.163.446 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.05.661.742 I mtmd batch encoding done in 1498 ms 0.05.753.829 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.07.281.957 I mtmd batch encoding done in 1529 ms 0.07.384.792 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.08.894.594 I mtmd batch encoding done in 1510 ms 0.09.008.415 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.10.507.266 I mtmd batch encoding done in 1499 ms 0.10.631.156 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.12.139.037 I mtmd batch encoding done in 1508 ms 0.12.272.766 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 0.13.776.787 I mtmd batch encoding done in 1504 ms 0.13.921.887 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 0.15.439.596 I mtmd batch encoding done in 1517 ms 0.15.594.882 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 0.17.102.069 I mtmd batch encoding done in 1507 ms 0.17.268.265 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 0.18.789.043 I mtmd batch encoding done in 1521 ms 0.18.963.225 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 0.20.458.679 I mtmd batch encoding done in 1495 ms 0.20.645.307 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 0.22.146.825 I mtmd batch encoding done in 1501 ms 0.22.344.075 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 0.23.841.183 I mtmd batch encoding done in 1497 ms 0.24.048.602 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 0.25.551.303 I mtmd batch encoding done in 1503 ms 0.25.767.808 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 0.27.265.663 I mtmd batch encoding done in 1498 ms 0.27.495.709 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 0.29.010.461 I mtmd batch encoding done in 1515 ms 0.29.249.238 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 0.30.748.033 I mtmd batch encoding done in 1499 ms 0.30.994.484 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 0.32.488.521 I mtmd batch encoding done in 1494 ms 0.32.745.138 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 0.34.241.663 I mtmd batch encoding done in 1496 ms 0.34.509.005 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 0.36.002.545 I mtmd batch encoding done in 1493 ms 0.36.282.905 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 0.37.777.469 I mtmd batch encoding done in 1494 ms 0.38.065.473 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 0.39.575.437 I mtmd batch encoding done in 1510 ms 0.39.874.617 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 0.41.369.725 I mtmd batch encoding done in 1495 ms 0.41.683.351 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 0.42.984.927 I mtmd batch encoding done in 1302 ms language EnglishMy fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country. The cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space. Will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see. There is comfort and hope. In the words of the prophet Isaiah. Lift your eyes, and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength. Not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless. America.DASLLAMA_IDS: 11528 6364 151704 5050 12357 8877 13 1096 1899 702 7117 17478 3669 13 758 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 8954 2524 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 13 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 730 12840 2210 1417 402 4260 11 323 68539 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 13 1597 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 13 1597 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 13 4940 279 8521 315 1493 2953 323 3198 11 879 614 1012 2661 419 10968 10755 304 37284 13 1446 525 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 13 4940 419 3146 13 576 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 13 30786 1039 1879 11 553 279 19760 315 18335 13 1597 279 78322 311 3535 13 5633 11618 1119 3550 13 4841 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 13 2619 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 13 52435 697 6414 11 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 13 1597 6738 1105 1817 553 829 13 9211 315 806 2244 2355 13 1597 41627 8170 13 2806 825 315 1105 374 7402 13 576 1852 19919 879 5036 279 9759 13 7281 8788 279 5036 13 4940 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 13 14568 537 470 21000 311 9237 13 14626 582 646 23803 13 2938 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 13 1597 1231 4264 3060 311 16072 13 5159 13 151645" } }, + "workload":"audio-chat", "source":"official", - "sha":"667d4c1d5", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 } ] }, { - "engine":"llama.cpp", + "engine":"llama-mtmd-cli", "backend":"metal", "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-metal/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-ASR-0.6B-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 99 -t 6", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -14868,24 +22219,56 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":7527.4361060000001, - "stddev":28.764002000000001 + "asr:jfk.wav":{ + "ms":133.30000000000001, + "encode_ms":47.100000000000001, + "text":"0.00.024.750 I common_init_result: fitting params to device memory ... 0.00.024.752 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.174.596 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.519.198 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.552.269 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.629.520 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.629.554 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.629.694 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.629.695 W For normal use cases, please use the standard llama-cli 0.00.634.390 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.00.655.170 I mtmd batch encoding done in 21 ms 0.00.656.249 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.00.667.229 I mtmd batch encoding done in 11 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 26 2548 1128 498 646 653 369 697 3146 13 151645" }, - "tg128":{ - "tok_s":136.59289799999999, - "stddev":0.146476 + "asr:jfk3.wav":{ + "ms":317.60000000000002, + "encode_ms":90.5, + "text":"0.00.026.445 I common_init_result: fitting params to device memory ... 0.00.026.448 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.183.820 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.529.422 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.562.622 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.639.804 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.639.839 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.639.993 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.639.994 W For normal use cases, please use the standard llama-cli 0.00.650.904 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.00.670.751 I mtmd batch encoding done in 19 ms 0.00.671.826 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.00.684.069 I mtmd batch encoding done in 13 ms 0.00.684.537 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.00.696.933 I mtmd batch encoding done in 13 ms 0.00.697.754 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.00.710.165 I mtmd batch encoding done in 13 ms 0.00.710.621 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.00.721.676 I mtmd batch encoding done in 11 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 151645" + }, + "asr:gb1.wav":{ + "ms":1836.5999999999999, + "encode_ms":462.60000000000002, + "text":"0.00.029.473 I common_init_result: fitting params to device memory ... 0.00.029.476 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.186.406 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.00.538.135 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.00.573.222 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.00.651.963 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.00.651.996 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.00.652.147 W WARN: This is an experimental CLI for testing multimodal capability. 0.00.652.148 W For normal use cases, please use the standard llama-cli 0.00.710.376 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.00.731.108 I mtmd batch encoding done in 21 ms 0.00.732.192 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.00.744.410 I mtmd batch encoding done in 12 ms 0.00.744.889 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.00.757.285 I mtmd batch encoding done in 12 ms 0.00.758.146 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.00.770.597 I mtmd batch encoding done in 12 ms 0.00.771.062 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.00.783.860 I mtmd batch encoding done in 13 ms 0.00.784.686 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.00.797.741 I mtmd batch encoding done in 13 ms 0.00.798.198 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.00.811.519 I mtmd batch encoding done in 13 ms 0.00.811.955 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 0.00.825.534 I mtmd batch encoding done in 13 ms 0.00.826.394 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 0.00.840.189 I mtmd batch encoding done in 14 ms 0.00.840.638 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 0.00.854.710 I mtmd batch encoding done in 14 ms 0.00.855.523 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 0.00.869.852 I mtmd batch encoding done in 15 ms 0.00.870.295 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 0.00.884.880 I mtmd batch encoding done in 15 ms 0.00.885.324 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 0.00.900.128 I mtmd batch encoding done in 15 ms 0.00.900.960 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 0.00.916.007 I mtmd batch encoding done in 15 ms 0.00.916.455 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 0.00.931.701 I mtmd batch encoding done in 15 ms 0.00.932.511 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 0.00.948.087 I mtmd batch encoding done in 16 ms 0.00.948.560 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 0.00.964.344 I mtmd batch encoding done in 16 ms 0.00.964.872 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 0.00.981.056 I mtmd batch encoding done in 16 ms 0.00.981.948 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 0.00.998.417 I mtmd batch encoding done in 16 ms 0.00.998.865 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 0.01.015.499 I mtmd batch encoding done in 16 ms 0.01.016.336 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 0.01.033.276 I mtmd batch encoding done in 17 ms 0.01.033.745 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 0.01.050.891 I mtmd batch encoding done in 17 ms 0.01.051.339 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 0.01.068.707 I mtmd batch encoding done in 17 ms 0.01.069.537 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 0.01.087.246 I mtmd batch encoding done in 18 ms 0.01.087.728 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 0.01.105.350 I mtmd batch encoding done in 18 ms language EnglishMy fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes, and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America.DASLLAMA_IDS: 11528 6364 151704 5050 12357 8877 13 1096 1899 702 7117 17478 3669 13 758 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 8954 2524 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 13 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 730 12840 2210 1417 402 4260 11 323 68539 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 13 1597 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 13 1597 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 13 4940 279 8521 315 1493 2953 323 3198 11 879 614 1012 2661 419 10968 10755 304 37284 13 1446 525 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 13 4940 419 3146 11 279 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 13 30786 1039 1879 11 553 279 19760 315 18335 13 1597 279 78322 311 3535 13 5633 11618 1119 3550 686 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 11 1052 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 13 52435 697 6414 11 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 13 1597 6738 1105 1817 553 829 13 9211 315 806 2244 2355 13 1597 41627 8170 11 537 825 315 1105 374 7402 13 576 1852 19919 879 5036 279 9759 13 7281 8788 279 5036 13 4940 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 13 14568 537 470 21000 311 9237 13 14626 582 646 23803 13 2938 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 13 1597 1231 4264 3060 311 16072 5159 13 151645" } }, + "workload":"audio-chat", "source":"official", - "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"bf16/q8_0", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 } ] }, @@ -14895,8 +22278,8 @@ "flavor":"tuned", "box":"m5", "threads":6, - "date":"2026-08-26", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -14909,129 +22292,100 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":417.2733831806496, - "stddev":6.4843430519104004 + "asr:jfk.wav":{ + "ms":606.52999999999997, + "audio_s":11, + "encode_ms":411.565, + "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." }, - "tg128":{ - "tok_s":103.24245394031865, - "stddev":0.75111651420593262 + "asr:jfk3.wav":{ + "ms":1735.617, + "audio_s":33, + "encode_ms":1084.2539999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":13149.772000000001, + "audio_s":198.734375, + "encode_ms":6590.6130000000003, + "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":20105.417000000001, + "audio_s":273.28724999999997, + "encode_ms":9199.9110000000001, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design, lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward, to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption: Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spannerhead. Triple Square, XZN. Others, Polydrive, Splinedrive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." + }, + "asr:hp0x2.wav":{ + "ms":52954.673000000003, + "audio_s":546.57449999999994, + "encode_ms":18164.330000000002, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" } }, + "workload":"audio-chat", "source":"official", - "sha":"5e59c0bf1", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"7137eccccd43974aec7a294f4a6153c34fd9c6401e9b6e4f2ba98d797e450a2f", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - } - ] - }, - { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"clean-cpu", - "box":"m5", - "threads":6, - "date":"2026-08-25", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-3737e41/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M5 Max", - "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":281.13087400000001, - "stddev":1.903705 + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 }, - "tg128":{ - "tok_s":74.544515000000004, - "stddev":0.40743000000000001 - } - }, - "source":"official", - "sha":"3737e4137", - "exec_fmt":"native gguf formats; cpu runtime layout repack", - "files":[ { - "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"accel", - "box":"m5", - "threads":6, - "date":"2026-08-26", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", - "hardware":{ - "cpu":"Apple M5 Max", - "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":442.17742567543337, - "stddev":6.7096719741821289 + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 }, - "tg128":{ - "tok_s":102.38307420903708, - "stddev":0.39548566937446594 - } - }, - "source":"official", - "sha":"5e59c0bf1", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"7137eccccd43974aec7a294f4a6153c34fd9c6401e9b6e4f2ba98d797e450a2f", - "noise":"ok", - "parity":"ok", - "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "files":[ { - "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] }, { - "engine":"llama.cpp", + "engine":"das", "backend":"cpu", - "flavor":"stock", + "flavor":"accel", "box":"m5", "threads":6, - "date":"2026-08-26", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-3737e41/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -15044,768 +22398,591 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":403.17842100000001, - "stddev":8.1003729999999994 + "asr:jfk.wav":{ + "ms":434.44900000000001, + "audio_s":11, + "encode_ms":279.5, + "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." }, - "tg128":{ - "tok_s":73.163036000000005, - "stddev":1.1093090000000001 + "asr:jfk3.wav":{ + "ms":1288.857, + "audio_s":33, + "encode_ms":649.18299999999999, + "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":10537.040000000001, + "audio_s":198.734375, + "encode_ms":3951.0230000000001, + "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." + }, + "asr:hp0.wav":{ + "ms":16368.851000000001, + "audio_s":273.28724999999997, + "encode_ms":5735.5129999999999, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape, in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flat head. Phillips cross head. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." + }, + "asr:hp0x2.wav":{ + "ms":46298.241999999998, + "audio_s":546.57449999999994, + "encode_ms":11072.567999999999, + "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" } }, + "workload":"audio-chat", "source":"official", - "sha":"3737e4137", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 + "name":"Qwen3-ASR-0.6B-Q8_0.gguf", + "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", + "bytes":804749248 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", + "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", + "bytes":378575520 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + }, + { + "role":"clip", + "name":"hp0.wav", + "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", + "bytes":8745270 + }, + { + "role":"clip", + "name":"hp0x2.wav", + "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", + "bytes":17490462 } ] - }, + } + ], + "arch":"Qwen3-ASR-0.6B", + "size_bytes":804749248 + }, + { + "gguf":"Qwen3.8-27B-Q4_K_M.gguf", + "runs":[ { "engine":"das", "backend":"metal", "flavor":"tuned", - "box":"m5", - "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", "hardware":{ - "cpu":"Apple M5 Max", + "cpu":"Apple M1 Max", "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":37.079999999999998 - }, - "img:pp":{ - "tok_s":3542.7974473690188 + "pp512":{ + "tok_s":146.98464403666389, + "stddev":1.6775456666946411 }, - "img:tg":{ - "tok_s":155.15743307542721, - "text":": This is an image of two tabby cats lying on a pink surface." + "tg128":{ + "tok_s":14.454928980896796, + "stddev":0.0026774206198751926 } }, - "workload":"image-chat", "source":"official", - "sha":"667d4c1d5", + "sha":"aef0840b8", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"c1cd9c5035ca7d81e7f3bbe95a576c22a3601303bfa3c04e04f46d8052bb29d7", "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m5", - "threads":6, - "date":"2026-08-26", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M5 Max", + "cpu":"Apple M1 Max", "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":365.37099999999998 - }, - "img:pp":{ - "tok_s":429.05942473032513 + "pp512":{ + "tok_s":137.56638100000001, + "stddev":0.058006000000000002 }, - "img:tg":{ - "tok_s":98.923710034821141, - "text":": This is an image of two tabby cats lying on a pink surface." + "tg128":{ + "tok_s":11.520108, + "stddev":0.030023000000000001 } }, - "workload":"image-chat", "source":"official", - "sha":"5e59c0bf1", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"7137eccccd43974aec7a294f4a6153c34fd9c6401e9b6e4f2ba98d797e450a2f", - "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "sha":"ebd048f", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"llama.cpp", + "engine":"das", "backend":"cpu", - "flavor":"clean-cpu", - "box":"m5", - "threads":6, - "date":"2026-08-26", - "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ - "cpu":"Apple M5 Max", + "cpu":"Apple M1 Max", "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":13554 - }, - "img:pp":{ - "tok_s":368.65290980755918 + "pp512":{ + "tok_s":33.239019966861669, + "stddev":0.17517077922821045 }, - "img:tg":{ - "tok_s":63.757720661486353 + "tg128":{ + "tok_s":5.8207341408622959, + "stddev":0.0236338060349226 } }, - "workload":"image-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"c1cd9c5035ca7d81e7f3bbe95a576c22a3601303bfa3c04e04f46d8052bb29d7", + "noise":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"accel", - "box":"m5", - "threads":6, - "date":"2026-08-26", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-4-E2B-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-4-E2B-it-bf16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "flavor":"clean-cpu", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M5 Max", + "cpu":"Apple M1 Max", "arch":"arm64", - "os":"macOS 26.6", - "perf_cores":6, - "total_cores":18, - "ram_gb":128, - "gpu":"Apple M5 Max (40-core)", - "model_id":"Mac17,6", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "img:enc":{ - "ms":397.846 - }, - "img:pp":{ - "tok_s":409.8349888740309 + "pp512":{ + "tok_s":29.773734000000001, + "stddev":0.138298 }, - "img:tg":{ - "tok_s":98.09114629313558, - "text":": This is an image of two tabby cats lying on a pink surface." + "tg128":{ + "tok_s":5.563599, + "stddev":0.023219 } }, - "workload":"image-chat", "source":"official", - "sha":"5e59c0bf1", - "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"7137eccccd43974aec7a294f4a6153c34fd9c6401e9b6e4f2ba98d797e450a2f", - "noise":"ok", - "parity":"ok", - "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 - }, - { - "role":"image", - "name":"coco-val2017-000000039769.jpg", - "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", - "bytes":173131 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-05", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "flavor":"accel", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":2861.5819999999999, - "audio_s":11, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":7597.442, - "audio_s":33, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" - }, - "asr:gb1.wav":{ - "ms":57372.133000000002, - "audio_s":198.734375, - "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Fellow Americans, Colonel Rick Hudson and Colonel Michael Anderson and Admiral Clark at 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia and Elon Ramon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight borders the dangers of travel by rock, Anderson and Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Elon Ramon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's well-idealism, all humanity. There are no survivors. In an age when spaceflight borders the dangers of travel by rock, Anderson and Admiral Clark navigating the fierce atmosphere near 9:00 this morning, mission control lost contact with our space shuttle Columbia and Elon Ramon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. The words of all humanity are right." + "pp512":{ + "tok_s":33.375229600569654, + "stddev":0.14754222333431244 }, - "asr:hp0.wav":{ - "ms":80888.437000000005, - "audio_s":273.28724999999997, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips hand screw the free encyclopedia, named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realize F. Phillips centering property from automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American screw company. The Phillips uses port bonds of US to devise an American screw. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia. Although he received patents for the design. The American screw company. The Phillips uses port bonds of US to devise an American screw. Henry F. Phillips, 1890-1958 was a driving the crosshead screw businessman to the Portland, Oregon. It was so adominately has the name of the free encyclopedia." + "tg128":{ + "tok_s":5.8126415881974207, + "stddev":0.03507552295923233 } }, - "workload":"audio-chat", "source":"official", - "sha":"a63300c2f", + "sha":"aef0840b8", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep4_nrsplit2 (manifest); q51q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest)", - "tune_sha":"ca9b861fc16d900abcdd0d0cb04e61840e2ad26cc7ead9e89674130d64f99aa3", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", + "tune_sha":"c1cd9c5035ca7d81e7f3bbe95a576c22a3601303bfa3c04e04f46d8052bb29d7", + "noise":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"llama-mtmd-cli", + "engine":"llama.cpp", "backend":"cpu", "flavor":"stock", - "box":"zen2", - "threads":16, - "date":"2026-08-05", - "cmd":"D:\\Work\\llama.cpp-mtmd-ref\\build-cpu\\bin\\Release\\llama-mtmd-cli.exe -m D:\\work\\llama.cpp\\models\\gemma-4-E2B-it-Q8_0.gguf --mmproj D:\\work\\llama.cpp\\models\\mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 16", + "box":"m1", + "threads":8, + "date":"2026-08-17", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":3046.3000000000002, - "encode_ms":1824.0999999999999 - }, - "asr:jfk3.wav":{ - "ms":8999.7000000000007, - "encode_ms":5353.3999999999996 + "pp512":{ + "tok_s":29.789940999999999, + "stddev":0.099495 }, - "asr:gb1.wav":{ - "ms":57804, - "encode_ms":33322.800000000003 + "tg128":{ + "tok_s":5.5914400000000004, + "stddev":0.030686999999999999 } }, - "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@70af97d3", - "exec_fmt":"bf16/q8_0", + "sha":"ebd048f", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { - "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { "engine":"das", - "backend":"cpu", + "backend":"metal", "flavor":"tuned", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m gemma-4-E2B-it-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":2495.232, - "audio_s":11, - "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":6937.3069999999998, - "audio_s":33, - "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow Americans ask not what your country can do for you ask what you can do for your country and so my fellow American country" - }, - "asr:gb1.wav":{ - "ms":47726.870000000003, - "audio_s":198.734375, - "text":"Fellow Americans, this day has brought terrible news and great sadness to our country. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia's lost. There are no survivors. On board was the crew of seven. Colonel Rick Husband, Captain Michael Anderson, and Admiral Clark. At 9:00 this morning, mission control in Houston lost contact with our space shuttle Columbia. And Ilan Romon. A short time later, debris was seen falling from the skies above Texas. These men and women assumed great risk. The Columbia's lost to all humanity. There are no survivors. In an age when spaceflight bore witness to dangers, Colonel Rick Husband and Captain Michael Anderson, and Admiral Clark, navigating the fierce atmosphere near the Earth, lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas. This kind of women assumed great risk for the Columbia's well-idealism, all humanity. There are no survivors. In an age when spaceflight bore witness to dangers, Colonel Rick Husband and Captain Michael Anderson, and Admiral Clark, navigating the fierce atmosphere near the Earth, lost contact with our space shuttle Columbia and Ilan Romon, knowing they had a short time and noble purpose. Debris was seen falling from the skies above Texas." + "pp512":{ + "tok_s":127.02672073494846, + "stddev":0.93355661630630493 }, - "asr:hp0.wav":{ - "ms":115335.697, - "audio_s":273.28724999999997, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia at en.wikipedia.org. Henry F. Phillips, 1890 to 1958, a US businessman from Portland, Oregon. Henry F. has the honor of having the Phillips and screw, the free encyclopedia named after him. The importance of the crosshead screw design lies in Henry F. Phillips centering property from which of automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has the name of the free encyclopedia. Although he received patents for the design in 1930, the importance of the crosshead screw design to realizing Phillips centering property on automated production lines that use powered screw drives. Henry F. Phillips, 1890-1958 was a driving the Portland, Oregon US businessman to the Portland, Oregon. It was so adonic as has" + "tg128":{ + "tok_s":12.790665997073447, + "stddev":0.030512120574712753 } }, - "workload":"audio-chat", "source":"official", - "sha":"7e02c2451", + "sha":"aef0840b8", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", - "exec_fmt":"f32/q8", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"llama-mtmd-cli", - "backend":"cpu", + "engine":"llama.cpp", + "backend":"metal", "flavor":"stock", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /home/boris/models/gemma-4-E2B-it-Q8_0.gguf --mmproj /home/boris/models/mmproj-gemma-4-E2B-it-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":2849.0999999999999, - "encode_ms":1745.8 - }, - "asr:jfk3.wav":{ - "ms":8500.3999999999996, - "encode_ms":5230.3000000000002 + "pp512":{ + "tok_s":126.183144, + "stddev":0.030702 }, - "asr:gb1.wav":{ - "ms":57821.5, - "encode_ms":35343.099999999999 + "tg128":{ + "tok_s":11.468781, + "stddev":0.046730000000000001 } }, - "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", - "exec_fmt":"bf16/q8_0", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"gemma-4-E2B-it-Q8_0.gguf", - "sha256":"996d08777aadc6bfd3c7375ef70ba25a0f55240075860754fdb18d6d860aa63a", - "bytes":4967497152 - }, - { - "role":"mmproj", - "name":"mmproj-gemma-4-E2B-it-bf16.gguf", - "sha256":"711e1e8f43fa0664adbac493129be1e6c25b81af4b4cdea97c7d798b25c0a3a4", - "bytes":986833664 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] - } - ], - "arch":"Gemma-4 E2B audio", - "quant":"q8", - "params_b":4.6474501469999998, - "active_b":2.2476226559999999, - "size_bytes":4967497152 - }, - { - "gguf":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "runs":[ + }, { "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-05", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, + "perf_cores":10, + "total_cores":14, "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":45.757711153225522, + "stddev":0.27520489692687988 + }, + "tg128":{ + "tok_s":11.579745382700445, + "stddev":0.018587170168757439 + } + }, + "source":"official", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"cpu", + "flavor":"clean-cpu", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":2465.7139999999999, - "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":5084.5069999999996, - "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":51144.660000000003, - "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." - }, - "asr:hp0.wav":{ - "ms":71238.297999999995, - "audio_s":273.28724999999997, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U.S. patent number two million forty six thousand three hundred forty three, U.S. patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox, which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + "pp512":{ + "tok_s":40.134383, + "stddev":1.4757629999999999 }, - "asr:hp0x2.wav":{ - "ms":181929.913, - "audio_s":546.57449999999994, - "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + "tg128":{ + "tok_s":10.896379, + "stddev":0.048517999999999999 } }, - "workload":"audio-chat", "source":"official", - "sha":"a63300c2f", - "version":"0.6.4", - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=kstep2 (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"fe8408bf2a4c00d535f1d21276651c1cd5b0c32d03a169c9b1237e62882a1946", - "exec_fmt":"q8/q8", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 - }, - { - "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"llama-mtmd-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-05", - "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-18", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M4 Pro", "arch":"arm64", "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, + "perf_cores":10, + "total_cores":14, "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":21167.299999999999, - "encode_ms":21038.400000000001 - }, - "asr:jfk3.wav":{ - "ms":45273.5, - "encode_ms":45227.5 + "pp512":{ + "tok_s":46.646229924123567, + "stddev":0.37202411890029907 }, - "asr:gb1.wav":{ - "ms":248033.60000000001, - "encode_ms":226682.79999999999 + "tg128":{ + "tok_s":11.586199873885437, + "stddev":0.027674870565533638 } }, - "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", - "exec_fmt":"bf16/q8_0", + "sha":"aef0840b8", + "version":"0.6.4", + "dasllama_version":4, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "noise":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", "files":[ { "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 - }, - { - "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"llama-mtmd-cli", + "engine":"llama.cpp", "backend":"cpu", "flavor":"stock", "box":"m4", "threads":10, "date":"2026-08-18", - "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/dasbox/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /Users/dasbox/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 10", + "cmd":"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", "hardware":{ "cpu":"Apple M4 Pro", "arch":"arm64", @@ -15818,510 +22995,433 @@ "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":52148.199999999997, - "encode_ms":10325.6, - "text":"0.00.006.081 I common_init_result: fitting params to device memory ... 0.00.006.083 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.126.439 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 65536 MiB of total host memory 0.00.193.805 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.28.301.494 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.29.438.686 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.29.442.015 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.29.442.018 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.29.442.018 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.30.579.079 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.30.579.295 I main: loading model: /Users/dasbox/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.30.579.752 W WARN: This is an experimental CLI for testing multimodal capability. 0.30.579.753 W For normal use cases, please use the standard llama-cli 0.31.271.667 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.35.045.002 I mtmd batch encoding done in 3774 ms 0.38.413.576 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.40.229.501 I mtmd batch encoding done in 1816 ms <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|> <|im_start|>DASLLAMA_IDS: 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 198 151644 151645" + "pp512":{ + "tok_s":40.402389999999997, + "stddev":1.4450940000000001 }, - "asr:jfk3.wav":{ - "ms":22666.099999999999, - "encode_ms":22637.599999999999, - "text":"0.00.003.046 I common_init_result: fitting params to device memory ... 0.00.003.050 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.114.187 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 65536 MiB of total host memory 0.00.182.295 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.24.000.355 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.25.104.042 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.25.107.342 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.25.107.343 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.25.107.343 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.26.274.570 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.26.274.615 I main: loading model: /Users/dasbox/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.26.274.952 W WARN: This is an experimental CLI for testing multimodal capability. 0.26.274.953 W For normal use cases, please use the standard llama-cli 0.26.971.224 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.30.748.672 I mtmd batch encoding done in 3778 ms 0.34.915.779 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.38.550.932 I mtmd batch encoding done in 3635 ms 0.39.239.596 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.42.870.428 I mtmd batch encoding done in 3630 ms 0.43.424.666 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.47.065.443 I mtmd batch encoding done in 3640 ms 0.47.606.755 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.48.516.125 I mtmd batch encoding done in 909 ms <|im_start|>DASLLAMA_IDS: 151644 151645" + "tg128":{ + "tok_s":10.952062, + "stddev":0.022928 + } + }, + "source":"official", + "sha":"ebd048fc5", + "exec_fmt":"native gguf formats; cpu runtime layout repack", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":913.87787110893373, + "stddev":10.144181251525879 }, - "asr:gb1.wav":{ - "ms":126126.89999999999, - "encode_ms":114091.3, - "text":"0.00.002.865 I common_init_result: fitting params to device memory ... 0.00.002.869 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.113.670 I common_params_fit_impl: projected to use 7118 MiB of host memory vs. 65536 MiB of total host memory 0.00.183.698 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.24.473.658 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.25.753.671 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.25.757.169 W load_hparams: Qwen-VL models require at minimum 1024 image tokens to function correctly on grounding tasks 0.25.757.177 W load_hparams: if you encounter problems with accuracy, try adding --image-min-tokens 1024 0.25.757.177 W load_hparams: more info: https://github.com/ggml-org/llama.cpp/issues/16842 0.26.935.401 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.26.935.511 I main: loading model: /Users/dasbox/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf 0.26.936.703 W WARN: This is an experimental CLI for testing multimodal capability. 0.26.936.704 W For normal use cases, please use the standard llama-cli 0.27.710.026 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.31.487.306 I mtmd batch encoding done in 3777 ms 0.35.730.371 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.39.362.802 I mtmd batch encoding done in 3632 ms 0.40.105.090 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.43.742.445 I mtmd batch encoding done in 3638 ms 0.44.317.956 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.47.954.669 I mtmd batch encoding done in 3637 ms 0.48.530.233 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.52.167.000 I mtmd batch encoding done in 3637 ms 0.52.719.184 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.56.355.799 I mtmd batch encoding done in 3637 ms 0.56.924.135 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 1.00.561.088 I mtmd batch encoding done in 3637 ms 1.01.157.429 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 1.04.795.350 I mtmd batch encoding done in 3637 ms 1.05.415.562 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 1.09.060.582 I mtmd batch encoding done in 3645 ms 1.09.686.142 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 1.13.323.508 I mtmd batch encoding done in 3638 ms 1.13.972.472 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 1.17.613.026 I mtmd batch encoding done in 3640 ms 1.18.280.069 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 1.21.918.821 I mtmd batch encoding done in 3639 ms 1.22.610.964 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 1.26.249.966 I mtmd batch encoding done in 3639 ms 1.26.965.825 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 1.30.604.532 I mtmd batch encoding done in 3639 ms 1.31.347.281 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 1.34.990.432 I mtmd batch encoding done in 3644 ms 1.35.756.662 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 1.39.398.134 I mtmd batch encoding done in 3641 ms 1.40.189.121 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 1.43.829.512 I mtmd batch encoding done in 3641 ms 1.44.645.562 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 1.48.286.218 I mtmd batch encoding done in 3640 ms 1.49.130.801 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 1.52.771.903 I mtmd batch encoding done in 3641 ms 1.53.641.690 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 1.57.283.172 I mtmd batch encoding done in 3641 ms 1.58.186.861 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 2.01.829.485 I mtmd batch encoding done in 3643 ms 2.02.754.895 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 2.06.401.271 I mtmd batch encoding done in 3646 ms 2.07.358.280 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 2.11.001.222 I mtmd batch encoding done in 3643 ms 2.11.984.068 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 2.15.626.982 I mtmd batch encoding done in 3643 ms 2.16.637.644 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 2.19.828.123 I mtmd batch encoding done in 3190 ms <|im_start|>: My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America.DASLLAMA_IDS: 151644 25 3017 12357 8877 11 419 1899 702 7117 17478 3669 323 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 23220 7779 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 25 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 26832 848 64 910 672 4260 11 323 7543 276 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 323 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 11 323 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 315 279 8521 315 1493 2953 323 3198 879 614 1012 2661 419 10968 10755 323 37284 13 1446 2299 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 315 419 3146 13 576 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 7797 1039 1879 553 279 19760 315 18335 323 279 78322 311 3535 13 5633 11618 1119 3550 686 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 11 1052 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 11 330 43 2085 697 6414 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 323 6738 1105 1817 553 829 13 9211 315 806 2244 2355 323 41627 8170 11 537 825 315 1105 374 7402 1189 576 1852 35678 879 5036 279 9759 1083 8788 279 5036 315 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 1521 537 470 21000 311 9237 13 14626 582 646 23803 429 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 11 323 1231 4264 3060 311 16072 5159 13 151645" + "tg128":{ + "tok_s":27.837882924443051, + "stddev":0.22432254254817963 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", + "files":[ + { + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"llama.cpp", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":752.12047700000005, + "stddev":0.68127599999999999 + }, + "tg128":{ + "tok_s":25.360036000000001, + "stddev":0.56916199999999995 } }, - "workload":"audio-chat", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", - "exec_fmt":"bf16/q8_0", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 - }, - { - "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } - ], - "comment":"On jfk.wav the reference's decode phase runs away (41.7 s of generation vs 30 ms on jfk3.wav; reproduced 3x with --temp 0 --reasoning off) - the two engines emit different amounts of text there, so that clip's ratio is a behavior difference, not a speed measurement.", - "void_clips":"jfk.wav" + ] }, { "engine":"das", "backend":"cpu", "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":1394.5360000000001, - "audio_s":11, - "encode_ms":352.30900000000003, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":3001.5909999999999, - "audio_s":33, - "encode_ms":1059.4200000000001, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":31362.771000000001, - "audio_s":198.734375, - "encode_ms":6724.0450000000001, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." - }, - "asr:hp0.wav":{ - "ms":43309.881999999998, - "audio_s":273.28724999999997, - "encode_ms":8832.0939999999991, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U.S. patent number two million forty six thousand, three hundred forty three, U.S. patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered five hundred one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + "pp512":{ + "tok_s":30.874932436495232, + "stddev":0.091422267258167267 }, - "asr:hp0x2.wav":{ - "ms":114117.28999999999, - "audio_s":546.57449999999994, - "encode_ms":17676.286, - "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + "tg128":{ + "tok_s":11.594469009746922, + "stddev":0.10863354057073593 } }, - "workload":"audio-chat", "source":"official", - "sha":"965e57877", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 - }, - { - "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":1302.0930000000001, - "audio_s":11, - "encode_ms":270.99099999999999, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":2667.9920000000002, - "audio_s":33, - "encode_ms":773.10199999999998, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":26210.597000000002, - "audio_s":198.734375, - "encode_ms":5020.3860000000004, - "text":"my fellow americans this day has brought terrible news and great sadness to our country at nine o'clock this morning mission control in houston lost contact with our space shuttle columbia a short time later debris was seen falling from the skies above texas the columbia is lost there are no survivors on board was a crew of seven colonel rick husband lieutenant colonel michael anderson commander laura clark captain david brown commander william mccool doctor kalpana chawla and ilan ramon a colonel in the israeli air force these men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth these astronauts knew the dangers and they faced them willingly knowing they had a high and noble purpose in life because of their courage and daring and idealism we will miss them all the more all americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief you're not alone our entire nation grieves with you and those you loved will always have the respect and gratitude of this country the cause in which they died will continue mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand our journey into space will go on in the skies today we saw destruction and tragedy yet farther than we can see there is comfort and hope in the words of the prophet isaiah lift your eyes and look to the heavens who created all these he who brings out the starry hosts one by one and calls them each by name because of his great power and mighty strength not one of them is missing the same creator who names the stars also knows the names of the seven souls we mourn today the crew of the shuttle columbia did not return safely to earth yet we can pray that all are safely home may god bless the grieving families and may god may god continue to bless america" - }, - "asr:hp0.wav":{ - "ms":40293.927000000003, - "audio_s":273.28724999999997, - "encode_ms":6622.1189999999997, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at www dot g n u dot org slash copyleft slash f d l dot h t m l." + "pp512":{ + "tok_s":27.745199, + "stddev":0.14399400000000001 }, - "asr:hp0x2.wav":{ - "ms":107645.408, - "audio_s":546.57449999999994, - "encode_ms":13228.153, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one c three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + "tg128":{ + "tok_s":9.6123250000000002, + "stddev":0.019518000000000001 } }, - "workload":"audio-chat", "source":"official", - "sha":"965e57877", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", - "noise":"ok", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 - }, - { - "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" + }, + "tests":{ + "pp512":{ + "tok_s":31.316112223124588, + "stddev":0.21900658309459686 }, + "tg128":{ + "tok_s":11.624427733359934, + "stddev":0.11489127576351166 + } + }, + "source":"official", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "parity":"ok", + "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", + "files":[ { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "role":"weights", + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] }, { - "engine":"das", + "engine":"llama.cpp", "backend":"cpu", - "flavor":"tuned", - "box":"zen2", - "threads":16, - "date":"2026-08-05", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 16 --json-path modules/dasLLAMA/performance/records/_cell_zen2.json", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -nopo 1 -t 6 -p 512 -n 128 -r 5 -o json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":4167.3230000000003, - "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:jfk3.wav":{ - "ms":6978.0540000000001, - "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." - }, - "asr:gb1.wav":{ - "ms":69751.832999999999, - "audio_s":198.734375, - "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven: Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Dr. Kalpana Chawla, and Ilan Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers, and they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief. You're not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude of this country. The cause in which they died will continue. Mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah, \"Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one and calls them each by name. Because of his great power and mighty strength, not one of them is missing.\" The same Creator who names the stars also knows the names of the seven souls we mourn today. The crew of the shuttle Columbia did not return safely to Earth. Yet we can pray that all are safely home. May God bless the grieving families, and may God continue to bless America." - }, - "asr:hp0.wav":{ - "ms":95647.919999999998, - "audio_s":273.28724999999997, - "text":"Henry F Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips. From Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + "pp512":{ + "tok_s":27.619783999999999, + "stddev":0.14457100000000001 }, - "asr:hp0x2.wav":{ - "ms":250960.19500000001, - "audio_s":546.57449999999994, - "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips. From Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Poly Drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + "tg128":{ + "tok_s":9.601915, + "stddev":0.0094240000000000001 } }, - "workload":"audio-chat", "source":"official", - "sha":"a63300c2f", - "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_maddubs_width256_mr8 (manifest); k5q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest); k6q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q40q8_tile_gen=dot_maddubs_width256_mr8 (manifest); q8q8_tile_gen=dot_maddubs_width256_mr8_kstep4_nrsplit2 (manifest); q51q8_tile_gen=dot_maddubs_width256_mr8_nrsplit2 (manifest)", - "tune_sha":"ca9b861fc16d900abcdd0d0cb04e61840e2ad26cc7ead9e89674130d64f99aa3", - "exec_fmt":"q8/q8", - "env":"DASLLAMA_BOX=zen2 DASLLAMA_MODELS_DIR=D:\\work\\llama.cpp\\models\\", + "sha":"6fdd0ac89", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 - }, - { - "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 - }, - { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 + "name":"Qwen3.8-27B-Q4_K_M.gguf", + "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", + "bytes":18973870432 } ] - }, + } + ], + "arch":"qwen35", + "quant":"q8", + "params_b":26.895998464000002, + "active_b":23.84986112, + "size_bytes":18973870432 + }, + { + "gguf":"gemma-3-4b-it-Q8_0.gguf", + "runs":[ { - "engine":"llama-mtmd-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"zen2", - "threads":16, - "date":"2026-08-05", - "cmd":"D:\\Work\\llama.cpp-mtmd-ref\\build-cpu\\bin\\Release\\llama-mtmd-cli.exe -m D:\\work\\llama.cpp\\models\\Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj D:\\work\\llama.cpp\\models\\mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 16", + "flavor":"tuned", + "box":"m1", + "threads":8, + "date":"2026-08-21", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-3-4b-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-3-4b-it-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", "hardware":{ - "cpu":"AMD Ryzen Threadripper 3990X 64-Core Processor", - "arch":"AMD64", - "os":"Microsoft Windows [Version 10.0.26200.8875]", - "total_cores":128, - "ram_gb":256, - "gpu":"NVIDIA GeForce RTX 5060 Ti", - "ram_config":"8×32 GB @ 2666 MT/s", - "power_plan":"High performance", - "smt":"on", + "cpu":"Apple M1 Max", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":8, + "total_cores":10, + "ram_gb":64, + "gpu":"Apple M1 Max (32-core)", + "model_id":"MacBookPro18,2", "remote_desktop":"off" }, "tests":{ - "asr:jfk.wav":{ - "ms":299664.79999999999, - "encode_ms":6603.3999999999996 + "img:enc":{ + "ms":11615.703 }, - "asr:jfk3.wav":{ - "ms":11336.799999999999, - "encode_ms":11258.299999999999 + "img:pp":{ + "tok_s":275.64379682474208 }, - "asr:gb1.wav":{ - "ms":84854.5, - "encode_ms":47120.5 + "img:tg":{ + "tok_s":26.214017406107558, + "text":"The picture shows two tabby cats lounging on a pink cushion with television remotes nearby." } }, - "workload":"audio-chat", - "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@70af97d3", - "exec_fmt":"bf16/q8_0", + "workload":"image-chat", + "sha":"18336ae9d", + "version":"0.6.4", + "dasllama_version":6, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"6184eac1527f5d36731e9e188d3943f52f86b6c7383f7213c742e07f84af0972", + "noise":"ok", + "exec_fmt":"tower gemma3v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m1", "files":[ { "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 + "name":"gemma-3-4b-it-Q8_0.gguf", + "sha256":"97b06383df48336e7d2f9b56b6ce545e0fa476407a62c0bd081b53447a58e644", + "bytes":4130226336 }, { "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 - }, - { - "role":"clip", - "name":"jfk.wav", - "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", - "bytes":352078 - }, - { - "role":"clip", - "name":"jfk3.wav", - "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", - "bytes":1056078 + "name":"mmproj-gemma-3-4b-it-F16.gguf", + "sha256":"8c0fb064b019a6972856aaae2c7e4792858af3ca4561be2dbf649123ba6c40cb", + "bytes":851251104 }, { - "role":"clip", - "name":"gb1.wav", - "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", - "bytes":6359578 + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } - ], - "comment":"Same jfk.wav decode runaway as on the M4 box (the reference generates at length on that clip despite --temp 0 --reasoning off), amplified by CPU-only decode - a behavior difference, not a speed measurement.", - "void_clips":"jfk.wav" - }, + ] + } + ], + "arch":"gemma3v", + "size_bytes":4130226336 + }, + { + "gguf":"canary-qwen-2.5b-decoder-q8_0.gguf", + "runs":[ { "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench/dasllama-bench.exe -- --asr -m Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_zen4.json", - "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "backend":"metal", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 1", + "hardware":{ + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":3615, + "ms":307.61900000000003, "audio_s":11, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":206.45699999999999, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" }, "asr:jfk3.wav":{ - "ms":7012.3609999999999, + "ms":889.78700000000003, "audio_s":33, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":552.92899999999997, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":65548.563999999998, + "ms":6484.2790000000005, "audio_s":198.734375, - "text":"my fellow americans this day has brought terrible news and great sadness to our country at nine o'clock this morning mission control in houston lost contact with our space shuttle columbia a short time later debris was seen falling from the skies above texas the columbia is lost there are no survivors on board was a crew of seven colonel rick husband lieutenant colonel michael anderson commander laura clark captain david brown commander william mccool doctor kalpana chawla and ilan ramon a colonel in the israeli air force these men and women assumed great risk in the service to all humanity in an age when space flight has come to seem almost routine it is easy to overlook the dangers of travel by rocket and the difficulties of navigating the fierce outer atmosphere of the earth these astronauts knew the dangers and they faced them willingly knowing they had a high and noble purpose in life because of their courage and daring and idealism we will miss them all the more all americans today are thinking as well of the families of these men and women who have been given this sudden shock and grief you're not alone our entire nation grieves with you and those you loved will always have the respect and gratitude of this country the cause in which they died will continue mankind is led into the darkness beyond our world by the inspiration of discovery and the longing to understand our journey into space will go on in the skies today we saw destruction and tragedy yet farther than we can see there is comfort and hope in the words of the prophet isaiah lift your eyes and look to the heavens who created all these he who brings out the starry hosts one by one and calls them each by name because of his great power and mighty strength not one of them is missing the same creator who names the stars also knows the names of the seven souls we mourn today the crew of the shuttle columbia did not return safely to earth yet we can pray that all are safely home may god bless the grieving families and may god may god continue to bless america" - }, - "asr:hp0.wav":{ - "ms":93800.944000000003, - "audio_s":273.28724999999997, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F. Phillips, from Wikipedia, the free encyclopedia. Henry F. Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand three hundred forty three, U S patents two million forty six thousand eight hundred thirty seven, to two million forty six thousand eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri-wing. Torx set. Spanner head. Triple square, XZN. Others, Poilly drive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of april two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at www dot g n u dot org slash copyleft slash f d l dot h t m l." - }, - "asr:hp0x2.wav":{ - "ms":261113.886, - "audio_s":546.57449999999994, - "text":"Henry F Phillips from Wikipedia, the free encyclopedia at en dot wikipedia dot org. Henry F Phillips from Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l. Henry F Phillips, from Wikipedia, the free encyclopedia, at en dot wikipedia dot org. Henry F Phillips. From Wikipedia, the free encyclopedia. Henry F Phillips, eighteen ninety to nineteen fifty eight, a U S businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines, that use powered screwdrivers. Phillips major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in nineteen thirty six, U S patent number two million forty six thousand, three hundred forty three, U S patents two million forty six thousand, eight hundred thirty seven, to two million forty six thousand, eight hundred forty. It was so widely copied, that by nineteen forty nine, Phillips lost his patent. The American Screw Company, was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the nineteen thirties dismissed the Phillips concept, since it calls for a relatively complex, recessed socket shape, in the head of the screw. As distinct from the simple milled slot, of a slotted type screw. The Phillips Screw Company, and the American Screw Company, went on to devise the Pozidriv screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an infobox which accompanies this article. Infobox, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Pozidriv, Supadriv. Torx. Hex, Allen. Robertson. Tri wing. Torx set. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this infobox. This page was last modified on the ninth of April, two thousand eight, at seventeen oh four. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U S registered five hundred and one C three, tax deductible nonprofit charity. This sound file and all text in the article, are licensed under the GNU Free Documentation License, available at, w w w dot g n u dot org slash copyleft slash f d l dot h t m l." + "encode_ms":5832.9409999999998, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." } }, - "workload":"audio-chat", + "workload":"asr", "source":"official", - "sha":"7e02c2451", + "sha":"fa67fe165", "version":"0.6.4", - "tune":"k4q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); k5q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); k6q8_tile_gen=dot_vpdpbusd_width512_mr16_nrsplit2 (manifest); q40q8_tile_gen=dot_vpdpbusd_width512_mr16 (manifest); q8q8_tile_gen=dot_vpdpbusd_width512_mr16_kstep2_gkstep2_bias128 (manifest); q51q8_gemv_gen=reference (reference)", - "tune_sha":"b8958825af80aef76f8effdf0a7abe7c95eb8b65e549da74278ebbcd511cf2df", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", "exec_fmt":"f32/q8", - "env":"DASLLAMA_BOX=zen4 DASLLAMA_MODELS_DIR=/home/boris/models/", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 }, { "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 }, { "role":"clip", @@ -16340,69 +23440,47 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"llama-mtmd-cli", + "engine":"nemo", "backend":"cpu", "flavor":"stock", - "box":"zen4", - "threads":8, - "date":"2026-08-04", - "cmd":"/home/boris/llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /home/boris/models/Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf --mmproj /home/boris/models/mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", "hardware":{ - "cpu":"AMD Ryzen 7 PRO 8700GE w/ Radeon 780M Graphics", - "arch":"x86_64", - "os":"Debian GNU/Linux 12 (bookworm) 6.1.0-49-amd64", - "total_cores":16, - "ram_gb":62, - "gpu":"Advanced Micro Devices, Inc. [AMD/ATI] Phoenix1 (rev d2)", - "smt":"on" + "cpu":"Apple M5 Max", + "arch":"arm64", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", + "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":266305.20000000001, - "encode_ms":3067.0999999999999 + "ms":2469.598, + "audio_s":11 }, "asr:jfk3.wav":{ - "ms":8061, - "encode_ms":7997.1000000000004 + "ms":6092.9560000000001, + "audio_s":33 }, "asr:gb1.wav":{ - "ms":90574.300000000003, - "encode_ms":54331.300000000003 + "ms":20080.164000000001, + "audio_s":199 } }, - "workload":"audio-chat", + "workload":"asr", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", - "exec_fmt":"bf16/q8_0", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", + "exec_fmt":"bf16", "files":[ - { - "role":"weights", - "name":"Qwen3-Omni-30B-A3B-Instruct-Q8_0.gguf", - "sha256":"8a50e5a7d29ae6a28fea9ca45e3bb0a142e76ec07e6787a7703cd498eb08ffaa", - "bytes":32484494336 - }, - { - "role":"mmproj", - "name":"mmproj-Qwen3-Omni-30B-A3B-Instruct-bf16.gguf", - "sha256":"f0dfe825fb692d426362b1ac79678fc08daa4758f7151526cad110515f122883", - "bytes":2207465568 - }, { "role":"clip", "name":"jfk.wav", @@ -16421,90 +23499,46 @@ "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 } - ], - "comment":"Same jfk.wav decode runaway as on the M4 and zen2 boxes (the reference generates at length on that clip despite --temp 0 --reasoning off; 266 s vs 8 s on jfk3.wav) - a behavior difference, not a speed measurement.", - "void_clips":"jfk.wav" - } - ], - "arch":"Qwen3-Omni-30B audio", - "size_bytes":32484494336 - }, - { - "gguf":"Qwen3-ASR-0.6B-Q8_0.gguf", - "runs":[ + ] + }, { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json", + "engine":"nemo", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --device mps --threads 6 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":885.29100000000005, - "audio_s":11, - "encode_ms":575.37900000000002, - "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." + "ms":704.654, + "audio_s":11 }, "asr:jfk3.wav":{ - "ms":2641.8670000000002, - "audio_s":33, - "encode_ms":1595.1120000000001, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "ms":1795.721, + "audio_s":33 }, "asr:gb1.wav":{ - "ms":18886.09, - "audio_s":198.734375, - "encode_ms":9391.3150000000005, - "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." - }, - "asr:hp0.wav":{ - "ms":27029.031999999999, - "audio_s":273.28724999999997, - "encode_ms":12883.653, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the crosshead screw design, lies in its self-centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the crosshead concept forward, to the point where it was adopted by screwmakers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screwmakers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape in the head of the screw, as distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption: Phillips Screw Head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flathead. Phillips, crosshead. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spannerhead. Triple Square, XZN. Others, Polydrive, Splinedrive, Double Hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License. See copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax-deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." - }, - "asr:hp0x2.wav":{ - "ms":69347.548999999999, - "audio_s":546.57449999999994, - "encode_ms":25359.042000000001, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" + "ms":4383.4219999999996, + "audio_s":199 } }, - "workload":"audio-chat", + "workload":"asr", "source":"official", - "sha":"ef6af462c", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", - "noise":"ok", - "exec_fmt":"q8/q8", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", + "exec_fmt":"bf16", "files":[ - { - "role":"weights", - "name":"Qwen3-ASR-0.6B-Q8_0.gguf", - "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", - "bytes":804749248 - }, - { - "role":"mmproj", - "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", - "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", - "bytes":378575520 - }, { "role":"clip", "name":"jfk.wav", @@ -16522,93 +23556,70 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m Qwen3-ASR-0.6B-Q8_0.gguf -r 2 -t 8 --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":677.21500000000003, + "ms":707.33299999999997, "audio_s":11, - "encode_ms":337.31700000000001, - "text":"And so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country." + "encode_ms":284.23899999999998, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" }, "asr:jfk3.wav":{ - "ms":1968.5630000000001, + "ms":2163.7109999999998, "audio_s":33, - "encode_ms":958.61000000000001, - "text":"And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country." + "encode_ms":895.18299999999999, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":15084.93, + "ms":14250.135, "audio_s":198.734375, - "encode_ms":5629.7910000000002, - "text":"My fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America." - }, - "asr:hp0.wav":{ - "ms":21843.557000000001, - "audio_s":273.28724999999997, - "encode_ms":7723.1890000000003, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958, a U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. Patent Number 2,000,46,000,343, U.S. Patents 2,000,46,000,837 to 2,000,46,000,840. It was so widely copied that by 1949, Phillips lost his patent. The American Screw Company was responsible for devising a means of manufacturing the screw, and successfully patented and licensed their method. Other screw makers of the 1930s dismissed the Phillips concept since it calls for a relatively complex recessed socket shape, in the head of the screw. As distinct from the simple milled slot of a slotted type screw. The Phillips Screw Company and the American Screw Company, went on to devise the Posidrive screw, which differs from the Phillips, in that it is designed to accommodate greater torque than the Phillips. An image accompanied this article, caption, Phillips screw head. The following is an info box which accompanies this article. Info box, part of the series on screw drive types. Slotted, commonly erroneously flat head. Phillips cross head. Posidrive, Supadrive. Torx. Hex, Allen. Robertson. Triwing. Torxet. Spanner head. Triple square, XZN. Others, Polydrive, spline drive, double hex. Many images accompanied this info box. This page was last modified on the 9th of April 2008, at 17:04. All text is available under the terms of the GNU Free Documentation License, see copyrights for details. Wikipedia is a registered trademark of the Wikimedia Foundation Incorporated, a U.S. registered 501c3, tax deductible non-profit charity. This sound file and all text in the article are licensed under the GNU Free Documentation License, available at www.gnu.org/slash, copyleft/slash, fdl.shtml." - }, - "asr:hp0x2.wav":{ - "ms":59070.235000000001, - "audio_s":546.57449999999994, - "encode_ms":15581.647999999999, - "text":"Henry F. Phillips, from Wikipedia, the free encyclopedia, at en.wikipedia.org. Henry F. Phillips. From Wikipedia, the free encyclopedia. Henry F. Phillips, 1890 to 1958. A U.S. businessman from Portland, Oregon, has the honor of having the Phillips head screw and screwdriver named after him. The importance of the cross head screw design, lies in its self centering property, useful on automated production lines that use powered screwdrivers. Phillips' major contribution was in driving the cross head concept forward, to the point where it was adopted by screw makers and automobile companies. Although he received patents for the design in 1936, U.S. patent number 2,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,000,00" + "encode_ms":8003.7449999999999, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." } }, - "workload":"audio-chat", + "workload":"asr", "source":"official", - "sha":"ef6af462c", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"aed41bee687bddced749e95c3a02611d43540e81bf03dec798ed8e13ca63a0ae", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3-ASR-0.6B-Q8_0.gguf", - "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", - "bytes":804749248 + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 }, { "role":"mmproj", - "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", - "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", - "bytes":378575520 + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 }, { "role":"clip", @@ -16627,73 +23638,70 @@ "name":"gb1.wav", "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", "bytes":6359578 - }, - { - "role":"clip", - "name":"hp0.wav", - "sha256":"3a7fbe30706a0c6e7184cda0013dc7ddf731f2ea42ba3dd4ff0f64e6e0d93969", - "bytes":8745270 - }, - { - "role":"clip", - "name":"hp0x2.wav", - "sha256":"43acaa61356b9a51694ebadeb68c4a2512484da1c69da2fba223cc0bb7cba57c", - "bytes":17490462 } ] }, { - "engine":"llama-mtmd-cli", + "engine":"das", "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3-ASR-0.6B-bf16.gguf --audio modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav -p \"Transcribe the audio.\" --temp 0 --jinja --reasoning off -ngl 0 -t 8", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 6 --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ "asr:jfk.wav":{ - "ms":3631, - "encode_ms":3411.3000000000002, - "text":"0.00.002.825 I common_init_result: fitting params to device memory ... 0.00.002.829 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.150.924 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 65536 MiB of total host memory 0.00.246.414 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.381.457 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.530.702 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.627.863 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.627.916 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.01.628.151 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.628.153 W For normal use cases, please use the standard llama-cli 0.01.640.082 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 4) 0.03.838.627 I mtmd batch encoding done in 2198 ms 0.03.908.815 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 4) 0.04.981.565 I mtmd batch encoding done in 1072 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you; ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 26 2548 1128 498 646 653 369 697 3146 13 151645" + "ms":693.39599999999996, + "audio_s":11, + "encode_ms":314.98099999999999, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" }, "asr:jfk3.wav":{ - "ms":10218.799999999999, - "encode_ms":9566.5, - "text":"0.00.002.778 I common_init_result: fitting params to device memory ... 0.00.002.783 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.151.295 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 65536 MiB of total host memory 0.00.246.618 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.382.534 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.531.144 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.628.678 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.628.728 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.01.628.986 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.628.987 W For normal use cases, please use the standard llama-cli 0.01.650.672 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 7) 0.03.855.027 I mtmd batch encoding done in 2205 ms 0.03.924.504 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 7) 0.06.066.919 I mtmd batch encoding done in 2143 ms 0.06.141.993 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 7) 0.08.302.970 I mtmd batch encoding done in 2161 ms 0.08.382.558 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 7) 0.10.518.900 I mtmd batch encoding done in 2137 ms 0.10.604.874 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 7) 0.11.139.481 I mtmd batch encoding done in 534 ms language EnglishAnd so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.DASLLAMA_IDS: 11528 6364 151704 3036 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 1597 773 11 847 12357 8877 11 2548 537 1128 697 3146 646 653 369 498 11 2548 1128 498 646 653 369 697 3146 13 151645" + "ms":2158.46, + "audio_s":33, + "encode_ms":906.07899999999995, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." }, "asr:gb1.wav":{ - "ms":65002.400000000001, - "encode_ms":57179.699999999997, - "text":"0.00.002.778 I common_init_result: fitting params to device memory ... 0.00.002.784 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.00.150.965 I common_params_fit_impl: projected to use 7927 MiB of host memory vs. 65536 MiB of total host memory 0.00.246.505 W load: control-looking token: 128247 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.376.286 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.01.519.070 I mtmd_cli_context: chat template example: <|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant 0.01.616.380 W init_audio: audio input is in experimental stage and may have reduced quality: https://github.com/ggml-org/llama.cpp/discussions/13759 0.01.616.431 I main: loading model: /Users/borisbatkin/Work/llama.cpp/models/Qwen3-ASR-0.6B-Q8_0.gguf 0.01.616.663 W WARN: This is an experimental CLI for testing multimodal capability. 0.01.616.664 W For normal use cases, please use the standard llama-cli 0.01.715.326 I encoding mtmd batch, n_chunks = 1 (done = 1, total = 27) 0.03.920.249 I mtmd batch encoding done in 2205 ms 0.03.989.480 I encoding mtmd batch, n_chunks = 1 (done = 2, total = 27) 0.06.129.445 I mtmd batch encoding done in 2140 ms 0.06.204.261 I encoding mtmd batch, n_chunks = 1 (done = 3, total = 27) 0.08.345.157 I mtmd batch encoding done in 2141 ms 0.08.456.484 I encoding mtmd batch, n_chunks = 1 (done = 4, total = 27) 0.10.594.888 I mtmd batch encoding done in 2138 ms 0.10.680.754 I encoding mtmd batch, n_chunks = 1 (done = 5, total = 27) 0.12.820.107 I mtmd batch encoding done in 2140 ms 0.12.912.022 I encoding mtmd batch, n_chunks = 1 (done = 6, total = 27) 0.15.064.588 I mtmd batch encoding done in 2152 ms 0.15.161.516 I encoding mtmd batch, n_chunks = 1 (done = 7, total = 27) 0.17.296.728 I mtmd batch encoding done in 2135 ms 0.17.400.463 I encoding mtmd batch, n_chunks = 1 (done = 8, total = 27) 0.19.552.829 I mtmd batch encoding done in 2152 ms 0.19.662.924 I encoding mtmd batch, n_chunks = 1 (done = 9, total = 27) 0.21.798.724 I mtmd batch encoding done in 2135 ms 0.21.912.233 I encoding mtmd batch, n_chunks = 1 (done = 10, total = 27) 0.24.073.586 I mtmd batch encoding done in 2161 ms 0.24.195.406 I encoding mtmd batch, n_chunks = 1 (done = 11, total = 27) 0.26.331.711 I mtmd batch encoding done in 2136 ms 0.26.456.647 I encoding mtmd batch, n_chunks = 1 (done = 12, total = 27) 0.28.608.969 I mtmd batch encoding done in 2153 ms 0.28.739.760 I encoding mtmd batch, n_chunks = 1 (done = 13, total = 27) 0.30.878.410 I mtmd batch encoding done in 2139 ms 0.31.019.269 I encoding mtmd batch, n_chunks = 1 (done = 14, total = 27) 0.33.155.206 I mtmd batch encoding done in 2136 ms 0.33.333.160 I encoding mtmd batch, n_chunks = 1 (done = 15, total = 27) 0.35.492.949 I mtmd batch encoding done in 2160 ms 0.35.642.193 I encoding mtmd batch, n_chunks = 1 (done = 16, total = 27) 0.37.776.954 I mtmd batch encoding done in 2135 ms 0.37.932.145 I encoding mtmd batch, n_chunks = 1 (done = 17, total = 27) 0.40.084.322 I mtmd batch encoding done in 2152 ms 0.40.244.192 I encoding mtmd batch, n_chunks = 1 (done = 18, total = 27) 0.42.380.933 I mtmd batch encoding done in 2137 ms 0.42.548.164 I encoding mtmd batch, n_chunks = 1 (done = 19, total = 27) 0.44.702.428 I mtmd batch encoding done in 2154 ms 0.44.872.938 I encoding mtmd batch, n_chunks = 1 (done = 20, total = 27) 0.47.007.286 I mtmd batch encoding done in 2134 ms 0.47.184.267 I encoding mtmd batch, n_chunks = 1 (done = 21, total = 27) 0.49.339.683 I mtmd batch encoding done in 2155 ms 0.49.523.933 I encoding mtmd batch, n_chunks = 1 (done = 22, total = 27) 0.51.659.114 I mtmd batch encoding done in 2135 ms 0.51.847.637 I encoding mtmd batch, n_chunks = 1 (done = 23, total = 27) 0.54.001.165 I mtmd batch encoding done in 2154 ms 0.54.196.215 I encoding mtmd batch, n_chunks = 1 (done = 24, total = 27) 0.56.332.282 I mtmd batch encoding done in 2136 ms 0.56.533.995 I encoding mtmd batch, n_chunks = 1 (done = 25, total = 27) 0.58.415.840 I mtmd batch encoding done in 1881 ms language EnglishMy fellow Americans. This day has brought terrible news. In great sadness to our country. At nine o'clock this morning, mission control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. On board was a crew of seven. Colonel Rick Husband, Lieutenant Colonel Michael Anderson, Commander Laurel Clark, Captain David Brown, Commander William McCool, Doctor Kulpina Shavla, and Elon Ramon, a colonel in the Israeli Air Force. These men and women assumed great risk in the service to all humanity. In an age when space flight has come to seem almost routine, it is easy to overlook the dangers of travel by rocket. And the difficulties of navigating the fierce outer atmosphere of the Earth. These astronauts knew the dangers. And they faced them willingly, knowing they had a high and noble purpose in life. Because of their courage and daring and idealism, we will miss them all the more. All Americans today are thinking as well. Of the families of these men and women, who have been given this sudden shock in grief. You are not alone. Our entire nation grieves with you. And those you loved will always have the respect and gratitude. Of this country, the cause in which they died will continue. Mankind is led into the darkness. Beyond our world, by the inspiration of discovery. And the longing to understand. Our journey into space will go on. In the skies today, we saw destruction and tragedy. Yet farther than we can see, there is comfort and hope. In the words of the prophet Isaiah. Lift your eyes and look to the heavens. Who created all these? He who brings out the starry hosts one by one. And calls them each by name. Because of his great power. And mighty strength, not one of them is missing. The same creator who names the stars. Also knows the names. Of the seven souls we mourn today. The crew of the shuttle Columbia. Did not return safely to Earth. Yet we can pray. That all are safely home. May God bless the grieving families. And may God continue to bless America.DASLLAMA_IDS: 11528 6364 151704 5050 12357 8877 13 1096 1899 702 7117 17478 3669 13 758 2244 50878 311 1039 3146 13 2411 11627 297 62410 419 6556 11 8954 2524 304 16003 5558 3645 448 1039 3550 44541 18796 13 362 2805 882 2937 11 33998 572 3884 15679 504 279 49293 3403 8257 13 576 18796 374 5558 13 2619 525 902 31596 13 1913 4479 572 264 13627 315 8094 13 51698 22388 73359 11 54137 51698 7937 20642 11 34138 80464 21304 11 21316 6798 10471 11 34138 12375 14249 1749 11 18635 730 12840 2210 1417 402 4260 11 323 68539 15152 263 11 264 14889 301 304 279 15907 6553 11732 13 4220 2953 323 3198 19110 2244 5214 304 279 2473 311 678 21941 13 758 458 4231 979 3550 10971 702 2525 311 2803 4558 14021 11 432 374 4135 311 30705 279 35964 315 5821 553 24306 13 1597 279 26038 315 59399 279 41342 15955 16566 315 279 9237 13 4220 68422 6876 279 35964 13 1597 807 16601 1105 72552 11 14063 807 1030 264 1550 323 34382 7428 304 2272 13 9211 315 862 24744 323 58672 323 10507 2142 11 582 686 3116 1105 678 279 803 13 2009 8877 3351 525 7274 438 1632 13 4940 279 8521 315 1493 2953 323 3198 11 879 614 1012 2661 419 10968 10755 304 37284 13 1446 525 537 7484 13 5633 4453 6995 342 7231 2342 448 498 13 1597 1846 498 10245 686 2677 614 279 5091 323 45035 13 4940 419 3146 11 279 5240 304 892 807 8469 686 3060 13 386 69270 374 6069 1119 279 26298 13 30786 1039 1879 11 553 279 19760 315 18335 13 1597 279 78322 311 3535 13 5633 11618 1119 3550 686 728 389 13 758 279 49293 3351 11 582 5485 19258 323 30826 13 14626 42626 1091 582 646 1490 11 1052 374 6838 323 3900 13 758 279 4244 315 279 52504 63430 13 52435 697 6414 323 1401 311 279 62780 13 10479 3465 678 1493 30 1260 879 12434 700 279 6774 884 18432 825 553 825 13 1597 6738 1105 1817 553 829 13 9211 315 806 2244 2355 13 1597 41627 8170 11 537 825 315 1105 374 7402 13 576 1852 19919 879 5036 279 9759 13 7281 8788 279 5036 13 4940 279 8094 34726 582 59134 3351 13 576 13627 315 279 44541 18796 13 14568 537 470 21000 311 9237 13 14626 582 646 23803 13 2938 678 525 21000 2114 13 3217 4264 16072 279 90744 8521 13 1597 1231 4264 3060 311 16072 5159 13 151645" + "ms":13924.602000000001, + "audio_s":198.734375, + "encode_ms":7789.9780000000001, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." } }, - "workload":"audio-chat", + "workload":"asr", "source":"official", - "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@93138f65", - "exec_fmt":"bf16/q8_0", + "sha":"fa67fe165", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3-ASR-0.6B-Q8_0.gguf", - "sha256":"bca259818b50ca7c4c05e9bdb35a5dc04fa039653a6d6f3f0f331f96f6aa1971", - "bytes":804749248 + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 }, { "role":"mmproj", - "name":"mmproj-Qwen3-ASR-0.6B-bf16.gguf", - "sha256":"dae36c855f9a82a8916bea2238b24bda69a39d8da8b2f46dee7c103775656039", - "bytes":378575520 + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 }, { "role":"clip", @@ -16716,55 +23724,72 @@ ] } ], - "arch":"Qwen3-ASR-0.6B", - "size_bytes":804749248 + "arch":"Canary-Qwen 2.5B", + "size_bytes":1834425984 }, { - "gguf":"Qwen3.8-27B-Q4_K_M.gguf", + "gguf":"Qwen3VL-4B-Instruct-Q8_0.gguf", "runs":[ { "engine":"das", "backend":"metal", "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --ngl 99", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":146.98464403666389, - "stddev":1.6775456666946411 + "img:enc":{ + "ms":66.233999999999995 }, - "tg128":{ - "tok_s":14.454928980896796, - "stddev":0.0026774206198751926 + "img:pp":{ + "tok_s":3718.4078349713395 + }, + "img:tg":{ + "tok_s":112.79255569132437, + "text":"assistant\nTwo tabby cats are sleeping on a pink blanket with remote controls nearby." } }, + "workload":"image-chat", "source":"official", - "sha":"aef0840b8", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"c1cd9c5035ca7d81e7f3bbe95a576c22a3601303bfa3c04e04f46d8052bb29d7", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "parity":"ok", + "exec_fmt":"tower qwen3v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, @@ -16772,489 +23797,544 @@ "engine":"llama.cpp", "backend":"metal", "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 99 -t 8 -p 512 -n 128 -r 5 -o json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":137.56638100000001, - "stddev":0.058006000000000002 + "img:enc":{ + "ms":63 }, - "tg128":{ - "tok_s":11.520108, - "stddev":0.030023000000000001 - } - }, - "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats", - "files":[ - { - "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 - } - ] - }, - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":33.239019966861669, - "stddev":0.17517077922821045 + "img:pp":{ + "tok_s":463.27683615819211 }, - "tg128":{ - "tok_s":5.8207341408622959, - "stddev":0.0236338060349226 + "img:tg":{ + "tok_s":81.300813008130078 } }, + "workload":"image-chat", "source":"official", - "sha":"aef0840b8", - "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"c1cd9c5035ca7d81e7f3bbe95a576c22a3601303bfa3c04e04f46d8052bb29d7", - "noise":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 - } - ] - }, - { - "engine":"llama.cpp", - "backend":"cpu", - "flavor":"clean-cpu", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -t 8 -p 512 -n 128 -r 5 -o json", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, - "tests":{ - "pp512":{ - "tok_s":29.773734000000001, - "stddev":0.138298 + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 }, - "tg128":{ - "tok_s":5.563599, - "stddev":0.023219 - } - }, - "source":"official", - "sha":"ebd048f", - "exec_fmt":"native gguf formats; cpu runtime layout repack", - "files":[ { - "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"accel", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json --accel", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":33.375229600569654, - "stddev":0.14754222333431244 + "img:enc":{ + "ms":1088.5599999999999 }, - "tg128":{ - "tok_s":5.8126415881974207, - "stddev":0.03507552295923233 + "img:pp":{ + "tok_s":250.56570025403508 + }, + "img:tg":{ + "tok_s":56.564818568344442, + "text":"assistant\nTwo tabby cats are sleeping on a pink blanket with remote controls nearby." } }, + "workload":"image-chat", "source":"official", - "sha":"aef0840b8", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4_nrsplit2 (manifest)", - "tune_sha":"c1cd9c5035ca7d81e7f3bbe95a576c22a3601303bfa3c04e04f46d8052bb29d7", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "parity":"ok", + "exec_fmt":"tower qwen3v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"llama.cpp", "backend":"cpu", - "flavor":"stock", - "box":"m1", - "threads":8, - "date":"2026-08-17", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -nopo 1 -t 8 -p 512 -n 128 -r 5 -o json", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", "hardware":{ - "cpu":"Apple M1 Max", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":29.789940999999999, - "stddev":0.099495 + "img:enc":{ + "ms":1014 }, - "tg128":{ - "tok_s":5.5914400000000004, - "stddev":0.030686999999999999 + "img:pp":{ + "tok_s":30.834022711889904 + }, + "img:tg":{ + "tok_s":43.402777777777771 } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048f", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"das", - "backend":"metal", - "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 99", + "backend":"cpu", + "flavor":"accel", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":127.02672073494846, - "stddev":0.93355661630630493 + "img:enc":{ + "ms":884.07100000000003 }, - "tg128":{ - "tok_s":12.790665997073447, - "stddev":0.030512120574712753 + "img:pp":{ + "tok_s":246.67257668860663 + }, + "img:tg":{ + "tok_s":56.592561850954056, + "text":"assistant\nTwo tabby cats are sleeping on a pink blanket with remote controls nearby." } }, + "workload":"image-chat", "source":"official", - "sha":"aef0840b8", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "parity":"ok", + "exec_fmt":"tower qwen3v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"llama.cpp", - "backend":"metal", + "backend":"cpu", "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 99 -t 10 -p 512 -n 128 -r 5 -o json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3VL-4B-Instruct-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen3VL-4B-Instruct-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":126.183144, - "stddev":0.030702 + "img:enc":{ + "ms":1934 }, - "tg128":{ - "tok_s":11.468781, - "stddev":0.046730000000000001 + "img:pp":{ + "tok_s":28.264166551771684 + }, + "img:tg":{ + "tok_s":46.6618808327351 } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen3VL-4B-Instruct-Q8_0.gguf", + "sha256":"054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", + "bytes":4280406144 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen3VL-4B-Instruct-F16.gguf", + "sha256":"256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331", + "bytes":836180256 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] - }, + } + ], + "arch":"qwen3v", + "size_bytes":4280406144 + }, + { + "gguf":"Qwen2.5-Omni-3B-Q8_0.gguf", + "runs":[ { "engine":"das", - "backend":"cpu", + "backend":"metal", "flavor":"tuned", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":45.757711153225522, - "stddev":0.27520489692687988 + "img:enc":{ + "ms":105.991 }, - "tg128":{ - "tok_s":11.579745382700445, - "stddev":0.018587170168757439 + "img:pp":{ + "tok_s":6718.1945667416758 + }, + "img:tg":{ + "tok_s":136.54758062513966, + "text":"Two cats laying on a pink blanket with remotes." } }, + "workload":"image-chat", "source":"official", - "sha":"aef0840b8", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "parity":"ok", + "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; metal blob", + "env":"DASLLAMA_BOX=m5", "files":[ { - "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "role":"weights", + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"llama.cpp", - "backend":"cpu", - "flavor":"clean-cpu", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"/Users/dasbox/llama.cpp-ref-ebd048f/build-clean-cpu/bin/llama-bench -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -t 10 -p 512 -n 128 -r 5 -o json", + "backend":"metal", + "flavor":"stock", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 99", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":40.134383, - "stddev":1.4757629999999999 + "img:enc":{ + "ms":118 }, - "tg128":{ - "tok_s":10.896379, - "stddev":0.048517999999999999 + "img:pp":{ + "tok_s":829.08163265306121 + }, + "img:tg":{ + "tok_s":81.967213114754088 } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048fc5", - "exec_fmt":"native gguf formats; cpu runtime layout repack", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"das", "backend":"cpu", - "flavor":"accel", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 10 -o json --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "flavor":"tuned", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":46.646229924123567, - "stddev":0.37202411890029907 + "img:enc":{ + "ms":9003.7549999999992 }, - "tg128":{ - "tok_s":11.586199873885437, - "stddev":0.027674870565533638 + "img:pp":{ + "tok_s":308.13898264773655 + }, + "img:tg":{ + "tok_s":75.039736951613008, + "text":"Two cats laying on a pink blanket with remotes." } }, + "workload":"image-chat", "source":"official", - "sha":"aef0840b8", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":4, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"9a5c8455a263815e56c586774fe3a2fd66718d445a809524d317e4c05a2ea6a5", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "parity":"ok", + "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"llama.cpp", "backend":"cpu", - "flavor":"stock", - "box":"m4", - "threads":10, - "date":"2026-08-18", - "cmd":"/Users/dasbox/llama.cpp-ref-ebd048f/build-stock/bin/llama-bench -m /Users/dasbox/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 0 -nopo 1 -t 10 -p 512 -n 128 -r 5 -o json", + "flavor":"clean-cpu", + "box":"m5", + "threads":6, + "date":"2026-08-30", + "cmd":"../llama.cpp-mtmd-ref/build-cpu/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload", "hardware":{ - "cpu":"Apple M4 Pro", + "cpu":"Apple M5 Max", "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":10, - "total_cores":14, - "ram_gb":64, - "gpu":"Apple M4 Pro (20-core)", - "model_id":"Mac16,11", + "os":"macOS 26.6", + "perf_cores":6, + "total_cores":18, + "ram_gb":128, + "gpu":"Apple M5 Max (40-core)", + "model_id":"Mac17,6", "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":40.402389999999997, - "stddev":1.4450940000000001 + "img:enc":{ + "ms":2609 }, - "tg128":{ - "tok_s":10.952062, - "stddev":0.022928 + "img:pp":{ + "tok_s":48.435171385991055 + }, + "img:tg":{ + "tok_s":56.451612903225808 } }, + "workload":"image-chat", "source":"official", - "sha":"ebd048fc5", + "versions":"llama.cpp @ ebd048fc5 + mtmd-timing.patch@8026b1bd", "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"das", - "backend":"metal", - "flavor":"tuned", + "backend":"cpu", + "flavor":"accel", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -p 512 -n 128 -r 5 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --ngl 99", + "date":"2026-08-30", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 6 -o json --json-path modules/dasLLAMA/performance/records/_cell_m5.json --accel", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -17267,41 +24347,57 @@ "remote_desktop":"off" }, "tests":{ - "pp512":{ - "tok_s":891.6510131320847, - "stddev":3.1367990970611572 + "img:enc":{ + "ms":1534.6610000000001 }, - "tg128":{ - "tok_s":27.886035408758552, - "stddev":0.073721945285797119 + "img:pp":{ + "tok_s":301.59530741126548 + }, + "img:tg":{ + "tok_s":75.715859030837009, + "text":"Two cats laying on a pink blanket with remotes." } }, + "workload":"image-chat", "source":"official", - "sha":"667d4c1d5", + "sha":"fa67fe165", "version":"0.6.4", - "dasllama_version":10, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8 (manifest)", - "tune_sha":"d30db41e2278b4210ebeebb9e1c789a629936fcdc3839241967083755c2cfd60", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", + "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", "noise":"ok", "parity":"ok", - "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", + "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", + "env":"DASLLAMA_BOX=m5", "files":[ { "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 + }, + { + "role":"mmproj", + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 + }, + { + "role":"image", + "name":"coco-val2017-000000039769.jpg", + "sha256":"dea9e7ef97386345f7cff32f9055da4982da5471c48d575146c796ab4563b04e", + "bytes":173131 } ] }, { "engine":"llama.cpp", - "backend":"metal", + "backend":"cpu", "flavor":"stock", "box":"m5", "threads":6, - "date":"2026-08-27", - "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-bench -m /Users/borisbatkin/Work/llama.cpp/models/Qwen3.8-27B-Q4_K_M.gguf -ngl 99 -t 6 -p 512 -n 128 -r 5 -o json", + "date":"2026-08-30", + "cmd":"/Users/borisbatkin/Work/llama.cpp-ref-6fdd0ac/build-stock/bin/llama-mtmd-cli -m /Users/borisbatkin/Work/llama.cpp/models/Qwen2.5-Omni-3B-Q8_0.gguf --mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-Qwen2.5-Omni-3B-f16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -p \"What is in this picture? Answer in one sentence.\" --temp 0 --jinja -n 32 -t 6 -ngl 0 --no-mmproj-offload --no-op-offload", "hardware":{ "cpu":"Apple M5 Max", "arch":"arm64", @@ -17313,90 +24409,33 @@ "model_id":"Mac17,6", "remote_desktop":"off" }, - "tests":{ - "pp512":{ - "tok_s":752.63394100000005, - "stddev":0.68924799999999997 - }, - "tg128":{ - "tok_s":25.433668999999998, - "stddev":0.53600499999999995 - } - }, - "source":"official", - "sha":"6fdd0ac89", - "exec_fmt":"native gguf formats", - "files":[ - { - "role":"weights", - "name":"Qwen3.8-27B-Q4_K_M.gguf", - "sha256":"31629f53165ab6a7dad8c9847dcfd1fdf55829dac1e6e748f4a68581b0033d34", - "bytes":18973870432 - } - ] - } - ], - "arch":"qwen35", - "quant":"q8", - "params_b":26.895998464000002, - "active_b":23.84986112, - "size_bytes":18973870432 - }, - { - "gguf":"gemma-3-4b-it-Q8_0.gguf", - "runs":[ - { - "engine":"das", - "backend":"cpu", - "flavor":"tuned", - "box":"m1", - "threads":8, - "date":"2026-08-21", - "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- -m /Users/borisbatkin/Work/llama.cpp/models/gemma-3-4b-it-Q8_0.gguf --image-mmproj /Users/borisbatkin/Work/llama.cpp/models/mmproj-gemma-3-4b-it-F16.gguf --image /Users/borisbatkin/Work/llama.cpp/models/coco-val2017-000000039769.jpg -r 3 -t 8 -o json --json-path modules/dasLLAMA/performance/records/_cell_m1.json", - "hardware":{ - "cpu":"Apple M1 Max", - "arch":"arm64", - "os":"macOS 26.5.2", - "perf_cores":8, - "total_cores":10, - "ram_gb":64, - "gpu":"Apple M1 Max (32-core)", - "model_id":"MacBookPro18,2", - "remote_desktop":"off" - }, "tests":{ "img:enc":{ - "ms":11615.703 + "ms":4286 }, "img:pp":{ - "tok_s":275.64379682474208 + "tok_s":44.12163996741787 }, "img:tg":{ - "tok_s":26.214017406107558, - "text":"The picture shows two tabby cats lounging on a pink cushion with television remotes nearby." + "tok_s":63.348416289592762 } }, "workload":"image-chat", - "sha":"18336ae9d", - "version":"0.6.4", - "dasllama_version":6, - "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"6184eac1527f5d36731e9e188d3943f52f86b6c7383f7213c742e07f84af0972", - "noise":"ok", - "exec_fmt":"tower gemma3v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", - "env":"DASLLAMA_BOX=m1", + "source":"official", + "versions":"llama.cpp @ 6fdd0ac89 + mtmd-timing.patch@8026b1bd", + "exec_fmt":"native gguf formats; cpu runtime layout repack", "files":[ { "role":"weights", - "name":"gemma-3-4b-it-Q8_0.gguf", - "sha256":"97b06383df48336e7d2f9b56b6ce545e0fa476407a62c0bd081b53447a58e644", - "bytes":4130226336 + "name":"Qwen2.5-Omni-3B-Q8_0.gguf", + "sha256":"c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", + "bytes":3616087360 }, { "role":"mmproj", - "name":"mmproj-gemma-3-4b-it-F16.gguf", - "sha256":"8c0fb064b019a6972856aaae2c7e4792858af3ca4561be2dbf649123ba6c40cb", - "bytes":851251104 + "name":"mmproj-Qwen2.5-Omni-3B-f16.gguf", + "sha256":"f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e", + "bytes":2623983328 }, { "role":"image", @@ -17407,8 +24446,8 @@ ] } ], - "arch":"gemma3v", - "size_bytes":4130226336 + "arch":"qwen25v", + "size_bytes":3616087360 }, { "gguf":"Qwen3-4B-Instruct-2507-Q8_0.gguf", From 3d6bb49fe4fa34515927ee5c15d9a82d57b8b8e8 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 19:05:42 -0700 Subject: [PATCH 08/17] slice E: the M4 canary rows re-mint on the q8 artifact, the Efficiency gate proven live The retired f16-decoder rows' replacement: canary requanted ON THE BOX (llama-quantize Q8_0 per the recipe; a fresh build-quant dir - the old ref build's SDK path had gone stale), the m4 sidecar re-minted by the release, and the cells landed with a WORKING nemo torch-MPS twin: das metal 2.10x/2.19x ahead on jfk/jfk3, 0.79x on gb1 (the same CPU mel+subsample front residue as the M5 row - one ledgered class, two boxes). The tier-kind gate held live: M4's pool stays 10 lanes (the allowlist refuses the 4 E-cores; the live: real-lanes witness, not the regime intent line). One transient: the sweep-context nemo ref degenerated every rep right after three das children exited (the async-reclaim window) and the new DEGENERATE guard refused to record it - a quiet-box rerun passed 6/6 reps; the guard turned what used to be silent garbage timing into a loud retry. Site records regenerated; records + site schema gates green. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/performance/records/m4.json | 369 +++ .../records/m4.tune.05da62524756.json | 2648 +++++++++++++++++ site/files/dasllama/bench_records.json | 362 +++ 3 files changed, 3379 insertions(+) create mode 100644 modules/dasLLAMA/performance/records/m4.tune.05da62524756.json diff --git a/modules/dasLLAMA/performance/records/m4.json b/modules/dasLLAMA/performance/records/m4.json index 1cdf4c6326..95fe8dc0e3 100644 --- a/modules/dasLLAMA/performance/records/m4.json +++ b/modules/dasLLAMA/performance/records/m4.json @@ -5201,5 +5201,374 @@ "params_b":26.895998464000002, "active_b":23.84986112, "size_bytes":18973870432 + }, + { + "gguf":"canary-qwen-2.5b-decoder-q8_0.gguf", + "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":609.84799999999996, + "audio_s":11, + "encode_ms":267.62900000000002, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":1839.9780000000001, + "audio_s":33, + "encode_ms":731.52200000000005, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":11773.228999999999, + "audio_s":198.734375, + "encode_ms":7155.732, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"54595cfea", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":603.404, + "audio_s":11, + "encode_ms":260.77699999999999, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":1823.1610000000001, + "audio_s":33, + "encode_ms":728.96299999999997, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":11705.264999999999, + "audio_s":198.734375, + "encode_ms":7783.0370000000003, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"54595cfea", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 1", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":512.86400000000003, + "audio_s":11, + "encode_ms":247.178, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":1574.452, + "audio_s":33, + "encode_ms":746.52700000000004, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":12254.620999999999, + "audio_s":198.734375, + "encode_ms":10310.376, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"54595cfea", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"nemo", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":3305.2919999999999, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":7576.8860000000004, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":19144.050999999999, + "audio_s":199 + } + }, + "workload":"asr", + "source":"official", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", + "exec_fmt":"bf16", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"nemo", + "backend":"metal", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --device mps --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1076.4870000000001, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":3445.7959999999998, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":9723.1990000000005, + "audio_s":199 + } + }, + "workload":"asr", + "source":"official", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", + "exec_fmt":"bf16", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + } + ], + "arch":"Canary-Qwen 2.5B", + "size_bytes":1834425984 } ] \ No newline at end of file diff --git a/modules/dasLLAMA/performance/records/m4.tune.05da62524756.json b/modules/dasLLAMA/performance/records/m4.tune.05da62524756.json new file mode 100644 index 0000000000..eb9301edf8 --- /dev/null +++ b/modules/dasLLAMA/performance/records/m4.tune.05da62524756.json @@ -0,0 +1,2648 @@ +{ + "kernels" : { + "add_inplace" : "vec8_u2", + "cvt_f32_to_f16" : "vec8_u2", + "rope_scaled_neox_tab" : "vec8_u2", + "q51q8_tile_gen" : "mr8_nrsplit2", + "softmax" : "vec8_u2", + "mul_inplace" : "vec8_u2", + "quantize_q8_0_bs_into_ptr" : "plain", + "dot_q8kv" : "vec4_u2", + "dot_q8q8" : "vec16", + "quantize_q8kv_row" : "plain", + "axpy_f16" : "vec8_u2", + "q40q8_tile_gen" : "mr8", + "axpy_tq4kv" : "vec8_u2", + "cvt_tq4kv_to_f32" : "vec8_u2", + "axpy" : "vec8_u2", + "dot_q8q8kv" : "plain", + "dot_mx4q8" : "u2", + "softmax_sink" : "vec8_u2", + "dot_q8q8_laneq4x4" : "u2", + "dot_bf16" : "vec8_u2", + "add_scale_inplace" : "vec8_u2", + "cvt_q8kv_to_f32" : "plain", + "axpy_q8kv" : "vec8_u2", + "dot_q8q8_f16s" : "vec16", + "q8q8_tile_gen" : "mr8_budget", + "quantize_q8_0_into_ptr" : "plain", + "k4q8_tile_gen" : "mr8", + "k5q8_tile_gen" : "mr8", + "k6q8_tile_gen" : "mr4", + "gemm_f32_uk_4x16" : "u2", + "dot_q51e" : "vec16", + "dot_f16" : "vec8_u2", + "cvt_f16_to_f32" : "vec8_u2", + "dot" : "vec8_u2", + "dot_q8tq4kv" : "vec16", + "scale_inplace" : "vec8_u2", + "dot_q4" : "vec4_u4", + "quantize_tq4kv_row" : "plain", + "copy_floats" : "vec8_u2", + "rmsnorm" : "vec8_u2" + }, + "provenance" : { + "validation" : "ok", + "noise_probes" : "start cv 0.97%; mid1 cv 1.28%; mid2 cv 1.76%; end cv 0.62%", + "platform" : "darwin", + "noise_floor_cv_pct" : "1.76", + "engine_sha" : "54595cfea", + "box" : "darwin|arm64|Mac16,11|25F84|Apple M4 Pro", + "written" : "2026-08-31T01:26:02.283Z", + "validation_demoted" : "0", + "mode" : "normal", + "dasllama_version" : "15", + "noise" : "ok", + "binary" : "/Users/dasbox/daScript/./bin/daslang", + "arch" : "arm64", + "validation_max_drift_pct" : "12.05" + }, + "race" : { + "cvt_q8kv_to_f32" : { + "winner" : "plain", + "fallback" : "vec8_u2", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 5.0017875134063505, + "rows" : { + "vec32_u2" : { + "med_us" : 407.953125, + "best_us" : 400.8125 + }, + "vec32" : { + "med_us" : 431.25, + "best_us" : 410.71875 + }, + "vec32_u4" : { + "med_us" : 407.21875, + "best_us" : 395.125 + }, + "vec32_u8" : { + "med_us" : 407.4375, + "best_us" : 403.78125 + }, + "vec16_u2" : { + "med_us" : 410.34375, + "best_us" : 407.78125 + }, + "vec16_u4" : { + "med_us" : 410.125, + "best_us" : 409.5 + }, + "vec16_u8" : { + "med_us" : 418.375, + "best_us" : 404.96875 + }, + "vec4" : { + "med_us" : 410.65625, + "best_us" : 401.21875 + }, + "vec8" : { + "med_us" : 430.5, + "best_us" : 412 + }, + "vec4_u4" : { + "med_us" : 417.03125, + "best_us" : 407.84375 + }, + "vec8_u4" : { + "med_us" : 419.25, + "best_us" : 416.4375 + }, + "plain" : { + "med_us" : 407.609375, + "best_us" : 398.4375 + }, + "u2" : { + "med_us" : 409.59375, + "best_us" : 398.78125 + }, + "u4" : { + "med_us" : 409.03125, + "best_us" : 398.125 + }, + "u8" : { + "med_us" : 409.671875, + "best_us" : 398.71875 + }, + "vec4_u2" : { + "med_us" : 411.140625, + "best_us" : 398.46875 + }, + "vec4_u8" : { + "med_us" : 410.375, + "best_us" : 402.75 + }, + "vec8_u2" : { + "med_us" : 434.09375, + "best_us" : 396.0625 + }, + "vec8_u8" : { + "med_us" : 421.625, + "best_us" : 400.84375 + }, + "vec16" : { + "med_us" : 429.90625, + "best_us" : 408.46875 + } + } + }, + "add_inplace" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 360.4375, + "best_us" : 353.21875 + }, + "vec32" : { + "med_us" : 386.625, + "best_us" : 386.375 + }, + "vec32_u4" : { + "med_us" : 359.59375, + "best_us" : 354.40625 + }, + "vec32_u8" : { + "med_us" : 358.75, + "best_us" : 354.78125 + }, + "vec16_u2" : { + "med_us" : 362.46875, + "best_us" : 362.3125 + }, + "vec16_u4" : { + "med_us" : 362.09375, + "best_us" : 357.75 + }, + "vec16_u8" : { + "med_us" : 1242, + "best_us" : 1240.46875 + }, + "vec4" : { + "med_us" : 387.96875, + "best_us" : 381.3125 + }, + "vec8" : { + "med_us" : 388.59375, + "best_us" : 388.28125 + }, + "vec4_u4" : { + "med_us" : 360.8125, + "best_us" : 359.96875 + }, + "vec8_u4" : { + "med_us" : 360, + "best_us" : 351.9375 + }, + "plain" : { + "med_us" : 389.1875, + "best_us" : 389.0625 + }, + "u2" : { + "med_us" : 389.25, + "best_us" : 383.90625 + }, + "u4" : { + "med_us" : 360.375, + "best_us" : 360.3125 + }, + "u8" : { + "med_us" : 360.21875, + "best_us" : 357.875 + }, + "vec4_u2" : { + "med_us" : 388.40625, + "best_us" : 381.65625 + }, + "vec4_u8" : { + "med_us" : 360.84375, + "best_us" : 360.375 + }, + "vec8_u2" : { + "med_us" : 360.53125, + "best_us" : 360 + }, + "vec8_u8" : { + "med_us" : 359, + "best_us" : 352.6875 + }, + "vec16" : { + "med_us" : 361.65625, + "best_us" : 360.1875 + } + } + }, + "axpy_q8kv" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 425.96875, + "best_us" : 425.625 + }, + "vec32" : { + "med_us" : 423.59375, + "best_us" : 423.25 + }, + "vec32_u4" : { + "med_us" : 426.15625, + "best_us" : 424.625 + }, + "vec32_u8" : { + "med_us" : 425.6875, + "best_us" : 423.84375 + }, + "vec16_u2" : { + "med_us" : 425.21875, + "best_us" : 424.5625 + }, + "vec16_u4" : { + "med_us" : 425.4375, + "best_us" : 424.84375 + }, + "vec16_u8" : { + "med_us" : 425.40625, + "best_us" : 425.3125 + }, + "vec4" : { + "med_us" : 425.59375, + "best_us" : 425.34375 + }, + "vec8" : { + "med_us" : 425.65625, + "best_us" : 420.3125 + }, + "vec4_u4" : { + "med_us" : 425.78125, + "best_us" : 424.53125 + }, + "vec8_u4" : { + "med_us" : 425.59375, + "best_us" : 425.375 + }, + "plain" : { + "med_us" : 425.6875, + "best_us" : 425.46875 + }, + "u2" : { + "med_us" : 425.5, + "best_us" : 422.90625 + }, + "u4" : { + "med_us" : 425.1875, + "best_us" : 425.0625 + }, + "u8" : { + "med_us" : 425.6875, + "best_us" : 424.4375 + }, + "vec4_u2" : { + "med_us" : 425.125, + "best_us" : 420.71875 + }, + "vec4_u8" : { + "med_us" : 425.625, + "best_us" : 425.40625 + }, + "vec8_u2" : { + "med_us" : 425.875, + "best_us" : 425.5 + }, + "vec8_u8" : { + "med_us" : 425.625, + "best_us" : 425.25 + }, + "vec16" : { + "med_us" : 425.75, + "best_us" : 425.375 + } + } + }, + "cvt_f32_to_f16" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 384.75, + "best_us" : 383.5625 + }, + "vec32" : { + "med_us" : 384.59375, + "best_us" : 384.40625 + }, + "vec32_u4" : { + "med_us" : 384.3125, + "best_us" : 371.8125 + }, + "vec32_u8" : { + "med_us" : 378.65625, + "best_us" : 376.5625 + }, + "vec16_u2" : { + "med_us" : 384.71875, + "best_us" : 379.3125 + }, + "vec16_u4" : { + "med_us" : 384.25, + "best_us" : 375.375 + }, + "vec16_u8" : { + "med_us" : 384.28125, + "best_us" : 382.40625 + }, + "vec4" : { + "med_us" : 389.625, + "best_us" : 381.65625 + }, + "vec8" : { + "med_us" : 384.28125, + "best_us" : 384.1875 + }, + "vec4_u4" : { + "med_us" : 389.25, + "best_us" : 386.40625 + }, + "vec8_u4" : { + "med_us" : 384.34375, + "best_us" : 383.625 + }, + "plain" : { + "med_us" : 380.5625, + "best_us" : 376.9375 + }, + "u2" : { + "med_us" : 380.875, + "best_us" : 379.96875 + }, + "u4" : { + "med_us" : 383.125, + "best_us" : 380.34375 + }, + "u8" : { + "med_us" : 381.5, + "best_us" : 380.84375 + }, + "vec4_u2" : { + "med_us" : 389.53125, + "best_us" : 385.03125 + }, + "vec4_u8" : { + "med_us" : 388.59375, + "best_us" : 387.90625 + }, + "vec8_u2" : { + "med_us" : 384.65625, + "best_us" : 380.4375 + }, + "vec8_u8" : { + "med_us" : 383.96875, + "best_us" : 375.21875 + }, + "vec16" : { + "med_us" : 384.5, + "best_us" : 379.65625 + } + } + }, + "rope_scaled_neox_tab" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 1.7613747244362843, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 690.5, + "best_us" : 686.75 + }, + "vec32" : { + "med_us" : 653.2, + "best_us" : 652.6333333333333 + }, + "vec32_u4" : { + "med_us" : 653.4, + "best_us" : 644.4666666666667 + }, + "vec32_u8" : { + "med_us" : 653.7333333333333, + "best_us" : 653.7 + }, + "vec16_u2" : { + "med_us" : 398.34375, + "best_us" : 397.6875 + }, + "vec16_u4" : { + "med_us" : 402.5, + "best_us" : 401.0625 + }, + "vec16_u8" : { + "med_us" : 402.40625, + "best_us" : 399.65625 + }, + "vec4" : { + "med_us" : 423.8125, + "best_us" : 422.53125 + }, + "vec8" : { + "med_us" : 394.1875, + "best_us" : 393.875 + }, + "vec4_u4" : { + "med_us" : 395.53125, + "best_us" : 395.0625 + }, + "vec8_u4" : { + "med_us" : 393.625, + "best_us" : 392.90625 + }, + "plain" : { + "med_us" : 422.78125, + "best_us" : 422.09375 + }, + "u2" : { + "med_us" : 408.53125, + "best_us" : 408.0625 + }, + "u4" : { + "med_us" : 395.59375, + "best_us" : 395.15625 + }, + "u8" : { + "med_us" : 446.03125, + "best_us" : 445.34375 + }, + "vec4_u2" : { + "med_us" : 407.625, + "best_us" : 406.8125 + }, + "vec4_u8" : { + "med_us" : 445.8125, + "best_us" : 445.65625 + }, + "vec8_u2" : { + "med_us" : 396.46875, + "best_us" : 395.90625 + }, + "vec8_u8" : { + "med_us" : 439.125, + "best_us" : 438.15625 + }, + "vec16" : { + "med_us" : 394.1875, + "best_us" : 393.90625 + } + } + }, + "q51q8_tile_gen" : { + "winner" : "mr8_nrsplit2", + "rows" : { + "mr8" : { + "streamed_us" : 612 + }, + "dot_maddubs_width256_mr8" : { + "streamed_us" : 4238 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "streamed_us" : 4261 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "streamed_us" : 4154 + }, + "mr4" : { + "streamed_us" : 617 + }, + "reference" : { + "streamed_us" : 4121 + }, + "mr4_nrsplit2" : { + "streamed_us" : 625 + }, + "dot_vpdpbusd_width256_mr8" : { + "streamed_us" : 4237 + }, + "dot_vpdpbusd_width512_mr16" : { + "streamed_us" : 4257 + }, + "mr8_nrsplit2" : { + "streamed_us" : 621 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "streamed_us" : 4253 + } + } + }, + "softmax" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 3337.6, + "best_us" : 3326.4 + }, + "vec32" : { + "med_us" : 3376.6, + "best_us" : 3278 + }, + "vec32_u4" : { + "med_us" : 3360.2, + "best_us" : 3284 + }, + "vec32_u8" : { + "med_us" : 3359.2, + "best_us" : 3354.6 + }, + "vec16_u2" : { + "med_us" : 3369, + "best_us" : 3355.4 + }, + "vec16_u4" : { + "med_us" : 3371.4, + "best_us" : 3369.4 + }, + "vec16_u8" : { + "med_us" : 3382.6, + "best_us" : 3373 + }, + "vec4" : { + "med_us" : 3346, + "best_us" : 3273.2 + }, + "vec8" : { + "med_us" : 3372, + "best_us" : 3358.8 + }, + "vec4_u4" : { + "med_us" : 3366.4, + "best_us" : 3274.6 + }, + "vec8_u4" : { + "med_us" : 3380.2, + "best_us" : 3327 + }, + "plain" : { + "med_us" : 3369.8, + "best_us" : 3357.4 + }, + "u2" : { + "med_us" : 3381, + "best_us" : 3360 + }, + "u4" : { + "med_us" : 3372.8, + "best_us" : 3361 + }, + "u8" : { + "med_us" : 3368.8, + "best_us" : 3279.4 + }, + "vec4_u2" : { + "med_us" : 3364.4, + "best_us" : 3354.8 + }, + "vec4_u8" : { + "med_us" : 3363.8, + "best_us" : 3349.8 + }, + "vec8_u2" : { + "med_us" : 3371.8, + "best_us" : 3362.2 + }, + "vec8_u8" : { + "med_us" : 3359.4, + "best_us" : 3266.6 + }, + "vec16" : { + "med_us" : 3357, + "best_us" : 3298 + } + } + }, + "q8q8_tile_gen" : { + "winner" : "mr8_budget", + "rows" : { + "kstep1" : { + "tile_us" : 25318, + "gemv_us" : 199, + "hot_us" : 11.125 + }, + "kstep2_nrsplit2" : { + "tile_us" : 28364, + "gemv_us" : 204, + "hot_us" : 11.5625 + }, + "kstep1_nrsplit2" : { + "tile_us" : 28676, + "gemv_us" : 199, + "hot_us" : 11.5625 + }, + "reference" : { + "tile_us" : 37248, + "gemv_us" : 205, + "hot_us" : 11.625 + }, + "kstep4_nrsplit2" : { + "tile_us" : 27838, + "gemv_us" : 202, + "hot_us" : 11.0625 + }, + "kstep4_nrsplit2_mr8_gkstep2" : { + "tile_us" : 26307, + "gemv_us" : 198, + "hot_us" : 10.75 + }, + "kstep1_nrsplit2_mr8" : { + "tile_us" : 25610, + "gemv_us" : 194, + "hot_us" : 10.5625 + }, + "kstep2_nrsplit2_mr8" : { + "tile_us" : 25252, + "gemv_us" : 193, + "hot_us" : 10.4375 + }, + "kstep4_nrsplit2_mr8" : { + "tile_us" : 26315, + "gemv_us" : 202, + "hot_us" : 10.0625 + }, + "kstep2_gkstep2" : { + "tile_us" : 26053, + "gemv_us" : 201, + "hot_us" : 11.1875 + }, + "kstep2_gkstep4" : { + "tile_us" : 26252, + "gemv_us" : 202, + "hot_us" : 11.5 + }, + "kstep4_nrsplit2_mr8_gkstep4" : { + "tile_us" : 26474, + "gemv_us" : 196, + "hot_us" : 10.6875 + }, + "mr8_budget" : { + "tile_us" : 23789, + "gemv_us" : 199, + "hot_us" : 10.5625 + }, + "kstep2" : { + "tile_us" : 26001, + "gemv_us" : 200, + "hot_us" : 11.1875 + }, + "kstep4" : { + "tile_us" : 27476, + "gemv_us" : 201, + "hot_us" : 11.375 + } + } + }, + "mul_inplace" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 360.03125, + "best_us" : 359.875 + }, + "vec32" : { + "med_us" : 387.21875, + "best_us" : 386.84375 + }, + "vec32_u4" : { + "med_us" : 359.8125, + "best_us" : 357.875 + }, + "vec32_u8" : { + "med_us" : 357.0625, + "best_us" : 349.6875 + }, + "vec16_u2" : { + "med_us" : 389.53125, + "best_us" : 389.03125 + }, + "vec16_u4" : { + "med_us" : 360.90625, + "best_us" : 360.53125 + }, + "vec16_u8" : { + "med_us" : 360.5, + "best_us" : 360.21875 + }, + "vec4" : { + "med_us" : 389.875, + "best_us" : 388.34375 + }, + "vec8" : { + "med_us" : 389.53125, + "best_us" : 382.25 + }, + "vec4_u4" : { + "med_us" : 360.90625, + "best_us" : 360.375 + }, + "vec8_u4" : { + "med_us" : 359.375, + "best_us" : 353.65625 + }, + "plain" : { + "med_us" : 387.5, + "best_us" : 383.6875 + }, + "u2" : { + "med_us" : 389.4375, + "best_us" : 388.90625 + }, + "u4" : { + "med_us" : 360.5, + "best_us" : 360.25 + }, + "u8" : { + "med_us" : 360.09375, + "best_us" : 351.53125 + }, + "vec4_u2" : { + "med_us" : 388.71875, + "best_us" : 388.40625 + }, + "vec4_u8" : { + "med_us" : 360.5, + "best_us" : 360.40625 + }, + "vec8_u2" : { + "med_us" : 360, + "best_us" : 351.3125 + }, + "vec8_u8" : { + "med_us" : 359.21875, + "best_us" : 354.625 + }, + "vec16" : { + "med_us" : 389.125, + "best_us" : 388.65625 + } + } + }, + "k4q8_tile_gen" : { + "winner" : "mr8", + "rows" : { + "mr8" : { + "tile_us" : 29532, + "gemv_us" : 172, + "hot_us" : 10.75 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 505194, + "gemv_us" : 2390, + "hot_us" : 149.1875 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 505227, + "gemv_us" : 2326, + "hot_us" : 143.875 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 505354, + "gemv_us" : 2388, + "hot_us" : 149.5 + }, + "mr4" : { + "tile_us" : 32617, + "gemv_us" : 196, + "hot_us" : 12.3125 + }, + "reference" : { + "tile_us" : 505903, + "gemv_us" : 2390, + "hot_us" : 149.1875 + }, + "mr4_nrsplit2" : { + "tile_us" : 39827, + "gemv_us" : 196, + "hot_us" : 12.625 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 505345, + "gemv_us" : 2389, + "hot_us" : 149.3125 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 505156, + "gemv_us" : 2385, + "hot_us" : 149.125 + }, + "mr8_nrsplit2" : { + "tile_us" : 35621, + "gemv_us" : 185, + "hot_us" : 11.75 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 505229, + "gemv_us" : 2387, + "hot_us" : 149.1875 + } + } + }, + "k5q8_tile_gen" : { + "winner" : "mr8", + "rows" : { + "mr8" : { + "tile_us" : 29375, + "gemv_us" : 462, + "hot_us" : 29 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 247072, + "gemv_us" : 2721, + "hot_us" : 169.5 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 247403, + "gemv_us" : 2716, + "hot_us" : 169.625 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 248149, + "gemv_us" : 2717, + "hot_us" : 169.6875 + }, + "mr4" : { + "tile_us" : 31521, + "gemv_us" : 459, + "hot_us" : 28.625 + }, + "reference" : { + "tile_us" : 248486, + "gemv_us" : 2718, + "hot_us" : 170.375 + }, + "mr4_nrsplit2" : { + "tile_us" : 35762, + "gemv_us" : 454, + "hot_us" : 28.5 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 247153, + "gemv_us" : 2718, + "hot_us" : 169.375 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 247852, + "gemv_us" : 2715, + "hot_us" : 169.875 + }, + "mr8_nrsplit2" : { + "tile_us" : 31916, + "gemv_us" : 454, + "hot_us" : 28.5 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 247010, + "gemv_us" : 2722, + "hot_us" : 169.625 + } + } + }, + "k6q8_tile_gen" : { + "winner" : "mr4", + "rows" : { + "mr8" : { + "tile_us" : 46119, + "gemv_us" : 374, + "hot_us" : 23.25 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 221550, + "gemv_us" : 6528, + "hot_us" : 406.875 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 221782, + "gemv_us" : 6430, + "hot_us" : 400.875 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 221562, + "gemv_us" : 6516, + "hot_us" : 407.5 + }, + "mr4" : { + "tile_us" : 40898, + "gemv_us" : 367, + "hot_us" : 22.9375 + }, + "reference" : { + "tile_us" : 221607, + "gemv_us" : 6533, + "hot_us" : 403.125 + }, + "mr4_nrsplit2" : { + "tile_us" : 43590, + "gemv_us" : 350, + "hot_us" : 22.125 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 221882, + "gemv_us" : 6534, + "hot_us" : 388.75 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 221654, + "gemv_us" : 6533, + "hot_us" : 405.875 + }, + "mr8_nrsplit2" : { + "tile_us" : 46320, + "gemv_us" : 379, + "hot_us" : 23.4375 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 222013, + "gemv_us" : 6536, + "hot_us" : 407.3125 + } + } + }, + "quantize_q8_0_into_ptr" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 1.7613747244362843, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 2681.285714285714, + "best_us" : 2632 + }, + "vec32" : { + "med_us" : 2664.5714285714284, + "best_us" : 2627.285714285714 + }, + "vec32_u4" : { + "med_us" : 2673.8571428571427, + "best_us" : 2623 + }, + "vec32_u8" : { + "med_us" : 2657.5714285714284, + "best_us" : 2597.285714285714 + }, + "vec16_u2" : { + "med_us" : 2647.285714285714, + "best_us" : 2595 + }, + "vec16_u4" : { + "med_us" : 2663.285714285714, + "best_us" : 2634.285714285714 + }, + "vec16_u8" : { + "med_us" : 2652.714285714286, + "best_us" : 2649 + }, + "vec4" : { + "med_us" : 2664.714285714286, + "best_us" : 2642.285714285714 + }, + "vec8" : { + "med_us" : 2648.5714285714284, + "best_us" : 2640.714285714286 + }, + "vec4_u4" : { + "med_us" : 3373, + "best_us" : 3305.8 + }, + "vec8_u4" : { + "med_us" : 2760.1428571428573, + "best_us" : 2690.285714285714 + }, + "plain" : { + "med_us" : 2708.4285714285716, + "best_us" : 2680 + }, + "u2" : { + "med_us" : 2644.5714285714284, + "best_us" : 2594.8571428571427 + }, + "u4" : { + "med_us" : 2659.8571428571427, + "best_us" : 2639.285714285714 + }, + "u8" : { + "med_us" : 2653.5714285714284, + "best_us" : 2647.714285714286 + }, + "vec4_u2" : { + "med_us" : 3371.2, + "best_us" : 3352.2 + }, + "vec4_u8" : { + "med_us" : 3336.2, + "best_us" : 3307 + }, + "vec8_u2" : { + "med_us" : 2755, + "best_us" : 2728.5714285714284 + }, + "vec8_u8" : { + "med_us" : 2756.285714285714, + "best_us" : 2732.285714285714 + }, + "vec16" : { + "med_us" : 2664.5714285714284, + "best_us" : 2581.8571428571427 + } + } + }, + "dot_q8kv" : { + "winner" : "vec4_u2", + "fallback" : "vec8_u2", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 23.803627243395837, + "rows" : { + "vec32_u2" : { + "med_us" : 1353.4285714285713, + "best_us" : 1334.357142857143 + }, + "vec32" : { + "med_us" : 2033.6666666666667, + "best_us" : 2016.4444444444443 + }, + "vec32_u4" : { + "med_us" : 1351, + "best_us" : 1315.857142857143 + }, + "vec32_u8" : { + "med_us" : 1351.642857142857, + "best_us" : 1340.2142857142858 + }, + "vec16_u2" : { + "med_us" : 928.952380952381, + "best_us" : 914.8095238095239 + }, + "vec16_u4" : { + "med_us" : 927.35, + "best_us" : 912.05 + }, + "vec16_u8" : { + "med_us" : 923.2857142857143, + "best_us" : 900.5238095238095 + }, + "vec4" : { + "med_us" : 2037.111111111111, + "best_us" : 1984.3333333333333 + }, + "vec8" : { + "med_us" : 2030.5555555555557, + "best_us" : 2028.2222222222222 + }, + "vec4_u4" : { + "med_us" : 540, + "best_us" : 526.90625 + }, + "vec8_u4" : { + "med_us" : 712.1304347826087, + "best_us" : 700.304347826087 + }, + "plain" : { + "med_us" : 2029.111111111111, + "best_us" : 2019.7777777777778 + }, + "u2" : { + "med_us" : 1296.142857142857, + "best_us" : 1261.857142857143 + }, + "u4" : { + "med_us" : 1301, + "best_us" : 1296.0666666666666 + }, + "u8" : { + "med_us" : 1299.0666666666666, + "best_us" : 1296.6666666666667 + }, + "vec4_u2" : { + "med_us" : 539.703125, + "best_us" : 530.25 + }, + "vec4_u8" : { + "med_us" : 539.890625, + "best_us" : 523.625 + }, + "vec8_u2" : { + "med_us" : 711.24, + "best_us" : 689.64 + }, + "vec8_u8" : { + "med_us" : 713.04, + "best_us" : 702.36 + }, + "vec16" : { + "med_us" : 2030, + "best_us" : 1992.3333333333333 + } + } + }, + "quantize_q8_0_bs_into_ptr" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 1.7613747244362843, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 3191, + "best_us" : 3151.1666666666665 + }, + "vec32" : { + "med_us" : 2462.625, + "best_us" : 2390.875 + }, + "vec32_u4" : { + "med_us" : 3192.1666666666665, + "best_us" : 3177.6666666666665 + }, + "vec32_u8" : { + "med_us" : 3191.6666666666665, + "best_us" : 3074.3333333333335 + }, + "vec16_u2" : { + "med_us" : 3183.8333333333335, + "best_us" : 3133.1666666666665 + }, + "vec16_u4" : { + "med_us" : 3177.6666666666665, + "best_us" : 3092.5 + }, + "vec16_u8" : { + "med_us" : 3176.6666666666665, + "best_us" : 3135.1666666666665 + }, + "vec4" : { + "med_us" : 2397.75, + "best_us" : 2325.625 + }, + "vec8" : { + "med_us" : 2405.125, + "best_us" : 2402.75 + }, + "vec4_u4" : { + "med_us" : 3398.2, + "best_us" : 3372.8 + }, + "vec8_u4" : { + "med_us" : 3145.8333333333335, + "best_us" : 3084 + }, + "plain" : { + "med_us" : 2401.75, + "best_us" : 2319.375 + }, + "u2" : { + "med_us" : 3252.3333333333335, + "best_us" : 3215.5 + }, + "u4" : { + "med_us" : 3156.3333333333335, + "best_us" : 3075.5 + }, + "u8" : { + "med_us" : 3173.3333333333335, + "best_us" : 3082.1666666666665 + }, + "vec4_u2" : { + "med_us" : 3407.2, + "best_us" : 3368 + }, + "vec4_u8" : { + "med_us" : 3406.2, + "best_us" : 3396 + }, + "vec8_u2" : { + "med_us" : 3149.8333333333335, + "best_us" : 3074.8333333333335 + }, + "vec8_u8" : { + "med_us" : 3151.1666666666665, + "best_us" : 3116.5 + }, + "vec16" : { + "med_us" : 2407.75, + "best_us" : 2373.375 + } + } + }, + "dot_q8q8" : { + "winner" : "vec16", + "fallback" : "vec16", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 643.4193548387096, + "best_us" : 639.516129032258 + }, + "vec32" : { + "med_us" : 645.0322580645161, + "best_us" : 643.8387096774194 + }, + "vec32_u4" : { + "med_us" : 643.741935483871, + "best_us" : 641.8387096774194 + }, + "vec32_u8" : { + "med_us" : 642.4666666666667, + "best_us" : 641.5333333333333 + }, + "vec16_u2" : { + "med_us" : 643.3225806451613, + "best_us" : 642.0645161290323 + }, + "vec16_u4" : { + "med_us" : 643.09375, + "best_us" : 641.9375 + }, + "vec16_u8" : { + "med_us" : 643.0967741935484, + "best_us" : 642.258064516129 + }, + "vec4" : { + "med_us" : 643.3666666666667, + "best_us" : 642.1 + }, + "vec8" : { + "med_us" : 642.8387096774194, + "best_us" : 639.8387096774194 + }, + "vec4_u4" : { + "med_us" : 2080.6666666666665, + "best_us" : 2080.4444444444443 + }, + "vec8_u4" : { + "med_us" : 800.625, + "best_us" : 800 + }, + "plain" : { + "med_us" : 643.0689655172414, + "best_us" : 642.8620689655172 + }, + "u2" : { + "med_us" : 641.2666666666667, + "best_us" : 639.4666666666667 + }, + "u4" : { + "med_us" : 641.5, + "best_us" : 641.1 + }, + "u8" : { + "med_us" : 641.0333333333333, + "best_us" : 640.8333333333334 + }, + "vec4_u2" : { + "med_us" : 2080.5555555555557, + "best_us" : 2071.1111111111113 + }, + "vec4_u8" : { + "med_us" : 2081.222222222222, + "best_us" : 2049.222222222222 + }, + "vec8_u2" : { + "med_us" : 800.9090909090909, + "best_us" : 800.1818181818181 + }, + "vec8_u8" : { + "med_us" : 801.2, + "best_us" : 797.2 + }, + "vec16" : { + "med_us" : 644.5483870967741, + "best_us" : 643.483870967742 + } + } + }, + "gemm_f32_uk_4x16" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 1.7613747244362843, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 577.90625, + "best_us" : 572.625 + }, + "vec32" : { + "med_us" : 638.7741935483871, + "best_us" : 634.0645161290323 + }, + "vec32_u4" : { + "med_us" : 587.25, + "best_us" : 584.5625 + }, + "vec32_u8" : { + "med_us" : 583.75, + "best_us" : 574.96875 + }, + "vec16_u2" : { + "med_us" : 578.28125, + "best_us" : 577.8125 + }, + "vec16_u4" : { + "med_us" : 586.96875, + "best_us" : 584.5 + }, + "vec16_u8" : { + "med_us" : 583.75, + "best_us" : 579.65625 + }, + "vec4" : { + "med_us" : 640.483870967742, + "best_us" : 636.5483870967741 + }, + "vec8" : { + "med_us" : 640.6451612903226, + "best_us" : 634.4193548387096 + }, + "vec4_u4" : { + "med_us" : 586.8125, + "best_us" : 584.5 + }, + "vec8_u4" : { + "med_us" : 586.5, + "best_us" : 581.40625 + }, + "plain" : { + "med_us" : 640.483870967742, + "best_us" : 634.2258064516129 + }, + "u2" : { + "med_us" : 578.21875, + "best_us" : 576.78125 + }, + "u4" : { + "med_us" : 587.875, + "best_us" : 587 + }, + "u8" : { + "med_us" : 583.8125, + "best_us" : 583.5625 + }, + "vec4_u2" : { + "med_us" : 577.84375, + "best_us" : 577.65625 + }, + "vec4_u8" : { + "med_us" : 584.53125, + "best_us" : 582.78125 + }, + "vec8_u2" : { + "med_us" : 577.9375, + "best_us" : 577.75 + }, + "vec8_u8" : { + "med_us" : 583.34375, + "best_us" : 582.96875 + }, + "vec16" : { + "med_us" : 641, + "best_us" : 634.4193548387096 + } + } + }, + "quantize_q8kv_row" : { + "winner" : "plain", + "fallback" : "plain", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1288.9333333333334, + "best_us" : 1271.5333333333333 + }, + "vec32" : { + "med_us" : 1274.7333333333333, + "best_us" : 1259.6666666666667 + }, + "vec32_u4" : { + "med_us" : 1294.9333333333334, + "best_us" : 1254.4666666666667 + }, + "vec32_u8" : { + "med_us" : 1296.2666666666667, + "best_us" : 1284.4 + }, + "vec16_u2" : { + "med_us" : 1313.7333333333333, + "best_us" : 1288.9333333333334 + }, + "vec16_u4" : { + "med_us" : 1281.4666666666667, + "best_us" : 1271 + }, + "vec16_u8" : { + "med_us" : 1274.2666666666667, + "best_us" : 1244.4666666666667 + }, + "vec4" : { + "med_us" : 1313.4666666666667, + "best_us" : 1274.8 + }, + "vec8" : { + "med_us" : 1313.4, + "best_us" : 1312.4 + }, + "vec4_u4" : { + "med_us" : 1628.8333333333333, + "best_us" : 1626.4166666666667 + }, + "vec8_u4" : { + "med_us" : 1334.0714285714287, + "best_us" : 1320.7857142857142 + }, + "plain" : { + "med_us" : 1311.5333333333333, + "best_us" : 1280.8 + }, + "u2" : { + "med_us" : 1283.7333333333333, + "best_us" : 1228.7333333333333 + }, + "u4" : { + "med_us" : 1287.8, + "best_us" : 1264.8 + }, + "u8" : { + "med_us" : 1283.9333333333334, + "best_us" : 1259.2666666666667 + }, + "vec4_u2" : { + "med_us" : 1626.090909090909, + "best_us" : 1587.8181818181818 + }, + "vec4_u8" : { + "med_us" : 1634.0833333333333, + "best_us" : 1626.6666666666667 + }, + "vec8_u2" : { + "med_us" : 1335.2142857142858, + "best_us" : 1294.357142857143 + }, + "vec8_u8" : { + "med_us" : 1334.5714285714287, + "best_us" : 1279.142857142857 + }, + "vec16" : { + "med_us" : 1276.4, + "best_us" : 1246.7333333333333 + } + } + }, + "dot_f16" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 303.9375, + "best_us" : 303.71875 + }, + "vec32" : { + "med_us" : 305.59375, + "best_us" : 305.25 + }, + "vec32_u4" : { + "med_us" : 304.9375, + "best_us" : 304.40625 + }, + "vec32_u8" : { + "med_us" : 306.03125, + "best_us" : 305.90625 + }, + "vec16_u2" : { + "med_us" : 288.1875, + "best_us" : 287.3125 + }, + "vec16_u4" : { + "med_us" : 288.3125, + "best_us" : 282.5 + }, + "vec16_u8" : { + "med_us" : 289.5625, + "best_us" : 288.28125 + }, + "vec4" : { + "med_us" : 439.3125, + "best_us" : 430.875 + }, + "vec8" : { + "med_us" : 278, + "best_us" : 277.71875 + }, + "vec4_u4" : { + "med_us" : 445.9375, + "best_us" : 444.25 + }, + "vec8_u4" : { + "med_us" : 279.3125, + "best_us" : 277.875 + }, + "plain" : { + "med_us" : 3954.25, + "best_us" : 3949.25 + }, + "u2" : { + "med_us" : 3944.8, + "best_us" : 3939.6 + }, + "u4" : { + "med_us" : 3979.2, + "best_us" : 3977.6 + }, + "u8" : { + "med_us" : 3969.4, + "best_us" : 3967 + }, + "vec4_u2" : { + "med_us" : 445.625, + "best_us" : 443.15625 + }, + "vec4_u8" : { + "med_us" : 444.03125, + "best_us" : 443.0625 + }, + "vec8_u2" : { + "med_us" : 279.71875, + "best_us" : 277.3125 + }, + "vec8_u8" : { + "med_us" : 280.15625, + "best_us" : 278.1875 + }, + "vec16" : { + "med_us" : 286.65625, + "best_us" : 284.96875 + } + } + }, + "axpy_f16" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 308.53125, + "best_us" : 305.59375 + }, + "vec32" : { + "med_us" : 310.75, + "best_us" : 310.28125 + }, + "vec32_u4" : { + "med_us" : 307.84375, + "best_us" : 306 + }, + "vec32_u8" : { + "med_us" : 308.125, + "best_us" : 306.0625 + }, + "vec16_u2" : { + "med_us" : 308.15625, + "best_us" : 306.75 + }, + "vec16_u4" : { + "med_us" : 306.46875, + "best_us" : 304.125 + }, + "vec16_u8" : { + "med_us" : 305.6875, + "best_us" : 304.75 + }, + "vec4" : { + "med_us" : 314.90625, + "best_us" : 313.34375 + }, + "vec8" : { + "med_us" : 309.4375, + "best_us" : 304.53125 + }, + "vec4_u4" : { + "med_us" : 306.21875, + "best_us" : 306.09375 + }, + "vec8_u4" : { + "med_us" : 308.3125, + "best_us" : 306.84375 + }, + "plain" : { + "med_us" : 309.5, + "best_us" : 306.34375 + }, + "u2" : { + "med_us" : 308.90625, + "best_us" : 306.8125 + }, + "u4" : { + "med_us" : 308.46875, + "best_us" : 307.71875 + }, + "u8" : { + "med_us" : 308.0625, + "best_us" : 307.03125 + }, + "vec4_u2" : { + "med_us" : 321.46875, + "best_us" : 311.53125 + }, + "vec4_u8" : { + "med_us" : 310.6875, + "best_us" : 309.53125 + }, + "vec8_u2" : { + "med_us" : 307.78125, + "best_us" : 306.78125 + }, + "vec8_u8" : { + "med_us" : 307.3125, + "best_us" : 306.09375 + }, + "vec16" : { + "med_us" : 305.96875, + "best_us" : 304.125 + } + } + }, + "cvt_f16_to_f32" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 271.1875, + "best_us" : 268.03125 + }, + "vec32" : { + "med_us" : 273.8125, + "best_us" : 267.75 + }, + "vec32_u4" : { + "med_us" : 269.96875, + "best_us" : 268.0625 + }, + "vec32_u8" : { + "med_us" : 269.59375, + "best_us" : 268.84375 + }, + "vec16_u2" : { + "med_us" : 270.53125, + "best_us" : 263.59375 + }, + "vec16_u4" : { + "med_us" : 270.28125, + "best_us" : 259.375 + }, + "vec16_u8" : { + "med_us" : 271.03125, + "best_us" : 262.46875 + }, + "vec4" : { + "med_us" : 307.78125, + "best_us" : 272.65625 + }, + "vec8" : { + "med_us" : 276.125, + "best_us" : 259.5 + }, + "vec4_u4" : { + "med_us" : 271.875, + "best_us" : 270.21875 + }, + "vec8_u4" : { + "med_us" : 269.46875, + "best_us" : 267.84375 + }, + "plain" : { + "med_us" : 274.8125, + "best_us" : 270.96875 + }, + "u2" : { + "med_us" : 269.34375, + "best_us" : 262.09375 + }, + "u4" : { + "med_us" : 268.9375, + "best_us" : 267.9375 + }, + "u8" : { + "med_us" : 269.09375, + "best_us" : 262.96875 + }, + "vec4_u2" : { + "med_us" : 324.75, + "best_us" : 287.34375 + }, + "vec4_u8" : { + "med_us" : 271.0625, + "best_us" : 262.6875 + }, + "vec8_u2" : { + "med_us" : 270.03125, + "best_us" : 267.3125 + }, + "vec8_u8" : { + "med_us" : 268.6875, + "best_us" : 267.78125 + }, + "vec16" : { + "med_us" : 271.59375, + "best_us" : 266.03125 + } + } + }, + "dot" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1764.7272727272727, + "best_us" : 1745.2727272727273 + }, + "vec32" : { + "med_us" : 1749.909090909091, + "best_us" : 1704.8181818181818 + }, + "vec32_u4" : { + "med_us" : 1777.3636363636363, + "best_us" : 1746.909090909091 + }, + "vec32_u8" : { + "med_us" : 1772.909090909091, + "best_us" : 1759 + }, + "vec16_u2" : { + "med_us" : 1756.909090909091, + "best_us" : 1740.2727272727273 + }, + "vec16_u4" : { + "med_us" : 1766.1818181818182, + "best_us" : 1762.6363636363637 + }, + "vec16_u8" : { + "med_us" : 1778.6363636363637, + "best_us" : 1773.3636363636363 + }, + "vec4" : { + "med_us" : 1845.090909090909, + "best_us" : 1836.3636363636363 + }, + "vec8" : { + "med_us" : 1742.1818181818182, + "best_us" : 1724.1818181818182 + }, + "vec4_u4" : { + "med_us" : 1842.2, + "best_us" : 1834.7 + }, + "vec8_u4" : { + "med_us" : 1771.4545454545455, + "best_us" : 1755.2727272727273 + }, + "plain" : { + "med_us" : 15629, + "best_us" : 15593 + }, + "u2" : { + "med_us" : 15594, + "best_us" : 15542 + }, + "u4" : { + "med_us" : 15535, + "best_us" : 15525 + }, + "u8" : { + "med_us" : 15735, + "best_us" : 15707 + }, + "vec4_u2" : { + "med_us" : 1862, + "best_us" : 1825 + }, + "vec4_u8" : { + "med_us" : 1844.3, + "best_us" : 1833.9 + }, + "vec8_u2" : { + "med_us" : 1760.3636363636363, + "best_us" : 1748.909090909091 + }, + "vec8_u8" : { + "med_us" : 1768.3636363636363, + "best_us" : 1741.7272727272727 + }, + "vec16" : { + "med_us" : 1742.8181818181818, + "best_us" : 1710.1818181818182 + } + } + }, + "q40q8_tile_gen" : { + "winner" : "mr8", + "rows" : { + "mr8" : { + "tile_us" : 30722, + "gemv_us" : 177, + "hot_us" : 10.5625 + }, + "dot_maddubs_width256_mr8" : { + "tile_us" : 337320, + "gemv_us" : 1334, + "hot_us" : 82.25 + }, + "dot_vpdpbusd_width256_mr8_nrsplit2" : { + "tile_us" : 335168, + "gemv_us" : 1221, + "hot_us" : 77.0625 + }, + "dot_maddubs_width256_mr8_nrsplit2" : { + "tile_us" : 335817, + "gemv_us" : 1328, + "hot_us" : 81.6875 + }, + "mr4" : { + "tile_us" : 35118, + "gemv_us" : 185, + "hot_us" : 11.5 + }, + "reference" : { + "tile_us" : 334568, + "gemv_us" : 1309, + "hot_us" : 81 + }, + "mr4_nrsplit2" : { + "tile_us" : 38919, + "gemv_us" : 188, + "hot_us" : 11.125 + }, + "dot_vpdpbusd_width256_mr8" : { + "tile_us" : 335445, + "gemv_us" : 1317, + "hot_us" : 82 + }, + "dot_vpdpbusd_width512_mr16" : { + "tile_us" : 335041, + "gemv_us" : 1313, + "hot_us" : 81.6875 + }, + "mr8_nrsplit2" : { + "tile_us" : 34840, + "gemv_us" : 157, + "hot_us" : 9.8125 + }, + "dot_vpdpbusd_width512_mr16_nrsplit2" : { + "tile_us" : 335836, + "gemv_us" : 1315, + "hot_us" : 81 + } + } + }, + "axpy" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 360.84375, + "best_us" : 360.4375 + }, + "vec32" : { + "med_us" : 387.0625, + "best_us" : 382.09375 + }, + "vec32_u4" : { + "med_us" : 360.46875, + "best_us" : 360.34375 + }, + "vec32_u8" : { + "med_us" : 360.09375, + "best_us" : 359.6875 + }, + "vec16_u2" : { + "med_us" : 381.0625, + "best_us" : 371.5625 + }, + "vec16_u4" : { + "med_us" : 360.46875, + "best_us" : 357.15625 + }, + "vec16_u8" : { + "med_us" : 359.3125, + "best_us" : 355.46875 + }, + "vec4" : { + "med_us" : 380.8125, + "best_us" : 375.28125 + }, + "vec8" : { + "med_us" : 387, + "best_us" : 383.125 + }, + "vec4_u4" : { + "med_us" : 358.375, + "best_us" : 355.5625 + }, + "vec8_u4" : { + "med_us" : 360.5625, + "best_us" : 360.375 + }, + "plain" : { + "med_us" : 376.34375, + "best_us" : 375.3125 + }, + "u2" : { + "med_us" : 385.375, + "best_us" : 382.21875 + }, + "u4" : { + "med_us" : 360.5, + "best_us" : 358.3125 + }, + "u8" : { + "med_us" : 360.21875, + "best_us" : 358.03125 + }, + "vec4_u2" : { + "med_us" : 371.8125, + "best_us" : 366.40625 + }, + "vec4_u8" : { + "med_us" : 359.90625, + "best_us" : 359.03125 + }, + "vec8_u2" : { + "med_us" : 360.9375, + "best_us" : 360.59375 + }, + "vec8_u8" : { + "med_us" : 359.875, + "best_us" : 359.53125 + }, + "vec16" : { + "med_us" : 386.4375, + "best_us" : 385.5 + } + } + }, + "dot_q8q8kv" : { + "winner" : "plain", + "fallback" : "vec16", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 4.878572963679346, + "rows" : { + "vec32_u2" : { + "med_us" : 156.0625, + "best_us" : 155.96875 + }, + "vec32" : { + "med_us" : 145.78125, + "best_us" : 145.71875 + }, + "vec32_u4" : { + "med_us" : 156.1875, + "best_us" : 156.03125 + }, + "vec32_u8" : { + "med_us" : 156.1875, + "best_us" : 155.84375 + }, + "vec16_u2" : { + "med_us" : 157.15625, + "best_us" : 155.15625 + }, + "vec16_u4" : { + "med_us" : 157.3125, + "best_us" : 157.125 + }, + "vec16_u8" : { + "med_us" : 157.375, + "best_us" : 157.09375 + }, + "vec4" : { + "med_us" : 138.359375, + "best_us" : 135.21875 + }, + "vec8" : { + "med_us" : 138.34375, + "best_us" : 137.9375 + }, + "vec4_u4" : { + "med_us" : 520.34375, + "best_us" : 512.1875 + }, + "vec8_u4" : { + "med_us" : 208, + "best_us" : 207.875 + }, + "plain" : { + "med_us" : 138.0625, + "best_us" : 136.9375 + }, + "u2" : { + "med_us" : 157.71875, + "best_us" : 156.34375 + }, + "u4" : { + "med_us" : 157.5, + "best_us" : 157.375 + }, + "u8" : { + "med_us" : 157.71875, + "best_us" : 157.59375 + }, + "vec4_u2" : { + "med_us" : 523.0625, + "best_us" : 509.9375 + }, + "vec4_u8" : { + "med_us" : 521.28125, + "best_us" : 509.40625 + }, + "vec8_u2" : { + "med_us" : 207.84375, + "best_us" : 205.53125 + }, + "vec8_u8" : { + "med_us" : 207.71875, + "best_us" : 207.625 + }, + "vec16" : { + "med_us" : 145.609375, + "best_us" : 141.0625 + } + } + }, + "dot_mx4q8" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 1.7613747244362843, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 175.4375, + "best_us" : 175.25 + }, + "vec32" : { + "med_us" : 175.5, + "best_us" : 175.3125 + }, + "vec32_u4" : { + "med_us" : 175.6875, + "best_us" : 175.375 + }, + "vec32_u8" : { + "med_us" : 176.59375, + "best_us" : 176.1875 + }, + "vec16_u2" : { + "med_us" : 175.34375, + "best_us" : 175.09375 + }, + "vec16_u4" : { + "med_us" : 175.75, + "best_us" : 175.5625 + }, + "vec16_u8" : { + "med_us" : 176.21875, + "best_us" : 176.0625 + }, + "vec4" : { + "med_us" : 174.625, + "best_us" : 173.0625 + }, + "vec8" : { + "med_us" : 176, + "best_us" : 175.34375 + }, + "vec4_u4" : { + "med_us" : 175.5625, + "best_us" : 175.3125 + }, + "vec8_u4" : { + "med_us" : 176, + "best_us" : 175.5 + }, + "plain" : { + "med_us" : 175.46875, + "best_us" : 175.34375 + }, + "u2" : { + "med_us" : 175.53125, + "best_us" : 175.25 + }, + "u4" : { + "med_us" : 175.4375, + "best_us" : 175.21875 + }, + "u8" : { + "med_us" : 176.21875, + "best_us" : 171.59375 + }, + "vec4_u2" : { + "med_us" : 175.21875, + "best_us" : 174.46875 + }, + "vec4_u8" : { + "med_us" : 176.25, + "best_us" : 175.9375 + }, + "vec8_u2" : { + "med_us" : 175.4375, + "best_us" : 175.1875 + }, + "vec8_u8" : { + "med_us" : 176.625, + "best_us" : 176.375 + }, + "vec16" : { + "med_us" : 175.65625, + "best_us" : 175.3125 + } + } + }, + "dot_q8q8_laneq4x4" : { + "winner" : "u2", + "fallback" : "u2", + "floor_pct" : 1.7613747244362843, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 831.0416666666666, + "best_us" : 822.2916666666666 + }, + "vec32" : { + "med_us" : 823.625, + "best_us" : 808.2083333333334 + }, + "vec32_u4" : { + "med_us" : 824.5, + "best_us" : 821.6666666666666 + }, + "vec32_u8" : { + "med_us" : 941.952380952381, + "best_us" : 917.2857142857143 + }, + "vec16_u2" : { + "med_us" : 830.2083333333334, + "best_us" : 823.0833333333334 + }, + "vec16_u4" : { + "med_us" : 825.2916666666666, + "best_us" : 824.375 + }, + "vec16_u8" : { + "med_us" : 946.6666666666666, + "best_us" : 911.4285714285714 + }, + "vec4" : { + "med_us" : 821.9166666666666, + "best_us" : 812.9583333333334 + }, + "vec8" : { + "med_us" : 822.6666666666666, + "best_us" : 819.5833333333334 + }, + "vec4_u4" : { + "med_us" : 823.625, + "best_us" : 819.6666666666666 + }, + "vec8_u4" : { + "med_us" : 824.7083333333334, + "best_us" : 807.7083333333334 + }, + "plain" : { + "med_us" : 822.8333333333334, + "best_us" : 818.125 + }, + "u2" : { + "med_us" : 830.7916666666666, + "best_us" : 828.5 + }, + "u4" : { + "med_us" : 822.4166666666666, + "best_us" : 811.9583333333334 + }, + "u8" : { + "med_us" : 946.5238095238095, + "best_us" : 927.2857142857143 + }, + "vec4_u2" : { + "med_us" : 828.6666666666666, + "best_us" : 826.7916666666666 + }, + "vec4_u8" : { + "med_us" : 946.047619047619, + "best_us" : 942.0952380952381 + }, + "vec8_u2" : { + "med_us" : 830.3913043478261, + "best_us" : 826.6521739130435 + }, + "vec8_u8" : { + "med_us" : 945.952380952381, + "best_us" : 928.7142857142857 + }, + "vec16" : { + "med_us" : 822.5, + "best_us" : 810.4166666666666 + } + } + }, + "scale_inplace" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 273.53125, + "best_us" : 267.40625 + }, + "vec32" : { + "med_us" : 270.125, + "best_us" : 269.65625 + }, + "vec32_u4" : { + "med_us" : 272.4375, + "best_us" : 267.71875 + }, + "vec32_u8" : { + "med_us" : 272.625, + "best_us" : 269.71875 + }, + "vec16_u2" : { + "med_us" : 279.8125, + "best_us" : 278.71875 + }, + "vec16_u4" : { + "med_us" : 276.71875, + "best_us" : 267.46875 + }, + "vec16_u8" : { + "med_us" : 291.125, + "best_us" : 288.1875 + }, + "vec4" : { + "med_us" : 267.34375, + "best_us" : 267 + }, + "vec8" : { + "med_us" : 269.90625, + "best_us" : 269.78125 + }, + "vec4_u4" : { + "med_us" : 267.78125, + "best_us" : 267.5 + }, + "vec8_u4" : { + "med_us" : 273.59375, + "best_us" : 270.75 + }, + "plain" : { + "med_us" : 267.125, + "best_us" : 266.6875 + }, + "u2" : { + "med_us" : 267, + "best_us" : 263.96875 + }, + "u4" : { + "med_us" : 269, + "best_us" : 268.875 + }, + "u8" : { + "med_us" : 268.8125, + "best_us" : 266.25 + }, + "vec4_u2" : { + "med_us" : 266.65625, + "best_us" : 265.3125 + }, + "vec4_u8" : { + "med_us" : 269.1875, + "best_us" : 268.96875 + }, + "vec8_u2" : { + "med_us" : 273.34375, + "best_us" : 265.21875 + }, + "vec8_u8" : { + "med_us" : 270.03125, + "best_us" : 268.125 + }, + "vec16" : { + "med_us" : 279.75, + "best_us" : 278.65625 + } + } + }, + "dot_q4" : { + "winner" : "vec4_u4", + "fallback" : "vec4_u4", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 1765, + "best_us" : 1762.7272727272727 + }, + "vec32" : { + "med_us" : 2215.1111111111113, + "best_us" : 2210.3333333333335 + }, + "vec32_u4" : { + "med_us" : 1684.090909090909, + "best_us" : 1674.090909090909 + }, + "vec32_u8" : { + "med_us" : 1645.9166666666667, + "best_us" : 1638.1666666666667 + }, + "vec16_u2" : { + "med_us" : 1084.0526315789473, + "best_us" : 1054.157894736842 + }, + "vec16_u4" : { + "med_us" : 1085.0526315789473, + "best_us" : 1077.8947368421052 + }, + "vec16_u8" : { + "med_us" : 1085.7894736842106, + "best_us" : 1073.3157894736842 + }, + "vec4" : { + "med_us" : 2195.75, + "best_us" : 2162.625 + }, + "vec8" : { + "med_us" : 2217.75, + "best_us" : 2213.5 + }, + "vec4_u4" : { + "med_us" : 865.4545454545455, + "best_us" : 850.0909090909091 + }, + "vec8_u4" : { + "med_us" : 906.6521739130435, + "best_us" : 880.5217391304348 + }, + "plain" : { + "med_us" : 2226.75, + "best_us" : 2205.375 + }, + "u2" : { + "med_us" : 1089.764705882353, + "best_us" : 1066.8823529411766 + }, + "u4" : { + "med_us" : 1090.111111111111, + "best_us" : 1084.5555555555557 + }, + "u8" : { + "med_us" : 1089.6470588235295, + "best_us" : 1076.7058823529412 + }, + "vec4_u2" : { + "med_us" : 872.1818181818181, + "best_us" : 854.5454545454545 + }, + "vec4_u8" : { + "med_us" : 869.2272727272727, + "best_us" : 866.5 + }, + "vec8_u2" : { + "med_us" : 907.2380952380952, + "best_us" : 896.6190476190476 + }, + "vec8_u8" : { + "med_us" : 904.5833333333334, + "best_us" : 894.7083333333334 + }, + "vec16" : { + "med_us" : 2207.3333333333335, + "best_us" : 2195.6666666666665 + } + } + }, + "copy_floats" : { + "winner" : "vec8_u2", + "fallback" : "vec8_u2", + "floor_pct" : 0.965734682675114, + "margin_pct" : 0, + "rows" : { + "vec32_u2" : { + "med_us" : 301.9375, + "best_us" : 277.09375 + }, + "vec32" : { + "med_us" : 302.59375, + "best_us" : 279.65625 + }, + "vec32_u4" : { + "med_us" : 291.3125, + "best_us" : 284.09375 + }, + "vec32_u8" : { + "med_us" : 290.28125, + "best_us" : 275.59375 + }, + "vec16_u2" : { + "med_us" : 294.90625, + "best_us" : 284.78125 + }, + "vec16_u4" : { + "med_us" : 287.40625, + "best_us" : 281.46875 + }, + "vec16_u8" : { + "med_us" : 289.3125, + "best_us" : 276.65625 + }, + "vec4" : { + "med_us" : 287.625, + "best_us" : 279.8125 + }, + "vec8" : { + "med_us" : 288, + "best_us" : 284.0625 + }, + "vec4_u4" : { + "med_us" : 293.21875, + "best_us" : 282.28125 + }, + "vec8_u4" : { + "med_us" : 284.09375, + "best_us" : 281.8125 + }, + "plain" : { + "med_us" : 285.09375, + "best_us" : 279.46875 + }, + "u2" : { + "med_us" : 293.625, + "best_us" : 282.59375 + }, + "u4" : { + "med_us" : 301.21875, + "best_us" : 276.375 + }, + "u8" : { + "med_us" : 295.0625, + "best_us" : 284.28125 + }, + "vec4_u2" : { + "med_us" : 284.25, + "best_us" : 277.125 + }, + "vec4_u8" : { + "med_us" : 284.46875, + "best_us" : 280.625 + }, + "vec8_u2" : { + "med_us" : 289.625, + "best_us" : 284.65625 + }, + "vec8_u8" : { + "med_us" : 289.5625, + "best_us" : 282.1875 + }, + "vec16" : { + "med_us" : 284.8125, + "best_us" : 277.4375 + } + } + }, + "rmsnorm" : { + "winner" : "vec8_u2", + "fallback" : "plain", + "floor_pct" : 1.2776221617032368, + "margin_pct" : 85.28201945558988, + "rows" : { + "vec32_u2" : { + "med_us" : 662.4666666666667, + "best_us" : 659.8333333333334 + }, + "vec32" : { + "med_us" : 660.0333333333333, + "best_us" : 654.1333333333333 + }, + "vec32_u4" : { + "med_us" : 662.8666666666667, + "best_us" : 652.1 + }, + "vec32_u8" : { + "med_us" : 665.5333333333333, + "best_us" : 663.3 + }, + "vec16_u2" : { + "med_us" : 706.9677419354839, + "best_us" : 656.258064516129 + }, + "vec16_u4" : { + "med_us" : 647.35, + "best_us" : 638.2666666666667 + }, + "vec16_u8" : { + "med_us" : 652.6451612903226, + "best_us" : 644.5483870967741 + }, + "vec4" : { + "med_us" : 785.8214285714286, + "best_us" : 763.7142857142857 + }, + "vec8" : { + "med_us" : 687.741935483871, + "best_us" : 639.5806451612904 + }, + "vec4_u4" : { + "med_us" : 734.1111111111111, + "best_us" : 725.5925925925926 + }, + "vec8_u4" : { + "med_us" : 639.9677419354839, + "best_us" : 633.5483870967741 + }, + "plain" : { + "med_us" : 4345.5, + "best_us" : 4323 + }, + "u2" : { + "med_us" : 4426.5, + "best_us" : 4322.25 + }, + "u4" : { + "med_us" : 4279.25, + "best_us" : 4274.75 + }, + "u8" : { + "med_us" : 4302.75, + "best_us" : 4296 + }, + "vec4_u2" : { + "med_us" : 842.8518518518518, + "best_us" : 782.5555555555555 + }, + "vec4_u8" : { + "med_us" : 742.8461538461538, + "best_us" : 740.7307692307693 + }, + "vec8_u2" : { + "med_us" : 638.1774193548388, + "best_us" : 630.3225806451613 + }, + "vec8_u8" : { + "med_us" : 638.9193548387096, + "best_us" : 631.1935483870968 + }, + "vec16" : { + "med_us" : 655.3387096774193, + "best_us" : 642.4516129032259 + } + } + } + }, + "runtime" : { + "jobque_spin_us" : 30000, + "target_chunk_work" : 1, + "norm_par_threshold" : 256000, + "gemv_lane_cap" : 0, + "matmul_min_chunk_rows" : 16, + "batch_grid_2d" : 0, + "metal_devw_small_panel_mb" : 32, + "team_rank_gate" : -1, + "kv_store_par_threshold" : 256000, + "q8_l2_budget" : 4194304, + "rope_par_threshold" : 100000, + "jobque_join_poll" : 50, + "q8_token_block" : 128, + "requant_par_threshold" : 256000, + "metal_tensor" : "mulmm_bf16", + "matmul_min_chunk_rows_gemv" : 64, + "attn_par_threshold" : 100000, + "batch_lane_cap" : 0, + "metal_cvt_min_rows" : 256, + "metal_tall_floor" : 64, + "act_par_threshold" : 100000, + "threads" : 10, + "dispatch_worker_limit" : 0, + "q8_batch_chunks_per_job" : 4, + "q8_chunks_per_job" : 2, + "q4_chunks_per_job" : 4 + } +} \ No newline at end of file diff --git a/site/files/dasllama/bench_records.json b/site/files/dasllama/bench_records.json index 59668738b9..0345a0eaec 100644 --- a/site/files/dasllama/bench_records.json +++ b/site/files/dasllama/bench_records.json @@ -23361,6 +23361,368 @@ { "gguf":"canary-qwen-2.5b-decoder-q8_0.gguf", "runs":[ + { + "engine":"das", + "backend":"cpu", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":609.84799999999996, + "audio_s":11, + "encode_ms":267.62900000000002, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":1839.9780000000001, + "audio_s":33, + "encode_ms":731.52200000000005, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":11773.228999999999, + "audio_s":198.734375, + "encode_ms":7155.732, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"54595cfea", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"cpu", + "flavor":"accel", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --accel", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":603.404, + "audio_s":11, + "encode_ms":260.77699999999999, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":1823.1610000000001, + "audio_s":33, + "encode_ms":728.96299999999997, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":11705.264999999999, + "audio_s":198.734375, + "encode_ms":7783.0370000000003, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"54595cfea", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "noise":"ok", + "exec_fmt":"q8/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"das", + "backend":"metal", + "flavor":"tuned", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/performance/_rig/dasllama-bench.app/Contents/MacOS/dasllama-bench -- --asr -m canary-qwen-2.5b-decoder-q8_0.gguf -r 2 -t 10 --json-path modules/dasLLAMA/performance/records/_cell_m4.json --ngl 1", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":512.86400000000003, + "audio_s":11, + "encode_ms":247.178, + "text":"And so my fellow Americans ask not what your country can do for you ask what you can do for your country" + }, + "asr:jfk3.wav":{ + "ms":1574.452, + "audio_s":33, + "encode_ms":746.52700000000004, + "text":"And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country. And so my fellow Americans ask not what your country can do for you, ask what you can do for your country." + }, + "asr:gb1.wav":{ + "ms":12254.620999999999, + "audio_s":198.734375, + "encode_ms":10310.376, + "text":"My fellow Americans, this day has brought terrible news and great sadness to our country. At nine o'clock this morning, Mission Control in Houston lost contact with our space shuttle Columbia. A short time later, debris was seen falling from the skies above Texas. The Columbia is lost. There are no survivors. In the words of the prophet Isaiah, May God bless the grieving families and may God continue to bless America." + } + }, + "workload":"asr", + "source":"official", + "sha":"54595cfea", + "version":"0.6.4", + "dasllama_version":15, + "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", + "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "noise":"ok", + "exec_fmt":"f32/q8", + "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", + "files":[ + { + "role":"weights", + "name":"canary-qwen-2.5b-decoder-q8_0.gguf", + "sha256":"24c5f521ef7fce86f3752a9566605527921e3c534d27dd9ab262879b4690cabe", + "bytes":1834425984 + }, + { + "role":"mmproj", + "name":"canary-qwen-2.5b-encoder-f32.bin", + "sha256":"37d1057ced3150cfde2fb996c1fc0a3d702d23a97f9347aedb52795ebec03e5c", + "bytes":3252768256 + }, + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"nemo", + "backend":"cpu", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":3305.2919999999999, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":7576.8860000000004, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":19144.050999999999, + "audio_s":199 + } + }, + "workload":"asr", + "source":"official", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", + "exec_fmt":"bf16", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, + { + "engine":"nemo", + "backend":"metal", + "flavor":"stock", + "box":"m4", + "threads":10, + "date":"2026-08-31", + "cmd":"modules/dasLLAMA/benchmarks/asr/.venv-nemo/bin/python modules/dasLLAMA/benchmarks/asr/canary_qwen_bench.py --device mps --threads 10 --reps 2 --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/jfk3.wav --wav modules/dasLLAMA/benchmarks/asr/corpus/gb1.wav", + "hardware":{ + "cpu":"Apple M4 Pro", + "arch":"arm64", + "os":"macOS 26.5.2", + "perf_cores":10, + "total_cores":14, + "ram_gb":64, + "gpu":"Apple M4 Pro (20-core)", + "model_id":"Mac16,11", + "remote_desktop":"off" + }, + "tests":{ + "asr:jfk.wav":{ + "ms":1076.4870000000001, + "audio_s":11 + }, + "asr:jfk3.wav":{ + "ms":3445.7959999999998, + "audio_s":33 + }, + "asr:gb1.wav":{ + "ms":9723.1990000000005, + "audio_s":199 + } + }, + "workload":"asr", + "source":"official", + "versions":"nemo 3.1.0+06312c963 / torch 2.12.1", + "exec_fmt":"bf16", + "files":[ + { + "role":"clip", + "name":"jfk.wav", + "sha256":"59dfb9a4acb36fe2a2affc14bacbee2920ff435cb13cc314a08c13f66ba7860e", + "bytes":352078 + }, + { + "role":"clip", + "name":"jfk3.wav", + "sha256":"a4d13f9d48ccce40db0621969fdaa39b8bf280e25b9de5eda902decdfe26f484", + "bytes":1056078 + }, + { + "role":"clip", + "name":"gb1.wav", + "sha256":"b55890c635c795309706aaa40a5c670042d989af43da3512d7e486c989bf0787", + "bytes":6359578 + } + ] + }, { "engine":"das", "backend":"metal", From 59a3788106dc5a1325e95a1cf69d4f4165576e3e Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 19:12:49 -0700 Subject: [PATCH 09/17] the two qwen vision carriers join the serving catalog, and the news carries the final board Qwen3-VL-4B and Qwen2.5-Omni-3B get serve rows (commit-pinned urls per the serving rule - resolve/main floats), each naming its mmproj companion, so dasllama-server's /catalog offers the deepstack tower and the window-ViT tower alongside the gemma line. The dasllama.io entry is rewritten on the re-minted board: every figure now quotes a committed record row (E2B 9074/161 vs 7413/137, Qwen3.8-27B 914/27.8 vs 752/25.4, 30B-A3B 3753/166 vs 3422/137, gpt-oss 3995/163 vs 3477/149; 12B image encode 7.1 vs 95 ms, the qwen25v window ViT 106 vs 118, whisper turbo jfk 140 vs 153), with the M4 refresh and the M1 record named. Gates: model-specs invariants 12/12, openai-server suite 21/21 (the catalog is a view over the spec table, so the serve rows are gated there), site metadata 4/4. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/performance/model_specs.das | 12 ++++++++++-- site-dasllama/_news/2026-08-30-apple-m5.md | 19 ++++++++++++------- site-dasllama/feed.xml | 19 ++++++++++++------- site-dasllama/index.html | 19 ++++++++++++------- 4 files changed, 46 insertions(+), 23 deletions(-) diff --git a/modules/dasLLAMA/performance/model_specs.das b/modules/dasLLAMA/performance/model_specs.das index 2e6b2253c3..e8947c67ae 100644 --- a/modules/dasLLAMA/performance/model_specs.das +++ b/modules/dasLLAMA/performance/model_specs.das @@ -403,7 +403,11 @@ def model_specs() : array { // nolint:STYLE038 — flat model-set t // the qwen vision pairs (the qwen3vl arc): parity-less provenance carriers — // test_vision_chat's deepstack/qwen25o legs and the qwen tier-1 suites are their coverage ModelSpec(file = "Qwen3VL-4B-Instruct-Q8_0.gguf", display = "Qwen3-VL-4B", official = true, - url = "{HF}/Qwen/Qwen3-VL-4B-Instruct-GGUF/resolve/main/Qwen3VL-4B-Instruct-Q8_0.gguf", + url = "{HF}/Qwen/Qwen3-VL-4B-Instruct-GGUF/resolve/1cd86afb9a95c410a6038ab3b40d8b578c892266/Qwen3VL-4B-Instruct-Q8_0.gguf", + serve_name = "qwen3-vl-4b", serve_display = "Qwen3 VL 4B", + serve_note = "the deepstack vision Qwen - reads images through wide multi-tap rows", + serve_ctx = 262144, serve_vram_gb = 6.0, + serve_vision = "mmproj-Qwen3VL-4B-Instruct-F16.gguf", bytes = 4280406144l, sha256 = "054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", // verified 40/40 against the live oracle 2026-08-30 (the deepstack tower's carrier) parity <- ev_qwen_count(), @@ -419,7 +423,11 @@ def model_specs() : array { // nolint:STYLE038 — flat model-set t url = "{HF}/Qwen/Qwen3-VL-8B-Instruct-GGUF/resolve/main/mmproj-Qwen3VL-8B-Instruct-F16.gguf", bytes = 1159029824l, sha256 = "ca524100ebf825c9a870db1c580d03879e0da0ab2541697e2458e64891cf9d38")]), ModelSpec(file = "Qwen2.5-Omni-3B-Q8_0.gguf", display = "Qwen2.5-Omni-3B", official = true, - url = "{HF}/ggml-org/Qwen2.5-Omni-3B-GGUF/resolve/main/Qwen2.5-Omni-3B-Q8_0.gguf", + url = "{HF}/ggml-org/Qwen2.5-Omni-3B-GGUF/resolve/75f1b73b657a50f5092502799457ccb4a4a1f9df/Qwen2.5-Omni-3B-Q8_0.gguf", + serve_name = "qwen2.5-omni-3b", serve_display = "Qwen2.5 Omni 3B", + serve_note = "the window-ViT omni - compact vision chat on the Metal tower", + serve_ctx = 32768, serve_vram_gb = 5.5, + serve_vision = "mmproj-Qwen2.5-Omni-3B-f16.gguf", bytes = 3616087360l, sha256 = "c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", // verified 40/40 against the live oracle 2026-08-30 (the window-ViT tower's carrier) parity <- ev_qwen_count(), diff --git a/site-dasllama/_news/2026-08-30-apple-m5.md b/site-dasllama/_news/2026-08-30-apple-m5.md index 8083da9211..ad7ed1e3cf 100644 --- a/site-dasllama/_news/2026-08-30-apple-m5.md +++ b/site-dasllama/_news/2026-08-30-apple-m5.md @@ -8,14 +8,19 @@ dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the -pool spanning both tiers with decode parking the slower one. +pool spanning both tiers with decode parking the slower one (the M1/M4 efficiency cores +stay excluded, verified live on both boxes). -First official rows on an M5 Max (pp512 / tg128, Metal, llama-bench protocol): -gemma-4-E2B Q8_0 - das 8692.8 / 161.7 tok/s, llama.cpp 7527.4 / 136.6; gpt-oss-20b - -das 3989.4 / 163.2, llama.cpp 3475.3 / 147.5; Qwen3-30B-A3B - das 3506.8 / 165.2, -llama.cpp 3425.5 / 136.4. The image turn rides the same rails - the gemma-4-12B image -encode lands at 7.2 ms. Full rows for the box are on the -[board](https://daslang.io/dasllama.html). +The full M5 Max board is re-minted and on the [board](https://daslang.io/dasllama.html) +(pp512 / tg128, Metal, llama-bench protocol): gemma-4-E2B Q8_0 - das 9074.3 / 161.3 +tok/s, llama.cpp 7413.4 / 137.0; Qwen3.8-27B - das 913.9 / 27.8, llama.cpp 752.1 / 25.4; +Qwen3-30B-A3B - das 3752.9 / 165.7, llama.cpp 3422.4 / 137.0; gpt-oss-20b - das 3995.1 / +162.7, llama.cpp 3476.6 / 149.0. The other modalities ride the same rails: the +gemma-4-12B image encode lands at 7.1 ms against the reference's 95 ms, the Qwen2.5-Omni +window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms +against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside - +including Canary-Qwen on its new Q8_0 serving artifact, ahead of the NeMo torch-MPS +reference on both boxes - and the M1 rows stand as the long-term record. Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely diff --git a/site-dasllama/feed.xml b/site-dasllama/feed.xml index 34d1af91df..44a5508e7f 100644 --- a/site-dasllama/feed.xml +++ b/site-dasllama/feed.xml @@ -15,13 +15,18 @@ M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the -pool spanning both tiers with decode parking the slower one.</p> -<p>First official rows on an M5 Max (pp512 / tg128, Metal, llama-bench protocol): -gemma-4-E2B Q8_0 - das 8692.8 / 161.7 tok/s, llama.cpp 7527.4 / 136.6; gpt-oss-20b - -das 3989.4 / 163.2, llama.cpp 3475.3 / 147.5; Qwen3-30B-A3B - das 3506.8 / 165.2, -llama.cpp 3425.5 / 136.4. The image turn rides the same rails - the gemma-4-12B image -encode lands at 7.2 ms. Full rows for the box are on the -<a href="https://daslang.io/dasllama.html">board</a>.</p> +pool spanning both tiers with decode parking the slower one (the M1/M4 efficiency cores +stay excluded, verified live on both boxes).</p> +<p>The full M5 Max board is re-minted and on the <a href="https://daslang.io/dasllama.html">board</a> +(pp512 / tg128, Metal, llama-bench protocol): gemma-4-E2B Q8_0 - das 9074.3 / 161.3 +tok/s, llama.cpp 7413.4 / 137.0; Qwen3.8-27B - das 913.9 / 27.8, llama.cpp 752.1 / 25.4; +Qwen3-30B-A3B - das 3752.9 / 165.7, llama.cpp 3422.4 / 137.0; gpt-oss-20b - das 3995.1 / +162.7, llama.cpp 3476.6 / 149.0. The other modalities ride the same rails: the +gemma-4-12B image encode lands at 7.1 ms against the reference's 95 ms, the Qwen2.5-Omni +window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms +against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside - +including Canary-Qwen on its new Q8_0 serving artifact, ahead of the NeMo torch-MPS +reference on both boxes - and the M1 rows stand as the long-term record.</p> <p>Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely fun.</p> diff --git a/site-dasllama/index.html b/site-dasllama/index.html index ad326e1f1f..8e87c4b145 100644 --- a/site-dasllama/index.html +++ b/site-dasllama/index.html @@ -69,13 +69,18 @@

Local inference, written in daslang.

M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the -pool spanning both tiers with decode parking the slower one.

-

First official rows on an M5 Max (pp512 / tg128, Metal, llama-bench protocol): -gemma-4-E2B Q8_0 - das 8692.8 / 161.7 tok/s, llama.cpp 7527.4 / 136.6; gpt-oss-20b - -das 3989.4 / 163.2, llama.cpp 3475.3 / 147.5; Qwen3-30B-A3B - das 3506.8 / 165.2, -llama.cpp 3425.5 / 136.4. The image turn rides the same rails - the gemma-4-12B image -encode lands at 7.2 ms. Full rows for the box are on the -board.

+pool spanning both tiers with decode parking the slower one (the M1/M4 efficiency cores +stay excluded, verified live on both boxes).

+

The full M5 Max board is re-minted and on the board +(pp512 / tg128, Metal, llama-bench protocol): gemma-4-E2B Q8_0 - das 9074.3 / 161.3 +tok/s, llama.cpp 7413.4 / 137.0; Qwen3.8-27B - das 913.9 / 27.8, llama.cpp 752.1 / 25.4; +Qwen3-30B-A3B - das 3752.9 / 165.7, llama.cpp 3422.4 / 137.0; gpt-oss-20b - das 3995.1 / +162.7, llama.cpp 3476.6 / 149.0. The other modalities ride the same rails: the +gemma-4-12B image encode lands at 7.1 ms against the reference's 95 ms, the Qwen2.5-Omni +window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms +against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside - +including Canary-Qwen on its new Q8_0 serving artifact, ahead of the NeMo torch-MPS +reference on both boxes - and the M1 rows stand as the long-term record.

Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely fun.

From 18af12be4b5495853f915f3a2c109efa56d45fc8 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 19:29:27 -0700 Subject: [PATCH 10/17] row 0a0: the harvest settles - one rule, three facts, the asr-gpu-pairs section The dasLLAMA harvester's ledger, ruled and landed: the recovery-file rule (performance/REVIEW.md - a fallback names the tool that writes its file and reads it for no other); ARCHITECTURE_MEASUREMENT.md sec.2.20 {#asr-gpu-pairs} (the metal_served opt-in + anti-sandbag, the three GPU ref arms and the two pairless legs, the sibling build + timing patch + Metal-ON twin) cited from build_flavor, gen_bench_records main and mtmd_bin_metal; the scaffold-vs-family-tail binding-number fact appended to ARCHITECTURE_GPU_PREFILL.md sec.2.2g and cited from race_moe_mulmm_mx4; comment compressions and drops across the diff per the ledger; the two stale //! docs (run_asr_mtmd gpu arm, asr_pybench_args device) extended; the mtmd_bin comment restored onto its function; test_exe_smoke's census entry in tests/CLAUDE.md. dasMetal's harvest: the gate-cell header drops (law lives in REVIEW.md + finding strings), ARCHITECTURE.md gains Gate C in the test-gate inventory, and tests/msl's needle rule shrinks to the machine-checked residue form. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/ARCHITECTURE.md | 2 +- modules/dasLLAMA/ARCHITECTURE_GPU_PREFILL.md | 7 +++++- modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md | 25 +++++++++++++++++++ .../dasLLAMA/benchmarks/setup_lcpp_ref.das | 6 +---- modules/dasLLAMA/dasllama/dasllama_math.das | 3 --- .../dasllama/dasllama_metal_prefill.das | 7 +++--- .../dasLLAMA/dasllama/dasllama_version.das | 2 +- modules/dasLLAMA/performance/REVIEW.md | 5 ++++ .../performance/gen_bench_records.das | 13 ++-------- .../dasLLAMA/performance/profile_common.das | 16 ++++++------ .../dasLLAMA/performance/setup_asr_rig.das | 3 +-- modules/dasLLAMA/tests/CLAUDE.md | 4 +++ modules/dasLLAMA/tests/_exe_smoke_root.das | 9 +++---- modules/dasLLAMA/tests/test_exe_smoke.das | 16 ++++++------ .../dasLLAMA/tests/test_kernel_coverage.das | 10 +++----- .../tests/test_metal_misc_kernels.das | 2 +- modules/dasMetal/ARCHITECTURE.md | 4 +++ modules/dasMetal/REVIEW.das | 3 --- tests/msl/REVIEW.md | 7 +++--- 19 files changed, 81 insertions(+), 63 deletions(-) diff --git a/modules/dasLLAMA/ARCHITECTURE.md b/modules/dasLLAMA/ARCHITECTURE.md index 53892bd8a5..e0da7ceef5 100644 --- a/modules/dasLLAMA/ARCHITECTURE.md +++ b/modules/dasLLAMA/ARCHITECTURE.md @@ -54,7 +54,7 @@ re-transcoding `$LCPP/src/unicode-data.cpp`). MoE region split. - `ARCHITECTURE_MEDIA.md` - sec.2.13-2.16: the padded tower GEMM widths, the family GPU hooks, the tower weight lane, and the plain-Model ASR decoders. -- `ARCHITECTURE_MEASUREMENT.md` - sec.2.5, 2.10: the benchmark rig, the tune gate, and the +- `ARCHITECTURE_MEASUREMENT.md` - sec.2.5, 2.10, 2.20: the benchmark rig, the tune gate, and the sanctioned instrumentation rails. ## 3. Inherited invariants diff --git a/modules/dasLLAMA/ARCHITECTURE_GPU_PREFILL.md b/modules/dasLLAMA/ARCHITECTURE_GPU_PREFILL.md index fea4877964..882c966448 100644 --- a/modules/dasLLAMA/ARCHITECTURE_GPU_PREFILL.md +++ b/modules/dasLLAMA/ARCHITECTURE_GPU_PREFILL.md @@ -177,7 +177,12 @@ prologue, the staged K walk with its barrier pair, and the store; a weight forma owns its weight-view bindings, and overrides the staged decode (`stage_block`) - mx4 also the store (its per-expert bias) and the chunk shape (32-deep, 128-item quota). The q8 twin is not a copy of this scaffold: its whole body is the tuned `tmm2d_q8u_f32` staged helper, a -different staging mechanism, so it stays its own template. The gather-X pass +different staging mechanism, so it stays its own template. The scaffold fixes its own binding numbers - `xf` at 3, `y` at 4, kargs at 5, `cnt` at 6, +`basep` at 7 - and every derived twin inherits them. Those are NOT the family tail's numbers +(`kn_moe_mm_family_tail` binds `cnt` at 7, `basep` at 8, `bkt` at 9), so a race harness +hand-binding a tensor twin follows the scaffold's declaration and its base arm follows the +tail's; binding a twin at the base's numbers hands the kernel the OUTPUT buffer as X, and the +race then crowns whichever arm computed nothing. The gather-X pass copies the bucket's token rows into a CONTIGUOUS f16 panel with pad rows zeroed, which lets the up and gate sites ride the contiguous tensor twins instead of the in-kernel gather form; the panel is minted once per layer and shared by both sites. An X read through the bucket index can never diff --git a/modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md b/modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md index ef5b6398dd..9b6ec93045 100644 --- a/modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md +++ b/modules/dasLLAMA/ARCHITECTURE_MEASUREMENT.md @@ -62,6 +62,31 @@ contract - it suppresses the re-exec, it does not tune the box, and a number mea is not a benchmark. Benches and the rig keep minting their own; refresh the copy when a re-mint moves the crowns or `DASLLAMA_RELEASE` bumps. +### 2.20 The ASR board's GPU row pairs {#asr-gpu-pairs} + +The das Metal ASR leg is OPT-IN per catalog row: `AsrModelSpec.metal_served` +(`performance/profile_common.das`) declares that the Metal driver serves that family end to +end - tower and decoder both. An unflagged family keeps the CPU by design, and asking for its +GPU leg trips the anti-sandbag: the `--ngl` arms assert that the tower engage counters moved, +so a family whose tower silently falls back reds its row instead of publishing a CPU wall +under a GPU heading. + +Three reference tools carry a GPU arm the board pairs against a das Metal row, each with its +own spelling: the whisper reference exe takes `-ngl`, the media-chat reference exe takes +`-ngl 99`, and the NeMo bench script takes `--device mps`. The remaining two reference legs +have no pair - the parakeet exe measures slower on the GPU, and the ONNX export is CPU-only - +so their das rows stand alone in the CPU category. + +The media-chat reference exe is built as the bench exe's sibling in one reference worktree: +`benchmarks/setup_lcpp_ref.das` builds both targets, because a bench-only build leaves the +image and audio-chat cells with no binary and the board quietly mints das-only rows. That +sibling needs the timing patch beside it (`benchmarks/asr/patches/`) - the record parser reads +its per-rep timing lines, and an unpatched sibling mints "no rep parsed" failures. The apply +is guarded on the patched marker already being in the tree, and runs three-way so it rides +pin drift. On Apple boxes `performance/setup_asr_rig.das` builds a second, Metal-ON copy of +the same patched checkout, because `-ngl` on a Metal-OFF build is inert; `mtmd_bin_metal()` +returns "" when it is absent and the GPU reference leg skips loudly. + ### 2.10 Sanctioned instrumentation rails Engine timing goes through the rails that aggregate and tag it: the `jobque_profile` markers diff --git a/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das b/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das index cc75a9e447..c96563e413 100644 --- a/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das +++ b/modules/dasLLAMA/benchmarks/setup_lcpp_ref.das @@ -157,6 +157,7 @@ def main : int { return rc } +[arch(at="../ARCHITECTURE_MEASUREMENT.md#asr-gpu-pairs")] def private build_flavor(dest, f, short_sha : string; jobs : int) : int { let build_dir = path_join(dest, "build-{f}") print("=== {f} -> {build_dir} (minutes-class: configure + build llama-bench)\n") @@ -167,11 +168,6 @@ def private build_flavor(dest, f, short_sha : string; jobs : int) : int { return 1 } } - // llama-mtmd-cli rides along: the image/audio-chat ref cells resolve it as llama-bench's - // sibling (gen_bench_records' sibling_mtmd rule) - a bench-only build mints das-only rows. - // The sibling needs mtmd-timing.patch (parse_mtmd_image reads MTMD_TIMING lines - an - // unpatched sibling mints "no rep parsed" failures); -3 rides pin drift, and a tree that - // already carries the print skips the apply if (find(fread(path_join(dest, "tools/mtmd/mtmd-cli.cpp")), "MTMD_TIMING") < 0) { let patch = get_full_file_name("modules/dasLLAMA/benchmarks/asr/patches/mtmd-timing.patch") if (run_visible("git -C \"{dest}\" apply -3 \"{patch}\"") != 0) { diff --git a/modules/dasLLAMA/dasllama/dasllama_math.das b/modules/dasLLAMA/dasllama/dasllama_math.das index c19aa52c8e..3dbe5e8d37 100644 --- a/modules/dasLLAMA/dasllama/dasllama_math.das +++ b/modules/dasLLAMA/dasllama/dasllama_math.das @@ -684,9 +684,6 @@ def clear_float_batch_override() { g_fp_override_active = false } -// Function values do not survive program serialization (a baked exe restores globals as DATA - -// the declaration defaults arrive null); the g_fp_override_active gate keeps the invokes off -// the null today, but the restore holds the invariant structurally (REVIEW.md's rule) [init] def private restore_float_override_defaults { if (g_mm_fp_batch_override == null) { diff --git a/modules/dasLLAMA/dasllama/dasllama_metal_prefill.das b/modules/dasLLAMA/dasllama/dasllama_metal_prefill.das index b73e4bc3af..9fcbf636cb 100644 --- a/modules/dasLLAMA/dasllama/dasllama_metal_prefill.das +++ b/modules/dasLLAMA/dasllama/dasllama_metal_prefill.das @@ -6494,6 +6494,7 @@ def private race_moe_mulmm_q8(dev : MetalDevice?; queue : MetalCommandQueue?) : return res } +[arch(at="../ARCHITECTURE_GPU_PREFILL.md#prefill-moe-buckets")] def private race_moe_mulmm_mx4(dev : MetalDevice?; queue : MetalCommandQueue?) : MetalTensorRaceResult { // nolint:STYLE038 — one-shot A/B race harness; buffers + PSOs stay live to the release tail var res = MetalTensorRaceResult(family = "moe_mulmm_mx4", winner = "", base_ms = -1.0lf, twin_ms = -1.0lf, note = "") let ne = 4 @@ -6575,9 +6576,9 @@ def private race_moe_mulmm_mx4(dev : MetalDevice?; queue : MetalCommandQueue?) : kn_tgmem(enc, MetalMoeMulMmMx4T_metal_moe_mulmm_mx4_t_msl_tgmem, 0) kn_buffer(enc, bnq, 0ul, 0) kn_buffer(enc, bee, 0ul, 1) - kn_buffer(enc, bxa, 0ul, 3) //! the scaffold family contract: xf@3, y@4 (the followup-53 - kn_buffer(enc, by_twin, 0ul, 4) //! renumber; the old 2/3 read the OUTPUT buffer as X - the race - kn_kargs(enc, rka, 5) //! then un-crowned a correct twin and gpt-oss pp halved) + kn_buffer(enc, bxa, 0ul, 3) + kn_buffer(enc, by_twin, 0ul, 4) + kn_kargs(enc, rka, 5) kn_buffer(enc, bcnt, 0ul, 6) kn_buffer(enc, bbase, 0ul, 7) kn_buffer(enc, bwbb, 0ul, 12) diff --git a/modules/dasLLAMA/dasllama/dasllama_version.das b/modules/dasLLAMA/dasllama/dasllama_version.das index 8c21045d04..e2d0629648 100644 --- a/modules/dasLLAMA/dasllama/dasllama_version.das +++ b/modules/dasLLAMA/dasllama/dasllama_version.das @@ -13,4 +13,4 @@ require dasllama/dasllama_lint public //! layout fingerprint for images; kernel-identity hashing for tune winners when it lands). //! Tune sidecars scope on it, the sidecar exchange keys validity on (release, box), and bench //! records carry it — all under the wire name `dasllama_version`, which is schema-stable. -let DASLLAMA_RELEASE = 15 // release 15 == the last DASLLAMA_VERSION value, so every v15 artifact stays valid across the rename +let DASLLAMA_RELEASE = 15 diff --git a/modules/dasLLAMA/performance/REVIEW.md b/modules/dasLLAMA/performance/REVIEW.md index fcc230bf26..a108785c25 100644 --- a/modules/dasLLAMA/performance/REVIEW.md +++ b/modules/dasLLAMA/performance/REVIEW.md @@ -43,6 +43,11 @@ reference exe the ref pin builds.** `../dasllama/dasllama_exchange_schema.das`'s run validation in the same change** - the validator ignores run keys it does not know, so an unvalidated field ships silently. +**A fallback that recovers reference rows from a file on disk names the tool that writes +that file, and reads it for no other tool - a shared recovery file read by a second tool +copies the first tool's rows into the second's record under a matching clip name.** The +laundered row carries the wrong engine and looks real. + **Never add a second HTTP path to the sidecar exchange - every HTTP call (lookup, download, submit) goes through `../dasllama/dasllama_exchange.das`.** The mechanical half (no second `dashv` requirer under the module) is `REVIEW.das`'s to enforce. diff --git a/modules/dasLLAMA/performance/gen_bench_records.das b/modules/dasLLAMA/performance/gen_bench_records.das index 22f3cb5307..c60482c9f4 100644 --- a/modules/dasLLAMA/performance/gen_bench_records.das +++ b/modules/dasLLAMA/performance/gen_bench_records.das @@ -1010,9 +1010,6 @@ def private image_ref_pass(file, path, mm, pic, bin, flavor : string; ngl : int; // ===== ASR legs (the audio workloads, same adjacency discipline as the LLM legs) ===== // das side: one lcpp_bench --asr child per catalog model, absorbed via the same cell protocol -// the families the metal das leg serves end to end (tower + decoder) declare it on their -// catalog row; an unflagged row (parakeet — its GPU arm measures slower and keeps the CPU -// by design) would trip the --ngl anti-sandbag def private is_metal_served_family(spec : AsrModelSpec) : bool => spec.metal_served def private asr_das_cell(spec : AsrModelSpec; cfg : Args; threads : int; cellPath, store, exe : string; @@ -1121,10 +1118,7 @@ def private asr_ref_pass(spec : AsrModelSpec; ref : AsrRef; versions : string; c var out = run_capture_argv(pyargs) if (find(out, "BENCH") < 0) { // pipe came back rowless — for onnx ONLY, fall back to its --out file (Windows: - // parakeet loaders wreck the child's stdout pipe; the file survives everything). - // Only onnx WRITES that file, so any other tool reading it would launder a STALE - // onnx row into its own record under a matching clip name (a nemo-mps crash did - // exactly that - the recovered "nemo" jfk was onnx-whisper-turbo's). + // parakeet loaders wreck the child's stdout pipe; the file survives everything) let sidecar = ref.tool == "onnx" ? fread(asr_pybench_out_path()) : "" if (find(sidecar, "BENCH") >= 0) { to_log(LOG_INFO, "gen_bench_records: {ref.tool} pipe was rowless - rows recovered from --out file\n") @@ -1240,7 +1234,7 @@ def private asr_ref_pass(spec : AsrModelSpec; ref : AsrRef; versions : string; c // The orchestrator never measures: it spawns the released exe per cell and reads its JSON, so its // own kernels are irrelevant and tuning them would put minutes of hidden work in front of a // measurement run — the trap this rig exists to avoid. -[export, tune_policy(missing = "fallback")] +[export, tune_policy(missing = "fallback"), arch(at="../ARCHITECTURE_MEASUREMENT.md#asr-gpu-pairs")] def main : int { var r <- parse_args(type) if (r |> is_err) { @@ -1519,9 +1513,6 @@ def main : int { settle(cfg) asr_ref_pass(spec, rf, toolVersions?[rf.tool] ?? "", cfg, threads, hw, box, date, store, models, failed) static_if (typeinfo builtin_module_exists(das_metal)) { - // the metal das row's like-for-like pair: whisper-cli gets its own -ngl - // arm, mtmd its -ngl 99 arm, nemo its torch-MPS arm; parakeet-cli and - // onnx have no GPU arm worth pairing (measured slower / CPU-only export) let gpu_pair = rf.tool == "whisper-cli" || rf.tool == "mtmd" || rf.tool == "nemo" if (gpu_pair && is_metal_served_family(spec)) { settle(cfg) diff --git a/modules/dasLLAMA/performance/profile_common.das b/modules/dasLLAMA/performance/profile_common.das index 5dc7e5851b..94bfe1e725 100644 --- a/modules/dasLLAMA/performance/profile_common.das +++ b/modules/dasLLAMA/performance/profile_common.das @@ -1122,8 +1122,6 @@ struct AsrModelSpec { // model-speed, and bytes mis-sort it — large-v3-turbo is 1.51 GB against Parakeet's 2.33 GB // yet costs 97.5 s per rep against Parakeet's 38.6 s (m1, the five corpus buckets). tier : Tier = Tier.small - // the das metal leg serves this family end to end (tower + decoder) — the board mints a - // gpu-category row pair for it; false = the --ngl anti-sandbag would refuse the leg metal_served : bool = false // provenance facet ([[models_provenance]]): `prov` pins the das-side carrier itself // (ProvEntry.root is the symbolic "llm"/"whisper", not this spec's resolved dir); @@ -1326,17 +1324,18 @@ def nemo_py() : string { return normalize(empty(g_env_prof.nemo_py) ? venv_python("modules/dasLLAMA/benchmarks/asr/.venv-nemo") : g_env_prof.nemo_py) } -// The clean CPU-only reference build (ebd048fc5, Accelerate ON, Metal OFF, no dasprof) -// patched with patches/mtmd-timing.patch. CPU-only is deliberate: the fast historical mtmd numbers -// rode Metal (GPU) despite the "CPU-only" label — ggml's Conformer audio ops don't route through -// BLAS/AMX, so a genuine CPU encode is ~16 s (and das's optimized scalar Conformer beats it). //! The Metal twin of mtmd_bin() — the same patched checkout built with Metal ON //! (setup_asr_rig's build-metal, Apple boxes); "" when absent, and the gpu ref leg skips loudly. +[arch(at="../ARCHITECTURE_MEASUREMENT.md#asr-gpu-pairs")] def mtmd_bin_metal() : string { let c = normalize("../llama.cpp-mtmd-ref/build-metal/bin/llama-mtmd-cli") return stat(c).is_valid ? c : "" } +// The clean CPU-only reference build (ebd048fc5, Accelerate ON, Metal OFF, no dasprof) +// patched with patches/mtmd-timing.patch. CPU-only is deliberate: the fast historical mtmd numbers +// rode Metal (GPU) despite the "CPU-only" label — ggml's Conformer audio ops don't route through +// BLAS/AMX, so a genuine CPU encode is ~16 s (and das's optimized scalar Conformer beats it). def mtmd_bin() : string { let env = g_env_prof.mtmd_bin if (!empty(env)) { @@ -1556,7 +1555,7 @@ def run_asr_cli_multi(cli, model_path : string; wav_paths : array; threa } //! patched llama-mtmd-cli — one process per clip (30B load is heavy; MTMD_TIMING excludes it). -//! Best total over `reps`. +//! Best total over `reps`; `gpu` runs the Metal-ON sibling ([[mtmd_bin_metal]]) at -ngl 99. def run_asr_mtmd(model_path, mmproj_path, wav_path : string; threads, reps : int; var cmd_out : string&; var encode_out : double&; var text_out : string&; gpu : bool = false) : double { var best = -1.0lf @@ -1620,7 +1619,8 @@ def private mtmd_log_line(s : string) : bool { //! is expensive, amortize it); the caller parses per-clip rows out with [[parse_bench_best]]. //! The onnx rows ALSO land in [[asr_pybench_out_path]] via --out: parakeet-variant loaders //! wreck the child's stdout pipe on Windows (~1 byte then EOF while the run continues), so -//! the caller re-reads the file whenever the captured stream carries no rows. +//! the caller re-reads the file whenever the captured stream carries no rows - onnx only. +//! `device` reaches the nemo script alone (its torch-MPS arm); onnx stays CPU. def asr_pybench_args(tool, handle : string; clips : array; threads, reps : int; device : string = "") : array { var args <- (tool == "onnx" ? [onnx_py(), "{asr_dir()}/onnx_bench.py", "--variant", handle, "--out", asr_pybench_out_path()] diff --git a/modules/dasLLAMA/performance/setup_asr_rig.das b/modules/dasLLAMA/performance/setup_asr_rig.das index 30d3ccfb7a..6c1d837c90 100644 --- a/modules/dasLLAMA/performance/setup_asr_rig.das +++ b/modules/dasLLAMA/performance/setup_asr_rig.das @@ -314,8 +314,7 @@ def private setup_refs(cfg : Args) : bool { run_capture("cmake -S \"{lroot}\" -B \"{lroot}/build-cpu\" -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=OFF && cmake --build \"{lroot}/build-cpu\" --config Release -j 8 --target llama-mtmd-cli", false) to_log(LOG_INFO, "setup_asr_rig: set MTMD_BIN={lroot}/build-cpu/bin/llama-mtmd-cli\n") } - // the Metal twin (Apple boxes): the same patched checkout, Metal ON - the gpu ref leg - // pairs the das metal ASR rows against it (a -ngl on the CPU-only build is inert) + // the Metal twin (Apple boxes): the same patched checkout, Metal ON if (is_apple_box() && !stat(mtmd_bin_metal()).is_valid && stat(normalize("{lroot}/CMakeLists.txt")).is_valid) { to_log(LOG_INFO, "setup_asr_rig: building llama-mtmd-cli (build-metal: Metal ON)\n") run_capture("cmake -S \"{lroot}\" -B \"{lroot}/build-metal\" -DCMAKE_BUILD_TYPE=Release && cmake --build \"{lroot}/build-metal\" --config Release -j 8 --target llama-mtmd-cli", false) diff --git a/modules/dasLLAMA/tests/CLAUDE.md b/modules/dasLLAMA/tests/CLAUDE.md index 511ecbd8ea..2630339396 100644 --- a/modules/dasLLAMA/tests/CLAUDE.md +++ b/modules/dasLLAMA/tests/CLAUDE.md @@ -240,6 +240,10 @@ against the committed `site/files/dasllama/bench_records.json` (what daslang.io/ renders); red means a records commit skipped `gen_site_records`. `test_tok_seed.das` - model-free: `lcpp_bench.das`'s `tok_read_seed` corpus-header walk, required by relative path (`../benchmarks/lcpp_bench.das`), so it pays the bench's full engine compile. +`test_exe_smoke.das` - model-free suite; model-gated (SmolLM2-135M, small tier): the +standalone-exe context gate. Builds `_exe_smoke_root.das` with `-jit -exe` and runs the +artifact - the one rail where globals restore as DATA, so a function-typed global with no +boot-restore `[init]` dies on its first invoke while every `-jit` suite stays green. ~90 s. `test_sizing_helpers.das` - model-free: the sizing helpers (`reserve_resize` exact capacity, `grow_resize` geometric reuse, `overwrite_resize` grow-only no-init) fed directly, including grows past the `max_unreserved_size` guard that must not panic. diff --git a/modules/dasLLAMA/tests/_exe_smoke_root.das b/modules/dasLLAMA/tests/_exe_smoke_root.das index dc1fe2128b..2415146081 100644 --- a/modules/dasLLAMA/tests/_exe_smoke_root.das +++ b/modules/dasLLAMA/tests/_exe_smoke_root.das @@ -1,15 +1,12 @@ options gen2 -options stack = 524288 // every dasllama program root takes this budget +options stack = 524288 // every dasLLAMA program root takes this budget (options stack does not unify up from libs) require dasllama/dasllama require daslib/jobque_boost require daslib/fio -// The standalone-exe smoke root (test_exe_smoke builds it with -jit -exe and runs the artifact): -// one tiny load + a 4-token generate through the facade. A serialized exe restores globals as -// DATA - function values arrive null unless a boot-restore [init] heals them - so this is the -// one context the -jit suites can never cover; the vulkan decode-mirror claim shipped crashing -// exactly here while every script-mode gate stayed green. +// The fixture test_exe_smoke builds with `-jit -exe` and runs: one tiny load plus a 4-token +// generate through the facade, on the serialized-globals rail no `-jit` suite can reach. [export] def main { diff --git a/modules/dasLLAMA/tests/test_exe_smoke.das b/modules/dasLLAMA/tests/test_exe_smoke.das index 7729b9e527..143b7c519f 100644 --- a/modules/dasLLAMA/tests/test_exe_smoke.das +++ b/modules/dasLLAMA/tests/test_exe_smoke.das @@ -1,6 +1,6 @@ options gen2 -options stack = 524288 // every dasllama program root takes this budget -options _dasllama_internal = true // spawns the fixture; its own requires stay light +options stack = 524288 // every dasLLAMA program root takes this budget (options stack does not unify up from libs) +options _dasllama_internal = true require dastest/testing_boost public require daslib/fio @@ -9,12 +9,10 @@ require daslib/strings_boost require strings require _model_tier -// The standalone-exe context gate: build _exe_smoke_root.das with `-jit -exe` and run the -// artifact. A serialized exe restores globals as DATA - function-typed globals arrive null -// unless a boot-restore [init] heals them (dasllama_config's restore_dlim_source_defaults is -// the precedent) - and every -jit suite is structurally blind to that class: the vulkan -// decode-mirror claim shipped crashing every exe forward while all script-mode gates ran -// green. One tiny model, one 4-token generate, ~90 s; skips honestly without the model. +// The standalone-exe context gate: build `_exe_smoke_root.das` with `-jit -exe` and run the +// artifact - the one rail where globals restore as DATA, so a function-typed global with no +// boot-restore [init] dies on its first invoke while every -jit suite stays green. One tiny +// model, one 4-token generate, ~90 s; skips honestly without the model. def private self_daslang() : string { let argv <- get_command_line_arguments() @@ -34,7 +32,7 @@ def test_exe_smoke(t : T?) { return } let dir = unsafe(dir_r.value) - let exe = path_join(dir, "smoke.exe") // daslang -exe appends `.exe` to -output itself + let exe = path_join(dir, "smoke.exe") //! daslang -exe appends `.exe` to -output itself var bout = "" let brc = run_and_capture([self_daslang(), "-jit", "-exe", "-output", path_join(dir, "smoke"), "modules/dasLLAMA/tests/_exe_smoke_root.das"], bout, 600.0) diff --git a/modules/dasLLAMA/tests/test_kernel_coverage.das b/modules/dasLLAMA/tests/test_kernel_coverage.das index 0228fd79a7..65daafd0a8 100644 --- a/modules/dasLLAMA/tests/test_kernel_coverage.das +++ b/modules/dasLLAMA/tests/test_kernel_coverage.das @@ -391,9 +391,7 @@ def private cov_tower_gemma4v(t : T?) { // cov_tower: the tower-driver kernels (LN / f32 mul_mm / the gelu flavors / posadd / the // borrowed trio / the gemma4v clamp, rope2d, GEGLU-quick) AND the decoder-side cross-KV kernels // go non-zero — a whisper tiny MIXED chunk (f32 enc = the tower LUT flavor, q8 dec = the wdec -// driver), the qwen3a GPU-mel + conv2d window, the gemma4a whole-chunk Conformer, the canary -// FastConformer chain, small gemma4uv/gemma4v canvases, the gemma3v flash+slab pair, the -// qwen25v single window, and the qwen3v GPU-stem canvas +// driver) plus one row per tower family, each row's own comment naming the kernels it reaches [unused_argument(t)] // off-Apple the gated body is empty def private cov_tower(t : T?) { static_if (typeinfo builtin_module_exists(das_metal)) { @@ -433,9 +431,9 @@ def private cov_tower(t : T?) { delete aenc delete atw } - // the qwen3a conv2d + mel carrier: the mel built from raw samples so the GPU mel hook - // (twiddle-T DFT GEMM + power + mel-major log store) dispatches, then one padded - // window drives the im2col2d + padded tile GEMMs + // the qwen3a conv2d + mel carrier: the mel is built from raw samples so the GPU mel hook + // (twiddle-T DFT GEMM + power + mel-major log store) dispatches ahead of the im2col2d + // window and its padded tile GEMMs let qpath = path_join(models_dir(), "mmproj-Qwen3-ASR-0.6B-bf16.gguf") if (model_available(t, qpath) && !empty(samples)) { var inscope qtw <- load_qwen3a_tower(qpath) diff --git a/modules/dasLLAMA/tests/test_metal_misc_kernels.das b/modules/dasLLAMA/tests/test_metal_misc_kernels.das index 39c9126023..e56d83463a 100644 --- a/modules/dasLLAMA/tests/test_metal_misc_kernels.das +++ b/modules/dasLLAMA/tests/test_metal_misc_kernels.das @@ -1915,7 +1915,7 @@ def test_metal_misc_kernels(t : T?) { } } -// a spawned one-class [metal_dispatch] program: @workgroup state, tgmem= present or absent +//! spawns a compile of a one-class [metal_dispatch] program carrying @workgroup state def private spawn_wg_fixture(with_tgmem : bool; tag : string) : tuple { let tgarg = with_tgmem ? "tgmem = \"wg_fixture_msl_tgmem\", " : "" let src = join([ diff --git a/modules/dasMetal/ARCHITECTURE.md b/modules/dasMetal/ARCHITECTURE.md index de364169f4..fe272472a5 100644 --- a/modules/dasMetal/ARCHITECTURE.md +++ b/modules/dasMetal/ARCHITECTURE.md @@ -134,6 +134,10 @@ Three behavioral layers + enforcement gates: census across all fixtures and asserts equality with the declared supported set, both directions. Census-record and emit are fused in one helper so they cannot drift; the golden-snapshot layer catches emissions that bypass it. +- **Gate C - fail-closed sync.** The `tests/msl/_fail_closed/` fixture list and the + `check_rejects` needle list in `test_msl_fail_closed.das` are both hand-maintained; + `check_fail_closed_sync` (`REVIEW.das`) holds them equal in both directions, so an unpinned + rejection or a stranded assert cannot pass as a green suite. - **Leak gate.** Metal objects are invisible to the das leak detectors, so the shim counts live objects - `metal_live_object_count()`. diff --git a/modules/dasMetal/REVIEW.das b/modules/dasMetal/REVIEW.das index 4834fa3018..20057bccac 100644 --- a/modules/dasMetal/REVIEW.das +++ b/modules/dasMetal/REVIEW.das @@ -33,9 +33,6 @@ def private check_rp_law { let private FC_DIR = "tests/msl/_fail_closed" let private FC_TEST = "tests/msl/test_msl_fail_closed.das" -// every _fail_closed/*.das fixture has its check_rejects needle assert and vice versa - the -// two lists are hand-synced, and a fixture without its assert (or an assert whose fixture -// was deleted) drifts silently: the suite stays green while the rejection it pins is gone def private check_fail_closed_sync { var fixtures : table dir(FC_DIR) $(name) { diff --git a/tests/msl/REVIEW.md b/tests/msl/REVIEW.md index adfdefd9c5..4ec043f07f 100644 --- a/tests/msl/REVIEW.md +++ b/tests/msl/REVIEW.md @@ -11,6 +11,7 @@ from `declared_msl_census` or a fixture's census from `all_msl_censuses` (both i `_msl_common.das`). Emitted text cannot be read back into constructs, so the census is the only measure of coverage. -**Every file under `_fail_closed/` fails to compile and has a needle assertion in -`test_msl_fail_closed.das`.** A fixture that compiles, or a needle no emitter error contains, is -a defect - delete the fixture and its assertion together. +**Every file under `_fail_closed/` fails to compile.** A fixture that compiles, or a needle no +emitter error contains, is a defect - delete the fixture and its assertion together. The +fixture-has-its-assert half is machine-checked (`modules/dasMetal/REVIEW.das`'s +`check_fail_closed_sync`, both directions); weakening that check is a defect. From 013a151f48afeba03cd92f5bd1b3d74e5da9f19f Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 21:59:12 -0700 Subject: [PATCH 11/17] the review round pays out - re-stamped records, pinned lanes, in-memory census mints The per-checklist audit fan-out (14 auditors: 11 walk checklists + the MEASUREMENT/GPU/TOWER routed companions) over the release-remint branch, every accepted finding applied: Records: the four orphaned pre-rebase commit stamps re-stamped to byte-identical reachable twins (rows' sha, three tune archives re-hashed + renamed with every tune_sha repointed, LKG + the in-tree bench sidecar); gen_site_records --verify OK, all schema gates green. Serving catalog: the two new serve rows' mmproj companion urls commit-pinned (the catalog gate was red on the floating /main/ refs); catalog_idle.json re-captured from a live boot (7 cards), playwright 106/106 after teaching two specs the vision-present behaviors. Tests: the census tower rows gain family_on tags + lane pins and mint IN MEMORY via stage_*+mint_* (a pinned-lane disk bake GC-purges the serving lane's .dlim - it broke test_audio_embedder; new mint_gemma4a_encoder fills the one missing wrapper); the strict whisper/gemma4uv cells pin the simdgroup lane through the new pin_metal_tensor_crowns latch (the re-minted sidecar armed crowns in suites for the first time; a bare setter cannot hold a lane - every load re-applies profile crowns; the trio's crown flags cache at prefill init); the role fixtures gain their tgmem= (the new lens refusal fired ahead of the role error); the exe smoke reads env through env_value_of and spawns Windows-safe. Docs: news entry drops a false cross-box superiority claim and carries record provenance; the checklist self-review repairs land across tests/benchmarks/performance/site/msl/server/ ladder/GPU/TOWER/MEASUREMENT (six exchange rules move to the module checklist, gate-enforced rules collapse to weakening residue, enumerations become properties); followup 60 ledgers the crowned-lane strict-parity question. All three owed suites green on the final tree: model-free, kernels, coverage. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- .gitignore | 2 + modules/dasLLAMA/ARCHITECTURE_ENGINE.md | 5 + modules/dasLLAMA/PERF_LEDGER.md | 14 +- modules/dasLLAMA/REVIEW.md | 46 ++- modules/dasLLAMA/REVIEW_GPU.md | 33 ++- modules/dasLLAMA/REVIEW_MEASUREMENT.md | 41 ++- modules/dasLLAMA/REVIEW_TOWER.md | 47 +-- modules/dasLLAMA/benchmarks/REVIEW.md | 33 +-- .../dasLLAMA/benchmarks/asr/_pybench_rows.txt | 2 - modules/dasLLAMA/dasllama/dasllama_common.das | 24 +- .../dasLLAMA/dasllama/dasllama_gemma4a.das | 7 + .../dasllama/dasllama_metal_tower.das | 8 + modules/dasLLAMA/followup_general.md | 24 +- modules/dasLLAMA/performance/REVIEW.md | 62 ++-- .../performance/gen_bench_records.das | 16 + .../performance/last_known_good_sidecar.json | 2 +- modules/dasLLAMA/performance/model_specs.das | 4 +- modules/dasLLAMA/performance/records/m4.json | 12 +- ...2524756.json => m4.tune.17d503d8574d.json} | 2 +- modules/dasLLAMA/performance/records/m5.json | 268 ++++++++--------- ...7914ced.json => m5.tune.506843b9bcb2.json} | 2 +- ...28dd577.json => m5.tune.61f4ee8c1a4b.json} | 2 +- modules/dasLLAMA/release_remint_plan.md | 83 +++++- modules/dasLLAMA/tests/CLAUDE.md | 13 +- modules/dasLLAMA/tests/REVIEW.md | 41 ++- modules/dasLLAMA/tests/_exe_smoke_root.das | 10 +- .../tests/_role_fixtures/_rf_deva_read.das | 2 +- .../tests/_role_fixtures/_rf_deva_wrong.das | 2 +- modules/dasLLAMA/tests/test_exe_smoke.das | 7 +- modules/dasLLAMA/tests/test_gemma4uv.das | 15 + .../dasLLAMA/tests/test_kernel_coverage.das | 56 +++- .../tests/test_metal_misc_kernels.das | 2 +- modules/dasLLAMA/tests/test_whisper.das | 20 ++ modules/dasMetal/ARCHITECTURE.md | 3 +- modules/dasMetal/REVIEW.das | 2 +- modules/dasMetal/REVIEW.md | 10 +- site-dasllama/REVIEW.md | 16 +- site-dasllama/_news/2026-08-30-apple-m5.md | 14 +- site-dasllama/build_news.py | 22 +- site-dasllama/feed.xml | 16 +- site-dasllama/index.html | 16 +- site/REVIEW.md | 2 +- site/files/dasllama/bench_records.json | 280 +++++++++--------- tests/msl/REVIEW.md | 9 +- utils/dasllama-server/REVIEW.md | 17 +- utils/dasllama-server/tests/catalog.spec.js | 4 +- .../tests/fixtures/catalog_idle.json | 2 +- utils/dasllama-server/tests/towers.spec.js | 11 +- utils/internal/dasllama-ladder/REVIEW.md | 4 +- 49 files changed, 816 insertions(+), 519 deletions(-) delete mode 100644 modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt rename modules/dasLLAMA/performance/records/{m4.tune.05da62524756.json => m4.tune.17d503d8574d.json} (99%) rename modules/dasLLAMA/performance/records/{m5.tune.144fd7914ced.json => m5.tune.506843b9bcb2.json} (99%) rename modules/dasLLAMA/performance/records/{m5.tune.3865c28dd577.json => m5.tune.61f4ee8c1a4b.json} (99%) diff --git a/.gitignore b/.gitignore index fcbba81e14..45a03e3e42 100644 --- a/.gitignore +++ b/.gitignore @@ -187,6 +187,8 @@ ZEN2.md web/_serve/ web/build_pt/_deps/freetype_src-build/include/freetype/config/ftoption.h modules/dasLLAMA/benchmarks/modules/.daspkg.log +# asr pybench recovery file (raw reference rows, re-minted every sweep) +modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt # python bytecode, anywhere __pycache__/ diff --git a/modules/dasLLAMA/ARCHITECTURE_ENGINE.md b/modules/dasLLAMA/ARCHITECTURE_ENGINE.md index ea966c28f4..dd81aebf0b 100644 --- a/modules/dasLLAMA/ARCHITECTURE_ENGINE.md +++ b/modules/dasLLAMA/ARCHITECTURE_ENGINE.md @@ -2,6 +2,11 @@ Companion to `ARCHITECTURE.md`; section numbers are that document's. +`REVIEW.das`'s `check_exe_fn_global_restore` walks every `dasllama/` file and licenses no +names: each `var g_x = @@fn` declaration carries an `if (g_x == null)` boot-restore guard in +the same file - a serialized exe restores globals as data, and only a boot-restore `[init]` +heals the null function value. + ### 1.1 Engine core - **`dasllama.das`** - the public API facade and nothing else: `load_model` -> `create_session` -> diff --git a/modules/dasLLAMA/PERF_LEDGER.md b/modules/dasLLAMA/PERF_LEDGER.md index ba30a33a16..d921079cfd 100644 --- a/modules/dasLLAMA/PERF_LEDGER.md +++ b/modules/dasLLAMA/PERF_LEDGER.md @@ -1166,14 +1166,18 @@ group; wording kept. adopting").** The arena (yukon.org/mlxfast, repo Layr-Labs/mlxfast-gemma4-26b-a4b-engine, local clone ~/Work/mlxfast) runs a collective ratchet: every accepted submission lands on `main`, so the trunk is a continuously-updated record of what 26 solvers' search found on - Apple silicon. The 2026-08 delta (+30% composite in 33 commits, 100% kernel work) carries - three candidates for our Metal kernels, cited in ~/.claude/plans/mtp-research/mlxfast.md: + Apple silicon. Every figure in this entry is `external` (their arena composite scorer and + their `mlxfast-reports` engine.md - not our instruments; the composite is a two-commit + delta of their trunk on their box, `direction-grade`): the 2026-08 delta (+30% composite + in 33 commits, 100% kernel work) carries three candidates for our Metal kernels, surveyed + in the MTP research notes (local: ~/.claude/plans/mtp-research/mlxfast.md): (1) tight-grid dispatch - launch only causally/structurally valid threadgroups instead of early-returning ~75% of them (their decode step waived 158k of 211k tgs; our QK/AV grids - have the same triangular waste, mlxfast-reports engine.md item 4); (2) identity `scale*q` + have the same triangular waste, their engine.md item 4); (2) identity `scale*q` elision (~4.4 GB/prefill of traffic on their shapes); (3) a nine-dispatch norm/residual - fusion. Re-check the trunk each arc; diff since the last-read sha before every adoption - pass. License verified 2026-08-30: MIT top to bottom - harness + submissions (c) 2026 + fusion. External figures ground the lead only - each candidate adopts through our own race + or knockout plus a re-minted cell. Re-check the trunk each arc; diff since the last-read + sha before every adoption pass. License verified 2026-08-30: MIT top to bottom - harness + submissions (c) 2026 Layr Labs, vendored mlx-swift incl. Metal kernels (c) 2023 ml-explore/Apple - so adoption is clean with those two attribution lines (the NAX arc's steel_attention_nax credit is the house pattern); model weights are not in the repo and carry their own terms. diff --git a/modules/dasLLAMA/REVIEW.md b/modules/dasLLAMA/REVIEW.md index ab3603ea96..a952df7adb 100644 --- a/modules/dasLLAMA/REVIEW.md +++ b/modules/dasLLAMA/REVIEW.md @@ -1,7 +1,9 @@ # dasLLAMA Code Review Checklist **Read `REVIEW_COMMON.md` (repo root) first - its contract binds this checklist.** Architecture -docs: `ARCHITECTURE.md` and the `ARCHITECTURE_*.md` companions it indexes. Planned work: +docs: `ARCHITECTURE.md` and the `ARCHITECTURE_*.md` companions it indexes - the rules below +cite `ARCHITECTURE_ENGINE.md`, `ARCHITECTURE_GPU.md`, `ARCHITECTURE_MEDIA.md`, and +`ARCHITECTURE_MEASUREMENT.md`. Planned work: `followup_general.md`, `followup_vulkan.md`, `PERF_LEDGER.md` (performance goes to the perf ledger, everything else to the followup ledgers). @@ -23,6 +25,32 @@ fixture. A test or tool merely opening a stocked model file by name does not rou sidecar exchange is the code that downloads tune winners to a box and submits that box's winners back. +**Never add a second HTTP path to the sidecar exchange - every HTTP call (lookup, download, +submit) goes through `dasllama/dasllama_exchange.das`.** The mechanical half (no second +`dashv` requirer under the module) is `performance/REVIEW.das`'s to enforce. + +**Weakening the exchange download gate, the submission strip, or the submit rails is a +defect.** The download gate checks content sha, schema, and `DASLLAMA_RELEASE`. The submit +rails stop a sidecar that came from the exchange, or was minted on another box, from being +submitted. `utils/dasllama-server/test_exchange_client.das` enforces the download gate, the +strip, and the rails. + +**A diff that adds a submission path around `exchange_strip_private` is a defect, even where +the strip itself is intact.** + +**A tune-boot path (`exchange_scope_resolver` / `exchange_boot_submit_check`, +`dasllama/dasllama_exchange.das`) that fails when `exchange_lookup` fails is a defect - it +falls through to the local sidecar and the baked winners.** + +**A diff that adds an outbound exchange request reachable from a tune-boot path +(`exchange_scope_resolver` / `exchange_boot_submit_check`) without routing it through +`exchange_may_contact` (`dasllama/dasllama_exchange.das`) is a defect.** + +**A diff that adds a tune-boot-path (`exchange_scope_resolver` / +`exchange_boot_submit_check`) consent question with no terminal to ask on also emits that +question as a `@sidecar` event, in the same change** - the watchdog dialog and the control +page are the answer surfaces a supervised boot has. + **Every `dasllama/` change applies this folder's `tests/REVIEW.md`.** **A GPU kernel, driver, dispatch-class, or K/V-mirror change applies `REVIEW_GPU.md`.** @@ -54,7 +82,8 @@ not thereby pick up the other modality's checklist. **`DASLLAMA_RELEASE` (`dasllama/dasllama_version.das`) is bumped only on a declared release - a maintainer ruling that bench comparability is broken - and a bump riding any other diff is -a defect.** Routine kernel work never bumps it: tune sidecars and board rows stay valid +a defect. A bump whose diff carries no `LAWS.md` entry recording the ruling is a defect +too.** Routine kernel work never bumps it: tune sidecars and board rows stay valid across code changes (a changed kernel keeping a stale sidecar winner is perf-only drift - crowns pick among envelope-verified twins), and per-change invalidation lives in the finer mechanisms (`IMAGE_VERSION`, the reflected layout fingerprint). @@ -63,13 +92,14 @@ mechanisms (`IMAGE_VERSION`, the reflected layout fingerprint). kernel as a uniform, a kargs field, an `@off` bind offset, or a helper parameter.** A value that can change between dispatches goes in a uniform, a kargs field, or an `@off` bind offset. -**A function-typed global with a declaration initializer joins its file's boot-restore -`[init]` in the same change, and weakening `REVIEW.das`'s restore check is a defect.** A +**Weakening `REVIEW.das`'s restore check - the walk over `dasllama/` requiring every +function-typed global with a declaration initializer to join its file's boot-restore +`[init]` - is a defect, and so is landing such a global anywhere the walk does not reach.** A serialized exe restores globals as data - the function value arrives null, and the first invoke to reach it dies at exe runtime while every `-jit` gate stays green (script mode runs the declaration initializers). The restore guard (`if (g_x == null) { g_x = @@sentinel }`) lets a real registrar win in either `[init]` order; `test_exe_smoke` is the end-to-end -tripwire for the class, the `REVIEW.das` check is the per-diff one. +tripwire for the class. **Never reorder or merge the float multiplies in a function that builds a RoPE angle table (`dasllama/dasllama_rope.das`) - keep the multiply order the code already has.** A regrouping @@ -214,9 +244,9 @@ owns lands the sec.1 edit that keeps the charters true - in `ARCHITECTURE_ENGINE a file beside one that has its own sec.1 charter line lands that edit too. A module-root doc file - a ledger, a plan, `LAWS.md` - has no charter line and lands free. -**A diff that adds an `ARCHITECTURE_*.md` companion, or moves a section between companions, -lands `ARCHITECTURE.md`'s index line and section range and repoints every prose `sec.N` / -file citation of the moved sections, in the same change.** The `[arch]` citations are +**A diff that adds or removes an `ARCHITECTURE_*.md` companion, or moves a section between +companions, lands `ARCHITECTURE.md`'s index line and section range and repoints every prose +`sec.N` / file citation of the moved sections, in the same change.** The `[arch]` citations are LINT026-gated; the prose ones are not, and a prose citation of a section that left its file sends the reader to nothing. diff --git a/modules/dasLLAMA/REVIEW_GPU.md b/modules/dasLLAMA/REVIEW_GPU.md index 88cee9a515..2d265a245b 100644 --- a/modules/dasLLAMA/REVIEW_GPU.md +++ b/modules/dasLLAMA/REVIEW_GPU.md @@ -119,10 +119,12 @@ an `upload_region` upload never written after arming - is a defect unless it car defect; a per-encode field either omits `@role` or names the access its body performs.** `weight` drops the hazard staging. -**A new kernel class carries `[metal_dispatch]` / `[vk_dispatch]` with every annotation that -backend's generated builder reads - per-field `@binding` / `@role` / `@off` / `@default`, and -`@workgroup` state with its `tgmem=` dispatch key.** A field carrying none of them is dropped -from the bind list with no error. +**A new kernel class declared in `dasllama/` carries `[metal_dispatch]` / `[vk_dispatch]` +with every annotation that backend's generated builder reads - per-field `@binding` / +`@role` / `@off` / `@default`.** A field carrying none of them is dropped from the bind list +with no error. (A source-text fixture a test spawns to compile is outside this rule.) The +`@workgroup`/`tgmem=` half is a lens compile refusal now - weakening that refusal, or its +gate `test_lens_tgmem_gate`, is a defect. **A kernel field carries `@span` only when every caller binds whole output rows.** A caller binding a column tile of a wider row passes the tile width as the kernel's n while its rows @@ -132,8 +134,14 @@ every row outside the tracked hazard range. **A NEW hand-written `enc_*` body is a defect unless it is a wrapper - a format or twin pick, a default-filling wrapper, or a composite over generated builders.** -**A hand-rolled bind list that dispatches a kernel in `dasllama/` or `performance/` is a -defect - dispatch through the kernel's `enc_*` builder instead.** +**A hand-rolled bind list on a SERVED dispatch in `dasllama/` or `performance/` is a defect - +dispatch through the kernel's `enc_*` builder instead.** A race or knockout arm hand-binds by +construction and answers to the hand-binding-arm rules instead. + +**A hand-binding arm binds every field at the binding number its target kernel class +declares - a number the class does not declare, or a field bound at another field's number, +is a defect.** A mis-numbered arm dispatches, reads the wrong buffer, and its timing crowns +the wrong kernel silently. **A value that reaches the kernel twice device-side - a scalar bound both as a uniform buffer and as a kargs field - is a defect.** A `params=` value that the `grid=`/`tg=` spec consumes @@ -189,9 +197,10 @@ bind site cannot shrink a buffer that was sized wrong. **A change to code that a served GPU decode or prefill path executes ships GPU-vs-CPU parity on one q8 and one kq (K-quant) model with the armed mirror codec.** That code is anything a -served GPU decode or prefill call executes - a driver, a kernel class it dispatches, that -class's builder, a servability gate, a weight-region or residency path, the tier forwarders -and engine seams the call routes through; never the bake paths, never a comment. The parity +served GPU decode or prefill call executes OR that selects what it executes - a driver, a +kernel class it dispatches, that class's builder, a servability gate, a kernel crown race, a +forwarder default, a weight-region or residency path, the tier forwarders and engine seams +the call routes through; never the bake paths, never a comment. The parity run is `harness/parity.das` on either backend, or - on Metal only - the in-suite instruments `tests/test_metal_decode_parity.das` / `tests/test_metal_prefill_parity.das` through `tests/run.das`. @@ -235,9 +244,9 @@ clear** - put it in a `*_ready` latch, or in a holder that function already clea **A diff that changes anything a hand-binding arm must mirror to dispatch a kernel - binding numbers, kargs layout, threadgroup memory, grid or threadgroup geometry - fixes or deletes, in the same change, every arm of a hand-binding lab that binds it** - a hand-binding lab is a -kernel A/B or knockout timing script, wherever it lives (`benchmarks/`, `harness/`), that -hand-lists its bindings instead of dispatching through the `enc_*` builder. A lab left -dispatching stale geometry measures the wrong kernel silently. +kernel A/B or knockout timing script, wherever it lives, that hand-lists its bindings +instead of dispatching through the `enc_*` builder. A lab left dispatching stale geometry +measures the wrong kernel silently. **A diff that ports an A/B lab's winning variant into a kernel deletes the ported arm in the same change - its variant class and any variants-module code that exists only for it; when diff --git a/modules/dasLLAMA/REVIEW_MEASUREMENT.md b/modules/dasLLAMA/REVIEW_MEASUREMENT.md index ff3a596860..7bcf185d71 100644 --- a/modules/dasLLAMA/REVIEW_MEASUREMENT.md +++ b/modules/dasLLAMA/REVIEW_MEASUREMENT.md @@ -1,7 +1,12 @@ # dasLLAMA Measurement Code Review Checklist **Read `REVIEW_COMMON.md` (repo root) first - its contract binds this checklist.** Architecture -doc: `ARCHITECTURE_MEASUREMENT.md`. Routed from `REVIEW.md`. +doc: `ARCHITECTURE_MEASUREMENT.md`. Planned work: `PERF_LEDGER.md`. + +The two figure rules below bind the surfaces this module owns - its ledgers, docs, code +comments, and the PR body of a diff under it. A number on a served page answers to the site +checklists (`site/REVIEW.md`, `site-dasllama/REVIEW.md`), which carry their own provenance +duty. **A self-measured served-turn time entering `PERF_LEDGER.md` comes from the released `lcpp_bench` exe, never from the `-jit` script.** A served-turn time is a tok/s figure or a @@ -17,11 +22,14 @@ in the entry.** reading.** The rule fires only for a reading no board cell produced. The entry also tags that reading `direction-grade` when the reading compares across two processes or two commits. The entry tags the reading `out-of-process` when the wall was measured from outside the benchmark -process. A reading that is neither carries no tag. +process. A reading that is neither carries no tag. A figure taken from another project names +its source and the report it came from and is tagged `external` - it grounds a lead worth +chasing, never an adoption decision. -**A diff that adds an entry to `PERF_LEDGER.md` never records a lab's A/B selection timing.** -That timing settles its adoption decision in the lab's own report and in the PR that lands the -kernel. The ledger learns the winner only through a re-measured cell. +**A diff that adds an entry to `PERF_LEDGER.md` never records the selection timing of one of +our own `harness/` or race A/B labs.** That timing settles its adoption decision in the lab's +own report and in the PR that lands the kernel. The ledger learns the winner only through a +re-measured cell. **A new servable capability gets its cell in the same change**: a board row spawned by `performance/gen_bench_records.das`, or a manual `benchmarks/lcpp_bench.das` cell with its own @@ -30,18 +38,19 @@ family, or backend no existing cell exercises - a q8 or f32 serving lane and a G included. A kernel or form that only makes a path an existing cell already serves faster is not a new capability - it re-mints that cell's row on at least one box instead. -**A timing figure describing a served turn as a whole - tok/s, latency, a whole-turn model -or engine comparison - is a defect wherever it is written down with no cell behind it: a -checked-in doc, a ledger, a code comment, or a PR description.** The cell states its quant -mode and stamps box and engine provenance, so a number can never silently describe a format -nobody serves or a kernel set nobody ships. +**A timing figure PRESENTED AS A MEASUREMENT of a served turn as a whole - tok/s, latency, a +whole-turn model or engine comparison - is a defect wherever this module writes it down with +no cell behind it: a checked-in doc, a ledger, a code comment, or a PR description.** The +cell states its quant mode and stamps box and engine provenance, so a number can never +silently describe a format nobody serves or a kernel set nobody ships. A figure labeled as a +prediction is not a reading - the prediction log is mandated and needs no cell. **A figure measuring one engine stage inside a served turn, or any other measured margin - a lab margin, a kernel-form delta, a gate knee - names the harness and flags that produced it.** A stage figure is a stage wall, a stage share, a stage speedup, or a -cross-engine comparison of one stage. The rule holds wherever the figure is written down: a -checked-in doc, a ledger, a code comment, or a PR description. A board cell's `pp`/`tg` rate -and the whole wall of a `benchmarks/lcpp_bench.das` `-p`/`-n` cell measure the turn, not a -stage, and are not stage figures. The naming sits in the figure's own sentence, in a table -heading that covers the table's rows, or in a section-level provenance line that covers the -paragraphs under it. +cross-engine comparison of one stage. The rule holds wherever this module writes the figure +down: a checked-in doc, a ledger, a code comment, or a PR description. A figure a committed +board cell produced - any metric of the row: `pp`/`tg`, an `img:enc` wall, an `asr:` wall - +is not a stage figure; naming the record and row is its provenance. The naming sits in the +figure's own sentence, in a table heading that covers the table's rows, or in a +section-level provenance line that covers the paragraphs under it. diff --git a/modules/dasLLAMA/REVIEW_TOWER.md b/modules/dasLLAMA/REVIEW_TOWER.md index bca6064023..53ba1fb148 100644 --- a/modules/dasLLAMA/REVIEW_TOWER.md +++ b/modules/dasLLAMA/REVIEW_TOWER.md @@ -1,39 +1,46 @@ # dasLLAMA GPU Tower Code Review Checklist **Read `REVIEW_COMMON.md` (repo root) first - its contract binds this checklist.** Architecture -docs: `ARCHITECTURE_GPU.md`, `ARCHITECTURE_IMAGE.md`, `ARCHITECTURE_MEDIA.md`. +doc: `ARCHITECTURE_MEDIA.md`. **Routed from `REVIEW_GPU.md`: a diff touching the tower driver -(`dasllama/dasllama_metal_tower.das`), a kernel class or builder the tower dispatches, or the -Metal ASR decoder applies this list together with `REVIEW_GPU.md`'s.** +(`dasllama/dasllama_metal_tower.das`), a kernel class or builder the tower dispatches, the +`[metal_dispatch]` emission those builders are generated from +(`dasllama/dasllama_metal_lens.das`), or the Metal ASR decoder applies this list together +with `REVIEW_GPU.md`'s.** **A change other than a comment-only one to `dasllama/dasllama_metal_tower.das`, to the `AttnArgs` kargs struct, to any kernel class the tower dispatches or builder the tower -borrows, or to state the whole driver shares (a module-level `g_tw_*` variable, -`metal_tower_init`, `dasllama_metal_tower_register` - reachable from every hook) runs the -gate of every registered tower hook the changed code is reachable from.** The gates are the -family gates `tests/test_gemma4uv.das`, `tests/test_gemma4v.das`, `tests/test_gemma3v.das`, -`test_qwen3v_tier1_metal` in `tests/test_qwen3v.das`, and `test_qwen25v_tier1_gpu` in -`tests/test_qwen25v.das`; the encoder-blocks leg's `tests/test_whisper.das`; the conv legs' -`tests/test_audio.das` and `tests/test_audio_embedder.das`; plus a `tests/test_model_image.das` -run with the `mtower` arm, with `metal_tower_stats()`'s encode count rising across the run. A -hook registered in `dasllama_metal_tower_register` that this rule's gates do not cover is the -rule's defect to fix in the same change. +borrows, to the builders' `[metal_dispatch]` emission, or to state the whole driver shares +(a module-level `g_tw_*` variable, `metal_tower_init`, `dasllama_metal_tower_register`) runs +every gate below.** One cheap path: a change confined to a function no other file under +`dasllama/` names may instead state that confinement where the run would be claimed. The +gates are the family gates `tests/test_gemma4uv.das`, `tests/test_gemma4v.das`, +`tests/test_gemma3v.das`, `test_qwen3v_tier1_metal` in `tests/test_qwen3v.das`, and +`test_qwen25v_tier1_gpu` in `tests/test_qwen25v.das`; the encoder-blocks leg's +`tests/test_whisper.das`; the conv legs' `tests/test_audio.das` and +`tests/test_audio_embedder.das`; plus a `tests/test_model_image.das` run with the `mtower` +arm, with `metal_tower_stats()`'s encode count rising across the run. + +**A hook registered in `dasllama_metal_tower_register` that the gate list above does not +cover is a defect - extend the list in the same change.** **A change to `dasllama/dasllama_metal_asr_dec.das`, to `dasllama/dasllama_metal_common.das`, -or to any kernel class the ASR decoder dispatches or builder the ASR decoder borrows, ships -a `tests/test_model_image.das` run with the `mtower` arm** - its CPU-vs-GPU transcript cells -are the ASR-decoder driver's parity instrument, and the shared common paths and borrowed -kernels reach that driver with no line of its own file touched. +to any kernel class the ASR decoder dispatches or builder the ASR decoder borrows, or to the +builders' `[metal_dispatch]` emission, ships a `tests/test_model_image.das` run with the +`mtower` arm** - its CPU-vs-GPU transcript cells are the ASR-decoder driver's parity +instrument, and the shared common paths and borrowed kernels reach that driver with no line +of its own file touched. **A tower driver that uploads fewer rows than the padded row count its kernels walk zeroes the pad rows in the same upload** - `dasllama/dasllama_metal_tower.das`. A pooled buffer comes back holding the previous encode's bytes, infinities included. **A tower attention buffer is sized from the widest extent any kernel's grid walks - the QK -key grid walks `nk64` rows, past the `mp` a query panel needs - never from the query pad -alone.** The pool's power-of-two bucket hides the overrun for some row sizes and not others, -so a undersized panel reads past its allocation only on specific canvas sizes. +key grid walks `nk64` rows (the key count rounded up to 64), past the `mp` (the query-panel +row pad) a query panel needs - never from the query pad alone.** The pool's power-of-two +bucket hides the overrun for some row sizes and not others, so an undersized panel reads +past its allocation only on specific canvas sizes. **A diff that changes a family's CPU encoder block loop also changes that family's chain in `dasllama/dasllama_metal_tower.das` in the same change, dispatch for dispatch - and the diff --git a/modules/dasLLAMA/benchmarks/REVIEW.md b/modules/dasLLAMA/benchmarks/REVIEW.md index 884b4e06aa..109d00ba22 100644 --- a/modules/dasLLAMA/benchmarks/REVIEW.md +++ b/modules/dasLLAMA/benchmarks/REVIEW.md @@ -1,7 +1,7 @@ # dasLLAMA benchmarks Code Review Checklist **Read `REVIEW_COMMON.md` (repo root) first - its contract binds this checklist.** Architecture -doc: `../ARCHITECTURE_MEASUREMENT.md` (the benchmark rig is sec.2.5). Planned work: +doc: `../ARCHITECTURE_MEASUREMENT.md` (the benchmark rig: `#one-benchmark-rig`). Planned work: `../followup_vulkan.md` for anything about the Vulkan backend, `../PERF_LEDGER.md` for any other performance followup, `../followup_general.md` for everything else. @@ -15,19 +15,13 @@ measures fallback kernels silently. through `race_pair_ms`.** A race is an instrument that compares two implementations. Two separate runs measure the box's drift between them as much as they measure the arms. -**A diff that adds or changes a race arm offered as the reason to adopt a change, where the arm -produces no comparable output, carries the literal token `timing-only` in the arm's report -line.** - -**A diff that adds or changes a race arm offered as the reason to adopt a change, where the arm -computes the baseline's result in a different precision, prints a bounded-difference compare.** -The compare runs against the baseline arm or against the CPU reference. The report line also -prints the bound the arm passed. - -**A diff that adds or changes a race arm offered as the reason to adopt a change, where the arm -computes the baseline's result in the same precision, prints the bit-exact compare over the -sampled region.** The sampled region is the set of output elements the run compares. The -compare prints on the report's "bit-exact vs ..." line. +**A diff that adds or changes a race arm offered as the reason to adopt a change proves the +arm's output on its report line, by what the arm computes:** an arm producing no comparable +output carries the literal token `timing-only`; an arm computing the baseline's result in a +different precision prints a bounded-difference compare (against the baseline arm or the CPU +reference) plus the bound it passed; an arm computing it in the same precision prints the +bit-exact compare over the sampled region - the set of output elements the run compares - on +the report's "bit-exact vs ..." line. **A diff that adds or changes a race also checks the race's baseline arm against a CPU reference.** The baseline arm is the arm running the implementation already in use. The @@ -53,14 +47,17 @@ script that measures a benchmark process from outside. repository does not build - a third-party reference tool - into `../performance/records/.json` or `../PERF_LEDGER.md`.** Such walls enter only through the reference cells of `../performance/gen_bench_records.das`, the cells that time such a -tool on a board workload. +tool on a board workload. A recovery file a reference leg writes (`asr/_pybench_rows.txt`) +is that leg's scratch - untracked, truncated before each spawn, never read by any other +tool's cell. **A diff that adds or changes an instrument that prints a number formed by subtracting one measured wall from another also prints both raw walls on that report line.** **A diff that changes what a board cell times ships before/after rows for each affected cell -and corpus.** A board cell is a timed cell of the published results board: one +and corpus - or withdraws the affected rows and names the withdrawal and its reason in the PR +body.** A board cell is a timed cell of the published results board: one `../performance/gen_bench_records.das` spawns, or a manual `lcpp_bench.das` cell with its own `../PROFILE.md` section. What a cell times changes when a change to its code, to its input -corpus, or to the pinned reference build (`DEFAULT_REF_SHA` in `setup_lcpp_ref.das`) moves the -measured quantity. +corpus, or to the pinned reference build - `DEFAULT_REF_SHA` in `setup_lcpp_ref.das`, the +targets it builds, or a patch it applies - moves the measured quantity. diff --git a/modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt b/modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt deleted file mode 100644 index 3450c22414..0000000000 --- a/modules/dasLLAMA/benchmarks/asr/_pybench_rows.txt +++ /dev/null @@ -1,2 +0,0 @@ -LOAD onnx-community/whisper-large-v3-turbo 976.173 -BENCH onnx-whisper-turbo-int8 jfk.wav 11.000 1 2172.818 5.063 diff --git a/modules/dasLLAMA/dasllama/dasllama_common.das b/modules/dasLLAMA/dasllama/dasllama_common.das index ab0de58a23..accbe371e0 100644 --- a/modules/dasLLAMA/dasllama/dasllama_common.das +++ b/modules/dasLLAMA/dasllama/dasllama_common.das @@ -1367,9 +1367,11 @@ def apply_box_profile_runtime(path : string = "") { // nolint:STYLE038 — a f apply_i64_knob(rt, "metal_devw_small_panel_mb") $(v) { set_metal_devw_small_panel_mb(v) } apply_i64_knob(rt, "metal_cvt_min_rows") $(v) { set_metal_cvt_min_rows(v) } let mtc = read_json_field(rt, "metal_tensor", "") - if (mtc != "") { + if (mtc != "" && !g_tensor_crowns_pinned) { set_metal_tensor_crowns(mtc) to_log(LOG_INFO, "dasLLAMA: box profile runtime: metal_tensor crowns = {mtc}\n") + } elif (mtc != "") { + to_log(LOG_INFO, "dasLLAMA: box profile metal_tensor crowns NOT applied - pinned via pin_metal_tensor_crowns\n") } let be = read_json_field(rt, "backend", "") if (be != "") { @@ -2152,6 +2154,26 @@ def public metal_tensor_crowned(family : string) : bool { return key_exists(g_tensor_crowns, family) } +//! The comma-list form of the current crowns — what a cell captures to restore on exit. +def public get_metal_tensor_crowns : string { + let fams <- [for (f in keys(g_tensor_crowns)); f] + return join(fams, ",") +} + +var private g_tensor_crowns_pinned = false + +//! Test-cell latch: a crown set that SURVIVES loads (each load re-applies the box profile's +//! crowns, so a bare setter cannot hold a lane across one). Pin BEFORE the load - image +//! flavor and PSO builds key on it; `unpin_metal_tensor_crowns` + a setter restore entry state. +def public pin_metal_tensor_crowns(list : string) { + set_metal_tensor_crowns(list) + g_tensor_crowns_pinned = true +} + +def public unpin_metal_tensor_crowns { + g_tensor_crowns_pinned = false +} + // ===== Metal prefill raced constants (sidecar "runtime" knobs; prefill caches at its init) ===== //! Defaults are the M5 race winners; another box's sidecar overrides without a rebuild. diff --git a/modules/dasLLAMA/dasllama/dasllama_gemma4a.das b/modules/dasLLAMA/dasllama/dasllama_gemma4a.das index 1a7ba49f7e..73175d426e 100644 --- a/modules/dasLLAMA/dasllama/dasllama_gemma4a.das +++ b/modules/dasLLAMA/dasllama/dasllama_gemma4a.das @@ -330,6 +330,13 @@ def load_gemma4a_encoder(path : string) : Gemma4aEncoder { return <- built } +//! Mint a served encoder from a staged read WITHOUT touching disk — the off-rail control for +//! suites (no `.dlim` written, no sibling-lane GC). +def mint_gemma4a_encoder(var st : Gemma4aStaging; var out : Gemma4aEncoder) { + // the tag is the staging's own precision — a caller-supplied flag could bake a lying tag + cache_via_image_staged(st, out, "", st.e.q8 ? "gemma4a-q8" : "gemma4a-f32") +} + //! META-only probe of an mmproj gguf: the gemma4a audio encoder's projection width, or 0 for no //! gemma4a audio tower (wrong family, vision-only, unreadable, a `.dlim`). Gates on the audio //! TENSOR — converters write the `clip.audio.*` keys unconditionally, tower or not. diff --git a/modules/dasLLAMA/dasllama/dasllama_metal_tower.das b/modules/dasLLAMA/dasllama/dasllama_metal_tower.das index 76b4d90bf1..da2e743a9f 100644 --- a/modules/dasLLAMA/dasllama/dasllama_metal_tower.das +++ b/modules/dasLLAMA/dasllama/dasllama_metal_tower.das @@ -65,6 +65,14 @@ def set_metal_tower_f16(on : bool) { g_tw_env_tower_f16 = on } +def get_metal_tower_f16 : bool { + return g_tw_env_tower_f16 +} + +def get_metal_tower_flash : bool { + return g_tw_env_tower_flash +} + //! The tower-flash route's A/B seat (DASLLAMA_METAL_TOWER_FLASH's in-process twin). def set_metal_tower_flash(on : bool) { g_tw_env_tower_flash = on diff --git a/modules/dasLLAMA/followup_general.md b/modules/dasLLAMA/followup_general.md index 84ace854bd..da5aece4ce 100644 --- a/modules/dasLLAMA/followup_general.md +++ b/modules/dasLLAMA/followup_general.md @@ -302,12 +302,10 @@ names its reason (stale-binary with both dates / foreign-box / version / missing entries / absent / unreadable), `DAS_TUNE_MANIFEST` at an untuned-reading file warns loudly instead of silently stamping fallbacks, and `[tune_scope] version_of=` pins the - scope to `DASLLAMA_VERSION` so a copy-restored old sidecar (fresh mtime, old winners - + scope to `DASLLAMA_RELEASE` so a copy-restored old sidecar (fresh mtime, old winners - the trap the forensics surfaced) refuses by name. Metal-arm measurement is unblocked; - bringup owes the standing fresh quiet-box mint, which also refreshes - `performance/last_known_good_sidecar.json` and the `performance/.tune.json` rig - sidecars - the checked-in and on-box copies predate the version pin, so until then they - serve fallbacks with the named warning. + the owed quiet-box mint landed with the release-scope re-mint + (`performance/last_known_good_sidecar.json` and the rig sidecars are fresh under it). 23. **Uniform-bound non-causal prefill kernels for Metal and Vulkan.** The image span currently serves on the CPU loop by decline: `attn_gpu_prefill_ready`, @@ -684,3 +682,19 @@ forward). The root fix is daslang-core: serialize a function value as its mangled name and re-resolve at restore - the whole hazard class disappears language-wide, and the restore inits + the gate collapse to history. das-core scope, its own arc. + +60. **Crowned-lane strict parity: decide whether the tensor twins owe token-exactness, or + the strict gates own the simdgroup lane only.** The release re-mint armed the box's + crowns in the test suites for the first time in a while (the pre-remint sidecar was + stale, so the crown-consuming gates had been silently measuring fallback), and two + strict cells crossed their bars under crowned kernels: whisper's cross-lane + token-identity (attn_qkmm - 10/25 flips on jfk) and gemma4uv's tier-1 rung (mulmm_bf16 - + 6e-05 past a scale-relative bar on one canvas). Both cells now pin the simdgroup lane + via `pin_metal_tensor_crowns` (dasllama_common - a latch `apply_box_profile_runtime` + respects, since every load re-applies profile crowns over a bare setter); the crowned + lane's serving quality stays covered by the board's parity pregate (word-level). The + open question: should the tensor twins' race envelope bar be tightened until the strict + gates pass crowned, or is per-lane gating the honest end state? Also ride-along: the + trio's crown flags cache at prefill init, so a crown pin needs + tower+wdec+prefill shutdowns - a single `metal_crown_flags_reset()` seam would retire + that triple-shutdown incantation. diff --git a/modules/dasLLAMA/performance/REVIEW.md b/modules/dasLLAMA/performance/REVIEW.md index a108785c25..8cbcd39137 100644 --- a/modules/dasLLAMA/performance/REVIEW.md +++ b/modules/dasLLAMA/performance/REVIEW.md @@ -8,21 +8,25 @@ validate through `../dasllama/dasllama_exchange_schema.das` instead.** The engin `dasllama/` require beyond the lint macro module) is `REVIEW.das`'s to enforce; weakening that gate is a defect. -**A diff that writes a row to `records/` (adds one or re-mints one in place) whose -`hardware.remote_desktop` is anything but `off` is a defect - re-mint on a box with no -remote-desktop session.** +**Weakening `REVIEW.das`'s record-hygiene checks - `hardware.remote_desktop` `off` on every +stored run, `provenance.noise` `ok` on every sidecar - is a defect; the fix for a red is a +re-mint on a quiet, session-free box, never an edit.** -**A diff that writes a sidecar to `records/` whose `provenance.noise` is not `ok` is a -defect - re-mint on a quiet box.** - -**A diff that writes a commit stamp to `records/` naming a commit the branch under review -cannot reach is a defect - re-mint, or re-stamp to a reachable commit whose +**A diff that writes a commit stamp anywhere under this folder - `records/`, +`last_known_good_sidecar.json`, any provenance manifest - naming a commit the branch under +review cannot reach is a defect - re-mint, or re-stamp to a reachable commit whose `modules/dasLLAMA/` tree is byte-identical to the tree that was measured, with the PR body naming the re-stamp.** The commit stamps are a `das` row's `sha` and a sidecar's `provenance.engine_sha`. A stamp that resolves to no commit at all counts as unreachable. +Re-stamping inside a content-addressed archive (`records/.tune..json`) re-hashes +and renames the file and repoints every row's `tune_sha` in the same change. -**A diff that writes a reference-engine row to `records/` whose `sha` is not the standing ref pin -(`DEFAULT_REF_SHA`, `../benchmarks/setup_lcpp_ref.das`) is a defect - re-mint.** +**A diff that writes a reference-engine row to `records/` whose `sha` names anything but the +standing ref pin (`DEFAULT_REF_SHA`, `../benchmarks/setup_lcpp_ref.das`) is a defect - +re-mint.** A reference row that carries no `sha` (the cli and python reference tools) is +pinned by its builder instead - the cli tools by that same ref pin's checkout, the python +legs by `../benchmarks/asr/requirements-*.txt` - and a diff that moves one of those pins +re-mints every row the moved pin's tool minted, or withdraws them. **A diff that writes a sidecar to `records/` whose `provenance.dasllama_version` differs from `DASLLAMA_RELEASE` (`../dasllama/dasllama_version.das`) is a defect - re-mint.** Read @@ -44,26 +48,8 @@ reference exe the ref pin builds.** validator ignores run keys it does not know, so an unvalidated field ships silently. **A fallback that recovers reference rows from a file on disk names the tool that writes -that file, and reads it for no other tool - a shared recovery file read by a second tool -copies the first tool's rows into the second's record under a matching clip name.** The -laundered row carries the wrong engine and looks real. - -**Never add a second HTTP path to the sidecar exchange - every HTTP call (lookup, download, -submit) goes through `../dasllama/dasllama_exchange.das`.** The mechanical half (no second -`dashv` requirer under the module) is `REVIEW.das`'s to enforce. - -**Weakening the exchange download gate, the submission strip, or the submit rails is a -defect.** The download gate checks content sha, schema, and `DASLLAMA_RELEASE`. The submit -rails stop a sidecar that came from the exchange, or was minted on another box, from being -submitted. `utils/dasllama-server/test_exchange_client.das` enforces the download gate, the -strip, and the rails. - -**A diff that adds a submission path around `exchange_strip_private` is a defect, even where -the strip itself is intact.** - -**A tune-boot path (`exchange_scope_resolver` / `exchange_boot_submit_check`, -`../dasllama/dasllama_exchange.das`) that fails when `exchange_lookup` fails is a defect - -it falls through to the local sidecar and the baked winners.** +that file, and reads it for no other tool** - a row recovered across tools lands in the +second tool's record carrying the wrong engine, and looks real. **Outside `model_specs()` (text, in `model_specs.das`) and `asr_catalog()` (audio, in `profile_common.das`), a `.das` function under this folder that lists model files, quants, @@ -82,6 +68,11 @@ count - an accessor forwarding to another accessor, or an unnamed table lookup. `companions` of the row that pins its carrier, and names it from every other row that consumes it.** Uniqueness itself is `../tests/test_model_specs.das`'s to enforce. +**A diff that adds or changes a `serve_*` field on a row of `model_specs()` lands +`utils/dasllama-server/test_model_catalog.das` (repo root) green in the same change** - the +serving catalog is a view over these rows, and its gates (pinned urls, unique ids, one +default) red on a row this folder ships. + **A convert, a bench, or a tune-state write reached from `fetch_models.das --fetch` is a defect - `--fetch` downloads only.** Each has its own home: a conversion recipe runs under `--convert`, a timing runs in a board cell (`gen_bench_records.das` or a @@ -99,7 +90,7 @@ scratch dir, or a documented resolve of the pinned revision's size and content s the row's canonical values** - the verify never reads the url of a file already on disk. **A diff that refreshes `last_known_good_sidecar.json` replaces it with one complete mint from -the box its provenance names, at the current `dasllama_version` - never a hand-edited copy.** +the box its provenance names, at the current `DASLLAMA_RELEASE` - never a hand-edited copy.** `REVIEW.das` (beside this file) machine-checks the age-independent half (`noise` `ok`, `validation` `ok`, every `race` winner equal to its `kernels` value); weakening that gate is a defect. @@ -111,12 +102,3 @@ the same change, and a diff that adds a copy names it here in the same change: `utils/dasllama-server/tests/fixtures/exchange.json` (repo root).** The console prompt and the control page render the served constant, so they are not copies. -**A diff that adds an outbound exchange request reachable from a tune-boot path -(`exchange_scope_resolver` / `exchange_boot_submit_check`) without routing it through -`exchange_may_contact` (`../dasllama/dasllama_exchange.das`) is a defect.** - -**A diff that adds a tune-boot-path (`exchange_scope_resolver` / -`exchange_boot_submit_check`) consent question with no terminal to ask on also emits that -question as a `@sidecar` event, in the same change** - the watchdog dialog and the control -page are the answer surfaces a supervised boot has. (The stdin-prompt ban itself is -`modules/dasLLAMA/REVIEW.md`'s, which every file under the module applies.) diff --git a/modules/dasLLAMA/performance/gen_bench_records.das b/modules/dasLLAMA/performance/gen_bench_records.das index c60482c9f4..201cc24073 100644 --- a/modules/dasLLAMA/performance/gen_bench_records.das +++ b/modules/dasLLAMA/performance/gen_bench_records.das @@ -127,6 +127,10 @@ let RIG_EXE_OUT = "modules/dasLLAMA/performance/_rig" let RIG_BENCH_SRC = "modules/dasLLAMA/benchmarks/lcpp_bench.das" let RIG_ENGINE_SRC = "modules/dasLLAMA/dasllama" +// every cell that lands a row bumps this - a run that measured NOTHING exits nonzero +// (a scoped run whose every selected cell declines would otherwise read as a green board) +var private g_cells_measured = 0 + def private rig_exe_path() : string { // macOS ships a clickable .app; every other platform gets //, .exe on Windows if (is_apple_box()) { @@ -405,6 +409,7 @@ def private das_cell(file, path, be, exe : string; accel : bool; cfg : Args; thr mint_check(models_dir(), "{file} das {tag}") absorb_cell(models, cell, store, note, failed, "ok") remove(cellPath) + g_cells_measured++ to_log(LOG_INFO, "gen_bench_records: DONE {file} das {tag} ({elapsed_ms(t0)} ms)\n") logger_info("bench.records", "cell done", JV({"model" => JV(file), "engine" => JV("das"), "leg" => JV(tag), "elapsed_ms" => JV(elapsed_ms(t0))})) } @@ -876,6 +881,7 @@ def private ref_pass(file, path, bin, flavor : string; ngl : int; nopo : bool; c upsert_bench_model(models, bm) stamp_note(models, file, note) write_bench_records(store, models) + g_cells_measured++ to_log(LOG_INFO, "gen_bench_records: DONE {file} ref {flavor} {backend} ({elapsed_ms(t0)} ms)\n") logger_info("bench.records", "cell done", JV({"model" => JV(file), "engine" => JV("llama.cpp"), "leg" => JV("{flavor} {backend}"), "elapsed_ms" => JV(elapsed_ms(t0))})) } @@ -917,6 +923,7 @@ def private image_das_cell(file, path, mm, pic : string; cfg : Args; threads : i mint_check(models_dir(), "{file} das {log_leg}") absorb_cell(models, cell, store, note, failed, "ok") remove(cellPath) + g_cells_measured++ to_log(LOG_INFO, "gen_bench_records: DONE {file} das {log_leg} ({elapsed_ms(t0)} ms)\n") logger_info("bench.records", "cell done", JV({"model" => JV(file), "engine" => JV("das"), "leg" => JV(log_leg), "elapsed_ms" => JV(elapsed_ms(t0))})) } @@ -1003,6 +1010,7 @@ def private image_ref_pass(file, path, mm, pic, bin, flavor : string; ngl : int; upsert_bench_model(models, bm) stamp_note(models, file, note) write_bench_records(store, models) + g_cells_measured++ to_log(LOG_INFO, "gen_bench_records: DONE {file} ref image {flavor} {backend} - enc {best_enc:.1f} ms | pp {best_pp:.1f} | tg {best_tg:.1f} tok/s ({elapsed_ms(t0)} ms)\n") logger_info("bench.records", "cell done", JV({"model" => JV(file), "engine" => JV("llama.cpp"), "leg" => JV("image {flavor} {backend}"), "elapsed_ms" => JV(elapsed_ms(t0))})) } @@ -1038,6 +1046,7 @@ def private asr_das_cell(spec : AsrModelSpec; cfg : Args; threads : int; cellPat } absorb_cell(models, cell, store, "", failed) remove(cellPath) + g_cells_measured++ to_log(LOG_INFO, "gen_bench_records: DONE {spec.display} das {log_leg} ({elapsed_ms(t0)} ms)\n") logger_info("bench.records", "cell done", JV({"model" => JV(spec.display), "engine" => JV("das"), "leg" => JV(log_leg), "elapsed_ms" => JV(elapsed_ms(t0))})) } @@ -1113,6 +1122,8 @@ def private asr_ref_pass(spec : AsrModelSpec; ref : AsrRef; versions : string; c } } to_log(LOG_INFO, "gen_bench_records: {ref.tool} over {length(clips)} clip(s) in one process (python model load amortized)\n") + fwrite(asr_pybench_out_path(), "") //! truncate the --out sidecar first: a stale row from an + //! earlier variant would launder in through the rowless-pipe fallback let pyargs <- asr_pybench_args(ref.tool, ref.handle, clips, threads, cfg.asr_reps, gpu ? "mps" : "") rr.cmd = argv_line(pyargs) var out = run_capture_argv(pyargs) @@ -1227,6 +1238,7 @@ def private asr_ref_pass(spec : AsrModelSpec; ref : AsrRef; versions : string; c bm.runs |> emplace(rr) upsert_bench_model(models, bm) write_bench_records(store, models) + g_cells_measured++ to_log(LOG_INFO, "gen_bench_records: DONE {spec.display} ref {ref.tool} ({measured} clip(s), {elapsed_ms(t0)} ms)\n") logger_info("bench.records", "cell done", JV({"model" => JV(spec.display), "engine" => JV(asr_engine_name(ref.tool)), "leg" => JV("asr"), "clips" => JV(measured), "elapsed_ms" => JV(elapsed_ms(t0))})) } @@ -1535,5 +1547,9 @@ def main : int { to_log(LOG_ERROR, "gen_bench_records: {length(failed)} FAILED cell(s): {list}\n") return 1 } + if (g_cells_measured == 0) { + to_log(LOG_ERROR, "gen_bench_records: ZERO cells measured - every selected cell skipped or declined; an empty run is never a green board\n") + return 1 + } return 0 } diff --git a/modules/dasLLAMA/performance/last_known_good_sidecar.json b/modules/dasLLAMA/performance/last_known_good_sidecar.json index aa49d1af38..18b19d767d 100644 --- a/modules/dasLLAMA/performance/last_known_good_sidecar.json +++ b/modules/dasLLAMA/performance/last_known_good_sidecar.json @@ -46,7 +46,7 @@ "noise_probes" : "start cv 0.08%; mid1 cv 0.05%; mid2 cv 0.10%; end cv 0.10%", "platform" : "darwin", "noise_floor_cv_pct" : "0.10", - "engine_sha" : "fa67fe165", + "engine_sha" : "345dcd667", "box" : "darwin|arm64|Mac17,6|25G72|Apple M5 Max", "written" : "2026-08-31T01:12:23.099Z", "validation_demoted" : "0", diff --git a/modules/dasLLAMA/performance/model_specs.das b/modules/dasLLAMA/performance/model_specs.das index e8947c67ae..cf806232ab 100644 --- a/modules/dasLLAMA/performance/model_specs.das +++ b/modules/dasLLAMA/performance/model_specs.das @@ -413,7 +413,7 @@ def model_specs() : array { // nolint:STYLE038 — flat model-set t parity <- ev_qwen_count(), companions <- [ ProvEntry(name = "mmproj-Qwen3VL-4B-Instruct-F16.gguf", root = "llm", - url = "{HF}/Qwen/Qwen3-VL-4B-Instruct-GGUF/resolve/main/mmproj-Qwen3VL-4B-Instruct-F16.gguf", + url = "{HF}/Qwen/Qwen3-VL-4B-Instruct-GGUF/resolve/1cd86afb9a95c410a6038ab3b40d8b578c892266/mmproj-Qwen3VL-4B-Instruct-F16.gguf", bytes = 836180256l, sha256 = "256f3a43bd4205ffef48d6b92715e1e70b5b0e9aef06522584967513a9985331")]), ModelSpec(file = "Qwen3VL-8B-Instruct-Q8_0.gguf", display = "Qwen3-VL-8B", url = "{HF}/Qwen/Qwen3-VL-8B-Instruct-GGUF/resolve/main/Qwen3VL-8B-Instruct-Q8_0.gguf", @@ -433,7 +433,7 @@ def model_specs() : array { // nolint:STYLE038 — flat model-set t parity <- ev_qwen_count(), companions <- [ ProvEntry(name = "mmproj-Qwen2.5-Omni-3B-f16.gguf", root = "llm", - url = "{HF}/ggml-org/Qwen2.5-Omni-3B-GGUF/resolve/main/mmproj-Qwen2.5-Omni-3B-f16.gguf", + url = "{HF}/ggml-org/Qwen2.5-Omni-3B-GGUF/resolve/75f1b73b657a50f5092502799457ccb4a4a1f9df/mmproj-Qwen2.5-Omni-3B-f16.gguf", bytes = 2623983328l, sha256 = "f6d9276e9fa4f060c7abdbe886786cf31a8911b62770f8a54b7581b7b99fa27e")]), // parity-less provenance carrier: the gemma3 vision 12B pair (the same SigLIP tower at // projection 3840; test_vision_chat's PARITY_FULL leg is its coverage) diff --git a/modules/dasLLAMA/performance/records/m4.json b/modules/dasLLAMA/performance/records/m4.json index 95fe8dc0e3..ceb8d85530 100644 --- a/modules/dasLLAMA/performance/records/m4.json +++ b/modules/dasLLAMA/performance/records/m4.json @@ -5246,11 +5246,11 @@ }, "workload":"asr", "source":"official", - "sha":"54595cfea", + "sha":"77dfc242d", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "tune_sha":"17d503d8574d5d8689999e2a56d8242eef67161beeebb8fd04a863cc34539281", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", @@ -5328,11 +5328,11 @@ }, "workload":"asr", "source":"official", - "sha":"54595cfea", + "sha":"77dfc242d", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "tune_sha":"17d503d8574d5d8689999e2a56d8242eef67161beeebb8fd04a863cc34539281", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", @@ -5410,11 +5410,11 @@ }, "workload":"asr", "source":"official", - "sha":"54595cfea", + "sha":"77dfc242d", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "tune_sha":"17d503d8574d5d8689999e2a56d8242eef67161beeebb8fd04a863cc34539281", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", diff --git a/modules/dasLLAMA/performance/records/m4.tune.05da62524756.json b/modules/dasLLAMA/performance/records/m4.tune.17d503d8574d.json similarity index 99% rename from modules/dasLLAMA/performance/records/m4.tune.05da62524756.json rename to modules/dasLLAMA/performance/records/m4.tune.17d503d8574d.json index eb9301edf8..2598efb238 100644 --- a/modules/dasLLAMA/performance/records/m4.tune.05da62524756.json +++ b/modules/dasLLAMA/performance/records/m4.tune.17d503d8574d.json @@ -46,7 +46,7 @@ "noise_probes" : "start cv 0.97%; mid1 cv 1.28%; mid2 cv 1.76%; end cv 0.62%", "platform" : "darwin", "noise_floor_cv_pct" : "1.76", - "engine_sha" : "54595cfea", + "engine_sha" : "77dfc242d", "box" : "darwin|arm64|Mac16,11|25F84|Apple M4 Pro", "written" : "2026-08-31T01:26:02.283Z", "validation_demoted" : "0", diff --git a/modules/dasLLAMA/performance/records/m5.json b/modules/dasLLAMA/performance/records/m5.json index 72af7a9783..24fb7ab773 100644 --- a/modules/dasLLAMA/performance/records/m5.json +++ b/modules/dasLLAMA/performance/records/m5.json @@ -32,11 +32,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", @@ -121,11 +121,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -210,11 +210,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -302,11 +302,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", @@ -365,11 +365,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -483,11 +483,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -560,11 +560,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -910,11 +910,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -1004,11 +1004,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -1091,11 +1091,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", @@ -1183,11 +1183,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", @@ -1243,11 +1243,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -1332,11 +1332,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -1479,11 +1479,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -1597,11 +1597,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -1722,11 +1722,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", @@ -1814,11 +1814,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", @@ -1874,11 +1874,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -1963,11 +1963,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -2110,11 +2110,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -2228,11 +2228,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -2353,11 +2353,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "tune_sha":"506843b9bcb2b856c2e39dde93d6512b644f56c3f5e6e09d96f61b3cc85182ad", "noise":"ok", "parity":"ok", "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", @@ -2442,11 +2442,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "tune_sha":"506843b9bcb2b856c2e39dde93d6512b644f56c3f5e6e09d96f61b3cc85182ad", "noise":"ok", "parity":"ok", "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -2531,11 +2531,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "tune_sha":"506843b9bcb2b856c2e39dde93d6512b644f56c3f5e6e09d96f61b3cc85182ad", "noise":"ok", "parity":"ok", "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -2630,11 +2630,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", @@ -2719,11 +2719,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -2808,11 +2808,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -2907,11 +2907,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", @@ -2996,11 +2996,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -3085,11 +3085,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -3184,11 +3184,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", @@ -3273,11 +3273,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -3362,11 +3362,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -3461,11 +3461,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", @@ -3550,11 +3550,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -3639,11 +3639,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -3738,11 +3738,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", @@ -3827,11 +3827,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -3916,11 +3916,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -4015,11 +4015,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; metal blob", @@ -4104,11 +4104,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -4193,11 +4193,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -4310,11 +4310,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8", "env":"DASLLAMA_BOX=m5", @@ -4405,11 +4405,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8", "env":"DASLLAMA_BOX=m5", @@ -4658,11 +4658,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8", "env":"DASLLAMA_BOX=m5", @@ -4907,11 +4907,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8", "env":"DASLLAMA_BOX=m5", @@ -5618,11 +5618,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -5718,11 +5718,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -5818,11 +5818,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -6121,11 +6121,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -6221,11 +6221,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -6321,11 +6321,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -6612,11 +6612,11 @@ }, "workload":"asr", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -6810,11 +6810,11 @@ }, "workload":"asr", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -6892,11 +6892,11 @@ }, "workload":"asr", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -6993,11 +6993,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -7245,11 +7245,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -7351,11 +7351,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -7464,11 +7464,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -7716,11 +7716,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -7822,11 +7822,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -7915,11 +7915,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen3v f32; weights q8 native; q8 activations; f16 scales; metal blob", @@ -8033,11 +8033,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen3v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -8151,11 +8151,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen3v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -8276,11 +8276,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; metal blob", @@ -8394,11 +8394,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -8512,11 +8512,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", diff --git a/modules/dasLLAMA/performance/records/m5.tune.144fd7914ced.json b/modules/dasLLAMA/performance/records/m5.tune.506843b9bcb2.json similarity index 99% rename from modules/dasLLAMA/performance/records/m5.tune.144fd7914ced.json rename to modules/dasLLAMA/performance/records/m5.tune.506843b9bcb2.json index f70bad0b6e..f1a9cb4c41 100644 --- a/modules/dasLLAMA/performance/records/m5.tune.144fd7914ced.json +++ b/modules/dasLLAMA/performance/records/m5.tune.506843b9bcb2.json @@ -46,7 +46,7 @@ "noise_probes" : "start cv 0.31%; mid1 cv 0.10%; mid2 cv 0.57%; end cv 0.09%", "platform" : "darwin", "noise_floor_cv_pct" : "0.57", - "engine_sha" : "fa67fe165", + "engine_sha" : "345dcd667", "box" : "darwin|arm64|Mac17,6|25G72|Apple M5 Max", "written" : "2026-08-31T00:44:42.729Z", "validation_demoted" : "0", diff --git a/modules/dasLLAMA/performance/records/m5.tune.3865c28dd577.json b/modules/dasLLAMA/performance/records/m5.tune.61f4ee8c1a4b.json similarity index 99% rename from modules/dasLLAMA/performance/records/m5.tune.3865c28dd577.json rename to modules/dasLLAMA/performance/records/m5.tune.61f4ee8c1a4b.json index c5fa746a4f..2f464b0a30 100644 --- a/modules/dasLLAMA/performance/records/m5.tune.3865c28dd577.json +++ b/modules/dasLLAMA/performance/records/m5.tune.61f4ee8c1a4b.json @@ -46,7 +46,7 @@ "noise_probes" : "start cv 0.26%; mid1 cv 0.24%; mid2 cv 0.17%; end cv 0.37%", "platform" : "darwin", "noise_floor_cv_pct" : "0.37", - "engine_sha" : "366669a53", + "engine_sha" : "f5417ba8f", "box" : "darwin|arm64|Mac17,6|25G72|Apple M5 Max", "written" : "2026-08-30T11:28:00.117Z", "validation_demoted" : "0", diff --git a/modules/dasLLAMA/release_remint_plan.md b/modules/dasLLAMA/release_remint_plan.md index f072f116d2..b186c01cf1 100644 --- a/modules/dasLLAMA/release_remint_plan.md +++ b/modules/dasLLAMA/release_remint_plan.md @@ -116,16 +116,91 @@ The two-tier stop rule: a FAIL (crash/refusal/no-measure) stops the sweep for an fix — it poisons every cell after it; a PERFORMANCE red lets the sweep finish, then fix and re-profile ONLY the red cells (`-o` narrowing) — no full re-sweep, the board is then good; more sweeps follow after the coming arcs. -Red #1: gpt-oss-20b (mxfp4 MoE) das metal pp halved vs the pre-merge row (3989 -> 2047) -while every k-quant MoE gained +6-7%; window = the master merge (first post-merge perf -pass); suspect = the ffn_moe_prefill_grouped seam x the 32-row split on the Metal mx4 -path (per-expert-bias staging pays per region where k-quant's cnt/basep walk does not). +Red #1: gpt-oss-20b (mxfp4 MoE) das metal pp halved vs the pre-merge row (3989.4, +`records/m5.json` @ master; the sweep's first-pass board cell read ~2.0k - VOIDED, the +mis-bound race arm had crowned the wrong twin; the committed post-fix cell is 3995.1) +while the k-quant MoE cells moved up (committed rows vs their @ master twins); window = the +master merge (first post-merge perf pass); suspect = the ffn_moe_prefill_grouped seam x the +32-row split on the Metal mx4 path (per-expert-bias staging pays per region where k-quant's +cnt/basep walk does not). ## Slice E — M4 over ssh Canary rows re-mint (Q8_0 decoder artifact) + the Efficiency-tier gate proof: live-lane print shows the fast-tier-only pool, pp/tg spot-check against existing rows within cv. +## Gate-phase evidence ledger (for the PR body) + +- **Suite evidence (the tests-checklist's owed runs, final tree, 2026-08-30)**: `run.das -- + --suite model-free` rc=0 (75 files); `--arm kernels --suite kernels` rc=0; `--arm coverage + --suite coverage` rc=0 (small tier; the large-tier census rows stay + `DASLLAMA_PARITY_FULL`-gated as designed). All under `-jit` with the box manifest armed - + the first suite pass on this box with live crowns (see the crowned-lane entry above). +- **Figure provenance line (goes in the PR body verbatim)**: all figures quoted in this PR: + `performance/records/m5.json` / `m4.json`, minted 2026-08-30 (m4 canary rows stamp + 2026-08-31 UTC) on the b10659 ref pin; `img:enc` / `asr:` figures are `lcpp_bench + --image` / `--asr` board cells, das metal vs `llama-mtmd-cli`/`whisper-cli`/NeMo torch-MPS + reference legs. + +- **Commit-stamp re-stamp** (per `performance/REVIEW.md`'s reachability rule): four orphaned + pre-rebase stamps re-stamped to byte-identical reachable twins (`git diff --stat + -- modules/dasLLAMA/` = 0 lines each): fa67fe165->345dcd667, 82e45e0a3->bbdcf8da1, + 366669a53->f5417ba8f, 54595cfea->77dfc242d. The three tune-generation archives re-hashed and + renamed (144fd7914ced->506843b9bcb2, 3865c28dd577->61f4ee8c1a4b, 05da62524756->17d503d8574d), + every `tune_sha` repointed; LKG + `benchmarks/lcpp_bench.tune.json` re-stamped in place. + `gen_site_records --verify` OK; bench-records/site/exchange schema gates green post-restamp. +- **M1 canary rows withdrawn, not re-minted**: the box is retired from runs by ruling ("we've + measured multiple times") and the rows pinned the deleted f16 decoder artifact. +- **Post-fix mx4 race**: the rebound `race_moe_mulmm_mx4` re-race re-crowned honestly and the + gpt-oss metal cell was re-profiled with the renumber in the built exe - the committed + 3995.1 row (`records/m5.json`, 2026-08-30) IS the post-fix reading; the fix and the record + land in one commit, which is why the row's stamp predates the commit carrying both. +- **GPU parity for the crown/forwarder changes**: every das Metal row of the m5/m4 re-mint ran + behind the per-row parity pregate with `--ngl` armed - q8 (E2B Q8_0, canary Q8_0) and kq + (12B/30B Q4_K_M) both covered. The 14 boot-restore `[init]`s are `if (== null)` guards - no-ops + on the `-jit` rail, exercised on the `-exe` rail by `test_exe_smoke`. The Vulkan-armed proof is + deferred: the vulkan hooks arrived from the parallel vulkan arc and no Vulkan box runs in this + arc. +- **exe-smoke knockout scope**: the smoke's SmolLM2 CPU generate reaches the decode claim path + (`g_moe_gpu_attn_dec*` trio via the prefill-tail claim mirrors); the rdec/ffn_xf seams are + unreached by it and covered statically by `REVIEW.das`'s `check_exe_fn_global_restore`. +- **Census numeric fixture claims**: assert-free by ledgered design (tests/CLAUDE.md, coverage + suite: dispatch diversity, parity suites own truth) - "yes, ledgered". +- **Twin binding divergence** (mx4 cnt@6/basep@7 vs k-quant cnt@7/basep@8): ledgered in + `ARCHITECTURE_GPU_PREFILL.md` sec.2.2g - "yes, ledgered". +- **url re-pins**: both new serve models AND their mmproj companions commit-pinned; each pinned + url resolved live (HTTP 200 through the CDN redirect) at pin time. +- **m4 canary run dates read 2026-08-31**: the box stamps UTC; minted the evening of 08-30 local. +- **Exchange roster drift**: the download gate keys on (release, box); the serve-roster growth + rides release 15 unchanged - older clients see the new rows only after their own catalog pull. +- **Server fixtures**: `catalog_idle.json` re-captured from a live boot (7 cards); + `catalog_downloading/done` keep their captures - the download-state shape they pin is + unchanged, and a mid-flight re-capture needs a live download (playwright suite 106/106). +- **Efficiency-tier gate, verified live**: M5 `pool 18 lanes` spanning Super+Performance; M4 + `live: 10 dispatch lanes` (efficiency cores excluded). +- **Suite-red forensics (post-audit fix pass)**: the re-minted sidecar armed the box's + crowns in the test suites for the first time (the pre-remint sidecar was binary-stale, so + crown-consuming gates had silently measured fallback). Two strict cells crossed bars under + crowned kernels - whisper cross-lane token-identity (attn_qkmm) and gemma4uv tier-1 rung + (mulmm_bf16, 6e-05 past the bar on one canvas). Both now pin the simdgroup lane via the + new `pin_metal_tensor_crowns` latch (a bare setter cannot hold a lane - every load + re-applies profile crowns); the crowned lane's serving quality remains the board parity + pregate's claim. Ledgered as followup 60 (should the twins' race envelope tighten until + strict gates pass crowned?). Also fixed on the way: the two role fixtures gained their + `tgmem=` (the new lens refusal fired first, masking the role-error the test expects), and + `test_exe_smoke` reads the env through `env_value_of` (the registry gate). +- **Census dlim purge (caught by the final suite pass)**: the pinned-lane census loads baked + wrong-lane `.dlim` flavors to disk, and the bake's sibling GC purged the serving lane's + image - `test_audio_embedder` then panicked on the wrong identity. All four new tower rows + now mint in memory (`stage_*` + `mint_*`, a new `mint_gemma4a_encoder` filling the one + missing wrapper); the stray flavors were removed and rebake on demand; the rule is now in + `tests/REVIEW.md` (pinned-lane loads go through the in-memory rail). +- **Tower-gate cheap path** (`REVIEW_TOWER.md`): the driver diff is confined to the + `get_metal_tower_f16` / `get_metal_tower_flash` getters, functions no other file under + `dasllama/` names - their only callers are the census rows in + `tests/test_kernel_coverage.das`. The coverage suite run additionally drives every tower + family encode (gemma4uv/4v/3v, qwen3v/25v, whisper, audio legs). + ## Done - Tune sidecars and board rows survive routine version-less changes; only a declared diff --git a/modules/dasLLAMA/tests/CLAUDE.md b/modules/dasLLAMA/tests/CLAUDE.md index 2630339396..62143d5dcc 100644 --- a/modules/dasLLAMA/tests/CLAUDE.md +++ b/modules/dasLLAMA/tests/CLAUDE.md @@ -139,7 +139,10 @@ the device-free rail unit; the serving vulkan census runs on the PC box. The `kernels` suite (test_metal_{prefill,decode,rope,gemv,misc,attn,gemm}_kernels - model-less per-class CPU-oracle units covering the FULL metal kernel census, ~2-3 min) has no arms; -remember it exists (the hand-bound-gate sync obligation is `REVIEW.md`'s). Shared fixtures +remember it exists (the hand-bound-gate sync obligation is `REVIEW.md`'s). The misc file also +carries `test_lens_tgmem_gate` - not a CPU-oracle unit: it spawns two `daslang -compile-only` +child builds (up to 120 s each) proving the lens refuses a `[metal_dispatch]` class with +`@workgroup` members and no `tgmem=`, twin fixture as the must-compile control. Shared fixtures (buf helpers, the mismatch compares that dump both sides, kq plane + q8 blob builders) live in `_metal_kernel_common.das`. `test_metal_prefill_kernels.das` keeps its tag-less mismatch compares local - a same-arity twin would collide with the shared tagged one. `_mtl_toy.das` @@ -149,9 +152,10 @@ dispatches through the GENERATED builders (kn_ rail), not hand binds. The control obligation for a new gate or bar is `REVIEW.md`'s. Size a poison as a value ADDED to the expected result, not as a multiple of the tolerance. A tolerance that scales with the accumulation length swallows a scaled poison at the kernel's longest dot product, which is -exactly where a bug hides. Every compare against a derived truth gets its own poison. A gate -that skips `metal_set_threadgroup_memory_length` for a kernel with `@workgroup` state reads -garbage silently - no error, a plausible wrong number. +exactly where a bug hides. Every compare against a derived truth gets its own poison. A +dispatch that skips `metal_set_threadgroup_memory_length` for a kernel with `@workgroup` state +reads garbage silently - no error, a plausible wrong number - which is why the lens makes the +omission a compile refusal (`test_lens_tgmem_gate` above). ## Model-free / no-arm tests @@ -431,6 +435,7 @@ carry no tag and always run. Family tokens: `llama` (`--suite decode`, `prefill` `qwen2`, `qwen3`, `phi3`, `gemma2`, `gemma3`, `gemma4`, `qwen3moe`, `gemma4moe`, `gptoss`, `qwen35`, `qwen35moe`, `qwen2moe` (the support-matrix family cells), `gemma`, `ultravox`, `whisper`, `voxtral`, `parakeet`, `qwen3a`, `canary`, `gemma4a` (image suite arms), +`gemma3v`, `qwen25v`, `qwen3v` (the coverage census tower rows), `gemma4e` (support-matrix rows under `fam-gemma4e` - E4B PARITY_FULL-gated; E2B Q8_0 and Q4_K_M small-tier always-on, carrying the per-layer-FFN-width and blob-kq-PLE-gather coverage. Both E2B rows assert parity through their forced-feed cells, not token equality, because diff --git a/modules/dasLLAMA/tests/REVIEW.md b/modules/dasLLAMA/tests/REVIEW.md index d42d07136b..6a4d0d21d3 100644 --- a/modules/dasLLAMA/tests/REVIEW.md +++ b/modules/dasLLAMA/tests/REVIEW.md @@ -86,10 +86,11 @@ defect** - that gate is a final pre-PR gate, not the iteration loop. In this fol spelling is `model_available` (`_model_tier.das`). A test that cannot require `_model_tier.das` open-codes the same env check. -**A test whose subject is not the `.dlim` image rail never calls `load_model`, -`load_model_cached`, or `load_model_image` - it loads each carrier through that carrier's own -loader.** Decoders load through `load_model_` (`../dasllama/dasllama_load.das`). Towers, -embedders, and union carriers load through their family or carrier loaders. +**A test - or a program a test builds or spawns - whose subject is not the `.dlim` image +rail never calls `load_model`, `load_model_cached`, or `load_model_image` - it loads each +carrier through that carrier's own loader.** Decoders load through `load_model_` +(`../dasllama/dasllama_load.das`). Towers, embedders, and union carriers load through their +family or carrier loaders. **A function that gains a parameter, or a parameter that gains an accepted value, ships a test for the new value.** The test feeds the new value and checks the result. It lives in @@ -138,8 +139,9 @@ that file's `CENSUS_NEVER_DISPATCHED`, with the reason no row can reach it. A `DASLLAMA_PARITY_FULL`-gated census row counts as the dispatching arm. Naming a class a census row could dispatch is a defect. -**A kernel-unit cell missing a compare against a CPU oracle that can witness the cell's -property is a defect.** +**A kernel-unit cell - a model-less cell that dispatches one kernel class and asserts on its +output - missing a compare against a CPU oracle that can witness the cell's property is a +defect.** (A census row dispatches without asserting on output, so it is not one.) **A kernel-unit cell that bit-compares a buffer the GPU writes prefills its output buffers with a sentinel.** An unprefilled output can pass a bit compare by staying stale. @@ -167,16 +169,23 @@ loads the dump names it. the backend, the flash-attention setting, and the mmproj precision the dump came from - is a defect.** -**A cell that does not establish every driver hook and serving-lane knob its claim depends on, -and restore each to its default before returning, is a defect.** This holds even when the -claim needs the knob at its DEFAULT value. A hook is any process-wide setter with no -read-back. The Vulkan tier's installs (`install_moe_gpu_tier` and the `set_moe_gpu_*_hook(s)` -seats) are one-way and establish-only - `ARCHITECTURE_GPU.md` sec.1.5 sanctions them. The environment can carry a knob either way. The mechanism (why the hooks flip legs -silently) is `CLAUDE.md`'s "Metal fixtures" section. - -**A cell claiming a family serving lane that does not pin it with `set__q8` and undo -the pin with `reset__q8` is a defect.** A runtime decline standing in for a pin -measures whichever lane the box's policy picked. +**A cell that does not establish every process-wide driver setter and serving-lane knob its +claim depends on, and restore each to the value it had on entry before returning, is a +defect.** This holds even when the claim needs the knob at its DEFAULT value. The Vulkan +tier's installs (`install_moe_gpu_tier` and the `set_moe_gpu_*_hook(s)` seats) are one-way +and establish-only - `ARCHITECTURE_GPU.md` sec.1.5 sanctions them. The environment can carry +a knob either way. The mechanism (why the hooks flip legs silently) is `CLAUDE.md`'s "Metal +fixtures" section. + +**A cell claiming a family serving lane that does not pin it through the family's own +pin/reset pair - `set__q8` / `reset__q8`, canary's `set_canary_enc_q8` / +`reset_canary_enc_q8` - or through a loader parameter that takes the lane, is a defect.** A +runtime decline standing in for a pin measures whichever lane the box's policy picked. + +**A cell that loads a media carrier under a lane pin loads it through the family's +`stage_*` + `mint_*` pair (the in-memory image rail), never the disk loader.** A disk bake +under a pinned lane GC-purges the serving lane's `.dlim` beside the model, and the next +direct-image load in another suite panics on the wrong identity. **A CPU-vs-GPU arm that does not run a PLANAR model for its CPU stages, and that model's `blob_twin(t, path, seq_cap)` for override-selected stages, is a defect.** One session spans diff --git a/modules/dasLLAMA/tests/_exe_smoke_root.das b/modules/dasLLAMA/tests/_exe_smoke_root.das index 2415146081..c4a75970f9 100644 --- a/modules/dasLLAMA/tests/_exe_smoke_root.das +++ b/modules/dasLLAMA/tests/_exe_smoke_root.das @@ -1,21 +1,23 @@ options gen2 options stack = 524288 // every dasLLAMA program root takes this budget (options stack does not unify up from libs) +options _dasllama_internal = true require dasllama/dasllama require daslib/jobque_boost -require daslib/fio +require strings // The fixture test_exe_smoke builds with `-jit -exe` and runs: one tiny load plus a 4-token // generate through the facade, on the serialized-globals rail no `-jit` suite can reach. [export] def main { - let path = get_env_variable("DASLLAMA_EXE_SMOKE_MODEL") - if (empty(path)) { + let cmd <- get_command_line_arguments() + let path = empty(cmd) ? "" : cmd[length(cmd) - 1] + if (!ends_with(path, ".gguf")) { print("EXE_SMOKE_SKIP no model\n") return } - var m <- load_model(path, QuantMode.q8) + var m <- load_model_(path, QuantMode.q8) //! the internal loader: the image rail is not the subject, and the facade would mint a .dlim beside the stocked model allow_cpu_prefill() with_job_que() { setup_dasllama_jobque() diff --git a/modules/dasLLAMA/tests/_role_fixtures/_rf_deva_read.das b/modules/dasLLAMA/tests/_role_fixtures/_rf_deva_read.das index eb04552913..d5bde3e92b 100644 --- a/modules/dasLLAMA/tests/_role_fixtures/_rf_deva_read.das +++ b/modules/dasLLAMA/tests/_role_fixtures/_rf_deva_read.das @@ -12,7 +12,7 @@ require metal/das_metal_boost var private g_rf_deva_pso : MetalComputePipeline? -[metal_dispatch(name = "enc_rf_deva", pso = "g_rf_deva_pso", tg = 128, grid = "m/32, n/64", params = "m : int64, n : int64")] +[metal_dispatch(name = "enc_rf_deva", pso = "g_rf_deva_pso", tgmem = "rf_deva_msl_tgmem", tg = 128, grid = "m/32, n/64", params = "m : int64, n : int64")] class RfDevaRead { @ssbo @binding = 0 @role = "read" src : array @ssbo @binding = 1 @role = "write" dst : array diff --git a/modules/dasLLAMA/tests/_role_fixtures/_rf_deva_wrong.das b/modules/dasLLAMA/tests/_role_fixtures/_rf_deva_wrong.das index e8fcd81409..71f4cc6a94 100644 --- a/modules/dasLLAMA/tests/_role_fixtures/_rf_deva_wrong.das +++ b/modules/dasLLAMA/tests/_role_fixtures/_rf_deva_wrong.das @@ -14,7 +14,7 @@ require metal/das_metal_boost var private g_rf_deva_w_pso : MetalComputePipeline? -[metal_dispatch(name = "enc_rf_deva_w", pso = "g_rf_deva_w_pso", tg = 128, grid = "m/32, n/64", params = "m : int64, n : int64")] +[metal_dispatch(name = "enc_rf_deva_w", pso = "g_rf_deva_w_pso", tgmem = "rf_deva_w_msl_tgmem", tg = 128, grid = "m/32, n/64", params = "m : int64, n : int64")] class RfDevaWrong { @ssbo @binding = 0 @role = "write" src : array @ssbo @binding = 1 @role = "write" dst : array diff --git a/modules/dasLLAMA/tests/test_exe_smoke.das b/modules/dasLLAMA/tests/test_exe_smoke.das index 143b7c519f..37720b6c8c 100644 --- a/modules/dasLLAMA/tests/test_exe_smoke.das +++ b/modules/dasLLAMA/tests/test_exe_smoke.das @@ -7,6 +7,7 @@ require daslib/fio require math require daslib/strings_boost require strings +require daslib/env_registry require _model_tier // The standalone-exe context gate: build `_exe_smoke_root.das` with `-jit -exe` and run the @@ -43,8 +44,10 @@ def test_exe_smoke(t : T?) { return } var out = "" - let rc = run_and_capture(["/usr/bin/env", "DASLLAMA_ALLOW_UNTUNED=1", - "DASLLAMA_EXE_SMOKE_MODEL={model}", exe], out, 300.0) + let prev_untuned = env_value_of("DASLLAMA_ALLOW_UNTUNED") + set_env_variable("DASLLAMA_ALLOW_UNTUNED", "1") //! inherited by the child; /usr/bin/env does not exist on Windows + let rc = run_and_capture([exe, "--", model], out, 300.0) + set_env_variable("DASLLAMA_ALLOW_UNTUNED", prev_untuned) t |> equal(0, rc, "the exe runs clean: {slice(out, max(0, length(out) - 400))}") t |> success(find(out, "EXE_SMOKE_OK") >= 0, "the generate completed in the exe: {slice(out, max(0, length(out) - 400))}") rmdir_rec_result(dir) diff --git a/modules/dasLLAMA/tests/test_gemma4uv.das b/modules/dasLLAMA/tests/test_gemma4uv.das index c6384f31c2..e57eaf91a0 100644 --- a/modules/dasLLAMA/tests/test_gemma4uv.das +++ b/modules/dasLLAMA/tests/test_gemma4uv.das @@ -5,12 +5,14 @@ options _dasllama_internal = true require dastest/testing_boost public require dasllama/dasllama_gemma4uv +require dasllama/dasllama_common // the tensor-crown pin (the rung is simdgroup-calibrated) require dasllama/dasllama_math // setup_dasllama_jobque_ require daslib/jobque_boost require daslib/fio require _model_tier // models_dir() + model_available() gate require _vision_oracle // the mtmd dump parser, fixture generators, per-token compare require ?das_metal dasllama/dasllama_metal_tower // the GPU tier-1 attempt; the CPU gate pins the knob off +require ?das_metal dasllama/dasllama_metal_prefill // metal_prefill_shutdown — the crown-pin cell drops the trio's cached flags // Tier-1 gemma4uv embedder parity vs llama-mtmd-debug -p encode (CPU, --no-mmproj-offload, dumps // minted from the f32-widened 12B mmproj twin; the embedder has no attention, so the flash-attn @@ -111,6 +113,15 @@ def test_gemma4uv_tier1_gpu(t : T?) { if (!model_available(tt, mm)) { return } + // the scale-relative rung is calibrated on the SIMDGROUP kernel set - pin it + // (a bare setter would not survive the load, which re-applies the box + // profile's crowns): the envelope-verified mulmm_bf16 tensor crown rounds + // differently and sits a hair past the rung on some canvases; the crowned + // lane's quality is the board pregate's claim, not this cell's + let prev_crowns = get_metal_tensor_crowns() + pin_metal_tensor_crowns("") + metal_tower_shutdown() + metal_prefill_shutdown() // the crown flags the shared GEMM/trio builders cache var emb <- load_gemma4uv_embedder(mm) var st = Gemma4uvState() set_metal_tower(true) @@ -126,6 +137,10 @@ def test_gemma4uv_tier1_gpu(t : T?) { "{fx.kind} {fx.w}x{fx.h}: GPU-served (encodes delta)") } } + unpin_metal_tensor_crowns() + set_metal_tensor_crowns(prev_crowns) + metal_tower_shutdown() + metal_prefill_shutdown() delete st delete emb } diff --git a/modules/dasLLAMA/tests/test_kernel_coverage.das b/modules/dasLLAMA/tests/test_kernel_coverage.das index 65daafd0a8..f71ede2d27 100644 --- a/modules/dasLLAMA/tests/test_kernel_coverage.das +++ b/modules/dasLLAMA/tests/test_kernel_coverage.das @@ -222,9 +222,11 @@ def private census_zoo(t : T?) { def private cov_tower_gemma3v(t : T?) { static_if (typeinfo builtin_module_exists(das_metal)) { let vpath = path_join(models_dir(), "mmproj-gemma-3-4b-it-F16.gguf") - if (model_available(t, vpath)) { + if (family_on(t, "gemma3v") && model_available(t, vpath)) { set_gemma3v_q8(false) // the driver serves f32 planes (the lane policy picks this with the tower on; pinned for the census) - var inscope tw <- load_gemma3v_tower(vpath) + var inscope g3stg <- stage_gemma3v_tower(vpath) // stage+mint: no .dlim written, no sibling-lane GC + var inscope tw = Gemma3vTower() + mint_gemma3v_tower(g3stg, tw) reset_gemma3v_q8() var st = Gemma3vState() var planes : array @@ -233,24 +235,30 @@ def private cov_tower_gemma3v(t : T?) { planes[i] = sin(float(i) * 0.017) * 0.5 + 0.5 } var out : array + let prev_flash = get_metal_tower_flash() with_job_que() { setup_dasllama_jobque() gemma3v_encode(tw, st, planes, 896l, 896l, out) set_metal_tower_flash(false) var out2 : array gemma3v_encode(tw, st, planes, 896l, 896l, out2) - set_metal_tower_flash(true) + set_metal_tower_flash(prev_flash) delete out2 } delete out delete st // the crowned twin-W leg: a fresh load under pinned crowns bakes the halfword - // twin, so the f16-route kernels (cvt_half + the half GEMMs) dispatch - set_metal_tensor_crowns("mulmm_q8") + // twin, so the f16-route kernels (cvt_half + the half GEMMs) dispatch - the PIN + // form, since the load re-applies the box profile's crowns over a bare setter + let prev_crowns = get_metal_tensor_crowns() + let prev_tower_f16 = get_metal_tower_f16() + pin_metal_tensor_crowns("mulmm_q8") metal_prefill_shutdown() set_metal_tower_f16(true) set_gemma3v_q8(false) // the exact lane is the one that bakes the twin - var twt <- load_gemma3v_tower(vpath) + var inscope g3stg2 <- stage_gemma3v_tower(vpath) // in-memory: the crowned bake must not purge the serving flavor + var twt = Gemma3vTower() + mint_gemma3v_tower(g3stg2, twt) reset_gemma3v_q8() var stt = Gemma3vState() var outt : array @@ -258,7 +266,9 @@ def private cov_tower_gemma3v(t : T?) { setup_dasllama_jobque() gemma3v_encode(twt, stt, planes, 896l, 896l, outt) } - set_metal_tensor_crowns("") + unpin_metal_tensor_crowns() + set_metal_tensor_crowns(prev_crowns) + set_metal_tower_f16(prev_tower_f16) metal_prefill_shutdown() delete outt delete stt @@ -274,8 +284,10 @@ def private cov_tower_gemma3v(t : T?) { def private cov_tower_qwen25v(t : T?) { static_if (typeinfo builtin_module_exists(das_metal)) { let vpath = path_join(models_dir(), "mmproj-Qwen2.5-Omni-3B-f16.gguf") - if (model_available(t, vpath)) { - var tw <- load_qwen25v_tower(vpath) + if (family_on(t, "qwen25v") && model_available(t, vpath)) { + var inscope q25stg <- stage_qwen25v_tower(vpath) // stage+mint: no .dlim written, no sibling-lane GC + var tw = Qwen25vTower() + mint_qwen25v_tower(q25stg, tw) var st = Qwen25vState() var planes : array planes |> reserve_resize(112l * 112l * 3l) @@ -301,8 +313,12 @@ def private cov_tower_qwen25v(t : T?) { def private cov_tower_qwen3v(t : T?) { static_if (typeinfo builtin_module_exists(das_metal)) { let vpath = path_join(models_dir(), "mmproj-Qwen3VL-4B-Instruct-F16.gguf") - if (model_available(t, vpath)) { - var tw <- load_qwen3v_tower(vpath) + if (family_on(t, "qwen3v") && model_available(t, vpath)) { + set_qwen3v_q8(false) // pinned for the census — the box's lane policy must not pick the row's kernel set + var inscope q3stg <- stage_qwen3v_tower(vpath) // stage+mint: no .dlim written, no sibling-lane GC + var tw = Qwen3vTower() + mint_qwen3v_tower(q3stg, tw) + reset_qwen3v_q8() var st = Qwen3vState() var planes : array planes |> reserve_resize(96l * 96l * 3l) @@ -328,8 +344,12 @@ def private cov_tower_qwen3v(t : T?) { def private cov_tower_gemma4a(t : T?; samples : array) { static_if (typeinfo builtin_module_exists(das_metal)) { let gpath = path_join(models_dir(), "mmproj-gemma-4-E2B-it-bf16.gguf") - if (model_available(t, gpath) && !empty(samples)) { - var inscope genc <- load_gemma4a_encoder(gpath) + if (family_on(t, "gemma4a") && model_available(t, gpath) && !empty(samples)) { + set_gemma4a_q8(false) // pinned for the census — the box's lane policy must not pick the row's kernel set + var inscope gstg <- stage_gemma4a_encoder(gpath) // stage+mint: no .dlim written, no sibling-lane GC + var inscope genc = Gemma4aEncoder() + mint_gemma4a_encoder(gstg, genc) + reset_gemma4a_q8() var gst = Gemma4aState() var grows : array with_job_que() { @@ -348,8 +368,10 @@ def private cov_tower_gemma4a(t : T?; samples : array) { def private cov_tower_canary(t : T?; samples : array) { static_if (typeinfo builtin_module_exists(das_metal)) { let cnpath = path_join(models_dir(), "canary-qwen-2.5b-encoder-f32.bin") - if (model_available(t, cnpath) && !empty(samples)) { - var inscope cenc <- load_canary_encoder(cnpath) + if (family_on(t, "canary") && model_available(t, cnpath) && !empty(samples)) { + var inscope cstg <- stage_canary_encoder(cnpath) // stage+mint: no .dlim written, no sibling-lane GC + var inscope cenc = CanaryEncoder() + mint_canary_encoder(cstg, cenc) var cst = CanaryState() with_job_que() { setup_dasllama_jobque() @@ -368,7 +390,9 @@ def private cov_tower_gemma4v(t : T?) { let vpath = path_join(models_dir(), "mmproj-gemma-4-E2B-it-bf16.gguf") if (model_available(t, vpath)) { set_gemma4v_q8(false) // the driver serves the file's planes (the lane policy picks this with the tower on; pinned for the census) - var inscope tw <- load_gemma4v_tower(vpath) + var inscope g4stg <- stage_gemma4v_tower(vpath) // stage+mint: no .dlim written, no sibling-lane GC + var inscope tw = Gemma4vTower() + mint_gemma4v_tower(g4stg, tw) reset_gemma4v_q8() var st = Gemma4vState() var planes : array diff --git a/modules/dasLLAMA/tests/test_metal_misc_kernels.das b/modules/dasLLAMA/tests/test_metal_misc_kernels.das index e56d83463a..9f26d27d08 100644 --- a/modules/dasLLAMA/tests/test_metal_misc_kernels.das +++ b/modules/dasLLAMA/tests/test_metal_misc_kernels.das @@ -1974,7 +1974,7 @@ def test_lens_tgmem_gate(t : T?) { let good = spawn_wg_fixture(true, "ok") t |> equal(0, good.rc, "the tgmem= twin compiles: {good.out}") } else { - feint("das_metal is not built on this platform; lens tgmem gate skipped\n") + t |> skip("das_metal is not built on this platform") } } } diff --git a/modules/dasLLAMA/tests/test_whisper.das b/modules/dasLLAMA/tests/test_whisper.das index 51c20ca876..4c2515bb94 100644 --- a/modules/dasLLAMA/tests/test_whisper.das +++ b/modules/dasLLAMA/tests/test_whisper.das @@ -22,6 +22,7 @@ require _model_tier // model_available() presence/size-tier gate (see the file require dasllama/dasllama_env require ?das_metal dasllama/dasllama_metal_asr_dec // set_metal_wdec — the CPU-claim cells pin the GPU cross-KV hook off require ?das_metal dasllama/dasllama_metal_tower // set_metal_tower — the mtmd-oracle cells pin the GPU conv hook off +require ?das_metal dasllama/dasllama_metal_prefill // metal_prefill_shutdown — the crown-pin cell drops the trio's cached flags // Whisper-proper tests. The f16/gelu/mel/id tests are self-contained; the loader and // transcription tests need a whisper.cpp ggml-tiny.bin (gitignored) and skip without it. @@ -564,6 +565,18 @@ def test_whisper_tower_fp32_knob(t : T?) { t |> skip("jfk.wav not present") return } + // token-identity between two GPU lanes is pinned to the SIMDGROUP kernel set: the + // envelope-verified tensor crowns (attn_qkmm here) round differently and flip + // whisper-tiny tokens; the crowned lane's transcription quality is the board + // pregate's claim, not this cell's. Pinned BEFORE the loads - the baked-image + // flavor and the PSO builds both key on the crown set. + let prev_crowns = get_metal_tensor_crowns() + pin_metal_tensor_crowns("") + static_if (typeinfo builtin_module_exists(das_metal)) { + metal_tower_shutdown() // earlier cells built PSOs and latched crown flags - + metal_wdec_shutdown() // every driver the encode rides rebuilds under the pin + metal_prefill_shutdown() // the attention trio's crown flags cache at prefill init + } set_asr_tower_fp32(true) var inscope mm <- load_asr_model(model_path) set_asr_tower_fp32(false) @@ -604,6 +617,13 @@ def test_whisper_tower_fp32_knob(t : T?) { } t |> success(mismatches == 0, "q8-default/mixed token-identical ({mismatches}/{total} flips)") } + unpin_metal_tensor_crowns() + set_metal_tensor_crowns(prev_crowns) + static_if (typeinfo builtin_module_exists(das_metal)) { + metal_tower_shutdown() + metal_wdec_shutdown() + metal_prefill_shutdown() + } delete m delete mm } diff --git a/modules/dasMetal/ARCHITECTURE.md b/modules/dasMetal/ARCHITECTURE.md index fe272472a5..cc7a7ef959 100644 --- a/modules/dasMetal/ARCHITECTURE.md +++ b/modules/dasMetal/ARCHITECTURE.md @@ -135,7 +135,8 @@ Three behavioral layers + enforcement gates: directions. Census-record and emit are fused in one helper so they cannot drift; the golden-snapshot layer catches emissions that bypass it. - **Gate C - fail-closed sync.** The `tests/msl/_fail_closed/` fixture list and the - `check_rejects` needle list in `test_msl_fail_closed.das` are both hand-maintained; + `check_rejects` assert list in `test_msl_fail_closed.das` (keyed by fixture name; the + needle text is the suite's to judge) are both hand-maintained; `check_fail_closed_sync` (`REVIEW.das`) holds them equal in both directions, so an unpinned rejection or a stranded assert cannot pass as a green suite. - **Leak gate.** Metal objects are invisible to the das leak detectors, so the shim counts live diff --git a/modules/dasMetal/REVIEW.das b/modules/dasMetal/REVIEW.das index 20057bccac..07d70777f0 100644 --- a/modules/dasMetal/REVIEW.das +++ b/modules/dasMetal/REVIEW.das @@ -53,7 +53,7 @@ def private check_fail_closed_sync { } for (fx in keys(fixtures)) { if (!key_exists(asserted, fx)) { - gate_finding(FC_TEST, 1, "fixture {FC_DIR}/{fx}.das has no check_rejects assert - its rejection is unpinned") + gate_finding("{FC_DIR}/{fx}.das", 0, "fixture has no check_rejects assert in {FC_TEST} - its rejection is unpinned") } } for (name, ln in keys(asserted), values(asserted)) { diff --git a/modules/dasMetal/REVIEW.md b/modules/dasMetal/REVIEW.md index 54915e2294..682e5f1dc0 100644 --- a/modules/dasMetal/REVIEW.md +++ b/modules/dasMetal/REVIEW.md @@ -22,12 +22,10 @@ the diff puts it.** An emitted-text fixture answers to `tests/msl/REVIEW.md` (re - **A diff that makes the MSL emitter reject at compile time a construct it accepted before - a new rejection, or a widened condition on an existing one - ships a - `tests/msl/_fail_closed/` (repo root) fixture for that construct in the same change.** The - same change asserts that construct's error - needle in `tests/msl/test_msl_fail_closed.das`. An error needle is the substring of the - compile error that names the rejected construct. A diff that stops rejecting a construct - deletes that construct's `_fail_closed/` fixture and its needle assertion in - `test_msl_fail_closed.das`, in the same change. + `tests/msl/_fail_closed/` (repo root) fixture for that construct in the same change.** An + error needle is the substring of the compile error that names the rejected construct; the + fixture-and-assert pairing itself is `REVIEW.das`'s to hold (`check_fail_closed_sync`, + both directions, `tests/msl/test_msl_fail_closed.das` (repo root)). - **A kernel behavioral change ships a CPU-oracle test under `tests/metal/` (repo root).** A kernel behavioral change is a change to what a kernel computes - its emitted arithmetic, diff --git a/site-dasllama/REVIEW.md b/site-dasllama/REVIEW.md index 82cb57329e..0337a9d93a 100644 --- a/site-dasllama/REVIEW.md +++ b/site-dasllama/REVIEW.md @@ -3,6 +3,9 @@ **Read `REVIEW_COMMON.md` (repo root) first - its contract binds this checklist.** Architecture doc: `README.md`. Planned work: `plans/dasllama_io_site.md`. +In this checklist "a page" means every served page in this directory - index.html, +ladder.html, sidecars.html - the generated news region inside index.html included. + **A shell command, flag, or output line shown on a page is a defect unless the command runs verbatim and produces the result the page shows.** Never show a command for an implementation that does not exist yet. @@ -10,14 +13,13 @@ implementation that does not exist yet. **A code sample shown on a page that does not compile and run with the current toolchain is a defect.** -**A number shown on a page carries checkable provenance: rendered from live data, copied from -a named checked-in measurement record, or an HTML comment naming the box, date, and what was -measured (or naming it a placeholder). A number with none of these is a defect.** +**A number shown on a page whose source is not identifiable from the page itself is a +defect: rendered from live data, or a page comment / prose clause naming the checked-in +measurement record (or the box, date and measurement - or naming it a placeholder).** -**A claim in words on index.html that one engine beats another ("beats", "Nx faster than", -"fastest") is a defect, the generated news region included.** Figures copied from a -checked-in record may stand side by side, ours and another engine's - the arithmetic a -reader does is not the page's claim. +**A comparative superiority claim made in words rather than as side-by-side figures, on any +page, is a defect.** Figures copied from a checked-in record may stand side by side, ours +and another engine's - the arithmetic a reader does is not the page's claim. **Copy or rendering that lets a row with no reference engine's figure imply parity with a reference engine is a defect - an empty ratio cell reads "not raced".** diff --git a/site-dasllama/_news/2026-08-30-apple-m5.md b/site-dasllama/_news/2026-08-30-apple-m5.md index ad7ed1e3cf..2670043b1c 100644 --- a/site-dasllama/_news/2026-08-30-apple-m5.md +++ b/site-dasllama/_news/2026-08-30-apple-m5.md @@ -4,12 +4,14 @@ tag: hardware title: Apple M5 support lands - text, vision and speech, tuned on the new silicon. --- + dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick up the M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the -pool spanning both tiers with decode parking the slower one (the M1/M4 efficiency cores -stay excluded, verified live on both boxes). +pool spanning both tiers with decode parking the slower one; on the M4 the efficiency +cores stay excluded. Both core gates were verified live this sweep. The full M5 Max board is re-minted and on the [board](https://daslang.io/dasllama.html) (pp512 / tg128, Metal, llama-bench protocol): gemma-4-E2B Q8_0 - das 9074.3 / 161.3 @@ -18,9 +20,11 @@ Qwen3-30B-A3B - das 3752.9 / 165.7, llama.cpp 3422.4 / 137.0; gpt-oss-20b - das 162.7, llama.cpp 3476.6 / 149.0. The other modalities ride the same rails: the gemma-4-12B image encode lands at 7.1 ms against the reference's 95 ms, the Qwen2.5-Omni window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms -against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside - -including Canary-Qwen on its new Q8_0 serving artifact, ahead of the NeMo torch-MPS -reference on both boxes - and the M1 rows stand as the long-term record. +against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside, +including Canary-Qwen on its new Q8_0 serving artifact - jfk in 307.6 ms on the M5 and +512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5. The M1 board +stands unchanged as the long-term record, its Canary rows retiring with the old decoder +artifact. Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely diff --git a/site-dasllama/build_news.py b/site-dasllama/build_news.py index 8c106a96a7..a780992a50 100644 --- a/site-dasllama/build_news.py +++ b/site-dasllama/build_news.py @@ -94,6 +94,13 @@ def entry_html(e: dict, lead: bool) -> str: ) +def write_lf(path: Path, text: str) -> None: + # not Path.write_text(newline=...): that keyword needs Python 3.10+, and the checklist + # tells authors to re-run this script on the stock macOS interpreter (3.9) + with open(path, 'w', encoding='utf-8', newline='\n') as f: + f.write(text) + + def rewrite_index(index: Path, entries: list[dict]) -> None: text = index.read_text(encoding='utf-8') if MARK_BEGIN not in text or MARK_END not in text: @@ -107,8 +114,7 @@ def rewrite_index(index: Path, entries: list[dict]) -> None: if end < begin: sys.exit(f"{index}: news:end precedes news:begin") items = '\n'.join(entry_html(e, i == 0) for i, e in enumerate(entries)) - index.write_text(text[:begin] + '\n' + items + '\n' + text[end:], - encoding='utf-8', newline='\n') + write_lf(index, text[:begin] + '\n' + items + '\n' + text[end:]) def write_feed(root: Path, entries: list[dict], site_url: str) -> None: @@ -142,7 +148,7 @@ def iso(date: str) -> str: + '\n'.join(items) + '\n\n' ) - (root / 'feed.xml').write_text(feed, encoding='utf-8', newline='\n') + write_lf(root / 'feed.xml', feed) def write_sitemap(root: Path, entries: list[dict], site_url: str) -> None: @@ -153,11 +159,11 @@ def write_sitemap(root: Path, entries: list[dict], site_url: str) -> None: + (f'{lastmod}' if lastmod else '') + '' for page, lastmod in urls) - (root / 'sitemap.xml').write_text( - '\n' - '\n' - f'{body}\n' - '\n', encoding='utf-8', newline='\n') + write_lf(root / 'sitemap.xml', + '\n' + '\n' + f'{body}\n' + '\n') def main() -> None: diff --git a/site-dasllama/feed.xml b/site-dasllama/feed.xml index 44a5508e7f..593efaac08 100644 --- a/site-dasllama/feed.xml +++ b/site-dasllama/feed.xml @@ -11,12 +11,14 @@ https://dasllama.io/#n-2026-08-30-apple-m5 2026-08-30T00:00:00Z -<p>dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick up the +<!-- figures: modules/dasLLAMA/performance/records/m5.json (M5 Max, minted 2026-08-30) + and m4.json (M4, 2026-08-31), rendered on the board from the same records --> +<p>dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick up the M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the -pool spanning both tiers with decode parking the slower one (the M1/M4 efficiency cores -stay excluded, verified live on both boxes).</p> +pool spanning both tiers with decode parking the slower one; on the M4 the efficiency +cores stay excluded. Both core gates were verified live this sweep.</p> <p>The full M5 Max board is re-minted and on the <a href="https://daslang.io/dasllama.html">board</a> (pp512 / tg128, Metal, llama-bench protocol): gemma-4-E2B Q8_0 - das 9074.3 / 161.3 tok/s, llama.cpp 7413.4 / 137.0; Qwen3.8-27B - das 913.9 / 27.8, llama.cpp 752.1 / 25.4; @@ -24,9 +26,11 @@ Qwen3-30B-A3B - das 3752.9 / 165.7, llama.cpp 3422.4 / 137.0; gpt-oss-20b - das 162.7, llama.cpp 3476.6 / 149.0. The other modalities ride the same rails: the gemma-4-12B image encode lands at 7.1 ms against the reference's 95 ms, the Qwen2.5-Omni window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms -against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside - -including Canary-Qwen on its new Q8_0 serving artifact, ahead of the NeMo torch-MPS -reference on both boxes - and the M1 rows stand as the long-term record.</p> +against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside, +including Canary-Qwen on its new Q8_0 serving artifact - jfk in 307.6 ms on the M5 and +512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5. The M1 board +stands unchanged as the long-term record, its Canary rows retiring with the old decoder +artifact.</p> <p>Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely fun.</p> diff --git a/site-dasllama/index.html b/site-dasllama/index.html index 8e87c4b145..7aa62f9d1e 100644 --- a/site-dasllama/index.html +++ b/site-dasllama/index.html @@ -65,12 +65,14 @@

Local inference, written in daslang.

build_news.py (run at deploy AND checked in, so preview matches production) -->
2026-08-30hardware

Apple M5 support lands - text, vision and speech, tuned on the new silicon.latest

▾
-

dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick up the +

+

dasLLAMA now treats the Apple M5 as a first-class target. The Metal kernels pick up the M5's GPU tensor units through the Metal 4 tensor API wherever the per-box tune races crown them, the vision towers and the speech-to-text encoders serve on the GPU, and the CPU lane learned the M5 Max's all-compute core layout - 6 "Super" plus 12 "Performance" cores, the -pool spanning both tiers with decode parking the slower one (the M1/M4 efficiency cores -stay excluded, verified live on both boxes).

+pool spanning both tiers with decode parking the slower one; on the M4 the efficiency +cores stay excluded. Both core gates were verified live this sweep.

The full M5 Max board is re-minted and on the board (pp512 / tg128, Metal, llama-bench protocol): gemma-4-E2B Q8_0 - das 9074.3 / 161.3 tok/s, llama.cpp 7413.4 / 137.0; Qwen3.8-27B - das 913.9 / 27.8, llama.cpp 752.1 / 25.4; @@ -78,9 +80,11 @@

Local inference, written in daslang.

162.7, llama.cpp 3476.6 / 149.0. The other modalities ride the same rails: the gemma-4-12B image encode lands at 7.1 ms against the reference's 95 ms, the Qwen2.5-Omni window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms -against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside - -including Canary-Qwen on its new Q8_0 serving artifact, ahead of the NeMo torch-MPS -reference on both boxes - and the M1 rows stand as the long-term record.

+against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside, +including Canary-Qwen on its new Q8_0 serving artifact - jfk in 307.6 ms on the M5 and +512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5. The M1 board +stands unchanged as the long-term record, its Canary rows retiring with the old decoder +artifact.

Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely fun.

diff --git a/site/REVIEW.md b/site/REVIEW.md index ac79b5920b..8dde3c02d6 100644 --- a/site/REVIEW.md +++ b/site/REVIEW.md @@ -25,7 +25,7 @@ defect - the pair belongs on the run object that produced the rows.** the same sweep output that regenerates those tables. **A cell in `files/performance_bench.json` differing from the same family-and-lane cell in the -`benchmarks/sql/results.md` tables is a defect.** +`benchmarks/sql/results.md` (repo root) tables is a defect.** **A diff that changes `files/performance_engines.json` also changes `examples/benchmarks/sql/results.md` (repo root), in the same change.** diff --git a/site/files/dasllama/bench_records.json b/site/files/dasllama/bench_records.json index 0345a0eaec..c204eaaab9 100644 --- a/site/files/dasllama/bench_records.json +++ b/site/files/dasllama/bench_records.json @@ -527,11 +527,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; metal blob", @@ -616,11 +616,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -705,11 +705,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -1469,11 +1469,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", @@ -1558,11 +1558,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -1647,11 +1647,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k5/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -2966,11 +2966,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", @@ -3058,11 +3058,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", @@ -3118,11 +3118,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -3207,11 +3207,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -3354,11 +3354,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -3472,11 +3472,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4uv f32; weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -4820,11 +4820,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", @@ -4912,11 +4912,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", @@ -4972,11 +4972,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -5061,11 +5061,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -5208,11 +5208,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -5326,11 +5326,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -6242,11 +6242,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "tune_sha":"506843b9bcb2b856c2e39dde93d6512b644f56c3f5e6e09d96f61b3cc85182ad", "noise":"ok", "parity":"ok", "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; metal blob", @@ -6331,11 +6331,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "tune_sha":"506843b9bcb2b856c2e39dde93d6512b644f56c3f5e6e09d96f61b3cc85182ad", "noise":"ok", "parity":"ok", "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -6420,11 +6420,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"144fd7914ced62e6f88e075b1b9bafb3499413f45497dafcdd0de32b5ce9aa06", + "tune_sha":"506843b9bcb2b856c2e39dde93d6512b644f56c3f5e6e09d96f61b3cc85182ad", "noise":"ok", "parity":"ok", "exec_fmt":"weights mxfp4/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -7184,11 +7184,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; metal blob", @@ -7273,11 +7273,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -7362,11 +7362,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -8132,11 +8132,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; metal blob", @@ -8221,11 +8221,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -8310,11 +8310,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6 native; q8 activations; f32 scales; planar arm64-gen (repacked)", @@ -9080,11 +9080,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; metal blob", @@ -9169,11 +9169,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -9258,11 +9258,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/q51/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -10118,11 +10118,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8", "env":"DASLLAMA_BOX=m5", @@ -10213,11 +10213,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8", "env":"DASLLAMA_BOX=m5", @@ -12590,11 +12590,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8", "env":"DASLLAMA_BOX=m5", @@ -12839,11 +12839,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8", "env":"DASLLAMA_BOX=m5", @@ -15168,11 +15168,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -15268,11 +15268,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -15368,11 +15368,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -17085,11 +17085,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -17185,11 +17185,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -17285,11 +17285,11 @@ }, "workload":"asr", "source":"official", - "sha":"82e45e0a3", + "sha":"bbdcf8da1", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -19128,11 +19128,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; metal blob", @@ -19217,11 +19217,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -19306,11 +19306,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -19398,11 +19398,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; metal blob", @@ -19461,11 +19461,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -19579,11 +19579,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower gemma4v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -19656,11 +19656,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -20006,11 +20006,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -20100,11 +20100,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -20979,11 +20979,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -21231,11 +21231,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -21337,11 +21337,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -22073,11 +22073,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -22325,11 +22325,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -22431,11 +22431,11 @@ }, "workload":"audio-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -23046,11 +23046,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; metal blob", @@ -23135,11 +23135,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -23224,11 +23224,11 @@ } }, "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"weights k4/k6/q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -23402,11 +23402,11 @@ }, "workload":"asr", "source":"official", - "sha":"54595cfea", + "sha":"77dfc242d", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "tune_sha":"17d503d8574d5d8689999e2a56d8242eef67161beeebb8fd04a863cc34539281", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", @@ -23484,11 +23484,11 @@ }, "workload":"asr", "source":"official", - "sha":"54595cfea", + "sha":"77dfc242d", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "tune_sha":"17d503d8574d5d8689999e2a56d8242eef67161beeebb8fd04a863cc34539281", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", @@ -23566,11 +23566,11 @@ }, "workload":"asr", "source":"official", - "sha":"54595cfea", + "sha":"77dfc242d", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr8 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr8_nrsplit2 (manifest)", - "tune_sha":"05da625247568832fb62c97386a74b5d7f092db3e58788b192078092d3f63a50", + "tune_sha":"17d503d8574d5d8689999e2a56d8242eef67161beeebb8fd04a863cc34539281", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m4 DASLLAMA_MODELS_DIR=/Users/dasbox/models", @@ -23764,11 +23764,11 @@ }, "workload":"asr", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"f32/q8", "env":"DASLLAMA_BOX=m5", @@ -23962,11 +23962,11 @@ }, "workload":"asr", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -24044,11 +24044,11 @@ }, "workload":"asr", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "exec_fmt":"q8/q8", "env":"DASLLAMA_BOX=m5", @@ -24125,11 +24125,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen3v f32; weights q8 native; q8 activations; f16 scales; metal blob", @@ -24243,11 +24243,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen3v q8; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -24361,11 +24361,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen3v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -24486,11 +24486,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; metal blob", @@ -24604,11 +24604,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", @@ -24722,11 +24722,11 @@ }, "workload":"image-chat", "source":"official", - "sha":"fa67fe165", + "sha":"345dcd667", "version":"0.6.4", "dasllama_version":15, "tune":"k4q8_tile_gen=mr8 (manifest); k5q8_tile_gen=mr4 (manifest); k6q8_tile_gen=mr4 (manifest); q40q8_tile_gen=mr8 (manifest); q8q8_tile_gen=mr8_budget (manifest); q51q8_tile_gen=mr4 (manifest)", - "tune_sha":"3865c28dd5776c53f439ea57851c352c1b8ef4b51e7ac2acf07ac797437ff320", + "tune_sha":"61f4ee8c1a4b36cb2e230b32ab1cdcb5ed8c536c7ff36964e5d1cf4701ddcfb6", "noise":"ok", "parity":"ok", "exec_fmt":"tower qwen25v f32; weights q8 native; q8 activations; f16 scales; planar arm64-gen (repacked)", diff --git a/tests/msl/REVIEW.md b/tests/msl/REVIEW.md index 4ec043f07f..cf5cf5f07f 100644 --- a/tests/msl/REVIEW.md +++ b/tests/msl/REVIEW.md @@ -11,7 +11,8 @@ from `declared_msl_census` or a fixture's census from `all_msl_censuses` (both i `_msl_common.das`). Emitted text cannot be read back into constructs, so the census is the only measure of coverage. -**Every file under `_fail_closed/` fails to compile.** A fixture that compiles, or a needle no -emitter error contains, is a defect - delete the fixture and its assertion together. The -fixture-has-its-assert half is machine-checked (`modules/dasMetal/REVIEW.das`'s -`check_fail_closed_sync`, both directions); weakening that check is a defect. +**Weakening `test_msl_fail_closed.das`'s `check_rejects` is a defect.** It asserts each +`_fail_closed/` fixture fails to compile and that the compile error contains the fixture's +needle - the substring naming the rejected construct. The fixture-has-its-assert pairing is +machine-checked both directions (`modules/dasMetal/REVIEW.das`'s `check_fail_closed_sync`; +its weakening rule lives with that checklist). diff --git a/utils/dasllama-server/REVIEW.md b/utils/dasllama-server/REVIEW.md index a792931765..b1d285c3c3 100644 --- a/utils/dasllama-server/REVIEW.md +++ b/utils/dasllama-server/REVIEW.md @@ -6,9 +6,10 @@ doc: `README.md`. Planned work: `CONTROL_PAGE_PLAN.md`. **A diff to a file that requires a `dasllama/*` module applies `modules/dasLLAMA/REVIEW.md` (repo root) too.** -**Never hand-write or hand-edit a fixture under `tests/fixtures/`, or a wire body in a spec -under `tests/` - capture the bytes of a real server run and normalize the machine-local paths -instead.** `tests/fixtures/README.md` gives the capture steps. +**Never hand-write or hand-edit a fixture under `tests/fixtures/` (beside this file), or a +wire body in a Playwright `.spec.js` under that `tests/` - capture the bytes of a real server +run and normalize the machine-local paths instead.** `tests/fixtures/README.md` gives the +capture steps. **Weakening `REVIEW.das` (beside this file) is a defect** - dropping a check, narrowing what a check scans, adding a name to a check's licensed set (the names that check does not flag), or @@ -18,7 +19,9 @@ the gate itself. **A diff that adds a route, or changes a request field the server reads, updates `control.html` where the page uses it, in the same change.** -**A diff that makes `control.html` or a spec under `tests/` read a response key that no -fixture under `tests/fixtures/` carries is a defect - re-capture the fixture and list the key -in that route's `README.md` row, in the same change.** The fixtures are the recorded response -shape, and the row is where a consumer learns the key exists. +**A diff that makes `control.html` or a Playwright `.spec.js` under `tests/` (beside this +file) read a response key no fixture under `tests/fixtures/` carries, or that changes the +set of items a route returns while the fixtures record the old set, is a defect - re-capture +the fixture and list a new key in that route's `README.md` row, in the same change.** The +fixtures are the recorded response shape, and the row is where a consumer learns the key +exists. diff --git a/utils/dasllama-server/tests/catalog.spec.js b/utils/dasllama-server/tests/catalog.spec.js index a74715034a..5ab596a9f9 100644 --- a/utils/dasllama-server/tests/catalog.spec.js +++ b/utils/dasllama-server/tests/catalog.spec.js @@ -108,7 +108,9 @@ test('serve-this-model writes the downloaded path as the roster default, then re await expect(page.locator('#badge')).toHaveText(/restarting/); const cfg = lastJson(posts.filter(p => p.path === '/config')); - expect(cfg.models).toEqual([{ path: present.path, default: true }]); + const expected = { path: present.path, default: true }; + if (present.vision_present) expected.image_mmproj = present.vision_path; + expect(cfg.models).toEqual([expected]); expect(posts.some(p => p.path === '/restart')).toBe(true); }); diff --git a/utils/dasllama-server/tests/fixtures/catalog_idle.json b/utils/dasllama-server/tests/fixtures/catalog_idle.json index 011e7b14f6..d21a11ec89 100644 --- a/utils/dasllama-server/tests/fixtures/catalog_idle.json +++ b/utils/dasllama-server/tests/fixtures/catalog_idle.json @@ -1 +1 @@ -{"models_dir": "C:\\Users\\user\\.dasllama\\models", "entries": [{"is_default": true, "path": "C:\\Users\\user\\.dasllama\\models\\gemma-4-E2B-it-Q4_K_M.gguf", "sha256": "740185b21d22ceb83a11c3aa62ad5842ef32c70f6096d756bbee85a1e4ec34b8", "vision_bytes": 986833664, "display": "Gemma 4 E2B", "file": "gemma-4-E2B-it-Q4_K_M.gguf", "bytes": 3106738272, "present": true, "name": "gemma-4-e2b", "vram_hint_gb": 4, "vision_file": "mmproj-gemma-4-E2B-it-bf16.gguf", "vision_present": false, "vision_path": "", "ctx": 32768, "note": "the recommended default - fast, capable, runs everywhere"}, {"is_default": false, "path": "C:\\Users\\user\\.dasllama\\models\\gemma-4-E4B-it-Q4_K_M.gguf", "sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87", "vision_bytes": 991552256, "display": "Gemma 4 E4B", "file": "gemma-4-E4B-it-Q4_K_M.gguf", "bytes": 4977171584, "present": true, "name": "gemma-4-e4b", "vram_hint_gb": 6.5, "vision_file": "mmproj-gemma-4-E4B-it-BF16.gguf", "vision_present": false, "vision_path": "", "ctx": 32768, "note": "the bigger E-series - better answers, still laptop-class"}, {"is_default": false, "path": "", "sha256": "f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", "vision_bytes": 0, "display": "Gemma 4 26B-A4B", "file": "gemma-4-26B-A4B-it-UD-Q4_K_M.gguf", "bytes": 16947541728, "present": false, "name": "gemma-4-26b-a4b", "vram_hint_gb": 19, "vision_file": "", "vision_present": false, "vision_path": "", "ctx": 131072, "note": "the MoE - 26B quality at 4B active weights per token"}, {"is_default": false, "path": "", "sha256": "322e194ff79741c7baa497c240f677f54b201b0efab44ca8e50f122b39123482", "vision_bytes": 0, "display": "Qwen 3.8 27B", "file": "Qwen3.8-27B-UD-Q4_K_M.gguf", "bytes": 16464440224, "present": false, "name": "qwen3.8-27b", "vram_hint_gb": 18.5, "vision_file": "", "vision_present": false, "vision_path": "", "ctx": 262144, "note": "the newest dense Qwen - thinking model, strong at code"}, {"is_default": false, "path": "", "sha256": "0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", "vision_bytes": 0, "display": "Qwen 3.6 35B-A3B", "file": "Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", "bytes": 22663387424, "present": false, "name": "qwen3.6-35b-a3b", "vram_hint_gb": 24, "vision_file": "", "vision_present": false, "vision_path": "", "ctx": 262144, "note": "the Qwen MoE - 3B active weights, MTP-ready"}], "asr": {"file": "ggml-parakeet-tdt-0.6b-v3-f32.bin", "bytes": 2508463079, "present": false, "path": ""}, "box": {"ram_gb": 64, "vram_mb": 0}, "download": {"state": "idle", "name": "", "got": 0, "total": 0, "error": ""}} +{"models_dir": "C:\\Users\\user\\.dasllama\\models", "entries": [{"is_default": true, "path": "C:\\Users\\user\\.dasllama\\models\\gemma-4-E2B-it-Q4_K_M.gguf", "sha256": "740185b21d22ceb83a11c3aa62ad5842ef32c70f6096d756bbee85a1e4ec34b8", "vision_bytes": 986833664, "display": "Gemma 4 E2B", "file": "gemma-4-E2B-it-Q4_K_M.gguf", "bytes": 3106738272, "present": true, "name": "gemma-4-e2b", "vram_hint_gb": 4, "vision_file": "mmproj-gemma-4-E2B-it-bf16.gguf", "vision_present": true, "vision_path": "C:\\Users\\user\\.dasllama\\models\\mmproj-gemma-4-E2B-it-bf16.gguf", "ctx": 32768, "note": "the recommended default - fast, capable, runs everywhere"}, {"is_default": false, "path": "", "sha256": "85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87", "vision_bytes": 991552256, "display": "Gemma 4 E4B", "file": "gemma-4-E4B-it-Q4_K_M.gguf", "bytes": 4977171584, "present": false, "name": "gemma-4-e4b", "vram_hint_gb": 6.5, "vision_file": "mmproj-gemma-4-E4B-it-BF16.gguf", "vision_present": true, "vision_path": "C:\\Users\\user\\.dasllama\\models\\mmproj-gemma-4-E4B-it-BF16.gguf", "ctx": 32768, "note": "the bigger E-series - better answers, still laptop-class"}, {"is_default": false, "path": "", "sha256": "f2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f", "vision_bytes": 0, "display": "Gemma 4 26B-A4B", "file": "gemma-4-26B-A4B-it-UD-Q4_K_M.gguf", "bytes": 16947541728, "present": false, "name": "gemma-4-26b-a4b", "vram_hint_gb": 19, "vision_file": "", "vision_present": false, "vision_path": "", "ctx": 131072, "note": "the MoE - 26B quality at 4B active weights per token"}, {"is_default": false, "path": "", "sha256": "322e194ff79741c7baa497c240f677f54b201b0efab44ca8e50f122b39123482", "vision_bytes": 0, "display": "Qwen 3.8 27B", "file": "Qwen3.8-27B-UD-Q4_K_M.gguf", "bytes": 16464440224, "present": false, "name": "qwen3.8-27b", "vram_hint_gb": 18.5, "vision_file": "", "vision_present": false, "vision_path": "", "ctx": 262144, "note": "the newest dense Qwen - thinking model, strong at code"}, {"is_default": false, "path": "C:\\Users\\user\\.dasllama\\models\\Qwen3VL-4B-Instruct-Q8_0.gguf", "sha256": "054721f478bc5fa6beffb7f38eae575d45298f88cbb8d2f83ef675a727863eb1", "vision_bytes": 836180256, "display": "Qwen3 VL 4B", "file": "Qwen3VL-4B-Instruct-Q8_0.gguf", "bytes": 4280406144, "present": true, "name": "qwen3-vl-4b", "vram_hint_gb": 6, "vision_file": "mmproj-Qwen3VL-4B-Instruct-F16.gguf", "vision_present": true, "vision_path": "C:\\Users\\user\\.dasllama\\models\\mmproj-Qwen3VL-4B-Instruct-F16.gguf", "ctx": 262144, "note": "the deepstack vision Qwen - reads images through wide multi-tap rows"}, {"is_default": false, "path": "C:\\Users\\user\\.dasllama\\models\\Qwen2.5-Omni-3B-Q8_0.gguf", "sha256": "c7d8b07c8d8d7a9ed1de1b8df7ac821eb4d259a224bd44310baacfaa5a473d4c", "vision_bytes": 2623983328, "display": "Qwen2.5 Omni 3B", "file": "Qwen2.5-Omni-3B-Q8_0.gguf", "bytes": 3616087360, "present": true, "name": "qwen2.5-omni-3b", "vram_hint_gb": 5.5, "vision_file": "mmproj-Qwen2.5-Omni-3B-f16.gguf", "vision_present": true, "vision_path": "C:\\Users\\user\\.dasllama\\models\\mmproj-Qwen2.5-Omni-3B-f16.gguf", "ctx": 32768, "note": "the window-ViT omni - compact vision chat on the Metal tower"}, {"is_default": false, "path": "C:\\Users\\user\\.dasllama\\models\\Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", "sha256": "0b21525e972670ed59e1812e170b27c26355381f0656ecc4e25617ece7dac58b", "vision_bytes": 0, "display": "Qwen 3.6 35B-A3B", "file": "Qwen3.6-35B-A3B-MTP-UD-Q4_K_M.gguf", "bytes": 22663387424, "present": true, "name": "qwen3.6-35b-a3b", "vram_hint_gb": 24, "vision_file": "", "vision_present": false, "vision_path": "", "ctx": 262144, "note": "the Qwen MoE - 3B active weights, MTP-ready"}], "asr": {"file": "ggml-parakeet-tdt-0.6b-v3-f32.bin", "bytes": 2508463079, "present": false, "path": ""}, "box": {"ram_gb": 128, "vram_mb": 0}, "download": {"state": "idle", "name": "", "got": 0, "total": 0, "error": ""}} \ No newline at end of file diff --git a/utils/dasllama-server/tests/towers.spec.js b/utils/dasllama-server/tests/towers.spec.js index 37b9eac7f8..636bba6c13 100644 --- a/utils/dasllama-server/tests/towers.spec.js +++ b/utils/dasllama-server/tests/towers.spec.js @@ -14,6 +14,15 @@ function withVisionPresent(doc) { return d; } +// the capture box may stock the tower - this test's subject is the download OFFER +function withVisionAbsent(doc) { + const d = JSON.parse(JSON.stringify(doc)); + const e = d.entries.find(x => x.name === 'gemma-4-e2b'); + e.vision_present = false; + e.vision_path = ''; + return d; +} + function withAsrPresent(doc) { const d = JSON.parse(JSON.stringify(doc)); d.asr.present = true; @@ -29,7 +38,7 @@ function servingE2B() { } test('a downloaded vision-capable model offers its tower with the pinned size', async ({ page }) => { - const { posts } = await openControl(page, { catalog: fx('catalog_idle') }); + const { posts } = await openControl(page, { catalog: withVisionAbsent(fx('catalog_idle')) }); const row = page.locator('#cat-body tr', { hasText: 'Gemma 4 E2B' }); const b = row.locator('button', { hasText: 'vision tower' }); await expect(b).toHaveText('vision tower (1.0 GB)'); diff --git a/utils/internal/dasllama-ladder/REVIEW.md b/utils/internal/dasllama-ladder/REVIEW.md index c020fdbf55..6b2dcf0176 100644 --- a/utils/internal/dasllama-ladder/REVIEW.md +++ b/utils/internal/dasllama-ladder/REVIEW.md @@ -60,8 +60,8 @@ engine-free `dasllama/dasllama_exchange_schema`, and only `ladder_store.das` req **A write path that stores a document without validating it first is a defect: every sidecar - community or planted - passes `validate_sidecar_submission`, every community record store -passes `validate_record_submission`, and `import_official_store` passes `validate_record_store` -(shape only - official records predate the `dasllama_version` stamp).** +passes `validate_record_submission`, and every official record store passes +`validate_record_store` (shape only - official records predate the `dasllama_version` stamp).** **Never write `Source` or `Verified` outside `ladder_store.das`, and never let a value from a public (proxied) request reach either column - the loopback operator surface sets `Verified` From d3acef8c8c1a60ed28810ac02cb88ea3d06edc7d Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 22:21:52 -0700 Subject: [PATCH 12/17] three instruments the tdd audit named, each shipped with its must-red control - test_asr_catalog_invariants pins the metal_served roster per row (the flag decides which rows get GPU board cells and which reference legs pair GPU-vs-GPU; flipping canary reds) - test_model_catalog pins the four curated card names (the count floor alone let a whole card vanish green; renaming qwen3-vl-4b reds) - test_exchange_schema pins the tune scope's version_of/version_key text (the rename's load-bearing compensator - llvm_tune exposes no runtime reader of the resolved key, so the pin is textual; blanking version_key reds) Woodpecker round 2 at the prior tip: zero findings. TDD audit: 19 controlled branches, 12/12 test edits justified; the remaining measurement-orchestrator branches ride the standing coverage-followup PR. Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/release_remint_plan.md | 12 ++++++++++++ .../dasLLAMA/tests/test_bench_records_schema.das | 6 ++++++ modules/dasLLAMA/tests/test_exchange_schema.das | 14 ++++++++++++++ utils/dasllama-server/test_model_catalog.das | 8 ++++++++ 4 files changed, 40 insertions(+) diff --git a/modules/dasLLAMA/release_remint_plan.md b/modules/dasLLAMA/release_remint_plan.md index b186c01cf1..6b329efa87 100644 --- a/modules/dasLLAMA/release_remint_plan.md +++ b/modules/dasLLAMA/release_remint_plan.md @@ -131,6 +131,18 @@ print shows the fast-tier-only pool, pp/tg spot-check against existing rows with ## Gate-phase evidence ledger (for the PR body) +- **TDD audit (worktree, tip 013a151f4)**: 47 branches - 19 CONTROLLED (all 14 restore + guards via `check_exe_fn_global_restore` incl. a base-source reverse run reporting exactly + the 14; the lens tgmem refusal via an inverted control; both fail-closed-sync arms; the two + serve rows), 12/12 test edits JUSTIFIED with reverse controls where runnable. Three of its + named gaps closed in-PR with must-red controls: the `metal_served` roster pin + (test_asr_catalog_invariants), serve-card presence pins (test_model_catalog), and the + `version_key = "dasllama_version"` textual pin (test_exchange_schema - llvm_tune exposes no + runtime reader). Remaining measurement-orchestrator branches (gen_bench_records x7, + canary pybench x4, rig plumbing) ride the standing coverage-followup PR; the mx4-race + bind-number gate is proposed to Boris as a REVIEW.das rule. +- **Woodpecker round 2** (tip 013a151f4): zero findings ("no discrete, actionable + correctness issues"); round 1 at the pre-fix tip was also zero. - **Suite evidence (the tests-checklist's owed runs, final tree, 2026-08-30)**: `run.das -- --suite model-free` rc=0 (75 files); `--arm kernels --suite kernels` rc=0; `--arm coverage --suite coverage` rc=0 (small tier; the large-tier census rows stay diff --git a/modules/dasLLAMA/tests/test_bench_records_schema.das b/modules/dasLLAMA/tests/test_bench_records_schema.das index 9da6ddf2f8..5da9a6c6db 100644 --- a/modules/dasLLAMA/tests/test_bench_records_schema.das +++ b/modules/dasLLAMA/tests/test_bench_records_schema.das @@ -162,6 +162,10 @@ def test_asr_catalog_invariants(t : T?) { t |> run("catalog stays reproducible") @(t : T?) { var cat <- asr_catalog() var libriCount = 0 + // the Metal-rail roster: metal_served decides which rows get GPU board cells and + // which reference legs pair GPU-vs-GPU, so a silent flip re-lanes the public board + let metal_families <- {"Whisper tiny", "Whisper large-v3-turbo", "Canary-Qwen 2.5B", + "Qwen3-ASR-0.6B", "Gemma-4 E2B audio", "Qwen3-Omni-30B audio"} for (spec in cat) { if (!empty(spec.libri_short)) { libriCount++ @@ -171,6 +175,8 @@ def test_asr_catalog_invariants(t : T?) { } let wl = asr_workload(spec) t |> success(wl == "asr" || wl == "audio-chat", "workload classifies") + t |> equal(spec.metal_served, key_exists(metal_families, spec.display), + "{spec.display}: metal_served matches the Metal-rail roster") } t |> equal(libriCount, 1) // LibriSpeech scope: Parakeet v3 only } diff --git a/modules/dasLLAMA/tests/test_exchange_schema.das b/modules/dasLLAMA/tests/test_exchange_schema.das index 02ae6f8759..54658df144 100644 --- a/modules/dasLLAMA/tests/test_exchange_schema.das +++ b/modules/dasLLAMA/tests/test_exchange_schema.das @@ -434,3 +434,17 @@ def test_writer_phrases(t : T?) { delete berrors } } + +[test] +def test_tune_scope_wire_key(t : T?) { + t |> run("the tune scope pins staleness under the schema-stable wire key") @(t : T?) { + // the rename's load-bearing compensator: without version_key= the scope's staleness + // pin silently becomes "dasllama_release" - a key no sidecar in records/ carries, so + // every box re-tunes; llvm_tune exposes no runtime reader, so the pin is textual + let src = fread("modules/dasLLAMA/dasllama/dasllama_math_gen.das") + t |> success(find(src, "version_of = \"dasllama_version/DASLLAMA_RELEASE\"") >= 0, + "the scope versions off DASLLAMA_RELEASE") + t |> success(find(src, "version_key = \"dasllama_version\"") >= 0, + "the wire key stays 'dasllama_version' (drop this and every sidecar reads version-stale)") + } +} diff --git a/utils/dasllama-server/test_model_catalog.das b/utils/dasllama-server/test_model_catalog.das index 61e5a2c71d..8c01d65638 100644 --- a/utils/dasllama-server/test_model_catalog.das +++ b/utils/dasllama-server/test_model_catalog.das @@ -45,6 +45,14 @@ def test_catalog_table(t : T?) { } t |> equal(defaults, 1, "exactly one recommended default") t |> success(count >= 5, "curated list shrank: {count} entries, expected at least 5") + // presence pins: a floor alone would let a whole card vanish green + for (want in ["gemma-4-e2b", "qwen3.8-27b", "qwen3-vl-4b", "qwen2.5-omni-3b"]) { + var found = false + for (e in model_catalog()) { + found ||= e.name == want + } + t |> success(found, "curated card '{want}' is on the roster") + } } t |> run("every vision tower resolves pinned, and the default model carries one") @(t : T?) { var towers = 0 From d71ecbc2c8a6e22947dcaa8724b4df11ab116a35 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 23:04:27 -0700 Subject: [PATCH 13/17] the chain's three reds: the exchange rules get their routed companion, two off-Apple lint nits - LINT027: the six exchange rules moved into modules/dasLLAMA/REVIEW.md pushed it to 317 lines - they now live in the routed REVIEW_EXCHANGE.md companion (the parent routes by trigger), 294 lines left - LINT012 (linux mirror): the two sample-fed census rows annotate [unused_argument(t, samples)] - off-Apple the gated bodies are empty - tests-interp / tests-jit reds were chained-load transients (three files erroring on builtins that resolve solo and on targeted lane reruns - both lanes PASS clean) Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/REVIEW.md | 27 ++------------- modules/dasLLAMA/REVIEW_EXCHANGE.md | 34 +++++++++++++++++++ modules/dasLLAMA/release_remint_plan.md | 8 +++++ .../dasLLAMA/tests/test_kernel_coverage.das | 4 +-- 4 files changed, 46 insertions(+), 27 deletions(-) create mode 100644 modules/dasLLAMA/REVIEW_EXCHANGE.md diff --git a/modules/dasLLAMA/REVIEW.md b/modules/dasLLAMA/REVIEW.md index a952df7adb..4b6a493f06 100644 --- a/modules/dasLLAMA/REVIEW.md +++ b/modules/dasLLAMA/REVIEW.md @@ -25,31 +25,8 @@ fixture. A test or tool merely opening a stocked model file by name does not rou sidecar exchange is the code that downloads tune winners to a box and submits that box's winners back. -**Never add a second HTTP path to the sidecar exchange - every HTTP call (lookup, download, -submit) goes through `dasllama/dasllama_exchange.das`.** The mechanical half (no second -`dashv` requirer under the module) is `performance/REVIEW.das`'s to enforce. - -**Weakening the exchange download gate, the submission strip, or the submit rails is a -defect.** The download gate checks content sha, schema, and `DASLLAMA_RELEASE`. The submit -rails stop a sidecar that came from the exchange, or was minted on another box, from being -submitted. `utils/dasllama-server/test_exchange_client.das` enforces the download gate, the -strip, and the rails. - -**A diff that adds a submission path around `exchange_strip_private` is a defect, even where -the strip itself is intact.** - -**A tune-boot path (`exchange_scope_resolver` / `exchange_boot_submit_check`, -`dasllama/dasllama_exchange.das`) that fails when `exchange_lookup` fails is a defect - it -falls through to the local sidecar and the baked winners.** - -**A diff that adds an outbound exchange request reachable from a tune-boot path -(`exchange_scope_resolver` / `exchange_boot_submit_check`) without routing it through -`exchange_may_contact` (`dasllama/dasllama_exchange.das`) is a defect.** - -**A diff that adds a tune-boot-path (`exchange_scope_resolver` / -`exchange_boot_submit_check`) consent question with no terminal to ask on also emits that -question as a `@sidecar` event, in the same change** - the watchdog dialog and the control -page are the answer surfaces a supervised boot has. +**A change to the sidecar-exchange client (`dasllama/dasllama_exchange.das`), or to a +tune-boot path that reaches it, applies `REVIEW_EXCHANGE.md`.** **Every `dasllama/` change applies this folder's `tests/REVIEW.md`.** diff --git a/modules/dasLLAMA/REVIEW_EXCHANGE.md b/modules/dasLLAMA/REVIEW_EXCHANGE.md new file mode 100644 index 0000000000..e46c88685b --- /dev/null +++ b/modules/dasLLAMA/REVIEW_EXCHANGE.md @@ -0,0 +1,34 @@ +# dasLLAMA Sidecar-Exchange Code Review Checklist + +**Read `REVIEW_COMMON.md` (repo root) first - its contract binds this checklist.** Architecture +doc: `ARCHITECTURE_ENGINE.md`. + +**Routed from `REVIEW.md`: a change to the sidecar-exchange client +(`dasllama/dasllama_exchange.das`), or to a tune-boot path that reaches it, applies this +list together with `REVIEW.md`'s.** + +**Never add a second HTTP path to the sidecar exchange - every HTTP call (lookup, download, +submit) goes through `dasllama/dasllama_exchange.das`.** The mechanical half (no second +`dashv` requirer under the module) is `performance/REVIEW.das`'s to enforce. + +**Weakening the exchange download gate, the submission strip, or the submit rails is a +defect.** The download gate checks content sha, schema, and `DASLLAMA_RELEASE`. The submit +rails stop a sidecar that came from the exchange, or was minted on another box, from being +submitted. `utils/dasllama-server/test_exchange_client.das` enforces the download gate, the +strip, and the rails. + +**A diff that adds a submission path around `exchange_strip_private` is a defect, even where +the strip itself is intact.** + +**A tune-boot path (`exchange_scope_resolver` / `exchange_boot_submit_check`, +`dasllama/dasllama_exchange.das`) that fails when `exchange_lookup` fails is a defect - it +falls through to the local sidecar and the baked winners.** + +**A diff that adds an outbound exchange request reachable from a tune-boot path +(`exchange_scope_resolver` / `exchange_boot_submit_check`) without routing it through +`exchange_may_contact` (`dasllama/dasllama_exchange.das`) is a defect.** + +**A diff that adds a tune-boot-path (`exchange_scope_resolver` / +`exchange_boot_submit_check`) consent question with no terminal to ask on also emits that +question as a `@sidecar` event, in the same change** - the watchdog dialog and the control +page are the answer surfaces a supervised boot has. diff --git a/modules/dasLLAMA/release_remint_plan.md b/modules/dasLLAMA/release_remint_plan.md index 6b329efa87..6c266b67b3 100644 --- a/modules/dasLLAMA/release_remint_plan.md +++ b/modules/dasLLAMA/release_remint_plan.md @@ -131,6 +131,14 @@ print shows the fast-tier-only pool, pp/tg spot-check against existing rows with ## Gate-phase evidence ledger (for the PR body) +- **Preflight --full ran ONCE** (the make-pr chain; every other gate green first pass). Its + three reds, each fixed and validated with the TARGETED lane per policy: lint = LINT027 + (module REVIEW.md hit 317 lines after the exchange-rule move - split into the routed + `REVIEW_EXCHANGE.md` companion, 294 left) + two off-Apple LINT012s + (`[unused_argument(t, samples)]`); tests-interp / tests-jit = the same three files + (jobque affinity, math_misc, crt_twins) erroring on missing builtins under the chained + full run only - solo-green with the same binary before the fix, both lanes PASS clean on + targeted rerun, so the failure was chained-load pressure, not code. CI validates the tip. - **TDD audit (worktree, tip 013a151f4)**: 47 branches - 19 CONTROLLED (all 14 restore guards via `check_exe_fn_global_restore` incl. a base-source reverse run reporting exactly the 14; the lens tgmem refusal via an inverted control; both fail-closed-sync arms; the two diff --git a/modules/dasLLAMA/tests/test_kernel_coverage.das b/modules/dasLLAMA/tests/test_kernel_coverage.das index f71ede2d27..88eabaa228 100644 --- a/modules/dasLLAMA/tests/test_kernel_coverage.das +++ b/modules/dasLLAMA/tests/test_kernel_coverage.das @@ -340,7 +340,7 @@ def private cov_tower_qwen3v(t : T?) { // the gemma4a row of cov_tower: one whole chunk from raw samples — GPU mel (twiddle-T DFT // GEMM + mag + filter + log), both subsample convs, and the 12-block Conformer chain -[unused_argument(t)] // off-Apple the gated body is empty +[unused_argument(t, samples)] // off-Apple the gated body is empty def private cov_tower_gemma4a(t : T?; samples : array) { static_if (typeinfo builtin_module_exists(das_metal)) { let gpath = path_join(models_dir(), "mmproj-gemma-4-E2B-it-bf16.gguf") @@ -364,7 +364,7 @@ def private cov_tower_gemma4a(t : T?; samples : array) { // the canary row of cov_tower: CPU mel, then the 32-block Metal FastConformer chain — the // bidirectional rel-pos XL attention and the centered-k9 depthwise kernels -[unused_argument(t)] // off-Apple the gated body is empty +[unused_argument(t, samples)] // off-Apple the gated body is empty def private cov_tower_canary(t : T?; samples : array) { static_if (typeinfo builtin_module_exists(das_metal)) { let cnpath = path_join(models_dir(), "canary-qwen-2.5b-encoder-f32.bin") From 637880dda69e5514a593274ab6420dc0feb838a7 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 23:17:54 -0700 Subject: [PATCH 14/17] the news entry names its one loss; the receipt rule identifies the run - the Canary sentence now carries the gb1 pair (das 6484 ms beside the reference's 4383 on the M5) - the long-audio gap stands on the page next to the wins, and is named the next dig - site/REVIEW.md's first receipt rule no longer contradicts its sibling: a rendered cmd identifies the RUN, and one run's cmd covers the several rows it produced (the ASR reference legs' per-clip rows) Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- site-dasllama/_news/2026-08-30-apple-m5.md | 7 ++++--- site-dasllama/feed.xml | 7 ++++--- site-dasllama/index.html | 7 ++++--- site/REVIEW.md | 5 +++-- 4 files changed, 15 insertions(+), 11 deletions(-) diff --git a/site-dasllama/_news/2026-08-30-apple-m5.md b/site-dasllama/_news/2026-08-30-apple-m5.md index 2670043b1c..f65c38ec17 100644 --- a/site-dasllama/_news/2026-08-30-apple-m5.md +++ b/site-dasllama/_news/2026-08-30-apple-m5.md @@ -22,9 +22,10 @@ gemma-4-12B image encode lands at 7.1 ms against the reference's 95 ms, the Qwen window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside, including Canary-Qwen on its new Q8_0 serving artifact - jfk in 307.6 ms on the M5 and -512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5. The M1 board -stands unchanged as the long-term record, its Canary rows retiring with the old decoder -artifact. +512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5; on the long gb1 +clip the das row reads 6484 ms beside the reference's 4383 - the one remaining gap on long +audio, and the next dig. The M1 board stands unchanged as the long-term record, its Canary +rows retiring with the old decoder artifact. Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely diff --git a/site-dasllama/feed.xml b/site-dasllama/feed.xml index 593efaac08..862ae98be9 100644 --- a/site-dasllama/feed.xml +++ b/site-dasllama/feed.xml @@ -28,9 +28,10 @@ gemma-4-12B image encode lands at 7.1 ms against the reference's 95 ms, the window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside, including Canary-Qwen on its new Q8_0 serving artifact - jfk in 307.6 ms on the M5 and -512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5. The M1 board -stands unchanged as the long-term record, its Canary rows retiring with the old decoder -artifact.</p> +512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5; on the long gb1 +clip the das row reads 6484 ms beside the reference's 4383 - the one remaining gap on long +audio, and the next dig. The M1 board stands unchanged as the long-term record, its Canary +rows retiring with the old decoder artifact.</p> <p>Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely fun.</p> diff --git a/site-dasllama/index.html b/site-dasllama/index.html index 7aa62f9d1e..961801586e 100644 --- a/site-dasllama/index.html +++ b/site-dasllama/index.html @@ -82,9 +82,10 @@

Local inference, written in daslang.

window ViT at 106 ms against 118, and whisper large-v3-turbo transcribes jfk in 140 ms against whisper-cli's 153 on the same GPU. The M4 board rows are refreshed alongside, including Canary-Qwen on its new Q8_0 serving artifact - jfk in 307.6 ms on the M5 and -512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5. The M1 board -stands unchanged as the long-term record, its Canary rows retiring with the old decoder -artifact.

+512.9 on the M4, beside the NeMo torch-MPS reference's 704.7 and 1076.5; on the long gb1 +clip the das row reads 6484 ms beside the reference's 4383 - the one remaining gap on long +audio, and the next dig. The M1 board stands unchanged as the long-term record, its Canary +rows retiring with the old decoder artifact.

Bringing a new chip up one model at a time - watching kernels tuned for one generation get re-raced, re-crowned, and here and there rewritten for the next - has been genuinely fun.

diff --git a/site/REVIEW.md b/site/REVIEW.md index 8dde3c02d6..57511723dd 100644 --- a/site/REVIEW.md +++ b/site/REVIEW.md @@ -6,8 +6,9 @@ with what the scripts it loads render into it. **Never show on a page a hand-written shell command, flag, or output line invented for -illustration - show only a command a run actually executed, producing the result the page -shows.** +illustration - show only a command the run actually executed.** A rendered `cmd` identifies +the RUN, not the row: where one run produced several rendered rows (an ASR run's per-clip +rows), each row's receipt is the run's command. **A diff that writes a `cmd` field in `files/dasllama/bench_records.json` that is not the exact argv `modules/dasLLAMA/performance/gen_bench_records.das` (or the released bench exe it From fa30a82cbc4dbc3d9f6463977e92563fb86187f1 Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 23:19:50 -0700 Subject: [PATCH 15/17] the stop's rulings enter the LAWS sidecars Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/LAWS.md | 10 ++++++++++ site/LAWS.md | 5 +++++ 2 files changed, 15 insertions(+) diff --git a/modules/dasLLAMA/LAWS.md b/modules/dasLLAMA/LAWS.md index 47ffa7f679..024423a9eb 100644 --- a/modules/dasLLAMA/LAWS.md +++ b/modules/dasLLAMA/LAWS.md @@ -56,3 +56,13 @@ a declaration-initialized function-typed global joins its file's boot-restore [init] in the same change; check_exe_fn_global_restore is the mechanical half, test_exe_smoke the end-to-end tripwire. + +- **2026-08-30** (`REVIEW_MEASUREMENT.md`): at the pre-PR .md stop Boris ratified the + figure rules' re-scoping to module-owned surfaces (ledgers, docs, code comments, PR + bodies), with served pages routed to the site checklists' own provenance duty - "3. + agreed". + +- **2026-08-30** (`REVIEW.md`): Boris ratified the DASLLAMA_RELEASE bump rule's paper-trail + clause - a bump's diff also carries the LAWS.md entry recording the declared release; the + declaration itself stays his call, on feel ("the intent was to bump due to major changes + ... i go on feel on that one" - "4. agreee"). diff --git a/site/LAWS.md b/site/LAWS.md index 6eb7a6a8ed..635c2db61d 100644 --- a/site/LAWS.md +++ b/site/LAWS.md @@ -11,3 +11,8 @@ compacted, or cited as rules. | 2026-08-24 | REVIEW.md (code-sample rule) | "if code example appears anywhere on the website, its linked to 'try it on playground' - and its verified to compile and run. here is an example - daslang.io/dasllama.html - code on that card"; on partial snippets: "nop. full examples" | | 2026-08-24 | REVIEW.md (dasprofile_bench.json record rule) | the cross-language benchmarks page: "i'd like a separate page though, under /performance menu - the very first thing on that submenu"; shape rulings: "bars should be default", heatmap removed, benchmark names link to playground samples ("we refresh samples"), no native-loop sample ("all it does is measures interop"); ship: "lets push the cards and new web page" | | 2026-08-29 | REVIEW.md (the sample and playground-run rules) | Port-convergence Q&A: approved moving the sample-source rules out of the blanket import ("yes"), batched into the convergence PR ("we ammend this one. its a bit more prose, not worth separate one"). The embedded-sample rules scope to pages, the Playwright trigger becomes what-the-runtime-loads with a coverage clause, and the artifact clause gets a diff-visible trigger | + +- **2026-08-30** (`REVIEW.md`): on the receipt-rule contradiction over ASR reference rows + (one run's cmd covering several per-clip rows), Boris ruled the rendered cmd identifies + the RUN, not the row - "2. agree" to amending the first rule rather than storing per-clip + argvs. From 61d4eaf9077498786c6e0694d55c0c5db1aa4bab Mon Sep 17 00:00:00 2001 From: Boris Batkin Date: Sun, 30 Aug 2026 23:26:11 -0700 Subject: [PATCH 16/17] the lens-gate fixture cleans its temp dir on the fwrite-failure path too Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/tests/test_metal_misc_kernels.das | 1 + 1 file changed, 1 insertion(+) diff --git a/modules/dasLLAMA/tests/test_metal_misc_kernels.das b/modules/dasLLAMA/tests/test_metal_misc_kernels.das index 9f26d27d08..b55023d442 100644 --- a/modules/dasLLAMA/tests/test_metal_misc_kernels.das +++ b/modules/dasLLAMA/tests/test_metal_misc_kernels.das @@ -1954,6 +1954,7 @@ def private spawn_wg_fixture(with_tgmem : bool; tag : string) : tuple Date: Mon, 31 Aug 2026 00:04:35 -0700 Subject: [PATCH 17/17] the arc plan speaks ASCII - the Markdown gate's ruling Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_01LY6gNeDZkF14X81rLz3QLc --- modules/dasLLAMA/release_remint_plan.md | 50 ++++++++++++------------- 1 file changed, 25 insertions(+), 25 deletions(-) diff --git a/modules/dasLLAMA/release_remint_plan.md b/modules/dasLLAMA/release_remint_plan.md index 6c266b67b3..142a843627 100644 --- a/modules/dasLLAMA/release_remint_plan.md +++ b/modules/dasLLAMA/release_remint_plan.md @@ -6,22 +6,22 @@ and the arc-end board re-mint on the b10659 ref pin. One PR. ## Rulings (Boris, 2026-08-30) -- The gate candidates from the m5-image round are REVIEW.das-shaped, not daslib lints — +- The gate candidates from the m5-image round are REVIEW.das-shaped, not daslib lints - assess scope first (step 0); update the CLAUDE.md routing wording so "lint opportunities" can land as folder-local REVIEW.das gates. No strong opinion on which land in this arc. - Plane `long_length` (followup 57) rides this arc. - M4 re-mints its canary rows + proves the Efficiency-tier gate. M1 gets NO runs - ("we've measured multiple times") — its stale canary rows retire. + ("we've measured multiple times") - its stale canary rows retire. - The version split is approved in the minimal RELEASE form: "it gives us flexibility we - were missing". Leaderboard must stop invalidating on every bump — a 'major release' + were missing". Leaderboard must stop invalidating on every bump - a 'major release' scope, declared by Boris, not derived from diffs. -## Slice V — the release split (FIRST: the re-mint must land on the new scope) +## Slice V - the release split (FIRST: the re-mint must land on the new scope) Recon facts: `DASLLAMA_VERSION` (dasllama_version.das:12, v15) is consumed ONLY by the tune scope (`dasllama_math_gen.das` `version_of=`), the sidecar exchange (`dasllama_exchange.das` accept/lookup/submit), records stamping (`lcpp_bench.das` x3, `tuner_noise.das` provenance -note) and tests. Dlim identity never reads it — `IMAGE_VERSION` (dasllama_image.das) is a +note) and tests. Dlim identity never reads it - `IMAGE_VERSION` (dasllama_image.das) is a separate per-change counter and stays exactly as it is. - Rename `DASLLAMA_VERSION` -> `DASLLAMA_RELEASE`, value stays 15 (existing v15 artifacts @@ -29,19 +29,19 @@ separate per-change counter and stays exactly as it is. changes from "ANY kernel work bumps it" to "bumped only when Boris declares comparability broken", and the old spelling breaking loudly is the sweep guarantee. - Wire/schema field names (`dasllama_version` in exchange JSON, sidecar provenance, bench - records) KEEP their spelling — they now carry the release number; no schema break. + records) KEEP their spelling - they now carry the release number; no schema break. - Docs sweep: the bump-duty rule in `REVIEW.md`, plus mentions in `ARCHITECTURE_ENGINE.md`, `ARCHITECTURE_MEASUREMENT.md`, `performance/REVIEW.md`, `BRINGUP.md`, ladder README/REVIEW, server README. - Hazard accepted (ruled): within a release a changed kernel can keep a stale sidecar winner - — perf-only drift (crowns pick twins; races verified the envelope at mint). The principled - hardening — per-entry kernel identity hashes in llvm_tune, the JIT-dll-cache - self-invalidation pattern — is ledgered as its own generic llvm_tune item, not blocking. + - perf-only drift (crowns pick twins; races verified the envelope at mint). The principled + hardening - per-entry kernel identity hashes in llvm_tune, the JIT-dll-cache + self-invalidation pattern - is ledgered as its own generic llvm_tune item, not blocking. - LAWS.md entries for the ruling (module folder + repo root for the CLAUDE.md wording). -## Step 0 — gate-candidate scope assessment (DONE, 2026-08-30) +## Step 0 - gate-candidate scope assessment (DONE, 2026-08-30) -- **tgmem-less `@workgroup` class: not a gate — a LENS fix, rides this arc.** The +- **tgmem-less `@workgroup` class: not a gate - a LENS fix, rides this arc.** The `[metal_dispatch]` apply already reads `tgmem=` (dasllama_metal_lens.das:236) and collects `@workgroup` members (sec.292); `@workgroup` always rides the DYNAMIC shmem buffer (msl_emit wg_bytes/wg_off), so a dispatch without `tgmem=` on such a class is always the @@ -49,15 +49,15 @@ separate per-change counter and stays exactly as it is. class has `@workgroup` members (explicit arg still overrides); omission becomes impossible at compile. Audit existing omission sites during implementation. - **tests/msl fail-closed fixture sync (followup 45): REVIEW.das cell, rides this arc.** - `modules/dasMetal/REVIEW.das` already exists (the RP law) — the followup's "creates it" + `modules/dasMetal/REVIEW.das` already exists (the RP law) - the followup's "creates it" clause is stale; add the list-A-equals-list-B cell (~30 lines). - **`set_*`/`reset_*` pin-leak walk: parked, own PR.** Needs an exception list (tests whose - subject IS the pin) — judgment-laden, a modules/dasLLAMA/tests REVIEW.das walk when done. + subject IS the pin) - judgment-laden, a modules/dasLLAMA/tests REVIEW.das walk when done. - **gemm_f32 into an ensure_length'd target: parked with spec, own PR.** Function-local dataflow heuristic (target allocated un-zeroed in the same function, no zero/fill before - the accumulate) — highest false-positive risk of the four. + the accumulate) - highest false-positive risk of the four. -## Slice A — census tower rows (tests/test_kernel_coverage.das) +## Slice A - census tower rows (tests/test_kernel_coverage.das) `cov_tower` exists (whisper-mixed, gemma4uv, gemma4v, gemma3v, qwen3a-conv). Missing rows for the arc's kernel families: gemma4a Conformer, canary FastConformer (q8 decoder @@ -65,7 +65,7 @@ artifact), qwen25v window ViT (win_attn + row_gather), qwen3v GPU stem, and a tower-flash-eligible leg (hs 72, npos%64==0 -> flash + kv_hc). Reconcile against the census NEVER-DISPATCHED report; blind-spot entries move onto real rows. -## Slice B — cell plumbing + followup 57 +## Slice B - cell plumbing + followup 57 - `gen_bench_records.das:1015` `is_metal_served_family` keys on Whisper alone -> extend to the four new servable capabilities (canary Q8_0 decoder lane, canary Metal FastConformer, @@ -76,17 +76,17 @@ NEVER-DISPATCHED report; blind-spot entries move onto real rows. - Retire the stale `records/m1.json` canary rows (they pin the deleted `canary-qwen-2.5b-decoder-f16.gguf`; no M1 runs by ruling). -## Slice C — fresh tune manifests on M5 (quiet box) +## Slice C - fresh tune manifests on M5 (quiet box) `benchmarks/lcpp_bench.tune.json` (v14) + the rig sidecar `performance/m5.tune.json` (v9!) re-mint under the new release scope; refresh `last_known_good_sidecar.json`. Sanity floor first; never `--quick` (followup 32); no rebuilds mid-race. -## Slice C — DONE 2026-08-30: manifests minted under release scope +## Slice C - DONE 2026-08-30: manifests minted under release scope -Predictions vs outcomes (the game): mint 6-12 min / noise ok — **held** (7.3 min release, -noise ok); >=36/40 winners identical to v14 — **held** (37/40; three near-tie elementwise -flips); provenance stamps release 15 under the wire key — **held**. The box-manifest mint +Predictions vs outcomes (the game): mint 6-12 min / noise ok - **held** (7.3 min release, +noise ok); >=36/40 winners identical to v14 - **held** (37/40; three near-tie elementwise +flips); provenance stamps release 15 under the wire key - **held**. The box-manifest mint (m5.tune.json) agreed with the bench sidecar on all 40 winners; LKG refreshed. Ref-side plumbing landed on the way: setup_asr_rig builds a build-metal mtmd twin on Apple (the CPU build's -ngl is inert), setup_lcpp_ref builds llama-mtmd-cli beside llama-bench (the @@ -102,7 +102,7 @@ sibling rule), stock + metal mtmd binaries built on this box. 1.1-1.5x on the ref ladder. - qwen25v image cell: enc ~106 ms vs mtmd ~117 (das ahead all three axes). -## Slice D — the full M5 board re-mint (ref pin b10659) +## Slice D - the full M5 board re-mint (ref pin b10659) clean-cpu + stock ref builds already minted in `llama.cpp-ref-6fdd0ac`. das cpu vs clean-cpu, das `--accel` vs stock, the Metal text/image/audio boards, the four new cells @@ -113,8 +113,8 @@ provenance (the v14/fallback-stamp taint is not per-cell diagnosable). ## Post-sweep ruling (Boris, 2026-08-30) The two-tier stop rule: a FAIL (crash/refusal/no-measure) stops the sweep for an immediate -fix — it poisons every cell after it; a PERFORMANCE red lets the sweep finish, then fix and -re-profile ONLY the red cells (`-o` narrowing) — no full re-sweep, the board is then good; +fix - it poisons every cell after it; a PERFORMANCE red lets the sweep finish, then fix and +re-profile ONLY the red cells (`-o` narrowing) - no full re-sweep, the board is then good; more sweeps follow after the coming arcs. Red #1: gpt-oss-20b (mxfp4 MoE) das metal pp halved vs the pre-merge row (3989.4, `records/m5.json` @ master; the sweep's first-pass board cell read ~2.0k - VOIDED, the @@ -124,7 +124,7 @@ master merge (first post-merge perf pass); suspect = the ffn_moe_prefill_grouped 32-row split on the Metal mx4 path (per-expert-bias staging pays per region where k-quant's cnt/basep walk does not). -## Slice E — M4 over ssh +## Slice E - M4 over ssh Canary rows re-mint (Q8_0 decoder artifact) + the Efficiency-tier gate proof: live-lane print shows the fast-tier-only pool, pp/tg spot-check against existing rows within cv.