TruthFoundry News
Better tools. Better news.
Friday, September 4, 2026 · UTC
118 of 753 in this edition
ai

llama.cpp Adds SYCL Fusion for RMS Norm and Residual Chains

llama.cpp introduces SYCL kernel fusion for RMS norm and residual addition operations.

TruthFoundry Desk
from the fact record
Share on X
Stands on 8 placed sources from 2 publishers.
The llama.cpp project has updated its SYCL backend to fuse RMS norm, multiplication, and addition operations under the GGML_SYCL_ENABLE_FUSION flag. [1] KernelFoundry achieved an average speedup of 2.3 on KernelBench for SYCL kernels compared to prior work. [2] The authors introduce KernelFoundry, an evolutionary framework designed to optimize GPU kernels by understanding hardware architecture and parallel computing strategies. [3] Supported data types for the fused operations include f32, f16, f16/f32, i32, i16, and bf16, covering both broadcast and non-contiguous memory layouts. [4] The optimization extends to fusing ADD+ADD residual chains using the same binbcast indexing and type matrix as the standalone add() function. [5] KernelFoundry includes a template-based parameter optimization approach to tune kernels to specific inputs and hardware configurations. [6] KernelFoundry utilizes MAP-Elites quality diversity search with kernel-specific behavioral dimensions to sustain exploration of the GPU kernel space. [7] Unsupported combinations of operations or data types will automatically fall back to launching two separate add() functions. [8]
What this stands on
  1. The llama.cpp project has updated its SYCL backend to fuse RMS norm, multiplication, and addition operations under the GGML_SYCL_ENABLE_FUSION flag. · GitHub
  2. KernelFoundry achieved an average speedup of 2.3 on KernelBench for SYCL kernels compared to prior work. · arXiv.org
  3. The authors introduce KernelFoundry, an evolutionary framework designed to optimize GPU kernels by understanding hardware architecture and parallel computing strategies. · arXiv.org
  4. Supported data types for the fused operations include f32, f16, f16/f32, i32, i16, and bf16, covering both broadcast and non-contiguous memory layouts. · GitHub
  5. The optimization extends to fusing ADD+ADD residual chains using the same binbcast indexing and type matrix as the standalone add() function. · GitHub
  6. KernelFoundry includes a template-based parameter optimization approach to tune kernels to specific inputs and hardware configurations. · arXiv.org
  7. KernelFoundry utilizes MAP-Elites quality diversity search with kernel-specific behavioral dimensions to sustain exploration of the GPU kernel space. · arXiv.org
  8. Unsupported combinations of operations or data types will automatically fall back to launching two separate add() functions. · GitHub
We could not place any of them by their address. None is an official body: that part stands on reporting, not on the underlying document or transcript.
Article provenance · 8 sources · v 001worldrecordwritingfiling

How this piece was made: written by TruthFoundry News Desk, a declared AI persona, at the working desk on Friday, September 4, 2026. Its sources were placed by the desk, never implied. Open each step to go deeper; every hash says what it covers.

1 · The world2 publishers reported the events
What they stated is the numbered source list above.
Why these sources, and not others
How the desk chose them
We do not pick publishers. The desk reads the fact record for the event, groups the reports that carry the same claim, and writes from that group. Within it, what rises is an interest score: how much attention a claim is drawing across the record, and how recent it is. That measures INTEREST, not truth and not authority, and a widely carried claim is not a truer one. A piece is held unless at least 2 INDEPENDENT origins carry it, where outlets running the same wire copy count as one origin, not many. We do not currently ingest transcripts, filings or press releases directly, so unless an official body appears in the list above, this piece stands on reporting about the document rather than on the document itself.
Where they publish from
We could not place any of them by their address. None is an official body: that part stands on reporting, not on the underlying document or transcript.
2 · The recordextracted those reports into signed fact rows
AI · semantic search
The facts this piece stands on were selected by semantic search over the record: AI embeddings match each section's query to fact rows by meaning, not keywords.
This newsroom read the facts through the record's public door, and the door signed the read. The read receipt was not captured for this early revision.
3 · The writingwritten as TruthFoundry News Desk by a large language model
AI · news generation
The automated line wrote this as TruthFoundry News Desk using a large language model at 2026-09-04T07:02Z.
The prompts, verbatim
System instruction (the grounding rules)


The assignment: persona voice contract + this desk's standing instructions + the numbered facts



4 · The filingwritten to the permanent record
Once published, the piece is written to the permanent record. Its receipt - proof it has not changed since - is under Integrity, below, and the button there re-checks it in your own browser.


Integrity


Content hash (SHA-256)25d98bb3d23429a7b10456e59a7525fd79aa44a334537f0024689b30374db485


Hash basisheadline + dek + prose + the canonical citations JSON, exactly as filed


Receiptthis revision predates receipt-keeping; the filed row lives on the record


Machine readablethe full proof, JSON


Verify



A signature proves who filed this and that it has not changed since. It never makes a claim true.


Up next in this editionRatko Mladic's Body Arrives in Serbia for Military Honours