Nightly
No. 87Thursday, 8 October 20264 min read

You’re reading an archived edition. Today’s is here →

Good morning.

Your GPU memory just got a 2‑bit diet, and nobody complained.

AI memory

KV cache shrinks with 2‑bit residuals

Tiny cache, big impact: ResidualQuant compresses the key‑value cache of looped Transformers to 2‑bit residuals plus a final‑loop reference, slashing memory use while keeping accuracy intact.

Why it mattersLess memory means larger models fit on the same hardware.

LLM reliability

Hallucinations still win on most tests

Hallucination‑heavy benchmark: PHRBench probes 18 LLMs on 4,820 crafted cases across four domains, showing successful correction of false premises is rare.

Why it mattersUnderstanding failure modes helps you guard downstream applications.

Algorithms

Subset convolution cracks the 3ⁿ barrier

Almost‑perfect exponent: A new deterministic reduction yields a Las Vegas algorithm with expected O*(2.9987ⁿ) time and a deterministic version at O*(2.9997ⁿ), nudging past the long‑standing 3ⁿ limit.

Why it mattersFaster subset convolution speeds up many combinatorial optimizations you might code.

Quick hits

Stay sharp, and may your bugs be few

10 stories
Top pickResearcharXiv cs.LG

ResidualQuant quantizes KV cache for looped Transformers using 2-bit residuals and a final-loop reference to cut memory while preserving accuracy.

Looped Transformers reuse the same block across multiple passes, increasing depth without extra parameters, but KV cache size grows with loops. ResidualQuant leverages similarity of KV states across loops, applying least‑square scaling, rotations, and mixed precision per loop to encode only the differences.

arxiv.org
Top pickResearcharXiv cs.LG

OrBIT learns a reusable local geometry for embedding compression, replacing fixed coding schemes with data‑driven orbit dynamics and shared codewords.

Instead of predefining block or low‑rank structures, OrBIT discovers the coding geometry from the data, allocating a global residual to guide where the limited code budget is spent. Overlapping charts let local errors cancel after gluing, and the learned orbit machinery is compiled away for efficient inference.

arxiv.org
Top pickResearcharXiv cs.CL

PHRBench evaluates how 18 LLMs handle hallucinated premises across 4 domains using 4,820 controlled instances, finding successful correction rare.

  • 4 domains
  • 18 models
  • 4820 instances

The benchmark measures Hallucination Compliance, Avoidance, and Heuristic Correction, defining an insightful trajectory as a successful correction that reaches the correct answer. Results show that recovery is uncommon and correlates with model size, highlighting limits of current post‑hallucination reasoning.

arxiv.org
Top pickhuggingface blog

huggingface blog

Newsopenai blog

OpenAI adds a College Planner feature to ChatGPT for Teens, plus flashcards, quizzes, and a teen AI council.

The College Planner aims to help teenagers manage college applications within the chat interface. Additional educational tools like flashcards and quizzes are introduced, and a teen AI council will provide feedback on the product.

Newsopenai blog

Radisson Hotel Group and Accenture launched a ChatGPT plugin that lets travelers search, compare, and book hotels directly within ChatGPT.

The plugin uses OpenAI's API to integrate hotel discovery into the chat interface, streamlining trip planning without leaving the conversation. It is a commercial partnership aimed at enhancing the travel booking experience.

ReleaseHF trending283 likes

The canberkkkkkk/ema-lightning model is a text‑to‑speech offering on Hugging Face with 2,724 downloads and 283 likes.

  • 2,724 downloads
  • 283 likes

It is listed under the text‑to‑speech category and has attracted moderate community interest. The model can be used for generating spoken audio from text inputs.

ReleaseHF trending1,069 likes

google/embeddinggemma-2 is a feature‑extraction model on Hugging Face that has been downloaded 7,562 times and received 1,069 likes.

  • 7,562 downloads
  • 1,069 likes

The model provides embeddings for downstream tasks such as similarity search or clustering. Its popularity reflects strong community adoption for embedding generation.

ReleaseHF trending542 likes

jialinyyzz/humanizer is a text‑generation model on Hugging Face with 19,483 downloads and 542 likes.

  • 19,483 downloads
  • 542 likes

The model focuses on generating human‑like text and is positioned for creative writing or dialogue applications. Its download count shows significant interest despite a modest like ratio.

6 stories
Top pickAnalysishackaday

A Hackaday article shows how to repurpose an ESP32 to revive legacy AM radios as the broadcast band declines.

The guide outlines hardware modifications and firmware to decode AM signals, aiming to prevent e‑waste from obsolete receivers. It demonstrates a low‑cost, hobbyist solution for preserving analog radio heritage.

Newslwn

Wednesday security updates were released for dozens of packages across AlmaLinux, Debian, Fedora, Mageia, Oracle, Red Hat, Slackware, SUSE, and Ubuntu.

Updates address vulnerabilities in components such as bind, kernel, nodejs, sudo, chromium, and many language runtimes. Administrators should apply the patches promptly to maintain system integrity.

lwn.net
Researchlwn

The LAVD scheduler, originally built for gaming, has been extended to handle broader server workloads and was detailed at the 2026 Kernel Recipes conference.

The extensible scheduler class enables custom CPU schedulers via BPF, fostering rapid innovation. LAVD's evolution reflects its adaptability beyond gaming, showing promise for diverse performance-critical environments.

lwn.net
Newslwn

LWN.net's weekly edition for October 8 2026 covers kernel bugs, Gentoo Chromium, Rust smart pointers, Sashiko, Charon, LAVD scheduler, and Python random modules.

The issue also includes briefs on OpenSSH 10.6, Rust 1.99.0, Zig 0.17, and announcements about newsletters, conferences, and security patches, providing a concise snapshot of current development topics.

lwn.net
Releaselwn

A new Raspberry Pi OS Desktop for x86‑64 has been released, built on Debian 13 (code‑named “trixie”) for the amd64 architecture.

  • Debian 13 (trixie)

The update follows a long delay after earlier Buster and Bullseye builds, responding to frequent community requests. It provides a 64‑bit desktop environment suitable for standard PCs.

lwn.net
Repolwn

Charon supplies a stable API that extracts internal information from the Rust compiler for use by external tools.

Developed by long‑time Rust contributor Nadrieril, the project addresses the difficulty of programmatically accessing compiler data, aiming to improve tooling interoperability across the Rust ecosystem.

lwn.net
6 stories
ResearcharXiv cs.DS

A deterministic reduction yields a Las Vegas algorithm for min‑sum subset convolution with expected time O*(2.9987ⁿ) and a deterministic version at O*(2.9997ⁿ), surpassing the previous 3ⁿ barrier.

  • Las Vegas O*(2.9987^n)
  • Deterministic O*(2.9997^n)
  • Breaks 3^n barrier

The approach leverages a reduction to min‑plus matrix multiplication and builds on the recent subcubic breakthrough by Alman and Vassilevska‑Williams, with immediate implications for database query optimization.

arxiv.org
ResearcharXiv cs.DC

MemFerry introduces a hybrid GPU‑CPU offload framework using Direct Host Access to keep GPU utilization high while training large models.

The system schedules layers to run in CPU memory via DHA and concurrently streams other parameters to GPU, reducing both forward and backward propagation times compared to standard ZeRO‑Offload.

arxiv.org
ResearcharXiv cs.DB

QCATS introduces query‑level transformer slicing that uses predicates and metadata to pre‑select feed‑forward network slices, enabling sparse inference inside relational databases.

The framework separates offline expert construction from lightweight query‑time routing, allowing dynamic expert selection per query. It avoids routing individual tuples, reducing inference overhead. System optimizations include asynchronous control path handling to further improve throughput.

arxiv.org
ResearcharXiv cs.DC

HPC‑MQBench reports a median balanced endpoint rate of 2,927 MiB/s with 1.24 % pending deliveries and 2.56 s 99th‑percentile latency across qualified Kafka workloads.

  • 2,927 MiB/s median rate
  • 1.24 % pending deliveries
  • 2.56 s 99th‑pct latency

The benchmark runs on a four‑node Slurm allocation with one Kafka broker, producers, consumers, and monitoring. Out of 120 configurations, 99 qualified observations passed all validation stages. Two validation rounds each repeated ten workloads in five blocks to ensure reproducibility.

arxiv.org
ResearcharXiv cs.DB

The paper proposes five hybrid DDR‑CXL indexing designs and an adaptive data distribution optimizer for single‑node in‑memory databases.

Designs differ in whether indexes and tuples share or separate memory tiers, affecting DDR efficiency and migration overhead. The analysis quantifies trade‑offs among runtime performance, memory utilization, and integration complexity, guiding system architects in tiered memory deployments.

arxiv.org
ResearcharXiv cs.DC

The study shows deterministic rendezvous is impossible with two colors under variable disorientation for FSTA in SSYNCH and for FCOM in ASYNCH, but achievable with two colors under RSYNCH and R‑RSYNCH.

Introducing fixed‑unit‑distance (FUD) enables periodic distance classes, turning multiplicative distance changes into cyclic phase shifts. This yields a two‑color self‑stabilizing algorithm for rendezvous despite arbitrary rotations, reflections, and rescalings of local coordinate systems.

arxiv.org
6 stories
RepoGitHub trending · c++98 ★

Confetti3/SF4‑Ember‑Netplay provides private rollback rooms and a controller‑first overlay for Ultra Street Fighter IV as an unofficial experimental port.

The project adapts Anthony Danducci's sf4e codebase to enable deterministic netplay with rollback support, targeting competitive play environments. It is distributed as open‑source C++ code on GitHub.

RepoGitHub trending7,960 ★

raddebugger is a native, user‑mode, multi‑process graphical debugger for Windows.

Developed by EpicGames, raddebugger runs entirely in user space, supports debugging of multiple processes simultaneously, and provides a visual interface for breakpoints, memory inspection, and call‑stack navigation.

RepoGitHub trending · c++5,151 ★

A GitHub repository named MAZHARMIK/Interview_DS_Algo provides a collection of data structures and algorithms resources for coding interview preparation.

The repo aggregates problems, solutions, and explanations across common interview topics, aiming to streamline study workflows for software engineers. It is written primarily in C++ and includes scripts to generate practice test sets.

RepoGitHub trending · python9,342 ★

MDX-Tom/gpt-instruct supplies a Codex jailbreak prompt and test suite targeting the GPT series.

The package contains prompt templates designed to bypass model safety filters and a set of test cases to evaluate effectiveness. Documentation is provided in both English and Chinese, and the code is implemented in Python.

RepoGitHub trending · python19,725 ★

The allenai/olmocr toolkit linearizes PDF files to generate datasets for training large language models.

It extracts text, layout, and visual features from PDFs and outputs them in a structured format suitable for LLM ingestion. The tool is open‑source, Python‑based, and aims to simplify the creation of high‑quality document corpora.

RepoGitHub trending26,339 ★

cloudflare/security-audit-skill is a coding‑agent skill that performs multi‑phase security audits and produces independently verified, machine‑readable findings.

The skill orchestrates scanning, analysis, and reporting steps, integrating with Cloudflare's automation platform. Results are emitted in a standardized JSON schema, enabling downstream tooling to consume audit outcomes without manual parsing.

You’re all caught up.

28 stories from 204 scanned overnight.

archived edition · 204 fetched → 28 publishedj/k move · enter expand · o open · / search