Nightly
No. 78Tuesday, 29 September 20264 min read

You’re reading an archived edition. Today’s is here →

Good morning.

LLMs are finally learning to count their own words before you do.

AI cost

TokenCast predicts LLM token use on the fly

Predictive token budgeting: TokenCast learns a composable cost model so you can forecast how many tokens an LLM agent will spend as it runs, updating without extra model calls.

Why it mattersHelps you avoid surprise API bills and plan prompt length.

Agentic RL

KV‑streams speed up context compaction

Plug‑and‑play cache streaming: KV‑streams accelerate agentic reinforcement‑learning training by 2.6–5×, shrinking context‑compaction time while keeping performance intact.

Why it mattersFaster iteration on RL agents saves compute budget.

Embedded graphics

ESP32‑S3 renders detailed 3D with Jet Megatextures

Mipmapping on a microcontroller: A Jet Megatextures demo shows the ESP32‑S3 can add texture detail to 3D scenes via mipmapping without overloading its modest GPU.

Why it mattersShows high‑fidelity graphics are possible on cheap IoT chips.

Quick hits

Catch you tomorrow, and keep those cycles humming (wink)

10 stories
Top pickResearcharXiv cs.LG

TokenCast learns a composable cost representation for LLM agent execution segments, enabling token‑consumption forecasts that update as the run proceeds without extra LLM calls.

The model records each segment's own token use and the context growth it adds, then composes adjacent segments to estimate cumulative cost, accounting for re‑reading earlier context in later calls. This approach tackles the order‑of‑magnitude variance seen across runs.

arxiv.org
Top pickResearcharXiv cs.LG

KV‑streams provide a plug‑and‑play cache‑streaming method that boosts training throughput for agentic LLM context compaction by 2.6–5× without harming performance.

  • 2.6–5× speedup

By streaming the KV cache forward instead of flushing after each compaction, KV‑streams work with any existing compaction strategy and keep GPU memory usage constant. Experiments show consistent wall‑clock gains across three different compaction techniques.

arxiv.org
Top pickResearcharXiv cs.AI

Latent Flow Reasoning Models use continuous diffusion in latent space and a compact prompt encoder to replace a teacher Transformer at inference, improving reasoning efficiency.

LFRMs train with an ELF‑based recipe, learning representations from multiple teacher layers and enabling asynchronous denoising at varied rates. A staged curriculum produces a prompt encoder that preserves only task‑relevant information, and self‑conditioning guidance further refines performance.

arxiv.org
NewsHacker News170 pts

Scrimba Explain generates on‑the‑fly explainer videos for Hacker News links, costing about $0.04 per video and rendering in a few seconds.

  • $0.04 per video
  • few seconds generation

The system uses an HTML‑based video format rather than pixel‑level diffusion, which speeds creation and keeps editing cheap. Image generation, when used, can increase costs, but the core pipeline remains low‑cost and fast.

hn.watch
NewsHacker News95 pts

An ESP32S3 cluster has been demonstrated running a 1.58‑bit BitNet language model.

The setup showcases the feasibility of deploying quantized language models on low‑power microcontroller clusters, extending AI capabilities to edge devices with limited compute and memory resources.

NewsHacker News230 pts

MicroLLM Lab offers a browser‑based playground for trying seven tiny LLMs directly in the client.

The platform runs the models entirely in WebAssembly/JavaScript, allowing users to experiment without server resources and demonstrating the practicality of ultra‑compact LLMs for interactive web applications.

Newsopenai blog

OpenAI apologised for incidents affecting Australian government websites and announced stronger safeguards and support to improve Australia's cyber defences.

The statement acknowledges previous security lapses and outlines a plan to enhance protection mechanisms, including technical and operational measures, aimed at preventing future breaches.

Researchopenai blog

OpenAI released early guidelines for safety cases in frontier AI training, covering technical safeguards, operational practices, and misalignment incident investigation.

These guidelines aim to formalise risk assessment for advanced AI systems, providing a framework that developers can adopt to document safety measures and response procedures.

Researchhuggingface blog

Holo4 introduces a generalist computer‑use agent capable of performing a wide range of software tasks.

The blog highlights the agent's ability to interpret visual cues and execute commands across different applications, positioning it as a step toward more versatile AI assistants.

RepoHF trending397 likes

The Viggle/Qwen-Image-2.1‑viggle‑turbo model is a text‑to‑image generator with 175,907 downloads and 397 likes on Hugging Face.

  • 175,907 downloads
  • 397 likes

The model is listed among trending HF repos, indicating strong community interest; its popularity suggests it is competitive for generating images from textual prompts.

6 stories
Top pickReleasehackaday

A Jet Megatextures demo shows how mipmapping adds detail to 3D scenes on the ESP32‑S3 without overloading its rendering hardware.

The technique stores multiple resolution levels of textures, allowing the ESP32‑S3 to display high‑quality graphics while conserving memory and processing power.

Top pickReleasehackaday

A port of the original 1987 Metal Gear game runs on an ESP32 microcontroller, bringing the classic title to low‑cost hardware.

The project demonstrates the ESP32's capability to emulate legacy game hardware, highlighting both the device's flexibility and the community's interest in retro gaming on embedded platforms.

Newslwn

Monday security updates were released for AlmaLinux, Debian, Fedora, Mageia, and Oracle, covering dozens of packages such as Firefox, kernel, Chromium, PostgreSQL, and libxml2.

The updates address vulnerabilities across a wide range of software stacks, from browsers and desktop environments to database extensions and system libraries. Each distribution lists its own set of affected packages, reflecting the heterogeneous nature of Linux ecosystems.

lwn.net
RepoHacker News136 pts

PaperMono is an M5Stack ESP32‑S3 e‑ink fridge‑magnet that runs a 2,400‑line C++ firmware and syncs a shopping list via Wi‑Fi to a phone web app.

  • ESP32‑S3
  • ~2400 lines C++
  • Wi‑Fi only

The device uses the M5Stack PaperMono board with an e‑ink touchscreen and operates offline, storing the list locally until synchronization. The firmware was generated with Claude Code, demonstrating AI‑assisted development for embedded hardware.

Researchlwn

Martin Uecker presented at Kernel Recipes on reducing undefined behavior in C to move toward memory safety.

Uecker, a biomedical engineering professor and long‑time Linux user, discussed challenges of undefined behavior in C and potential language or tooling changes that could improve safety for scientific and embedded applications.

lwn.net
Releaselwn

Git 2.56.0 was released with 748 non‑merge commits contributed by 104 developers, including 39 first‑time contributors.

  • 748 non‑merge commits
  • 104 developers
  • 39 first‑time contributors

The release adds a safer conflict‑resolution workflow, smaller path‑walk repacks, and a new "git history drop" sub‑command among other improvements. Development spanned several months since the June 2.55 release.

lwn.net
6 stories
ResearcharXiv cs.OS

Argus is an LLM‑driven system that localizes OS‑level bottlenecks by analyzing code paths without heavy instrumentation.

Targeting the growing CPU orchestration role in heterogeneous workloads, Argus combines agentic reasoning with reference‑calibrated models to pinpoint slowdown sources across subsystems like memory management and networking, reducing the need for repeated kernel tracing.

arxiv.org
ResearcharXiv cs.PL

Session type state spaces form bounded lattices; evaluation on 108 protocols showed 93 distributive and 15 non‑distributive lattices.

  • 108 protocols
  • 93 distributive
  • 15 non‑distributive

The work proves lattice properties for well‑formed session types and demonstrates duality and subtyping correspondences. Implementations were mechanised in Lean 4 with two independent tools, confirming the theoretical results across diverse benchmarks.

arxiv.org
ResearcharXiv cs.LO

A monitoring tool uses TLA+ trace checking on Kubernetes audit logs to detect multitenancy violations in live clusters.

The approach repurposes TLA+ specifications from design‑time model checking to runtime verification, allowing formal reasoning to be applied continuously. While focused on multitenancy, the pipeline can be adapted to other policy checks in Kubernetes environments.

arxiv.org
ResearcharXiv cs.LO

The paper introduces CCSa, an asynchronous variant of CCS that integrates reversible computation with explicit message entities.

CCSa separates output actions from consumption, enabling messages to be treated as first‑class objects that can be undone while preserving causal dependencies. This extends reversible semantics, previously limited to synchronous CCS, to more realistic asynchronous settings.

arxiv.org
ResearcharXiv cs.PL

Semantic Prefix Oracles enforce context‑sensitive constraints during LLM decoding, rejecting only irreparable prefixes.

The system augments a context‑free grammar with semantic checks (e.g., scope, typing) executed during Earley parsing, guaranteeing dead‑end freedom for remaining branches. It succeeds on finite‑lambda, core ML, and C‑like fragments, but not on plain STLC, which can produce unrepairable type errors.

arxiv.org
ResearcharXiv cs.AR

Torch-PIM adds profile‑guided placement of PyTorch loops onto processing‑in‑memory units to reduce data‑movement bottlenecks.

The compiler framework profiles each parallel loop nest for work amount and memory boundedness, then decides host versus PIM execution. Unlike prior offloading tools that target hand‑written code or fixed operator lists, Torch‑PIM works on the progressive lowering stages of PyTorch programs.

arxiv.org
6 stories
RepoGitHub trending · python2,780 ★

samugit83/redamon is an AI‑driven red‑team framework that automates the full offensive security workflow without human input.

The tool chains reconnaissance, exploitation, and post‑exploitation steps, leveraging language models to generate and execute actions. It is positioned as a fully autonomous penetration‑testing platform for continuous security assessment.

RepoGitHub trending · c++2,681 ★

Detanup01/gbe_fork is a C++ fork of the Goldberg emulator project hosted on GitLab.

The repository mirrors the original Goldberg emulator codebase, allowing developers to experiment with or extend the emulator under a separate GitHub namespace.

RepoGitHub trending · c++10,525 ★

PrismLauncher is a custom Minecraft launcher that lets users manage multiple game installations simultaneously, built as a fork of MultiMC.

The tool is written in C++ and targets both Windows and Linux platforms. It retains MultiMC's feature set while adding a modern UI and easier profile handling. Users can switch between different Minecraft versions, mod packs, and Java runtimes without reinstalling.

RepoGitHub trending · python1,106 ★

Rizzo-pii is a Python library that anonymizes documents locally before they are sent to large language models, protecting personal data.

It operates entirely on the user's machine, removing or redacting PII such as names, addresses, and IDs. The library provides a simple API for integration into existing pipelines and supports common document formats like TXT and PDF. By avoiding network transmission of raw data, it reduces privacy risks when using external LLM services.

RepoGitHub trending · c++33,881 ★

SerenityOS is an open-source operating system written in C++ that aims to recreate a classic desktop environment with modern development practices.

The project includes its own kernel, GUI, and a suite of native applications, all built from scratch. It emphasizes code readability and educational value, often showcasing retro-inspired design while supporting contemporary hardware. Contributors regularly add features like a web browser, text editor, and file manager.

RepoGitHub trending · c++3,213 ★

WidescreenFixesPack provides plugins that add or improve widescreen resolution support for various games, fixing related bugs and adding features.

The collection targets titles that originally lacked proper aspect‑ratio handling, enabling smoother gameplay on modern monitors. Plugins are written in C++ and can be applied via simple installers or manual injection. Community contributions keep the pack updated with new games and fixes.

You’re all caught up.

28 stories from 212 scanned overnight.

archived edition · 212 fetched → 28 publishedj/k move · enter expand · o open · / search