ALL Blogs

SnackOnAI Blog

Atomic Task Graph: A 7B Model That Beats GPT-4 ReAct on ALFWorld and WebShop Has Nothing to Do With the 7B. It Is the Control Framework.

Jul 15, 2026

•

18 min read

Atomic Task Graph: A 7B Model That Beats GPT-4 ReAct on ALFWorld and WebShop Has Nothing to Do With the 7B. It Is the Control Framework.

ATG (arXiv:2607.01942, South China University of Technology + Tsinghua University, July 2026) is a training-free control framework that represents LLM agent planning and execution as an explicit directed acyclic graph of atomic tool-use units.

Mohinish S

SnackOnAI Blog

DeLM: The Multi-Agent Framework That Proved the Central Orchestrator Is the Bottleneck, Not the Solution

Jul 14, 2026

•

18 min read

DeLM: The Multi-Agent Framework That Proved the Central Orchestrator Is the Bottleneck, Not the Solution

DeLM (yuzhenmao/DeLM, arXiv:2606.10662, Stanford University, June 2026) is a decentralized multi-agent framework where parallel agents coordinate through a shared verified context and a task queue, with no central controller.

Mohinish S

SnackOnAI Blog

FlashInfer: The Attention Kernel Library That Proves the Bottleneck in LLM Inference Was Never the Model. It Was the Memory Access Pattern.

Jul 13, 2026

•

17 min read

FlashInfer: The Attention Kernel Library That Proves the Bottleneck in LLM Inference Was Never the Model. It Was the Memory Access Pattern.

FlashInfer (flashinfer-ai/flashinfer, Apache 2.0, 5.8k stars, MLSys 2025, arXiv:2501.01005) is a kernel library and kernel generator for LLM inference serving. Its three core contributions are a block-sparse composable format for heterogeneous KV-cache storage, a JIT-compiled customizable attention template system, and a load-balanced scheduling algorithm that works with CUDAGraph despite dynamic batching.

Mohinish S

SnackOnAI Blog

M Star: Stanford and UW Built a Universal Multimodal Serving System. The Key Insight Is That Every Model, From BAGEL to V-JEPA to Qwen3-Omni, Is Just a Graph. Every Request Is Just a Walk.

Jul 12, 2026

•

14 min read

M Star: Stanford and UW Built a Universal Multimodal Serving System. The Key Insight Is That Every Model, From BAGEL to V-JEPA to Qwen3-Omni, Is Just a Graph. Every Request Is Just a Walk.

M (mstar-project/mstar, arXiv:2606.12688, preprint June 2026, Stanford + University of Washington + CMU) is a universal serving runtime for composite multimodal models. Its core abstraction is the Walk Graph: a model is a directed computation graph of heterogeneous components, and every request executes as a series of Walks over that graph.

Mohinish S

SnackOnAI Blog

OpenSage: The Agent Development Kit That Lets the AI Build Its Own Agent Team Solved 39 of 50 Elite CTF Challenges. Claude Code Solved 13 of the Same 50.

Jul 11, 2026

•

13 min read

OpenSage: The Agent Development Kit That Lets the AI Build Its Own Agent Team Solved 39 of 50 Elite CTF Challenges. Claude Code Solved 13 of the Same 50.

OpenSage (opensage-agent/opensage-adk, Apache 2.0, ICML 2026, arXiv:2602.16891) is the first agent development kit where the LLM creates its own sub-agents, writes its own tools, and manages its own memory at runtime, without a human pre-specifying the topology.

Mohinish S

SnackOnAI Blog

OmniRoute: The Free AI Gateway That Turns 160+ Providers Into One Endpoint, Compresses Your Tokens by Up to 95%, and Falls Back Automatically When Any of Them Fails

Jul 10, 2026

•

12 min read

OmniRoute: The Free AI Gateway That Turns 160+ Providers Into One Endpoint, Compresses Your Tokens by Up to 95%, and Falls Back Automatically When Any of Them Fails

OmniRoute (diegosouzapw/OmniRoute, MIT, 4.5k stars, v3.7.9) is a local AI proxy that runs on port 20128 and exposes a single OpenAI-compatible endpoint to every coding tool you use.

Mohinish S

ALL Blogs

Atomic Task Graph: A 7B Model That Beats GPT-4 ReAct on ALFWorld and WebShop Has Nothing to Do With the 7B. It Is the Control Framework.

DeLM: The Multi-Agent Framework That Proved the Central Orchestrator Is the Bottleneck, Not the Solution

FlashInfer: The Attention Kernel Library That Proves the Bottleneck in LLM Inference Was Never the Model. It Was the Memory Access Pattern.

M Star: Stanford and UW Built a Universal Multimodal Serving System. The Key Insight Is That Every Model, From BAGEL to V-JEPA to Qwen3-Omni, Is Just a Graph. Every Request Is Just a Walk.

OpenSage: The Agent Development Kit That Lets the AI Build Its Own Agent Team Solved 39 of 50 Elite CTF Challenges. Claude Code Solved 13 of the Same 50.

OmniRoute: The Free AI Gateway That Turns 160+ Providers Into One Endpoint, Compresses Your Tokens by Up to 95%, and Falls Back Automatically When Any of Them Fails

Quick Links

Subscription

Socials