Inference

Meet d3LLM: Ultra-Fast Diffusion LLMs Without the Accuracy Trade-Off

What if AI could write many words at once, not just one after another? Diffusion LLMs can—yet they often trade speed for accuracy. Meet d3LLM, a new approach that keeps both. * Smarter training: Pseudo-trajectory distillation teaches the model which tokens are safe to finalize early, enabling confident parallel decoding.

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging

TL;DR LoRA adapters are small plug-in modules that fine-tune big language models cheaply. But one adapter per task doesn’t fit messy, real-world inputs. What’s new LoRA on the Go (LoGo) lets a model pick and blend the best adapters for each individual input—no labels, no extra