Arthur Rasmusson
Arthur Rasmusson is Director of AI Architecture at LightBits Labs, where he works on the KV-cache data plane, Inferra by LightBits Labs - tiering and securing LLM cache state across HBM, DRAM, NVMe, and the network to raise tenant density and extend context length.
His career sits at the intersection of GPU/IO virtualization and large-scale inference: he was previously Engineering Co-Founder of Arc Compute, Principal AI Engineer at Weka and Machine Learning Engineer on Cohere’s Model Efficiency team.
Arthur is a contributor to the open source cache technology and storage ecosystem - author of NVIDIA TensorRT-LLM’s “KV Cache GPUDirect Storage” feature (PR #3209, merged, later moved to NIXL in the NVIDIA Dynamo Stack), Python-Native-libCuFile used in the GPUDirect Storage backend for LMCache/vLLM and creator of Open-IOV.org, a community documenting GPU virtualization, driver, and firmware internals.
Session
The boot security community has spent years pushing a measured, verified chain of trust upward from the boot ROM, through firmware, and into the OS. AI inference now runs above that chain, but the trust boundary usually stops where the runtime begins. This talk argues that the KV cache, the working memory of every LLM deployment, is the next surface that belongs inside the root of trust, and shows how to get it there.