iohann.s.titov@gmail.comIvan S. Titov InstantTensor is a safetensors loader that reads model weights straight into GPU memory over io_uring, libaio, cuFile or an in-memory path, and pipelines the prefetch across ranks of a torch process group. vllm exposes it as the "instanttensor" load format. instanttensor