alegendaryfish's picture
Fix padded KV-cache inference across CLI and packaged API
3296617 verified