Is it possible to further improve the accuracy if k v are constants ?

[Zeqiang-Lai]

No description provided.

[jason-huang03]

@Zeqiang-Lai What do you mean by kv to be constant? Can you show an example?

[Zeqiang-Lai]

I have a network that calls a cross attention multiple times with different queries but the same k, v.

k, v = ...
for chunk_q in q:
   attention(chunk_q,k,v)

[jason-huang03]

I think the speed can be faster (quantize k and v only once) but the accuracy cannot be improved.