Fix bf16 inference accuracy for mistral, phi3, dbrx (#833)

Fix bf16 inference accuracy for mistral, phi3, dbrx (#833) #43