Learn more about cloning repositories
You have read-only access
softcap gqa (#21683) ### Description Implement softcap for gqa. ### Motivation and Context Fixes certain models like Gemma-2 which need softcap to work so they don't output nan's.