Public
  1. Public

onnxruntime

Public

Commits

aciddelgadoGitHub
e771a763c3c
aciddelgado authored and GitHub committed 8eb49c5f009
fix gqa rotary dim 1 (#19874)

### Description
GQA Rotary Dimension 1 incorrectly assumed to be based on head size.



### Motivation and Context
This change should enable us to run phi-2 with GQA and Rotary Embedding
fused.