Public
  1. Public

onnxruntime

Public

Commits

Yufeng LiGitHub
2605faef887
Yufeng Li authored and GitHub committed 87d68d8531e
matmul integer fusion (#4195)

* Introduce DynamicQuantizeMatMul
It fuses DynamicQuantizeLinear, MatMul and following cast, multiplier. It gets float in and float out for quantized matmul. We have a MLAS kernel in implementation for this op.