Skip to content

aoti-cuda int8 gemm #20034

@Gasoonjia

Description

@Gasoonjia

🚀 The feature, motivation and pitch

we need a int8 gemm for model infernce support like gemma4

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

Status
In progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions