Optimizing Transformers with Hugging Face Optimum

#processed #article #Personal

Metadata

Page Notes

Highlights

  • Examples of graph optimizations include:Constant folding: evaluate constant expressions at compile time instead of runtimeRedundant node elimination: remove redundant nodes without changing graph structureOperator fusion: merge one node (i.e. operator) into another so they can be executed together — Updated on 2022-07-02 13:49:15 — Group: #Personal