Using Optimum Benchmarking

Using the built in benchmarking code to measure quantized model performance
quantization
Published

September 26, 2022

Reading through the documentation I have found the benchmarking page. It would be good to use this and see how it compares to the evaluations that I have already been doing.

Unfortunately there does not appear to be any easy way to actually invoke this code. The API is promising and I should check it out in future.