If you were to use torch._scaled_mm to do fp8 matmul you would notice that this private method has changed many times and will continue changing.

@drisspg has kindly published a backward compatibility guide to using it with different pytorch versions:So now those of us who use this method can write back-compat code.