math: fix two fma issues (only affects non-nearest rounding mode, x86)