fix stupid typo in floatscan that caused excess rounding of some values