Issue with ABS function within if statement

dbaete

I've got a very specific problem with an ABS function nested in an IF function. My formula is basically: IF(ABS(X-Y) <= 0.1,"","Out"). As far as I can tell the formula functions correctly, EXCEPT when X and Y are both values from 7.30 to 7.49. In this instance, if ABS(X-Y)=0.1, then it returns "Out".

Ex. when X=7.44 and Y=7.34, the formula returns "Out". It does the same if the X and Y values are swapped.

Ex. when X=7.50 and Y=7.40, the formula returns "". It does the same if the X and Y values are swapped.

There may be another range that malfunctions, but I haven't found one yet. Any thoughts on what could be going on here? Thanks for your help!

Paul Newcome

The ranges that contain the X and Y values... How exactly are those being populated?

dbaete

They are in a dropdown list of values, however the problem persists even when the column type is changed to text/number. I have also tried adding the value() function around the abs() function, but it did not change the result.

Paul Newcome

But how are they populated? Formula, manual, automation?

dbaete

Oh sorry. Manual entry/through a form

Paul Newcome

Try putting a basic formula in a temporary helper column that is basically

=ABS(X@row - Y@row)

Make sure you click the button to show as many decimal places as possible and then take a look at some fo those rows to see if maybe there is something going on with hidden decimal places.