Clear a reference field - SOLVED

Try undefined or simply not setting it at all if value if empty (so not doing the setFieldValue.