On close, we might get a return code which looks like an error but just
means that the other side closed gracefully. Handle that.