memif: fix the memif crash when slave disconnect