I'd hold it, because while that's the rule for taxpayers, it can't hold true for the deceased. I heard last night about another couple of folks who has the same thing happen. I suspect it's not the weirdest thing we'll see before this is over!
When my clients do that, I don't remove the Sch E, but I stop all depreciation on the date they moved back. Taxwise won't attach it if there isn't income and expenses. I just have to be sure it's clear.
That way, if they decide to sell, you'll have that record of depreciation for recapture.
I'm sure others will chime in on this.