No. As a matter of fact, there's no pattern to it. You'll only know for sure if all of their possessions disappear -- Ah. That's another thing. You'll receive your things in the mail from time to time, usually after one of the town's little games.