Just do not go to their homes at evening when they are going to rest there. And only talk to them wnen they are working. thanks for the answer!