I've been living alone in a house for longer than you've been here. If there's an angry mob demanding the real estate, I've never heard from it.

[ Then again Joshua's house does have one of the bedrooms ripped open to make for a more open downstairs and murals on three of the four outside walls, so it's possible that his just has terrible property value or something. ]

It's all in what you make of your own lifestyle, really. They may come back or they may not, so at this point anything they left behind is yours.