I've encountered that pretty often in alpha but not in beta until 0.10 some days ago i got random damage against my Fort and there was no one around and no sounds.
This was on my main account so i dont know if there 100% was no one (because i dont use cheese on it), but there was definitely no sounds and i encountered this often in alpha so i assume it's the same bug again.