"I knew he was bluffing/scare mongering, but the whole episode was stressing me enough at the time..."
I would have done the same Tim. I can't be bothered with the hassle.
But judging by his/her over the top response it was stressing them out much more than you. They have probably suffered a lot just with worry - so maybe justice was done.