[a humble lich]

I don't have 4e Horror, so I don't know if these rules have been updated and already suggested, but in 3e Horror, it was suggested that every failed fright check gives a -1 cumulative penalty on all future fright checks. This was specifically to model the downward spiral you are talking about.