80s (?) Horror, mad man sees dead father, kidnaps woman and kid

I think it’s 80s horror (or older)
It’s a family home where everyone is crazy, man (he has dark hair and a beard), his wife and daughter.
They kidnap this woman and her daughter and hold them hostage tormenting them in the process.
Man keeps seeing his old father sitting in the chair, judging him and it turns out that his father is actually long gone…
I recall title was something like Madness but maybe not cause I tried finding it unsuccessfully.
House is really old and in the middle of nowhere

Man kinda looks like guy from Amityville Horror (older, not remake)