Although there were plenty of signs that he was somewhat unhinged before, I get the impression that his conflict with his oldest daughter was the thing that really sent him over the edge.
Before that, lots of people really did believe his image of being a Tony Stark-level genius. Since then, he has thoroughly dispelled that myth. And not intentionally, unfortunately.