I have no clue why, as I'm no memory master, but loosening the sub timings at high clocks will help a ton.
Lower the SPP a notch at a time until it boots right. Too much nb voltage can make the system act a fool.
It's just a thought, as some nvidia boards want more volts while others like less.