None of the marriages should be an issue.
In the past, affairs and such were considered private and the press was even complicit in keeping them that way.
But after Gingrich insisted on impeaching Clinton for his affair, while Gingrich himself was having an affair... well what a tool.