So it goes for Jasper, Tennessee physician who is believed to be the nation's only D.C. lawmaker already with opposition in his own party.
"You know I have talked to constituents back home and for the most part, people I have talked to have been very supportive, pleased with the job I did in the last Congress," the congressman told Nashville's News 2 as he begins his second term.
"We saw a lot of TV both nationally, and certainly here in TN with a lot of politics of personal destruction I think people are ready to focus on the problems at hand."
All this follows the Tennessee Democratic Party releasing the Pro-Life Congressman's 2001 divorce transcripts shortly after his November re-election by 12-points over Democrat Eric Stewart.
It showed that while practicing medicine, DesJarlais dated a few patients, urged of one to get an abortion, and consented to an abortion for his then-wife.
DesJarlais has said in "God has forgiven him," and "has asked constituents and fellow Christians to do the same."
"I think that as you go through life, we make mistakes, and learn from them," he said Friday. "We try to move on and be better for it. Sometimes in life, fortunately, we are given second chances."
The divorce records also drew a medical ethics complaint with the Tennessee Department of Health from the group Citizens for Responsibility and Ethics in Washington.
"Again, this is a 13 to 14 year old issue and I am working with them in full cooperation," said DesJarlais.
He was asked if he had recently met with the Tennessee Health Department officials. "Yes, they had some questions and I answered them."
Earlier this week, the conservative voted against the partial fiscal cliff deal because it contained no spending cuts.
He would like to cuts in each area of the federal government to reduce the nation's debt.
"Somewhere from a one-to-three percent cut initially would be a good start, but its going to have to be aggressive and its going to have to be soon," added the congressman.
He's also been saying that he's working to repeal "Obamacare" even though its been allowed to move forward by the U.S. Supreme Court
"We certainly have our challenges with it, but we are not going to give up that fight because I think its very destructive to our health care system," said Rep. DesJarlais. "So I think there will be another Supreme Court challenge, there will certainly be legal challenges by companies when federal exchanges try to tax them."
The congressman thinks some parts of the health care law will be shoved back because they won't be implemented by the 2014 deadline.
As for his one announced party challenger, and several others thinking of joining in, DesJarlais said, "It's a two-year cycle so you are always campaigning we all know its marathon and not a sprint so we may see a lot of interesting entries as we move forward."