Vice President Joe Biden is drawing criticism after telling a crowd that Republican presidential challenger Mitt Romney's campaign policies would put them "back in chains."

Conservatives say the comment was racially charged and out of hand.

Biden made the remark during a campaign stop in Norfolk, Va., to what appeared to be a mixed crowd.

He prefaced the statement with a reference to Romney's campaign wanting to "unchain Wall Street."

Former New York City Mayor Rudy Giuliani told CNBC's Larry Kudlow that Biden's ongoing gaffes raise questions about his ability to assume the presidency, if needed.

"I've never seen a vice president that has made as many mistakes, said as many stupid things," Giuliani said. "I mean there's a real fear if, God forbid, he ever had to be entrusted with the presidency, whether he really has the mental capacity to handle it."

"This guy just isn't bright. He's never been bright," he continued. "People think, 'Well, he just talks too much.' Actually, he's just not very smart."

Even though there were a large amount of African Americans in the crowd, Biden said he meant that Republican policies will put the middle class in shackles.

Romney's camp called the Biden's comment a "new low" for Obama's campaign.