President Barack Obama and David Letterman

One day after a secretly taped video of Mitt Romney harshly criticizing nearly half of America was released, President Barack Obama responded to the Republican presidential candidate's claims, saying that most Americans are not "victims."

On Tuesday, during an appearance on the Late Show with David Letterman, Obama addressed the recent release of Romneys speech from a May fundraiser, in which Romney said there are 47 percent of Americans who are "dependent on government, who believe that they are victims, who believe government has the responsibility to care for them, who believe they are entitled to healthcare, to food, to housing!" Romney argued those 47 percent will vote for Obama no matter what.

Fall Preview: Get the scoop on your favorite returning TV shows

Obama noted that when he won the election in 2008, 47 percent of the American people actually voted for his opponent, John McCain. "They didn't vote for me," he said. "And what I said on election night was, 'Even though you didn't vote for me, I hear your voices, and I'm going to work as hard as I can to be your President.'"

Obama also said one of the many things he's learned as president is "you represent the entire country." "I promise you, there are not a lot of people out there who think they're victims," Obama said. "There are not a lot of people who think that they're entitled to something."

Check out more of Obama's interview with David Letterman below: