At first, only rich white men could vote. During Jackson's time, the common white man was giving the right to vote. During Reconstruction (the period after the Civil War) voting could no longer be denied on race or color because of the 15th Amendment, but this still only applied to men. Women got the right to vote with the 19th Amendment in 1920.