During the time period that Thomas Jefferson and Andrew Jackson lived (1743 - 1845), neither African Americans nor women had many rights.
African Americans were still slaves in all states. They had absolutely no rights. Even if they were free, there was much prejudice and they couldn't vote, etc.
Women were still not allowed to vote during that time period. They were expected to stay home and have children. Very little of them worked and if they did they were in "feminine" fields such as being a nanny.
The time period that Jefferson and Jackson lived was a time of white privilege, specifically for men. White men held the power and ran the country.