Jews were already prosecuted in Nazi Germany before the war, although the regular Holocaust started during the war.
In the years leading up to the war, many discriminatory laws were introduced, such as the prohibition of interracial marriages with the non-Jewish population, then gradual prohibition to hold certain professions, such as university professors and doctors for the general population (Jewish doctors could only tend to Jewish patients). In the beginning the aim was to make Jews leave Germany on their own accord, and in the beginning many Jews were encouraged to leave (but leave most of or all their possessions behind).
Jewish shops had to be marked as such, and the SA stood in front to stop people from entering. Jews had to use separate benches in the public, there was a segregation in buses and trains. With time, Jews in Germany also lost citizenship.