Answer :
The nativists believed immigrants were contributing to unemployment rates because they were taking jobs away from the nativists. This was of course silly because many nativists were immigrants themselves.
competing for jobs that they believed should go to people born in America