The main thing they risked was their life, especially during the Civil War. They could also be thrown in jail and lose their job, family, and livelihood.
Helping slaves could end up going to jail or even being killed. Many abolitionists were part of the underground rail round, if they were caught they could be in serious danger.
