Answer :

The band, including Herman, feel that Bud is just joking that HErman is his father, but they don't want to crack it.
the think he's joking about herman being his dad