The question here is which shirt reflects most of the light.
White shirt reflects most of the light. That is why we wear white shirts during hot summer to keep ourselves cool. Also, a white shirt appears white to our eyes as all colors are reflected equally. So our eye sees the mixture.
Red shirt reflects only red light. so we sense it as red in our eyes. The other colors are absorbed.