Let the genotype for a male child with color blindness be Xb Y, with b denotes colorblindness and B denotes regular vision. The father's genotype could be XB Y or Xb Y. The father's X chromosome does not matter if the offspring is male. The mother's genotype could be XB Xb or Xb Xb. The more likely of the two is XB Xb, because colorblind females are rare.
For a female child, the genotype would have to be Xb Xb. For this combination, the father would have to be colorblind (Xb Y) and the mother would have to either be colorblind (Xb Xb) or a carrier (XB Xb).