just think of it this way:
The Y-chromosome is very small simply because it mostly only codes for the testes and like men themselves, contain very little information.
The X-chromosome on the other hand, codes for a multitude of traits. Because the Y-chromosome contains very little information, it will not have an opposing gene for traits that the X-chromosome will code for. so whatever is on the X-chromosome will be fully expressed in males even if the trait is a recessive one.
In this way, whatever is on the X-chromosome will be what the male expresses. If its a recessive trait such as colour blindness, males that express the trait are carriers as well.