To my knowledge this is allowed. The rule for contrasting colors is mainly for making it easier on refs to call gloving.
The fact that it might confuse other players is irrelevant. It's up to them to look for more than just the stick.