This is ridiculous.
First, there are no colors in the world to register.
Absurd nonsense. Are you denying that light comes in different wavelengths? Are you denying that we have three types of photoreceptors, corresponding in general to the three colours red, green, and blue?
Go back to our thought experiment with the sober human, the dog, the person with tritanopia, and the guy on psilocybin. The same light ends up triggering 4 different colors. So what color is the light? Blue, green, yellow, or gray?
The light stays the colour it has been all the same, determined by its wavelengths. The fact that some people and animals do not have the same number of, or corresponding photoreceptors, does not change the light (we will ignore the question of white balance here).
Everybody sees something corresponding to the colour of the light, and children learn to call the green light 'green', red light 'red', and so on. Even a colour blind person sees something, despite not having the same types of photoreceptors as other people, and he learns from others that the colour of leaves is 'green' even if he can actually not distinguish it from red.
Everybody build up data structures for the colours they see, and associate them with leaves, sky, fruits, or whatever, and they call these data structures by the associated names they have learned from other people.
Colours exist. What is your problem?
Also, of course the baby sees red the first time it looks at something which appears red to us.
Of course the baby's photoreceptors register the red colours right from the start! Who have claimed differently? But the baby may not yet associate what it registers with all the stuff that it is associated with later. The baby will just have less of an experience at start. Was I supposed to disagree with you here, or are disagreeing with me, or are you just upset that there is no special magic about 'red'?
Your arguments are totally absurd.
Pot, meet kettle!