Wittgenstein once said that the world is the totality of facts. It seems to me that at least in the case of color this theory doesn't apply. What facts can be said about the "redness" of a red object. Perhaps no facts can be said about "redness" precisely because what is being experienced in an encounter with red isn't a "fact". Do we apprehend that redness through a fact or through an experience of consciousness? It seems to me that the fact that red exists and the actuality of red are two different things since saying "red exists" doesn't say anything about what red is when it is experienced. So maybe Wittgenstein is wrong?
You are right that, in the Tractatus, Wittgenstein claims that the world is the totality of facts. And it is also plausable to think that the experience of red (seeing red) may be difficult to express informatively in words, especially if you were to try to convey what it is like to see red to someone who is color blind or completely blind from birth. But I don't think Wittgenstein needs to deny this. I believe that, for Wittgenstein, the term 'fact' means something like 'state of affairs' and so one may speak similarly of the fact of you seeing red now and the state of affairs of you seeing red now, without this implying any difference between what you refer to as the fact that red exists and the actuality of red.