I could tell that he was a ghost since the Trailer. Then playing the game it was very obvious in the scenes that the companions didn't see/interact with Varric.
They barely mentioned him more than a handful of times leading up to the reveal outside of the awkward cutscenes.
I thought everyone could tell too until I started reading other player experiences.