This currently causes some major issues with the Braver New World mod in the early game since it doesn't really let you have much in your inventory. I guess you could just stick some blueprints in there and maybe that would do it. Otherwise, you're just kind of stuck with a ghost in your hand.
Interestingly, if the 'ghost item' is the result of a cut or copy, 'Q' clears your hand just fine.