Add a 'send directly with gift note' checkout option and say so in the copy - gift buyers who can't ship direct bounce to competitors who can.