Transposing instrument won't play in concert pitch

If I am writing a score with the instrument set to Bb trumpet the sound is always a whole tone lower then what I am inputting regardeless of the transpose/concert pitch mode I am in.

So if I input a G for the Bb trumpet it sounds like an F , if I then click notes -> concert pitch the notation changes to show F correctly only the audio also changes so I hear an Eb.