Have you experimented with having the rears open a crack whilst doing this? Seems to make it better for me (sportback).
I will have to try this to see if it makes things bearable. Did think about wind deflectors but I cant bring myself to do that, it reminds too much of old cars from the 70's!