you feel a little play when you wobble the wheel when stationary?
given the list of what you've described above, I'd say it's almost certainly the inner joints on the track control arms.
the control arms are not part of the rack, although they look like it at first glance.
If you pull back the gaitor, you'll see that the track control arms actually screw into the rack on each side. These are ball joints, and often wear out and give that small play when moving the wheel. Could also account for the left hand pull you've described in the past.
A3 track control arms are pretty cheap too, about £20 each, and dead easy to change, although it would need alignment afterwards.
jack up the front, and grab hold of the wheel, and see if you can wobble either of them left to right at all.