mesa3d: don't depend on the X server

There's no particular reason why you shouldn't be able to build mesa
without the X server (E.G. for remote X), so remove it.

Signed-off-by: Peter Korsgaard <jacmet@sunsite.dk>