Fixed #17485 regression -- only + select_related interaction

When doing deeper than one level select_related() + only queries(), the
code introduced in b6c356b7 errored
incorrectly.

Thanks to mrmachine for report & test case.