[1.5.x] Simplified the deletions performed by the swappable_models test.

This is required to allow the test to run without error under SQLite in the CI environment.

Backport of 18d7c1ea.