The silly trick I found is to use Apple's Smart Playlists to help. I've been creating playlists like "Not heard since Jan 1, 2023". Songs drop out after they are played in a shuffle.