That why iOS has a lot of fine grain control now as well as prompts after the fact letting you know how many times the app has accessed your location, and check if you still want it to have it.