Just a guess, but I wonder if they are not being attracted by pheromones emmitted by the first ones there, then more bugs more pheromone. I have seen accumulation on several different kinds of plants-- so I don't think it is actually the plant.
Anyway--you are just getting some free fertilizer-- organic to boot!