This plugin allow you to select layer(s) which use specific color.

color finder