Poppies

It is Rememberance Day next Sunday. I am exhorted by charities to "wear my poppy with pride". Will I? Isn't there some chance of some little minority group dictating to the majority that the wearing of poppies insults their religion?