If you even in a situation where it's not allocating the color you want it could be because of your images color allocation table. GIF and 8-bit PNG images are very susceptible to this.
If your using an GIF and PNG try dropping a color from the table, should let you allocate another.