Same thing has happened to my cartilage piercing. I dunno, it might have migrated and that could be scar tissue? Not sure. On mine, it came up after it had been irritated a few times, knocked around, slept on etc. so it might be caused by some kind of pressure.
My piercings? I have ear lobes x...