I graduated this year from a selective school that's ranked ~30.
Based on my experience, literally no one will care. In fact, only a small minority in my grade actually played instruments.
Although most people (including me) would've highly recommended it, no one cared or looked down on you if...