Yeah, the quants do the maths/programming. The structurers do a bit of everything. I think the GS's CRM team is more structuring than pure quant stuff.
Also, the level of math ability depends on what you are trading. In equities you don't need much but for exotics, fixed income, credit, etc...