No, marks aren't swapped around, you don't get anyone else's marks. People use those words to describe what happens but it can be misleading.
Your exam mark is always your own exam mark.
The assessment marks of the whole class are adjusted depending on how the class performs on the exam...