Don't feel bad. Are you casual? If you are, they can't force you to work, and so long as you give them as much notice as possible then there shouldn't be an issue.
Seriously, that is part of the produce manager's job, to replace shifts etc. they will be fine. Just let them know ASAP :)