I've never had an issue with unloading happening at the same time as passenger de-boarding. As far as I know, if you have refueling happening on the right side of the airplane, the baggage loading won't start until that is completed, so the fuel truck and the baggage trucks don't go crashing into each other. This is also why catering doesn't happen at the same time as anything else.