Ordinarily, it would be dangerous, yes. But the explosion itself is contained very carefully so that it only exits out one end and is blocked off from coming close to the passengers. The engineers that build them include safety measures in place as well.

[pchoo look at that shitty rocket with flames out one end]