A whole five seconds sounds steep. It's a punishment, but you still ought to have at least some chance to recover. Two seconds, perhaps three? It's not a long course.
[If you're gonna roll with Kaiba you're gonna have to deal with him getting picky and intense about rules.]