This manuscript aims to study finite horizon, first order Hamilton Jacobi Bellman (HJB) equations on stratified domains. This problem is related to optimal control problems with discontinuous dynamics. We use nonsmooth analysis techniques to derive a strong comparison principle as in the classical theory and deduce that the value function is the unique viscosity solution. Furthermore, we prove some stability results of the Hamilton Jacobi Bellman equation. Finally, we establish a general convergence result for monotone numerical schemes in the stratified case.