For pseudo-free and recurrent self-similar groups, we show that continuous orbit equivalence of inverse semigroup partial actions implies continuous orbit equivalence of group actions. Conversely, if group actions are continuous orbit equivalent, and the induced homeomorphism commutes with the shift maps on their groupoids, we obtain continuous orbit equivalence of inverse semigroup partial actions.