If the worthiness enchantment is broken, another wielder wouldn't get Thor's power, would they? They'd still have a nearly indestructible hammer that returns when thrown and can open dimensional portals, which is nothing to sneeze at, but they shouldn't have Thor's physical might or control over the weather.