Yes, you always have to pay pension insurance, however once you get your hello-work certificate you can go to your Ward Office Pension desk and apply for exemption while unemployed. But you have to specifically ask for it.