If you owe them money and you pay it off, then you should be able to continue receiving benefits. As long as your balance with them is $0, then you can collect.
If I owe money to unemployment and they are supposed to keep my state refund, can I still claim unemployment benefits, also if I pay remaining balance will that interfere with me getting my state refund?