You can get UI benefits...but the state might track you down to pay up what you owe the state first to get UI benefits...its a catch 22 for you.
Can You Collect Unemployment If You Owe State Taxes In GA?