So long as they fit certain criteria set up by the IRS they do not have to pay taxes.
Non-profits are tax-exempt (pending approval) under the federal government. However, there are still various state and local taxes that apply. Non-profits might still have to pay various payroll taxes, sales taxes, property taxes, etc., depending on where the are located.