The tax-free threshold should only be claimed with the payer who usually pays the highest salary or wage (this is known as your primary source of income). If you earn any additional income (for example, from a second job) then your other payer is required to withhold tax at a higher rate.
From the ato website