A proposal to give millions of Aussies an extra public holiday this year has sparked backlash, with fears one group would “bear the brunt” of the move.