disable item transfer (by number keys at the top) in a container

As title, is there a way to prevent player move stacks by using number keys?

Here's what I've tried:

@Override
	public ItemStack slotClick(int slotId, int dragType, ClickType clickTypeIn, PlayerEntity player)
	{
		return slotId == this.slot ? ItemStack.EMPTY : super.slotClick(slotId, dragType, clickTypeIn, player);
	}

In container class this works well on normal transfer (drag and drop), but not working on the number keys.

addSlot(new Slot(playerInv, x, 24 + x * 18, 165)
        {
          @Override
            public boolean canTakeStack(PlayerEntity playerIn)
          {
            return false;
          }

          @Override
            public boolean isItemValid(ItemStack stack)
          {
            return false;
          }
        });

Override these two methods from the Slot class doesn't help with that either.

Any hints or something I did not noticed? Thanks.