A stern warning has been delivered over the sharp rise in online hate and harassment aimed at witnesses giving evidence to the anti-Semitism royal commission.