The defeat ended the holders' hopes of becoming the first club since Blackburn Rovers in 1886 to win the FA Cup three times in a row.
Danny Welbeck pulled a goal back for Arsenal in the 88th minute but it was too late to change the result.
Watford go into the semi-finals alongside Premier League sides Everton and Crystal Palace.