The option to remove the item from the Tasklist is only available if the item is flagged.
Right-click the flag icon.
Select Remove from Tasklist.