There are three ways to remove (delete) a track. 

To delete either a graph or annotation track: