Click on the Filters icon first. There you will see several measurement types which you are able to hide on the drawing if it's necessary. They are:
All the measurement types are on by default. Click on the relevant group and you will switch off all the items of this particular type. They will be hidden both from the drawing and the Measurements panel. Click one more time to make them visible again.