When you delete a smart collection, you are not deleting the pinned original files to which the collected files refer. You are simply deleting the collection of references.
Delete a smart collection as you would any other item. See Delete items from Chorus.