In the Media Library window, hover over the item you want to delete. You will see a trashcan in the top right. Click the trashcan to delete the item permanently from your library.

Note that if the asset is still used in other scenes this may cause issues  (it will result in a blank object).

Did this answer your question?