No, this is not a bug, MT does not delete files from your server. If wish to delete the file, you will need to do it via FTP, or whatever File Manager tool your webhost provides.

And yes, the ability to do this is already on the Requested Features List.