Change the Trash Bin to allow Shift+Delete for immediate, permanent, file deletion, just like Windows.
Also when "Enforce unique file names" is checked, filter out/ignore files in the trash bin, or give us the option to delete the offending duplicates in the Trash Bin and then continuing with the intended file operation.