Hm, if you delete a song and the files are not referenced by another song, all files and directories should be deleted automatically. It might not happen right away but usually after the next restart of ST4. I just checked on all my test devices and there are no empty song folders even though I often delete songs during testing.
If those folders are empty, you can safely delete them. The app will recreate them automatically in case it needs them.