This happens when the mp3 tags contain different (wrong) artist names for the songs, which causes the the album to be spread over several differnet (fake) artists. If you delete the album under a wrong artist name, it will then be removed for all others including the correct one too, but there's nothing wrong about it.

Maybe you should just not display artist folders, since it doesn't really make much sense anyway (in my opinion).

-pn