If I've understood your question correctly, you would like to see a list of artists, and from there click to get only the albums of that artist. Correct? Well, in that case the option is already there for you.

When you 'Export to HTML' and select the 'CMI Style' template, you must select 'Display browse field x'. And then select 'Artist sort' as your browse field.