When you open an untrusted MP3 in Firefox, you get the yellow placeholder thing.

When you click on that and confirm the temp allow prompt, this happens:

When I allow the entire site, the MP3 plays just fine. Also, this only seems to happen when the MP3 is the top level document (as opposed to being an <audio> embed in an HTML page).