In the past I read somewhere on the web about several downsides to having favicons enabled. IIRC, there were a few security/privacy issues and last but not least, the bloating of the bookmarks.html file should you archive it and import it later. There is no good reason for favicons to be enabled, period.
I proposed they be disabled in Tor Browser, see here for the thread: