web traffic
is it really neccesary for singingfish to crawl my web site three times a month, downloading every single MP3 on it every time? Wouldn’t it be enough to seek to a few random spots in the file and verify they hadn’t changed since the last crawl?
I could exclude singingfish via robots, but I do want people to be able to find my mp3s.. (I should really add some id3 tags to increase the odds, I guess…)
Also, why on earth is the most popular file.. by far.. http://www.sheer.us/stuff/Cloe_MP3/Tory-060704.mp3
it’s not any different from any of the many jam files I have on the server.. except for some reason it generates several hundred downloads a month…
Strange.