web crawler / mirror website
Hello,
I wanted to mirror a database to be able to do my research offline too, I tried using HTTrack, which was very slow (two days downloading and one day verifying the files), does anyone know a better way to mirror a database/online encyclopedia? (without crashing their website of course

)
you can easily mirror most sites with a scraper... how useful that is questionable