>>9800 >That's "Powered by Invision Community", so there isn't a myBB-like easy complete index of all of the threads/post/data as far as I can tell. There's this: >Didn't see a total post count on that site. Can't view topics by number: With forums like that, I am impressed when I see activity that is even semi-regular nowadays. The software they use does seem to be a bit of a tough cookie to crack...
>>9807 >Maybe if I set a --delay setting in grab-site then I wouldn't get blocked. I would probably get blocked anyways. Even if it did work, it would take way too long with delay on. I wouldn't rule out delay entirely. Now, I don't know how big the site is, but let's say it is 100 GB (uncertain if conservative or liberal estimate). Calculate delay spped/bandwidth against whatever "too long" might be.
>>9804 >I understand. I haven't lurked much here. Was too busy lurking in older webpages, haha. Understandably so,
*looks at thread and the one and sometimes two man army saving terabytes of files.
Honestly, I am surprised you have time for much else, even with automated processes!