Anon 04/17/2024 (Wed) 02:24 No.10203 del
"Heinessen, the 4chan archiver" was the first website to automatically download 4chan /mlp/ images somewhat consistently for months. Copied:
. torrent? related to 221.89-GiB torrent magnet:?xt=urn:btih:79760b305316b095d30e7bdfa49b97d49f236618&dn=heinessen-mlp-images.tar -> an extracted version with extra data
. where? zb, offline, in MFS but not pinned /ipfs/QmcX2DkjkkXmCRBhGn6swbHrQKoY1WT1oXqSRVRYGTqYeY <- "ipfs add -wrH --raw-leaves --chunker=size-1048576 [folders]; [...]"
. size? 238,142,756,028-B folder /ipfs/QmVVnfdiiTP5EoZvzJtBQjJPopwVszRwouKj49kU7SdaMK - took about >24 hours due to problems and it contains 635,770 files total
. note? See below.

Extra data:
. "heinessen-mlp-images_hashes_via.txt" = "readme file"
. "heinessen-mlp-images_hashes.txt.zst" = precomputed data from months ago (which took days to compute); this contains stuff such as MD5 hashes which are relevant to Desuarchive /mlp/. I recently used it to see the file count: '$ zstd -cd /z0/data/1735f69/heinessen-mlp-images_hashes.txt.zst | head -n5499000 | grep "File: " | vim -'

As seen here - https://archive.ph/2014.10.15-042952/http://archive.heinessen.com/mlp/thread/17431556 - heinessen.com image links looked like this: http://archive.heinessen.com/boards/mlp/img/0174/31/1398400892326.png

238 GB here - https://gateway.pinata.cloud/ipfs/QmcX2DkjkkXmCRBhGn6swbHrQKoY1WT1oXqSRVRYGTqYeY - which contains more folders. Folders min+max (regarding the main 81 folders in "image/"):
. 1365/ QmNQ...csZk 310 MB
. 1401/ QmWh...SB8s 11 GB

I put less than 1% of QmcX...qYeY online - this 777-MB folder in there (1342/ QmZ9...3jZp):

Message too long. Click here to view full text.