r/DataHoarder • • 4h ago

Guide/How-to How to download from wtr lab?

2 Upvotes

I use wtr lab for reading mtl translated novels but don't have constant Internet connection and I like to keep record of what i read the problem is there is bo built in download and copy and pasting isn't a practical or viable option too is there a way to mass download chapters and not only from wtr lab but other sites too that have chapters as part of the web page for example novel543 and foxaholic


r/DataHoarder • • 14h ago

Question/Advice Backing up part of hugginface

1 Upvotes

With rumors starting (at least on the AI subreddits) that legislation may target open weight LLMs, local models, etc., would it be worthwhile to create a back up of hugginface?

I'm not tech savvy enough to do that on my own, but i could set aside some TB to save the smaller models. If someone is already doing that, let me know if i can contribute (even if in a marginal way). If no one is doing it yet, how can we start? Worst case i can sacrifice a mini pc and an external hdd.

Is there even a need or want for this?

Thanks in advance


r/DataHoarder • • 16h ago

Question/Advice Modern TV Show Archives/Resources Needed

1 Upvotes

Hey, this is not a request for a specific thing, just resources, but I'm looking for a modern tv show made by a network that shut down in 2020 and subsequently removed the show from every place it could be watched, what resources/archives should I look to find it? I've checked the internet archive, but I wasn't expecting it to be there, what resources would fit a scenario to where a network got discontinued making the original modern tv show unavailable, thanks. note: this is not a request for the show, just looking for advice.


r/DataHoarder • • 20h ago

Question/Advice Mac tool to archive RSS feeds?

2 Upvotes

Any recommendations on the best tool to archive RSS feeds on a Mac? Ideal features: saves as much of the post as possible, including images; for Bluesky type feeds, includes any referenced images; keeps everything, never deletes old items; can choose location of archive directory; can store and search huge numbers of items. I've tried Thunderbird and NetNewsWire (and Vienna a while ago) but would appreciate any other tips. Thanks!


r/DataHoarder • • 20h ago

Question/Advice Is using two different cloud storage providers as a storage strategy an okay idea?

1 Upvotes

I've been thinking about using two different cloud storage services to store all my data as I don't have enough local storage to keep everything starting next year.

The scenario I would be most worried about would my cloud account getting banned or deleted for whatever reason and immediately losing all my stuff. With this set up, if that happened I would still have one left and could very quickly buy a new account on a third provider and upload a copy of all my stuff ASAP. I am aware I would be screwed if both accounts were deactivated at the same time, but the odds of that seem really low to me.

I know that this is definitely not an ideal or perfect setup, but is it fine enough for someone who just wants a something simple and pretty safe? I also don't have tons of money.

Please tell me if there is anything horribly wrong with this idea because I am worried I'm missing something and want some peace of mind.


r/DataHoarder • • 20h ago

Question/Advice Verbatim DataLife bluray disks empty after writing

1 Upvotes

My Verbatim DataLife come out as empty even though there are no writing errors, no matter the write speed i use. You can see a really faint color change where the disks were written. Tried with disks from two different verbatim batches (printable and non printable) and also some cheap Omega discs.

Fist i though my second hand optical drive is to blame (2024 Asus BW-16D1HT) so i bought a other one (LG BH16NS40).

I've read that it might be the old FW to blame. both are on versions 1.0.0

Asus has that mediatek 1939 chip, according to MakeMKV, that does not allow flashing. And the flash process does not start for the LG at all when using it with the IcyBox IB-525-U3, and i don't have acces to a PC at all.

So now i have 90 verbatim blanks and the uncertainty that both BD writers are f****d.

Reading works without problems.

Writing on windows with imgBurn and windows burner. I also tried other free options.


r/DataHoarder • • 21h ago

Question/Advice EU-based data recovery company?

9 Upvotes

Yes I'm an idiot, you don't have to remind me or anyone else. My last backup dated well over a year back and I didn't notice. Then whoopsie - and damaged btrfs raid5. I'm prepared to pay if it's at all possible to salvage things. But I'm in Switzerland, and most companies advised here are North American. Does anyone know a reputable data recovery service in Europe?


r/DataHoarder • • 21h ago

Discussion Nickelodeon Gigaleak 2023 - Correcting the Misinformation

79 Upvotes

It has been incorrectly reported (and still continues to be incorrectly reported) that on the 28th of June 2023 Nickelodeon suffered a massive breach of their animation department servers and over 500GB of data was stolen and leaked to 4chan.

And this is why you should never trust journalists or "journalists" who report on stories instead of doing their own independent investigations.

What actually happened

Nickelodeon production servers were reachable via the internet and indexed by search engines in the same way that resulted in MSI warranty records, Zotec warranty records and private Claude and ChatGPT conversations [1], [2], [3] being exposed and publicly accessible.

Here is an example (2023) of the Paramount/Viacom still archive user registration page being exposed to the internet. (The page is still up for Paramount only related queries, Nickelodeon has removed all access). Through these public portals people were able to gain access to the entire Nickelodeon production server. Not just the animation department.

What was reported publicly as "500GB" is incorrect. 500GB is what was pieced together by a user from various Discord posts and made available to download before quickly being taken down. The real story is that these links have been exposed to the internet for years. Users who knew of their existence have been accessing and downloading small parts of Nickelodeons servers and sharing them on Discord in private communities as Ghosty Tongue reported on twitter (now removed).

What was reported as 1 giant 500GB leak/hack was actually a continuous leak that occurred over potentially many years and amounts to far more than 500GB. The entire production server was compromised. Every show ever aired on Nickelodeon including Drake and Josh, iCarly, My Life as a Teenage Robot, Dora the explorer, Spongebob Squarepants, The Wild Thornberrys etc was scraped.

The "500GB leak" and what is currently known to the public from the files nick.7z and 2024 Nickelodeon Gigaleak. zip are only a fraction of the total amount of data siphoned.

File Index:

I have, through publicly available information that I will not disclose, been able obtain a list of files that were exposed in these breaches to the internet.

The list is available here.


r/DataHoarder • • 1d ago

Hoarder-Setups cheapest solution

2 Upvotes

I have about 4tb of pictures and maybe another 1-2tb of other data at home. I had Synology ds923+, 2 drives failed simultaneously. I was able to copy all my data off I also have a hyper backup.
I am going to move away from Synology I don't trust it. Never received alert about drive failure until after failure. Also, I don't like they force you to use specific hardware. The apps are garbage as well. I am looking to move to immich and nextcloud running on some yet to be designed hardware. I may run these apps on unraid or I may run them on some other os.

I was considering buying a full tower and throwing a bunch of drives it in. However, even without the drives looking at $1800. I want about 32gb of ram, low power. Would like to get the cpu,ps,ram,tower,mb for around $1000 or less. Any ideas out there?


r/DataHoarder • • 1d ago

Discussion Why do modern JavaScript websites become so difficult to archive properly?

4 Upvotes

I've been interested in website archiving for a while, and one thing I've noticed is how unreliable offline copies can become with modern websites.

Tools like wget and HTTrack work really well for many traditional websites. But when I try archiving React or Next.js sites, I often run into problems:

- The initial HTML gets downloaded, but dynamically loaded content is missing.

- Internal navigation stops working in the offline copy.

- Some pages depend on API responses that aren't preserved.

- The result looks nothing like the original website.

I've been exploring how browser-based capturing could solve this by rendering pages first and preserving the network responses instead of just downloading the HTML.

I'm curious about how others here approach this problem.

A few questions:

  1. What tools are you currently using to archive JavaScript-heavy websites?
  2. Do you prefer WARC/WACZ archives or a browsable offline copy?
  3. How do you handle websites that change frequently?

Full disclosure: I'm a developer working on a Mac website archiving tool, so I've been dealing with these problems firsthand. I'm interested in learning how people in the archiving community handle them.

Would love to hear about your experiences.


r/DataHoarder • • 1d ago

Question/Advice Possible to use AI bot to crawl and download course membership site? (lecture videos, pdfs, mock tests)

0 Upvotes

I travel a lot for work - sometimes to areas with poor cellular/no wifi coverage and I am also studying a course - is it possible to use AI bots to crawl the site (requires login) to download the course material to my laptop before travelling so that I can have access to it offline?


r/DataHoarder • • 1d ago

News BlackBlaze now explicitly states selling your data for advertisement

649 Upvotes

It seems that BackBlaze updated their privacy policy and mention selling your data for advertisement purposes. A lot of the info is under the "expanding" sections:

https://www.backblaze.com/company/policy/privacy

Found this out from a submission to hacker news and like others there, I have some questions about what's sold. User "cjboco" shared a link to the page where we can opt out, last option I believe:

https://preferences.backblaze.com/

And there's also a discussion on BackBlaze's subreddit:

https://www.reddit.com/r/backblaze/comments/1y1mx2c/backblazes_dec_1_policy_update_is_more_than_a/

I only use their B2 service and encrypt files - even file names - before upload, so I don't think I'm too affected by the change, but something to be aware of.


Edit 1: "BackBlaze", not "Black Blaze", lol.

Edit 2: Some have pointed out that this is likely for the website. It's possible, but a quick look at the page (I may have missed it), it doesn't limit this to the site. If it's that, then it should be clarified.


r/DataHoarder • • 1d ago

Hoarder-Setups USB 3.2 DAS actually holding up for DrivePool so far.

1 Upvotes

Ran out of SATA ports and did not want to rebuild my node just yet. Against my better judgment, I grabbed a TerraMaster D4-321 to run 4 extra drives through StableBit DrivePool. The drives are a mix of WD Red Plus 8TBs pulled from an old ZFS array that got retired, so the data had already been moved off before any of this. DrivePool only works on NTFS and ReFS, which meant wiping and reformatting all four first.

Just finished migrating a few terabytes of media over this weekend. No dropped connections, no errors so far. StableBit Scanner shows temps peaking around 39C, and my office ambient sits around 72F (22C), so that is fine. SMART passes through to Windows without any extra work.

The pool has only been up a short time, so this is not a long term verdict. Posting mainly because running out of SATA ports seems common and an external box was the easiest way out for me.


r/DataHoarder • • 1d ago

Backup Snowchive - every published Snowden document in one place

Thumbnail snowchive.org
48 Upvotes

r/DataHoarder • • 1d ago

Scripts/Software Anyone else moving live stream archiving from local scripts to cloud setups?

1 Upvotes

Been looking into ways to keep stream recording running without leaving a PC on 24/7. Curious how others here handle automated recording and storage—local boxes/scripts or cloud-based tools?


r/DataHoarder • • 1d ago

News esuit.dev website is back i think? but the website is different

Thumbnail esuit.dev
0 Upvotes

Any thoughts?


r/DataHoarder • • 1d ago

News Try a NAS operating system in your browser - TrueNAS 27 demo, nothing to install

29 Upvotes

Disclosure: I'm a product manager at TrueNAS.

Quick intro if you haven't come across us: TrueNAS is an open-source storage operating system built on OpenZFS. You install it on your own system or in a VM, and you get a enterprise NAS built on ZFS pools, snapshots and replication, SMB and NFS shares, plus apps and containers. TrueNAS Community Edition is free.

The catch has always been that to really see it, you assemble a spare system or set up a VM, install from the ISO, and build a pool first. So we put the TrueNAS 27 web interface online at demo.truenas.com, running against a simulated TrueNAS Enterprise system with all of its data dynamically generated: No signup or email address required. Any username and password works.

Optional 10-minute guided tour: the dashboard, a ZFS pool with a flash tier (Fusion Pools), SMB shares, object storage with a standard S3 API and Object Lock, LXC containers, apps, data protection, and reporting. You can't break it. We tried. Each visitor gets a private copy, and starting over is as easy as refreshing the page. No cookies, anonymous visit counts only.

TrueNAS 27.0 ships in early December. If you've been curious about ZFS or building your own NAS, this is a low-effort way to look around first.

Blog post with more detail: https://www.truenas.com/blog/truenas-27-demo

Happy to answer questions or feedback in the comments.


r/DataHoarder • • 1d ago

Question/Advice Digitizing CD collection, have a few questions!

2 Upvotes

Hello! I wanted to seek out some advice prior to getting into ripping/digitizing 300 something CDs in order to hopefully make it an easy process without double handling everything.

I've never used EAC (Exact Audio Copy) before, but plan on following a guide for FLAC files to get the best backups I'm able to. My question is I was curious if there were a way (or an easy trick) to also get 320kbps files at the same time to use for the "itunes match" service as itunes doesn't support FLAC files.

I want to get away from streaming and seeing as I have so many albums itunes match with apple music seems to be the best route! I have a 4tb HDD which I'm fairly sure will hold both file types/copies of the albums.

Thanks in advance for any advice as it's likely to save me tons of time and stress!


r/DataHoarder • • 1d ago

Question/Advice Are BDXL M-Discs from Verbatim legit M-Discs?

7 Upvotes

I want to create permanent archives for cold storage and am thinking of getting a BluRay burner and BDXL M-Discs to do the job.

Where I live, access to most technology is piss poor, so I'm planning to order Verbatim's discs from Amazon: https://www.amazon.de/-/en/Verbatim-MDISC-BDXL-lifelong-archiving/dp/B01E0CUU1C I know buying tech from Amazon can be risky, but I seriously do not have other options.

However, I found this thread which claims that Verbatim doesn't sell actual M-Discs, but regular/"basic" BluRays which they market them as M-Discs: https://www.reddit.com/r/DataHoarder/comments/yu4j1u/psa_verbatim_no_longer_sells_real_m_discs_now/

Apparently, OP noticed that their 25GB M-Discs had the incorrect MID data, proving they were fake; but they were unsure about the 50GB and BDXL (100GB) versions.

I'll be honest, I'm not highly experienced in discs, so I'm not sure what to make of this. I've seen plenty of other people say they use Verbatim's M-Discs with no issues, but I don't want to get scammed, especially with how expensive M-Discs are!


r/DataHoarder • • 1d ago

Discussion Caught a dual-drive failure just in time: 2021 Samsung 870 EVO (138 bad blocks at 21.9 TBW) + 12-year-old Toshiba 3TB (40 pending sectors) (999 Reallocated sectors) — Samsung denied goodwill RMA by 3 months

0 Upvotes

Checked CrystalDiskInfo a couple of days ago and realized both my main C: drive and my D: bulk storage drive were actively dying at the exact same time:

  • Samsung 870 EVO 1TB (2021.04, S/N S625NJ0R...**,** SVT01B6Q firmware): Showed "98% Good" on the top bar, but SMART had 138 Reallocated/Runtime Bad Blocks (05/B3/B7) and 2,501 Uncorrectable ECC Errors (BB/C3) with only 21.9 TBW written out of 600 TBW. Classic early-2021 leaky NAND batch.
  • Toshiba DT01ACA300 3TB HDD (~12 years old): Jumped from 0 to 40 Current Pending Sectors (999 reallocated) in just a few days while holding old MiniDV transfers and film scans.

What I did to rescue everything:

  • Bought a SanDisk Optimus GX 7100 2TB NVMe for my personal rig, did a clean Windows 11 UEFI install, and moved ~1 TB of irreplaceable videos/scans off the dying Toshiba HDD first before copying my user folders off the Samsung SSD.
  • Picked up another 870 EVO 1TB for an office server, noticed it was also 2021.04 stock on SVT01B6Q (!), so I flashed it to SVT02B6Q at 0 hours before cloning the server onto it.

Where I'm stuck with Samsung:
I bought my personal 870 EVO on August 4, 2021, so I missed the 5-year warranty by ~3.5 months. Frontline Samsung Memory Support denied a goodwill RMA despite the documented 2021 batch flaw, so I just filed a BBB complaint with Samsung Electronics America's Plano HQ.

Has anyone here successfully gotten Samsung's executive relations team to replace an out-of-warranty S625NJ0R 870 EVO, or is there another escalation email that actually works? Also open to cheap, reliable backup drive recommendations in this economy


r/DataHoarder • • 1d ago

Question/Advice UGREEN DXP4800 GT for $380 on TikTok Shop vs. waiting for a 6 bay NAS?

0 Upvotes

I spotted a Black Friday deal on TikTok Shop for the UGREEN DXP4800 GT (the 4 bay AMD R2514 model with dual 10GbE, two M.2 NVMe slots, and ECC RAM support) at $380 diskless. That is roughly $150 below its normal sale price.
My plan is to wipe UGOS on day one and install standard Linux or TrueNAS SCALE on an M.2 NVMe drive so I can self host Immich and a few Docker containers. For storage, I want two drive fault tolerance with RAID 6 or ZFS RAIDZ2, aiming for around 36 to 40TB of usable space for photos, raw media, and backups.
Here is where I am stuck:

  1. Grab the DXP4800 GT now at $380: It is a great price for the hardware, and I can reach 40TB usable using four 20TB CMR drives in a compact, quiet box. The downside is losing 50% of my raw capacity to parity and having zero empty bays left if I ever want to expand.
  2. Hold out for a 6 bay unit: Stepping up to something like the DXP6800 Pro (currently around $970) or waiting for enclosure and drive prices to drop would let me run six smaller, cheaper drives (like six 12TB drives for 48TB usable in RAIDZ2) or start with four drives and add two later. Of course, the chassis itself costs almost $600 more upfront.
    For folks running RAID 6 or RAIDZ2 at home, would you jump on the $380 4 bay deal now and just eat the higher cost of 20TB drives, or is 4 bays too limiting when you want two drive parity?

r/DataHoarder • • 1d ago

Free-Post Friday! New SATA SSDs, PC is up and running..

Thumbnail
gallery
39 Upvotes

r/DataHoarder • • 2d ago

Discussion Haul from work

1 Upvotes

I think I should just throw them away.

Need to know if anyone here could kindly recommend a NAS/DAS for 7(1TB) Seagate Barracuda 3.5 inch drives and 3x5TB 2.5inch Seagate Barracuda and 2x5TB 2.5inch WD drives.

4 of the 1TB drives were in an ancient Netgear broken NAS, so I got given them to wipe/erase fully and reformat (done) the others were out of another ancient box computer.

The 2.5’s I have had for ages, I would hate to erase what is i/on them but if it meant I could chain/use them all together for the greater good I would do it.