Data hoarding is more important than ever
Data hoarding is more important than ever

Data hoarding is more important than ever

Data hoarding is more important than ever
Data hoarding is more important than ever
48TB rust in raidz2 reporting in
Heh... I'm actually rewatching Dragon Ball right now.
Awesome! I like the original series best by a decent margin. Soooo good.
Watched it for the first time last year. It was incredible. Absolutely holds up to modern stuff.... Except for some absolute creep moments around Bulma, various sexism... The overall purity culture weirdness.... Some really homophobic things... Some really racist things.... ...
Okay. It has issues. Lots of really big issues. But the music is amazingly fresh and the visuals top notch and it's always entertaining, minus the glaring problems. And that they did Lunch so dirty for some reason.
That's still modern Japan lol. At least, it stands out to me vs western media today.
That's a pity they haven't changed. I know a lot of Japan has gotten better, but I also know that they still have a prevailing homophobic purity culture.
Rant:
One of my favorite animes is one piece, and as much as I love it for it and some personal connections in my head around it, there's just so much hurtful and thoughtless stuff in it.
Generally, Oda does a good job of keeping it harmless and goofy, even when using racist or sexist or homophobic tropes. He generally keeps them colorful and just for the sake of having weird shit. Which I have always loved.
But..... Every once in a while there's like an ice cold bat to the face, be it something that is just old (I'm rewatching it) and at the time may have been trying to bridge an acceptance gap, or just downright mean spirited.
Like for example, I'm in the whitebeard war area of the story, and there's the crossdresser stuff and the king(queen?) of them. Fat, Giant Head, lingerie all the time even outside, giant chin and jawline, crazy makeup, and when he attacks, he winks at you. Like. Come on. That's so shitty. And I would say that the character is a drag queen, but he LITERALLY USES HORMONES TO CHANGE HIS AND OTHER'S PHYSIOLOGY. Like a military guard is about to attack him, and he injects him with hormones and turns the guard into a woman, who then gets embarrassed, mews, and collapses in heat and embarrassment. He's not a drag queen, they're a transgender non binary, genderfluid troll that everybody calls an okama, which, to my knowledge, is basically a sissy or maybe even a slur, >!faggot or fag!<.
And all the hyper stylized femininity toothpick waist girls and barrel shaped boys. Like come on, if you're gonna do that style, give me those waify boys, tough girls, and sexy and confusing enbies at least.
All the people in queer land are just manly crossdressers. Where are the femboys!? Where are the gorgeous women who just happen to be assigned male at birth?
Maybe one piece gets better over time. Maybe there are anime that are better. Maybe there's "Western" media today that's more realistic.
/Rant
Holy shit, you’ve nearly 20x’d me 🫡
Check again...
That's "free space". The 414 represents ~62% of my space (38% used). I'm at just under 700 for usable space. And 2 disks are out of the array at the moment because the backplane went stupid. Turns out that it's a pain in the ass to open server chassis to replace a backplane when you have to unmount 70 disks. And I'm pretty lazy.
6 x RAIDZ2 | 10 wide | 14.55 TiB
873TiB raw.
960TB raw.
This graph might be better...
lol yeah - I revised my comment from 10x to 20x after looking closer. You literally 20x’d me lol.
That is some thicc storage. Respect.
Let's just say that I do my part seeding Linux ISOs.
~72 TB uploaded the past 30 days.
I am unfortunately the epitome of a data hoarder. I still have files that I generated/created 30 years ago...
Damn, what sort of connection are you running? I feel like you’d be getting throttled, assuming throttling isn’t strictly illegal (side note: genuinely, thank you, People’s Republic of Massachusetts ❤️)
Fiber, 8gbps through Quantum Fiber (part of the Lumen/Centurylink family). No throttling here...
My bottleneck is the vpn that I have to have between me and the world... unfortunately. I only trust specific private trackers to not use it. I actually setup 4 seed boxes (VMs) in my garage to push more data out.
Proxmox cluster... and big storage truenas node.
And a dirty amount of networking... big cables on the right is QSFP, 40gbps 2x in lagg per server.
These pictures were just after a transplant to a new server rack. So everything is off... but the blinkin' lights are real.
Edit: Didn't turn off anything before I ran these...
Jfc please make sure that's hazard proof and don't get raided. People like you legitimately make the world go round.
So about that... I actually got solar installed on my house and when the "electrician" (subbed out contractor with dubious credentials but was operating under a legit company) ran dedicated breakers for the servers... the junction box caught fire.
That was a fun 2am to wake up at.
But it's pretty safe now. Have had several master electricians come in and evaluate it all at this point and all of them are happy with it now.
How do you afford all this?
I’m gonna guess incremental increases over the years, and snapping up used enterprise stuff on fire sale. It’s actually pretty feasible to do if you know where to look for this stuff.
More or less exactly this. Most of my servers are company decommission (some companies have a strict upgrade cycle, and I even have like 3 more "spares" sitting around). I've found some government liquidation here and there as well which has been great for resale to recoup some of what I spend. I have something like 4TB of Ram sitting in a box somewhere that I should sell somewhere...
Some stuff was "decent" ebay buys. A few items I just had to pony up for. Battery backups was mostly paid at full msrp, but has been worth it. HDDs are mostly "refurb" and built up over time as well, which is why raidz2 and several spares in the zfs pool.
But yeah, about 10 years of building it up. I use it as my playground for professional development, and it's helped prove a lot of what I say on my resume.
When you have a functional setup like this, and can show that to potential employer. It's been the best sole investment I've ever made. It's netted me more money in contracts by many many times what I put into it.
Edit: and saved me from countless "cloud" privacy violations, data breaches, etc...
Edit2: Recurring costs is basically energy. The rack itself uses about 90kWh a day (about $5/day for me), cooling and all. My solar install creates just about that much per day as well so that's all offset (and if I ever move my equipment into a colo, my house will basically have no electric bill at all). Internet is $165 a month, which is fucking great IMO... VPN is paid every 3 years or whatever that cycle is on. If I was to just take the non-replaceable stuff (about 20tb worth of data at last check, and a bunch of lxc containers) and put that on a VPS somewhere I'd be paying at least 10x what I do now in someone else's datacenter, forget that that's a recurring monthly cost.
Edit3: Just because it is likely useful information for SOMEONE out there... If you know that your setup takes 10kWh a day, you need to account for another %50 for cooling, so you should actually expect 15kWh in that usecase. My actual rack uses ~60... 30 more is cooling. I actually have all my power usages broken out in a sankey graph... Even goes further to break it down on a per server usage as well, but I can't take a reasonable screenshot that doesn't show personal information. This is 24 hours of usage (specifically 04/30, yesterday) and "garage dedicated" is what the A/C unit I have in the bottom of my rack is plugged into.
Probably years of passion. Possibly a career related to this stuff.
Ngl I am quite envious. That’s awesome.
108TB SHR reporting in.
8TB reporting for duty. 🫡😂
Seriously though. What's the best help to lend out say 2tb?
Edit:This is a serious question.
I think it was annas archive that has a page for what data they need mirrored the most based on your storage space available. After looking into it.
You can take a look at Interplanetary File System and see what data you want to mirror.
A bunch of USB sticks and external drives turned on and checked from time to time with rare files I need.
Walking along I guess. Bringing some tea.
IpFS like ddh says makes the most sense probably. But you can archive a lot of raw text. Try to save what you think the Nazis would burn. I doubt archive.org survives many more years. Leaked archives of american research papers too.
14TB RAID1 setup reporting in.
324TB misc here for duty
32TB right now.
Got +80TB coming in the mail!
And offside backup coming soon ™️
<3