Man, I get jealous of some Linus Tech Tips videos.
@mhamzahkhan No dedup, no special allocation class, single parity, and he didn't declare the vdev using UUID paths.
Watching ~$100k worth of equipment get configured anything less than perfectly gives me the irrates.
The guy's made his fortune, so good on him. But waving the money and gear around in the current economic environment, not to mention in front of his employees, seems a little tone deaf.
@michael haha yep, definitely a lot of problems with the setup but I get jealous at how much free stuff companies send them 🤣
@michael hmm dedup, wouldn't that require a crapnload of RAM? I've never switched it on for any of my ZFS machines because I always heard you need a crap load of RAM for it.
Hmmm what do you mean by special allocation class?
I thought he done raidz2? Ie double parity?
@sheogorath @mhamzahkhan I dislike any system that offers a "dumb" basic config of something, but then requires you to dive into the CLI anyway for fine tuning. (The Cockpit LibVirt module is a great example).
If you're going to end up there anyway, just start with the CLI and nothing else.
Furthermore what version of ZFS do you get in a packaged solution like unRAID/TrueNAS?
Installing the zfs-dkms module on an Arch box is one line?
@michael @mhamzahkhan It depends. These solutions are built for 80% use-cases. TrueNAS, as coming from the BSD world is certainly not the worst choice for ZFS and as far as I know handles these situations and updates very well for years now.
I wouldn't say there is that much release engineering happening around a DIY Archlinux solution.
@sheogorath I think they used Unraid mainly so they can run VMs on it using KVM. TrueNAS (Core) can also do virtualization using bhyve, but I guess they wanted to stick with something more familar. TrueNAS Scale is Linux based and has KVM, but it's still beta.
I prefer to use TrueNAS instead of a generic linux distro with ZoL installed just because it's just so much less hassle to setup all the auxilary tasks in TrueNAS, eg snapshots, replication, backups, scrubbing, etc.
Obviously you could set these up yourself using your own scripts + cron, but setting up the same in TrueNAS is just so much easier to maintain and in general you aren't getting any extra benefit by using a homegrown solution for a storage server imo.
@mhamzahkhan Dedup can consume a lot of ram (1-3 GB of RAM per TB of deduped data is the recommendation). But like with ARC you can set a limit on how much RAM it can consume. If the size of the dedup table exceeds this limit, dedup "spills over" to using disk. But in this case as they repeatedly stated, the disks aren't that much slower than RAM. So a spill over wouldn't cause much performance hit.
@michael ahhh. I never looked at it because I always thought it required a crap load of RAM. I wonder how well it would perform for my crappy NASs.
@mhamzahkhan In addition to RAM it will also thoroughly bludgeon your CPU. Not just on the initial data write, but also during pool scrubs. It's an enterprise feature meant for enterprise hardware to be sure. But in the case of the LTT video, that piece of kit is above and beyond even enterprise tier.
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!