Linux: Common Filesystems
-
@Dashrender said:
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
I'm saying you can easily get CAD files that are around 300-600 GB each for large assemblies with a bunch of sub-assemblies.
-
@Dashrender said:
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
I'm also saying a file server that is a VM. Not a CAD workstation.
-
@johnhooks said:
@Dashrender said:
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
I'm also saying a file server that is a VM. Not a CAD workstation.
Right, but when you're working with files that large - why bother storing them in a VM - just st.... OK yeah, that goes against the standard practice now.. so we need a VM, even if the whole host is a VM - welp, I guess your stuck with XFS
-
@Dashrender said:
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
A filesystem has to fit into a file. So a file limit becomes a filesystem limit.
-
@Dashrender said:
Right, but when you're working with files that large - why bother storing them in a VM - just st.... OK yeah, that goes against the standard practice now.. so we need a VM, even if the whole host is a VM - welp, I guess your stuck with XFS
Pretty much. EXT4 is pretty silly for a server of any size, which is why even for desktops RHEL is XFS by default and EXT4 only as an option for advanced users. EXT4's days are pretty much over.
