Show HN: ZeroFS – Make S3 your primary storage

Posted by Eikon 6 days ago

Comments

Comment by sysguru2046 5 days ago

I assessed the tool on a CentOS 7 system today. It can't run on older CentOS 6. It will generate core dump.

My testing went well. I was able to mount ZeroFS as NFS and write a 100M file to the mount point. The file persists after I deleted ZeroFS cache.

My plan is to use it for backup process. If we don't have such tool, we would need to prepare a large Filesystem stage area, then run rclone to upload to cloud space. With this tool, I can mount it on Backup server, rsync file server a large Filesystem to the ZeroFS mount point, eliminating stage area.

Will ZeroFS support large Filesystem size about 800GB?

Comment by Eikon 5 days ago

> I assessed the tool on a CentOS 7 system today. It can't run on older CentOS 6. It will generate core dump.

Perhaps your cpu is too old? The prebuilt binaries require newer CPUs but you can build your own.

> Will ZeroFS support large Filesystem size about 800GB?

Absolutely, and much, much more than that.

Comment by sysguru2046 5 days ago

Glad to hear it can support large file system. Is ZeroFS stable with:

Millions of files, Interrupted transfers, Backup Server Reboots, Long-term operation?

Comment by Eikon 4 days ago

> Millions of files, Interrupted transfers, Backup Server Reboots, Long-term operation?

Yes, that should work fine!

Comment by johntdyer 4 days ago

Is this only was S3 or any S3 compliant service? Does it support any sort of storage tiering ?

Comment by Eikon 4 days ago

> Is this only was S3 or any S3 compliant service?

Any S3 compliant service.

> Does it support any sort of storage tiering ?

Yes, it has a local cache that's populated on reads, but no writeback cache yet.

Comment by splitbrainhack 5 days ago

better than juicefs and without the macfuse shennanigans ?