Icebase: PostgreSQL-Stored Iceberg Metadata

Posted by jordepic 9 hours ago

Counter4Comment1OpenOriginal

Comments

Comment by jordepic 9 hours ago

Hi! I forked this project from https://github.com/udaysagar2177/apache-iceberg-fileio in order to make it delegate between database and object store for data/metadata, as well as use reflection for use within other query engines outside of the java api.

While this isn't as good of a spec for database-metadata as something like ducklake would be, there are still many intrinsic benefits to avoiding object store for these many small writes.

See the repo: https://github.com/jordepic/icebase