You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I’ve been working with scientific data, including numerical weather data stored with Blosc2 compression, and I’m interested in whether Vortex could support it too. At the moment, converting this data to Vortex means using pcodec which is nice and all however pcodec suffers a lot of smaller data sizes or nulls. Atleast based on my experience with vortex compact
Proposed solution
To add blosc2 byte shuffle + lz4 and blosc2 byte shuffle+ zstd1 as one of the compression levels, or something more configurable like how hdf5plugin does it. I can try to do a POC of it.
Activity