-
-
Notifications
You must be signed in to change notification settings - Fork 33
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feather file has issue with compression #294
Comments
Thanks, will take a look. What compressed this file? |
Tracking this upstream - lz4/lz4-java#190 |
A temporary (hopefully) solution I am going to try is to use FFI bindings to call into the C library directly. This one is going to be a tough one as the only example of dependent frame compression I can find is the go library. @behrica - How did you produce this file? |
The point of the question is is this pathway going to be the standard pathway everyone is using or did you produce this file with some magic set of options that very few other people are going to use? |
You will have to now also include jna and ensure that liblz4 is on your system which is system-dependent. My recommendation is to avoid dependent block compression on lz4 so if that was a parameter set it to false. |
Not that I remember. I think I created it in the simplest possible way from R:
It came out while I was working on the file from #292 , |
That was my fear - then these things will be all over the place. |
Reading
https://github.com/scicloj/scicloj.ml-tutorials/blob/main/data/tweets_sentiment.feather?raw=true
fails with
I followed the setup instructions for arrow support in TMD.
The text was updated successfully, but these errors were encountered: