Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate data pack/unpack code at runtime #17

Open
rockeet opened this issue Jan 9, 2023 · 0 comments
Open

Generate data pack/unpack code at runtime #17

rockeet opened this issue Jan 9, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@rockeet
Copy link
Contributor

rockeet commented Jan 9, 2023

Now MyTopling inherited MyRocks's pack/unpack code, which is slow because it pack/unpack data dynamically, in table scan stage, pack/unpack consume , as show in this flame graph:
image

We can optimize it as below:

  1. generate pack/unpack C++ code on create/alter table and create index
  2. compile the code into shared lib
  3. calling pack/unpack function in the shared lib

We expecting this will greatly improve pack/unpack performance.

@rockeet rockeet added the enhancement New feature or request label Jan 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant