Skip to content

[Java] Improving Arrow Vector Reading performance #416

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
1 of 2 tasks
asfimport opened this issue Apr 23, 2019 · 4 comments
Open
1 of 2 tasks

[Java] Improving Arrow Vector Reading performance #416

asfimport opened this issue Apr 23, 2019 · 4 comments
Labels
Type: enhancement New feature or request

Comments

@asfimport
Copy link

asfimport commented Apr 23, 2019

Currently the read interface of Java Arrow Vector is quite slow because the access operation has to go through validity bit check and boundary check before it can actually load the data. Such a safety check incurs unnecessary overhead in actually computation. 

The Arrow Vector and ArrowBuf should expose unsafe methods for advanced users to directly access underlying data without null check and boundary check.

Reporter: Yurui Zhou / @yuruiz

Subtasks:

Related issues:

PRs and other links:

Note: This issue was originally created as ARROW-5197. Please see the migration documentation for further details.

@asfimport
Copy link
Author

Wes McKinney / @wesm:
Possibly duplicate of ARROW-1833, I added a link to this JIRA

@asfimport
Copy link
Author

Yurui Zhou / @yuruiz:
oh yeah, you are right. There may some overlap on the work. 

@asfimport
Copy link
Author

Micah Kornfield / @emkornfield:
[~Yurui Zhou] I think all of these JIRAs can be resolved, since there is functionality in the code base to achieve them?

@asfimport
Copy link
Author

Todd Farmer / @toddfarmer:
This issue was last updated over 90 days ago, which may be an indication it is no longer being actively worked. To better reflect the current state, the issue is being unassigned. Please feel free to re-take assignment of the issue if it is being actively worked, or if you plan to start that work soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant