HBASE-29588: New HFile Design For MultiTenant Support#7296
Open
sairampola wants to merge 139 commits intoapache:HBASE-29588-featurefrom
Open
HBASE-29588: New HFile Design For MultiTenant Support#7296sairampola wants to merge 139 commits intoapache:HBASE-29588-featurefrom
sairampola wants to merge 139 commits intoapache:HBASE-29588-featurefrom
Conversation
added 30 commits
April 15, 2025 19:31
…are from v4 codeflow
added 30 commits
February 25, 2026 19:21
…ection entries to ensure non-negative offsets and positive sizes, maintaining order integrity
…cient next-section lookup. Added resolveCurrentSectionIndex method and updated findNextTenantSectionId to utilize the new index, improving performance and clarity
…nt exceeding maximum limits. Update MultiTenantHFileWriter to remove write verification and improve bloom filter handling. Refactor BucketCache to utilize BlockCacheUtil for HFile name matching, enhancing code clarity and maintainability
…egative offsets in constructors and seek/read methods. Update logging in TenantExtractorFactory to use debug level for improved clarity. Refactor MultiTenantStreamReader to optimize initialization checks. Adjust MultiTenantHFileSplittingTest to simplify table name generation.
…ader with section size validation and improved seek/read methods. Introduce new methods for checking bounds and clamping read lengths. Update MultiTenantBloomSupport interface to include row prefix bloom filter checks. Add tests for seekBefore functionality across tenant sections to ensure correct fallback behavior.
…gement of parent streams, improving resource management during closure. Update AbstractMultiTenantReader to handle section size validation and improve error handling for section initialization. Introduce checks for invalid tenant prefix lengths in SectionIndexManager, ensuring robust validation of section entries. Refactor logging for clarity and consistency across various components.
…cle by ensuring prevCell references are copied to on-heap before scanner recycling. This change aligns with the v4 bloom filter management strategy, improving resource handling during the shipping process.
…ingFSStream to reduce allocation overhead. Update AbstractMultiTenantReader's toString method for improved readability. Refactor DefaultTenantExtractor to enforce maximum prefix length validation. Modify MultiTenantReaderFactory to use a switch statement for reader type creation, improving clarity and error handling. Enhance SectionIndexManager with a fast prefix-to-entry lookup and refactor section entry handling for better performance.
…ror handling. Update MultiTenantFSDataInputStreamWrapper to ensure non-negative offsets and enforce section boundaries during read operations. Refactor AbstractMultiTenantReader to handle tenant index metadata more robustly, including checks for valid prefix lengths and improved logging for section initialization. Introduce a new test for the reseekTo functionality in MultiTenantScanner to ensure compliance with forward-only movement requirements. Additionally, adjust DefaultTenantExtractor to prevent allocation during tenant section ID comparisons, enhancing performance.
…FileReader to improve validation. Introduce checks for section count in bloom filter retrieval methods. Update passesDeleteFamilyBloomFilter and passesGeneralRowBloomFilter methods to streamline logic and enhance error handling. Add a new test for multi-tenant bloom filter correctness across multiple sections.
…d flag and streamline the close method. Update MultiTenantHFileWriter to catch and rethrow exceptions as IOException for improved error handling during section closure.
…lude DEFAULT_ERROR_TOLERATION_DURATION and configuration parameters. This change enhances error handling and ensures consistent cache restoration behavior during tests.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.