Repository navigation
Add TIBX archive parser #30
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
falklindner
wants to merge
48
commits into
fox-it:main
Choose a base branch
from
falklindner:feature/tibx-parser
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+6,737
−3
Open
Changes from 16 commits
Commits
Show all changes
48 commits
Select commit
Hold shift + click to select a range
c50a0be
Add TIBX archive parser
falklindner 10671e0
Add TIBX archive parser
falklindner 87c6e77
Merge branch 'feature/tibx-parser' of github.com:falklindner/dissect.…
falklindner 00a056c
Add some known fields to arch_superblock struct
yunzheng fc2de1c
uv run cstruct-stubgen dissect/archive/tibx/c_tibx.py
yunzheng 2534b29
Optimize TIBX parser read path
falklindner c009665
Detect TIBX encryption by locating the key
falklindner 92f199a
Address TIBX parser review feedback
claude 4297cb2
Credit acronis-tibx inline for the derived TIBX work
claude 93dc6f7
Correct and complete the TIBX third-party attribution
falklindner 7b495d0
Use the native CRC-32C and limit envelope offsetting to commit_roots
falklindner dabb829
Rename the TIBX modules to singular file names
falklindner 4873c7b
Drop the page LRU: it never hits
falklindner ec224b3
Use dissect.util's LZ4 wherever no dictionary is needed
falklindner 57fa473
Fix TIBX recovery points, volumes, add AES-GCM
falklindner 9b05168
Parse all TIBX records through c_tibx structs
falklindner 2cd6de9
Add TIBX archives written by Acronis Cyber Protect 15
falklindner 09e8e6a
Fix silent truncation of large TIBX trees
falklindner 6506b58
Speed up loading the TIBX index
falklindner 52f353d
Use dissect.util's LZ4 for dictionary blocks
falklindner b1d836e
Speed up resolving TIBX extents
falklindner f336e67
Release the TIBX index on close
falklindner 0459f8c
Find the TIBX live root with fewer reads
falklindner ecfc779
Read TIBX segments in a single I/O
falklindner ec5eb1e
Fix TIBX metadata streams listed as volumes
falklindner 063b05e
Speed up sequential reads of TIBX volumes
falklindner 62e52f3
Read TIBX index pages in runs
falklindner 45d89a6
Keep TIBX volume intervals in parallel lists
falklindner ee059e7
Merge TIBX segment_map runs without a set
falklindner 0b2a3a9
Keep the TIBX data_map in arrays
falklindner f720b8a
Look TIBX segments up run by run
falklindner a7f1030
Do not list sector-aligned TIBX bitmaps as volumes
falklindner e07ddd3
Parse TIBX LZ4 block headers with struct
falklindner 49a0c73
Tell sector-aligned TIBX bitmaps by their span
falklindner 5540c67
Import zstd only where a TIBX segment needs it
falklindner 6a74c30
Use dissect.util for LZ4 dictionary blocks
falklindner 1a4c4a2
Fix the PyPy test run and the docs build
falklindner 5ea269d
Fix review findings in the TIBX parser
8a0dce9
Declare the c_tibx constants in the stub
falklindner 7ca3ba0
Move the TIBX tests to mirror the package
falklindner 16095d6
Move the third-party notices into the docstrings
falklindner aa02dd2
Merge the review fixes from falklindner/dissect.archive#1
falklindner a6c586d
Skip the * split part name on Windows
falklindner 562b19d
Read the TIBX segment codec from its own byte
falklindner 49ee9e5
Decode every segment of the Acronis samples
falklindner a2d23fe
Read the segment header byte after the codec as the cache level
yunzheng eec906e
Test LZ4 segments at ComprLvl.LOW on real TIBX archives
yunzheng 5943b8d
Complete the slice_record and arch_header structs
yunzheng File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,68 @@ | ||
| # Third-party notices | ||
|
|
||
| `dissect.archive` is licensed under AGPL-3.0-or-later (see `LICENSE` and `COPYRIGHT`). | ||
|
|
||
| The TIBX ("archive3") parser in `dissect/archive/tibx/` is a clean reimplementation in | ||
| Dissect idioms — no third-party code is vendored — but the format knowledge and the | ||
| structure of several algorithms derive from the two MIT-licensed projects below. Their | ||
| licenses require that the following notices be preserved. | ||
|
|
||
| ## acronis-tib-reader ("tibread") | ||
|
|
||
| MIT License, Copyright (c) 2026 the tibread contributors | ||
| <https://github.com/TreadingTheTiber/acronis-tib-reader> | ||
|
|
||
| The LSM index engine and the layers built on it. Derived work, by module: | ||
|
|
||
| - `dissect/archive/tibx/lsm.py` — L-SB superblock parsing, the ARCH TLV directory, | ||
| LEAF/LDIR page framing and the cell-stream grammar (`tibread/tibx/lsm.py`, | ||
| `tibread/tibx/lsm_cells.py`) | ||
| - `dissect/archive/tibx/map.py` — `data_map` extent decoding and `segment_map` | ||
| index construction (`tibread/tibx/data_map.py`, `tibread/tibx/segment_map.py`) | ||
| - `dissect/archive/tibx/segment.py` — SG segment header parsing and segment | ||
| decompression (`tibread/tibx/segment.py`) | ||
| - `dissect/archive/tibx/crypto.py` — the wrapped-key blob layout, KEK derivation and | ||
| segment decryption (`tibread/tibx/encryption.py`) | ||
|
|
||
| ## acronis-tibx | ||
|
|
||
| MIT License, Copyright (c) 2026 mniedermaier | ||
|
|
||
| A research project by mniedermaier that is no longer publicly available. It vendored the | ||
| `tibread` engine above and built a container layer, codecs and tooling on top. Derived | ||
| work, by module: | ||
|
|
||
| - `dissect/archive/tibx/c_tibx.py` — the format findings that the structure definitions | ||
| encode | ||
| - `dissect/archive/tibx/page.py` — the 4 KiB page store and superblock/commit-root model | ||
| (`tibx/container.py`) | ||
| - `dissect/archive/tibx/codec.py` — the zstd frame, linked-LZ4 and LSM cell-stream | ||
| decoders (`tibx/codecs.py`) | ||
| - `dissect/archive/tibx/crypto.py` — the SE header and password-to-data-key flow | ||
| (`tibx/crypto.py`) | ||
| - `dissect/archive/tibx/lsm.py`, `dissect/archive/tibx/map.py` — LSM mem-tree (C0) | ||
| reading, merged into the extent and segment-index loaders | ||
| - `dissect/archive/tibx/segment.py` — the `comp=0x0001` (LZ4 / stored) segment variant | ||
| - `tests/_synth.py` — the synthetic archive fixtures | ||
|
|
||
| ## License text | ||
|
|
||
| Both projects above are distributed under the MIT License: | ||
|
|
||
| Permission is hereby granted, free of charge, to any person obtaining a copy | ||
| of this software and associated documentation files (the "Software"), to deal | ||
| in the Software without restriction, including without limitation the rights | ||
| to use, copy, modify, merge, publish, distribute, sublicense, and/or sell | ||
| copies of the Software, and to permit persons to whom the Software is | ||
| furnished to do so, subject to the following conditions: | ||
|
|
||
| The above copyright notice and this permission notice shall be included in all | ||
| copies or substantial portions of the Software. | ||
|
|
||
| THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR | ||
| IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, | ||
| FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE | ||
| AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER | ||
| LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, | ||
| OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE | ||
| SOFTWARE. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,24 @@ | ||
| from __future__ import annotations | ||
|
|
||
| from dissect.archive.tibx.exception import ( | ||
| CorruptArchiveError, | ||
| Error, | ||
| InvalidArchiveError, | ||
| InvalidPasswordError, | ||
| UnsupportedFormatError, | ||
| ) | ||
| from dissect.archive.tibx.stream import TibxVolumeStream | ||
| from dissect.archive.tibx.tibx import TIBX, RecoveryPoint, TibxVolume, find_split_parts | ||
|
|
||
| __all__ = [ | ||
| "TIBX", | ||
| "CorruptArchiveError", | ||
| "Error", | ||
| "InvalidArchiveError", | ||
| "InvalidPasswordError", | ||
| "RecoveryPoint", | ||
| "TibxVolume", | ||
| "TibxVolumeStream", | ||
| "UnsupportedFormatError", | ||
| "find_split_parts", | ||
| ] |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.