Skip to content

Add 2-byte pair lookup table to skip hashmap for initial BPE merge scan#551

Open
augustasio wants to merge 2 commits into
openai:mainfrom
augustasio:pair-table-optimization
Open

Add 2-byte pair lookup table to skip hashmap for initial BPE merge scan#551
augustasio wants to merge 2 commits into
openai:mainfrom
augustasio:pair-table-optimization

Commits

Commits on May 22, 2026