feat(connector): add Lever data-source connector - #215
Open
saurabh-itg wants to merge 1 commit into
Open
saurabh-itg wants to merge 1 commit into
saurabh-itg wants to merge 1 commit into
Conversation
Adds packages/connector/lever: a document-mode dlt source that syncs Lever job postings and, opt-in, interview feedback and notes into cognee. - Auth: Lever API key (HTTP Basic, read-only GETs) - Incremental sync via updated_at_start, cursor kept in dlt resource state - Forget-on-delete via /postings/deleted (<=29-day windows) and /opportunities/deleted, plus tombstones for records leaving scope - Candidate data restricted by default: feedback/notes are opt-in and never carry candidate contact data; secret notes and confidential records skipped - Tests: rendering, cursor, delete feeds, retries, restricted-data guarantees, real dlt merge, and a cognee.add forget-on-delete run Closes topoteretes/cognee#4799
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds a new document-mode dlt source for Lever that syncs job postings into Cognee, with optional support for interview feedback and notes.
The source uses the Lever API with a read-only API key and supports incremental syncing using updated_at_start, with the sync cursor persisted through dlt resource state. It also handles deletions through Lever's /postings/deleted and /opportunities/deleted endpoints, including tombstones for records that are no longer within the configured sync scope.
Candidate-related data is intentionally restricted. Feedback and notes are opt-in, and the source does not include candidate contact information. Secret notes and confidential records are skipped.
The test coverage includes:
dlt resource rendering and cursor/state handling
deletion feeds and tombstones
API retry behaviour
restricted candidate-data handling
real dlt merge behaviour
end-to-end cognee.add with forget-on-delete
Closes topoteretes/cognee#4799