feat: add partition artifacts for external vector backends#6463

Xuanwo wants to merge 22 commits intomainlance-format/lance:mainfrom

xuanwo/partition-artifact-backendlance-format/lance:xuanwo/partition-artifact-backendCopy head branch name to clipboard