Skip to content

E2E tests don't work on the latest versions of kpt functions #4297

@liamfallon

Description

@liamfallon

Expected behavior

All E2E tests (except tests for migration from old versions) must work on the latest versions of krm functions. It is OK for E2E tests to test multiple versions of krm functions but the latest version must always be tested.

Actual behavior

Many E2E tests break on the latest versions of KRM functions and their krm function versions had to be downgraded in order to get the tests to pass in the work for EPIC: Transfer of kptdev repositories from GoogleContainerTools

Information

The krm functions that do not work on "latest" and are pegged to specific versions are:

  • set-namespace:v0.2.0
  • set-namespace:v0.4.1
  • set-labels:v0.1.5
  • foo:v0.1
  • bar:v0.1
  • drop-comments:v0.1
  • printenv:v0.1

The following is a list of the tests that use the krm function versions above:

e2e/testdata/fn-eval/default-runtime
e2e/testdata/fn-eval/error-in-pipe
e2e/testdata/fn-eval/fn-config-file
e2e/testdata/fn-eval/fn-config-file-in-pkg
e2e/testdata/fn-eval/fn-source/include-meta-resource-out-of-place
e2e/testdata/fn-eval/fn-source/include-meta-resources
e2e/testdata/fn-eval/fnconfig-missing-name
e2e/testdata/fn-eval/function-chain
e2e/testdata/fn-eval/function-env
e2e/testdata/fn-eval/image-pull-policy-always
e2e/testdata/fn-eval/image-pull-policy-if-not-present
e2e/testdata/fn-eval/include-meta-resources
e2e/testdata/fn-eval/include-meta-resources-v1alpha1
e2e/testdata/fn-eval/include-meta-resources-v1alpha2
e2e/testdata/fn-eval/invalid-fn-config-file
e2e/testdata/fn-eval/krm-check-exclude-kustomize
e2e/testdata/fn-eval/missing-fn-config
e2e/testdata/fn-eval/missing-fn-image
e2e/testdata/fn-eval/multiple-fn-config-one-file
e2e/testdata/fn-eval/no-op
e2e/testdata/fn-eval/non-krm-resource
e2e/testdata/fn-eval/out-of-place-dir
e2e/testdata/fn-eval/out-of-place-dir-exists-error
e2e/testdata/fn-eval/out-of-place-fnchain-stdout
e2e/testdata/fn-eval/out-of-place-fnchain-unwrap
e2e/testdata/fn-eval/output-to-stdout
e2e/testdata/fn-eval/preserve-comments
e2e/testdata/fn-eval/preserve-order-include-meta-resources
e2e/testdata/fn-eval/preserve-order-null-values
e2e/testdata/fn-eval/save-fn/custom-pkg-path
e2e/testdata/fn-eval/save-fn/image
e2e/testdata/fn-eval/save-fn/match-selector
e2e/testdata/fn-eval/save-fn/no-save-when-fail
e2e/testdata/fn-eval/save-fn/override-fn
e2e/testdata/fn-eval/save-fn/preserve-kptfile-comments
e2e/testdata/fn-eval/save-fn/validator-type
e2e/testdata/fn-eval/selectors/basicpipeline
e2e/testdata/fn-eval/selectors/exclude
e2e/testdata/fn-eval/selectors/out-of-place-fnchain-unwrap
e2e/testdata/fn-eval/selectors/selectors-with-exclude
e2e/testdata/fn-eval/short-image-path
e2e/testdata/fn-eval/simple-function
e2e/testdata/fn-eval/simple-function-symlink
e2e/testdata/fn-eval/subpkg-exclude-fn-config-by-default
e2e/testdata/fn-eval/subpkg-has-samename-subdir
e2e/testdata/fn-eval/subpkg-include-meta-resources
e2e/testdata/fn-eval/subpkgs
e2e/testdata/fn-eval/subpkgs-with-krmignore
e2e/testdata/fn-eval/wasm-function
e2e/testdata/fn-render/all-resource-deletion
e2e/testdata/fn-render/basicpipeline
e2e/testdata/fn-render/basicpipeline-out-of-place
e2e/testdata/fn-render/basicpipeline-symlink
e2e/testdata/fn-render/basicpipeline-v1alpha2
e2e/testdata/fn-render/basicpipeline-wasm
e2e/testdata/fn-render/default-runtime
e2e/testdata/fn-render/fn-failure
e2e/testdata/fn-render/fnconfig
e2e/testdata/fn-render/fnconfig-ancestorfn-not-mutate-subpkg-config
e2e/testdata/fn-render/fnconfig-cannot-refer-subpkgs
e2e/testdata/fn-render/fnconfig-in-subdir
e2e/testdata/fn-render/fnconfig-missing-name
e2e/testdata/fn-render/fnconfig-multiple-config-one-file
e2e/testdata/fn-render/fnconfig-not-relative
e2e/testdata/fn-render/fnconfig-outside-package
e2e/testdata/fn-render/fnconfig-pkgfn-refers-subdir
e2e/testdata/fn-render/fnconfig-updated-in-render
e2e/testdata/fn-render/format-on-success
e2e/testdata/fn-render/generator
e2e/testdata/fn-render/image-pull-policy-always
e2e/testdata/fn-render/image-pull-policy-if-not-present
e2e/testdata/fn-render/invalid-configmap-fnconfig
e2e/testdata/fn-render/invalid-inline-fnconfig
e2e/testdata/fn-render/kptfile-unknown-fields
e2e/testdata/fn-render/krmignore
e2e/testdata/fn-render/missing-fn-image
e2e/testdata/fn-render/missing-fnconfig
e2e/testdata/fn-render/multiple-fnconfig
e2e/testdata/fn-render/mutate-path-index
e2e/testdata/fn-render/no-fnconfig
e2e/testdata/fn-render/no-format-on-failure
e2e/testdata/fn-render/no-op
e2e/testdata/fn-render/no-pipeline-in-subpackage
e2e/testdata/fn-render/non-krm-resource
e2e/testdata/fn-render/out-of-place-dir
e2e/testdata/fn-render/out-of-place-dir-exists-error
e2e/testdata/fn-render/out-of-place-fnchain-stdout
e2e/testdata/fn-render/out-of-place-fnchain-stdout-results
e2e/testdata/fn-render/out-of-place-fnchain-unwrap
e2e/testdata/fn-render/out-of-place-stdout
e2e/testdata/fn-render/out-of-place-unwrap
e2e/testdata/fn-render/preserve-comments
e2e/testdata/fn-render/preserve-order-null-values
e2e/testdata/fn-render/resource-deletion
e2e/testdata/fn-render/selectors/basicpipeline
e2e/testdata/fn-render/selectors/exclude
e2e/testdata/fn-render/selectors/generator
e2e/testdata/fn-render/selectors/selectors-with-exclude
e2e/testdata/fn-render/short-image-path
e2e/testdata/fn-render/subpkg-fn-failure
e2e/testdata/fn-render/subpkg-has-invalid-kptfile
e2e/testdata/fn-render/subpkg-has-samename-subdir
e2e/testdata/fn-render/subpkg-resource-deletion
e2e/testdata/fn-render/subpkgs
e2e/testdata/fn-render/subpkgs-with-krmignore
e2e/testdata/fn-render/success-stdout
e2e/testdata/fn-render/validator-mutates-resources

Steps to reproduce the behavior

Run any of the tests on the list above with the latest versions of any of the above krm functions to observe the tests failing.

Metadata

Metadata

Assignees

No one assigned

    Labels

    TestingbugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions