Skip to content

[CDAP-21242] Add optimized Pipeline Summary API endpoint#16115

Open
bhardwaj-priyanshu wants to merge 1 commit into
developfrom
feature/summary-api
Open

[CDAP-21242] Add optimized Pipeline Summary API endpoint#16115
bhardwaj-priyanshu wants to merge 1 commit into
developfrom
feature/summary-api

Conversation

@bhardwaj-priyanshu
Copy link
Copy Markdown
Contributor

@bhardwaj-priyanshu bhardwaj-priyanshu commented Apr 29, 2026

This PR introduces a new endpoint GET /v3/namespaces/{namespace}/apps/summary (Pipeline Summary API) to retrieve a summary of applications in a namespace. This endpoint is specifically optimized to return basic metadata, total run counts, and the latest run record while avoiding the heavy performance cost of full deserialization of application specifications.

Key Changes

  • API Endpoint: Added /apps/summary in ProgramLifecycleHttpHandler with support for filtering by artifact name, version, and application name, as well as pagination.
  • Performance Optimization: Implemented a streaming JSON parser in AppMetadataStore.AppScanEntry.getAppSummary() to extract only the necessary fields (artifact ID, description, and primary program) from the raw application metadata stored in the database.
  • Data Aggregation: Added logic in ProgramLifecycleService to batch-fetch total run counts and the latest run record for all visible programs in the page, avoiding N+1 queries.

Tesing

  • Added UTs
  • Tested different queries by deploying the code
image

Next Steps

  • Add next run time and tags in the summary API response

@bhardwaj-priyanshu bhardwaj-priyanshu self-assigned this Apr 29, 2026
@bhardwaj-priyanshu bhardwaj-priyanshu added the build Triggers github actions build label Apr 29, 2026
@sonarqubecloud
Copy link
Copy Markdown

@bhardwaj-priyanshu bhardwaj-priyanshu marked this pull request as ready for review April 30, 2026 05:44
@bhardwaj-priyanshu bhardwaj-priyanshu changed the title Add optimized Pipeline Summary API endpoint [CDAP-21242] Add optimized Pipeline Summary API endpoint Apr 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

build Triggers github actions build

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant