Skip to content

Handle long log lines from scrapers and plugins - #7171

Open
Maista6969 wants to merge 1 commit into
stashapp:developfrom
Maista6969:handle-long-log-lines
Open

Handle long log lines from scrapers and plugins#7171
Maista6969 wants to merge 1 commit into
stashapp:developfrom
Maista6969:handle-long-log-lines

Conversation

@Maista6969

Copy link
Copy Markdown
Contributor

Description

This changes the logging infrastructure used by scrapers and plugins to handle log lines that exceed 64KB by replacing the bufio.Scanner with a bufio.Reader that reads their stderr in chunks. I could have raised the buffer size on the bufio.Scanner but that would just be moving the breakpoint instead of fixing the core issue.

Related Issue

Resolves #7170

Testing

I have added a small test that exercises the fix and there is no change in behavior that scrapers or plugins need to be aware of.

Checklist

  • I have read and understood the Contributing document.
  • I have read and understood the AI Usage Policy document.
  • I have made corresponding changes to the documentation (if applicable).

AI Usage Disclosure

  • I have used AI tools to assist with this pull request, and I have disclosed the tools and how I used them below.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Plugins and scrapers break on long log lines

1 participant