Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Processor instance per data type #10664

Closed

Conversation

djaglowski
Copy link
Member

@djaglowski djaglowski commented Jul 18, 2024

This is a proof of concept implementation for what it would look like to instantiate processors on a per data type basis, as opposed to the current behavior which is per pipeline. See #10534 for detailed discussion about this idea.

This would mean that we treat processors more like receivers and exporters.

  1. The top-level processors section in the config is no longer conceptually different than that of the top-level receivers and exporters sections, meaning that all three would treat each configuration as a declaration of an instance, rather than treating processor configurations as a declaration of an abstract configuration.
  2. Data streams can flow across pipelines in between processors, instead of only immediately after receivers and immediate before exporters.

While I don't consider this PR complete, I want to put it up for review to demonstrate that it's not a terribly complicated implementation change. If this functionality were to move forward I would expect that it is behind a feature gate and accompanied by documentation.

Copy link

codecov bot commented Jul 18, 2024

Codecov Report

Attention: Patch coverage is 96.42857% with 1 line in your changes missing coverage. Please review.

Project coverage is 92.33%. Comparing base (2449345) to head (77734e9).
Report is 138 commits behind head on main.

Files Patch % Lines
service/internal/graph/nodes.go 95.00% 1 Missing ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##             main   #10664   +/-   ##
=======================================
  Coverage   92.33%   92.33%           
=======================================
  Files         403      403           
  Lines       18734    18746   +12     
=======================================
+ Hits        17298    17310   +12     
  Misses       1076     1076           
  Partials      360      360           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

github-actions bot commented Aug 6, 2024

This PR was marked stale due to lack of activity. It will be closed in 14 days.

Copy link
Contributor

Closed as inactive. Feel free to reopen if this PR is still being worked on.

@github-actions github-actions bot closed this Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant