Skip to content

Conversation

@ulemons
Copy link
Contributor

@ulemons ulemons commented Dec 3, 2025

PR: Dashboard Total Metrics Sink + Kafka Connect Image Update

Overview

This pull request introduces improvements to the data pipeline and infrastructure stability:

🚀 Changes

  • Added a new sink pipeline to aggregate and expose total dashboard metrics
  • Updated the Kafka Connect Docker image to a more reliable and compatible version

Note

Introduces a Tinybird sink to compute and publish global dashboard metrics.

  • New cdp_segment_metrics_total_sink.pipe with nodes aggregating activitiesTotal/activitiesLast30Days, membersTotal/membersLast30Days, and organizationsTotal/organizationsLast30Days using cdp_member_segment_aggregates_MV and cdp_organization_segment_aggregates_MV
  • Activities derived from latest activityRelations_enriched_deduplicated_ds snapshot; last-30-day filters applied via timestamp/lastActive
  • Exports as Kafka sink: connection lfx-oracle-kafka-streaming, topic cdp_dashboard_metrics_total_sink, schedule 0 9 * * *, format json, strategy @new

Written by Cursor Bugbot for commit 6cf808b. This will update automatically on new commits. Configure here.

@ulemons ulemons self-assigned this Dec 3, 2025
@ulemons ulemons added the Feature Created by Linear-GitHub Sync label Dec 3, 2025
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Conventional Commits FTW!

@ulemons ulemons changed the title Feat/add sink dashboard metrics feat: add sink dashboard metrics (CM-811) Dec 3, 2025
@ulemons ulemons marked this pull request as ready for review January 7, 2026 09:36
@ulemons ulemons requested a review from epipav January 9, 2026 15:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Feature Created by Linear-GitHub Sync

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants