Back to Designs page

Table of Contents

Related Research

No research entries have been linked to this design.

Connector messages processed

Yubo Xing avatar

Author: Yubo Xing | Last edit: May 24, 2023 | Design type: Metrics | Product area: Kafka

Overview

Messages processed for Connectors provide detailed information about the error/success statistics that provide a count of how many messages were successful and how many had error messages when an error handler is defined, so they can determine if any action is needed to address failed messages.


Context

Three error handling options exist: Stop, Ignore, and Dead letter queue for Connectors. Error handling options allow a user to decide what happens when a message fails in a running instance.

From  Epic, we could know that after error handling is defined, users need to be able to see details about the number of message failures. Let’s say a user chooses an error handling strategy of sending errors to a Dead letter queue. If the message can’t be sent to the designated topic because of an error, this message will be sent to a DLQ (essential kafka topic). The connector will continue to work on sending the next set of messages.


Processed messages — table

The column that displays metrics for the processed messages presents an info popover that includes all details about this concept.

The metric shows both the indicating icons and the number of messages.


Processed messages — Drawer

The card that includes processed messages statistics is under the tab in order to highlight the statistics, the text inside the card is 2xl.

This final design for message statistics is being determined following the POC created from MGDCTRS-1848   


Processed messages — Overview