Ensuring Reliability: Acknowledgements and Retention

Implement a consumer acknowledgment mechanism where consumers confirm message processing.

Update the consumer group coordinator to commit a consumer's offset only upon receiving an acknowledgment.

Implement a redelivery mechanism for messages that are not acknowledged within a configured timeout.

Implement a size-based log retention policy to clean up old log segments.

Implement a time-based log retention policy to clean up old log segments.