Feature request: Kafka Event Data Class

[lyoung-confluent]

Use case

When using a Kafka event source either from self-managed Apache Kafka or Amazon MSK there should be a relevant data class for easy iteration/decoding.

Such functionality is implemented already in aws-lambda-go and in aws-lambda-java-libs.

Solution/User Experience

Similar to other streaming data sources a records property should be iterable returning a KafkaEventRecord that transparently decodes the values from JSON:

from aws_lambda_powertools.utilities.data_classes import event_source, KafkaEvent

@event_source(data_class=KafkaEvent)
def handler(event: KafkaEvent, context: LambdaContext):
	for record in event.records:
		print(record.decoded_key, record.json_value)

Alternative solutions

No response

Acknowledgment

• This feature request meets Lambda Powertools Tenets
• Should this be considered in other Lambda Powertools languages? i.e. Java, TypeScript

[boring-cyborg]

Thanks for opening your first issue here! We'll come back to you as soon as we can.

[rubenfonseca]

Thank you so much for the feature request @lyoung-confluent! It makes a lot of sense to cover Kafka events too. We're looking forward to review your PR tomorrow!

[ran-isenberg]

@rubenfonseca i think we should also create a similar parser event for this one. what do you think?

[ran-isenberg]

see also #1499

[github-actions]

This is now released under 1.29.0 version!

[github-actions]

This is now released under 1.29.1 version!