Skip to content Skip to sidebar Skip to footer
Showing posts with the label Apache Kafka
How To Connect Python Consumer To Aws Msk

How To Connect Python Consumer To Aws Msk

Post a Comment
I'm trying to connect my python consumer to AWS MSK cluster. how can I do that? Have an AWS MSK… Read more How To Connect Python Consumer To Aws Msk
How To Consume Messages Using Beam's External Kafka Transform (locally)

How To Consume Messages Using Beam's External Kafka Transform (locally)

Post a Comment
I am trying to run an app that uses a kafka producer (Python client), and an apache beam pipeline t… Read more How To Consume Messages Using Beam's External Kafka Transform (locally)
Not Able To Access Messages From Confluent Kafka On Ec2

Not Able To Access Messages From Confluent Kafka On Ec2

Post a Comment
Confluent Kafka 5.0.0 has been installed on AWS EC2 which has Public IP say 54.XX.XX.XX Opened port… Read more Not Able To Access Messages From Confluent Kafka On Ec2
Kafka-python Read From Last Produced Message After A Consumer Restart

Kafka-python Read From Last Produced Message After A Consumer Restart

Post a Comment
i am using kafka-python to consume messages from a kafka queue (kafka version 0.10.2.0). In particu… Read more Kafka-python Read From Last Produced Message After A Consumer Restart
Kafka Consumer Losing State Of Messages After Shutdown

Kafka Consumer Losing State Of Messages After Shutdown

Post a Comment
Thanks for taking time to answer the question. I am using kafka with a python consumer. Everything … Read more Kafka Consumer Losing State Of Messages After Shutdown
Spark Streaming: Read Csv String From Kafka, Write To Parquet

Spark Streaming: Read Csv String From Kafka, Write To Parquet

Post a Comment
There are lots of online examples of reading json from Kafka (to write to parquet) - but I cannot f… Read more Spark Streaming: Read Csv String From Kafka, Write To Parquet