Thursday 15 April 2010

java - Retaining data in Apache Kafka -



java - Retaining data in Apache Kafka -

i have started reading apache kafka few days sort of newbie in technology. have doubts/queries , need clarification. such as:

as per configuration: log.retention.hours can set duration in hours here. can info retention time extended 2 years ?

as per link says:

the kafka cluster retains published messages—whether or not have been consumed—for configurable period of time. illustration if log retention set 2 days, 2 days after message published available consumption, after discarded free space. kafka's performance constant respect info size retaining lots of info not problem.

as says perfomance constant respect info size. mean can store info much possible ? require additional configuration or monitor ?

1) sure. log.retention.hours integer. 2 years 17520 hours. below maximal value integer.

2) can store much info fit in disks have. note while kafka's performance not degrade if store more data, consumer seek massive amounts of info disk absolutely impact performance. best performance create sure consumer read relatively recent info while still retained in memory.

java apache-kafka

No comments:

Post a Comment