Apache Pulsar 3.1.1
2023-10-24
Broker
- Fix incorrect number of read compacted entries #20978
 - Fix message loss during topic compaction #20980
 - Fix get outdated compactedTopicContext after compactionHorizon has been updated #20984
 - Fix compaction subscription delete by inactive subscription check #20983
 - Fix incorrect unack msk count when dup ack a message #20990
 - Fix ModularLoadManagerImpl always delete active bundle-data #20620
 - Use MessageDigest.isEqual when comparing digests #21061
 - Fix can't stop phase-two of compaction even though messageId read reaches lastReadId #20988
 - Make sure all inflight writes have finished before completion of compaction #21067
 - Fix chunked messages will be filtered by duplicating #20948
 - Fix potential case cause retention policy not working on topic level #21041
 - Make read compacted entries support maxReadSizeBytes limitation #21065
 - Remove bundle-data in local metadata store #21078
 - Fix write duplicate entries into the compacted ledger after RawReader reconnects #21081
 - Cleanup correctly heartbeat bundle ownership when handling broker deletion event #21083
 - Avoid splitting one batch message into two entries in StrategicTwoPhaseCompactor #21091
 - Fix unsubscribe non-durable subscription error #21099
 - Fix isolated group not work problem #21096
 - Consider iowait as idle #19110
 - Fix deleting topic not delete the related topic policy and schema #21093
 - Revert remove duplicate topics name when deleteNamespace #21087
 - Improve logs for troubleshooting #21141
 - Fix web tls url null cause NPE #21137
 - Fix unack count when mixing non batch index and batch index acks #21126
 - Backport fix UniformLoadShedder selecet wrong overloadbroker and underloadbroker #21180
 - Fix bug caused by optimistic locking #18390
 - Disable balancing based on DirectMemory #21168
 - Fix replicator leak when removeReplicator in NonPersistentTopic #21205
 - Fixed reset for AggregatedNamespaceStats #21225
 - Fixed produce and consume when anonymousUserRole enabled #21237
 
Pulsar IO and Pulsar Functions
- [FN] Fix ProducerConfig cannot update error #21037
 - [FN] Fix the --batch-builder not working error for functions #21023
 - [FN] Fix functions_log4j2.xml delete strategy config #21215
 - [IO] Fix --retain[-key]-ordering not working error for sink #21060
 
CLI
- [Admin] Fix get topic stats fail if a subscription catch up concurrently #20971
 
Others
- [META] Fix deadlock in AutoRecovery #21010
 - [META] Improve fault tolerance of blocking calls by supporting timeout #21028
 - [META] Improve to the ReplicaitonWorker performance by deleting invalid underreplication nodes #21059
 - [META] Fix metadata store deadlock due to BookkeeperInternalCallbacks.Processor #21159
 - [META] Fix PulsarLedgerUnderreplicationManager notify problem #21161
 - [META] Fix pulsar ledger auditor dead lock problem #21181
 - [ML] Persist mark deleted ops to ZK if create cursor ledger was failed #20935
 - [BK] Improve getIsolationGroup by avoid creating arrayList #20952
 - [BK] Fix RocksDB configuration #21157
 - [Proxy] Support disabling metrics endpoint #21031
 - [Proxy] Fix Proxy 502 gateway error when it is configured with Keystore TLS and admin API is called #21077
 - [TXN] Fix the consumer stuck due to deduplicated messages in pending ack state #21177
 
Library updates
- Bump GRPC version to 1.55.3 to fix CVE #21057
 - Bump broker okio version to 3.4.0 #21064
 - Upgrade bookkeeper to 4.16.3 #21146
 
A special thanks to the following contributors who contributed to Pulsar 3.1.1: mattisonchao, tuteng, poorbarcode, asafm, hanmz, horizonzy, aloyszhang, hrzzzz, thetumbled, hangc0276, zymap, Technoboy-, erobot, liangyepianzhou, Shawyeok, Demogorgon314, TakaHiR07, coderzc, Apurva007, RobertIndie, Crispy-fried-chicken, jiangpengcheng, michaeljmarshall, lifepuzzlefun, AnonHxy, codelipenghui