• fix issues about subqueries

This version fixes the following bugs.

Bug Fix

• fix(clickhousech@m-5284220525): defend against empty txn.
• fix(clickhousech@m-5258695035): turn off enable push topn through projection cnch dev
• fix(optimizer@m-5285119002): fix PredicatePushdown convert filter to join condition don't check mysql dialect type cnch-dev
• fix(clickhousech@m-5283670005): optimize unique index remote reading
• fix(clickhousech@m-5267391009): add prewhere blacklist cnch dev
• fix(optimizer@m-3798696696): statistics and explain support tenant_id and RBAC
• fix(clickhousech@m-5266987651): avoid generating two mutation entries in one ALTER query
• fix(clickhousech@m-5260405054): Fix ub in gin store factory
• fix(clickhousech@m-4711068146): support query forwarding for multiple tables select
• fix(clickhousech@m-4789676157): enable optimizer in ctas by default
• fix(clickhousech@m-5161178137): add new SET_SENSITIVE permission
• fix(clickhousech@m-4789419711): compatible bug about dedup stage 2.0
• fix(clickhousech@m-4670739530): minor fix ALTER & take effect of the settings from format factory for CnchKafka
• fix(clickhousech@m-5165672531): disk cache preload pool shutdown when exception
• fix(clickhousech@m-4874782005): „ÄêCP„Äëfix cancel by exchange cause early finish for cache
• fix(clickhousech@m-4970037630): fix recv noexcept core
• fix(clickhousech@m-3000709386): [cp fix] partial update for cnch unique table
• fix(clickhousech@m-4812090122): [cp]detach/drop staged partition command bug
• fix(clickhousech@m-4770366732): async delete for UB in multi-table TR.
• fix(clickhousech@m-4831876340): Support delay inverted index mark range filter till pipeline execution
• fix(clickhousech@m-4872683017): make max_server_memory_usage_to_ram_ratio consistent
• fix(optimizer@m-3005450618): fix explain cnch-dev
• fix(clickhousech@m-14513273): join support null aware equals cnch dev
• fix(clickhousech@m-4716961525): Preload gin into memory
• fix(clickhousech@m-4789406700): fix several bugs in source prune
• fix(clickhousech@m-4505484237): fix NvmCache UT
• fix(clickhousech@m-4691925668): scheduler will send progress during scheduling under bsp mode
• fix(clickhousech@m-4420282579): [cp & resolve] delay loadDataParts in sendResources
• fix(clickhousech@m-4872376514): undobuffer clean can't find history disk name should throw exception
• fix(clickhousech@m-4872376514): undobuffer clean can't find history disk name
• fix(clickhousech@m-4770366732): resolve live lock in txn cleaner w/ multi table.
• fix(clickhousech@m-4789434239): set correct relative path for UndoResourceType::Part
• fix(clickhousech@m-5165139004): sd local mode will lead to falsely deleting TR.
• fix(clickhousech@m-5034997189): fix compatability with clickhouse client after version 23.8
• fix(clickhousech@m-4656101775): add settings to not return nullable array
• fix(clickhousech@m-4691924501): more aggressive search that only regress after a whole round.
• fix(clickhousech@m-4789678206): Fix leak in SimpleState function (due to recrusive reference)
• fix(clickhousech@m-4789434239): set correct relative path for UndoResourceType::Part
• fix(clickhousech@m-4812137604): fix bitmapColumnCardinality miss partial agg cnch 2.2
• fix(optimizer@m-4770066004): add UnifyNullableType for AddBufferForDeadlockCTE cnch-2.2
• fix(clickhousech@m-4717110049): fix hualloc cache size set properly
• fix(clickhousech@m-4724042591):fix sendResource parse object column schema forward compatibility
• fix(clickhousech@m-4770366732): DM scan TR in a round-robin way.
• fix(clickhousech@m-4691925668): Merge 'bsp-schedule-send-progress' into 'cnch-2.2'
• fix(clickhousech@m-4770368288): add timeout for sendCreateQuery
• fix(clickhousech@m-4691886549): [TO CHCH-2.2] fix hybrid allocation bug when query multiple tables[2]
• fix(clickhousech@m-4679209062): [cp] flatten parts after calculating new part names
• fix(clickhousech@m-4717110049): fix hualloc config reload
• fix(clickhousech@m-4691895692): „ÄêCP„Äëfix cache core for reorder
• fix(optimizer@m-4717122209): statistics_expand_to_current handle only tail of histogram
• fix(clickhousech@m-4770113765): fix interpreter optimizer execute nullptr cnch 2.2
• fix(clickhousech@m-4656018162): [cp] cnch 2.2 fix map comparision
• fix(clickhousech@m-4679216622): [cp] fix some issues in catalog v2
• fix(clickhousech@m-4724154113): fix in subquery no super type error cnch 2.2
• fix(clickhousech@m-4679236657):[To CNCH-2.2] Fix tos error message when using compression or result empty
• fix(clickhousech@m-4731013521): pin to 21.8.7.1 to make it compatible.
• fix(clickhousech@m-4671091203): implicit cast for subcolumn cnch 2.2
• fix(clickhousech@m-4052801080): optimizer respect mysql implicit cast rules cnch 2.2
• fix(clickhousech@m-4724047605): [CP to 2.2]fix reserved inode not been released
• feat(clickhousech@m-4675508046): fix issues for connecting from PowerBI via MySQL protocol [CP]
• fix(clickhousech@m-4716941540): [CP to 2.2]fix parts assign table settings failed
• fix(clickhousech@m-4716918150): only async mv support tenant id settings
• fix(clickhousech@m-4691623503): [cp 2.2] make sure clean outdated txn for GC
• fix(optimizer@m-4679217588): fix symbol transform
• fix(clickhousech@m-4711215564): Merge 'fix-getBatchTaskToSchedule' into 'cnch-2.2'
• fix(optimizer@m-4711238875): fix static ast visitor
• fix(clickhousech@m-4711213091): Change index cache default argument
• fix(clickhousech@m-4691623503): [cp] fix active txn list leak for CTAS
• fix(clickhousech@m-3594234201): Fix calculating of intersection of access rights
• fix(clickhousech@m-17322645): Fix sensitive permission
• fix(clickhousech@m-4691886549): [TO CHCH-2.2] fix hybrid allocation bug when query multiple tables
• fix(clickhousech@m-4711548586): [CP to 2.2]support preload for attach operation
• fix(clickhousech@m-3000759214):fix lc(nullable(string)) as get_json_object arg
• fix(clickhousech@m-4692133136): [cp cnch-2.2] minor fix reloadFormatSchema to support cfs
• fix(clickhousech@m-4678891507): [cp] cnch 2.2 fix try get map implicit column
• fix(clickhousech@m-4675484022): [cp]fix wrong database name in loadDictsForCnchServer
• fix(optimizer@m-4674753509): MultipleDistinctAggregationToMarkDistinct supports count distinct with multi columns cnch-2.2
• fix(clickhousech@m-4677211522): improve performance for cityHash64V2 handling nullable type
• fix(clickhousech@m-4676838541): [cp] avoid coredump when disk is full
• fix(optimizer@m-4676553539): fix share common plan node coredump or identifier resolve error for join cnch-2.2
• fix(clickhousech@m-4209994537): fix mysql having name resolution for agg cnch 2.2
• fix(clickhousech@m-4678887102): add obsolete setting funnel_old_rule
• fix(clickhousech@m-4675985170): [To cnch-2.2] Make gzip compression ends with 'gz'
• fix(clickhousech@m-4679215614): [cp-cnch-2.2] bugfix the delete flag column may cannot be correctly initialized
• fix(optimizer@m-4086569214): Fix create view with settings
• fix(clickhousech@m-4675551081): add settings max_in_value_list_to_pushdown
• fix(clickhousech@m-4675644088): defend against empty tables_with_columns.
• fix(optimizer@m-4655162137): log json format query plan into query_log system table
• fix(clickhousech@m-4656097116): cancel from client
• fix(clickhousech@m-4655150073): fix StrictResizeProcessor losing chunks
• fix(clickhousech@m-4676540004): [cp] cnch 2.2 fix read map and map key with 0 rows
• fix(clickhousech@m-4548841616): Adjust MySQL DDL rewrite 2.2
• fix(clickhousech@m-4505469713): fix incorrect value for the table_type column in information_schema.tables [CP]
• fix(clickhousech@m-4676475056): Merge 'disable-row-policy-in-worker' into 'cnch-2.2'
• fix(clickhousech@m-4649412027):fix non-host server optimize merge json table
• fix(clickhousech@m-4675847030): Fix BRPC Deadlock 2.2
• fix(clickhousech@m-4656104342): Merge 'fix-send-dummy-source-session-expire' into 'cnch-2.2'
• fix(clickhousech@m-4655931866): [cp 2.2] minor fix for msyql compatibility
• fix(optimizer@m-4675314011): explain metadata output OutputDescriptions
• fix(clickhousech@m-4675069041): use reference in resource filtering
• fix(clickhousech@m-4655966539): Fix inverted index with mvcc part
• fix(optimizer@m-4674652509): fix unstable row count
• fix(optimizer@m-4670748330): fix multi distinct property
• fix(clickhousech@m-4505531776): Disable logical expression optimizer for expression with aliases. #47451
• fix(clickhousech@m-4671125918): hll memory leak
• fix(optimizer@m-4548822622): QueryAnalyzer process join_use_nulls
• fix(clickhousech@m-4616855063): [cp 2.2] fix bytes_on_disk for CNCH part
• fix(clickhousech@m-4549346716): [cp] minor fixes for merge mutation
• fix(optimizer@m-4549369693): cherry-pick 2 fixes from ce-dev
• fix(clickhousech@m-4505503868): remove mv materialized column check during create table
• fix(optimizer@m-4655932058): fix share common plan node for join cnch-2.2
• fix(optimizer@m-4619270650): optimizer ban some function with subquery
• fix(clickhousech@m-4655288004): fix unknown func [cp2.2]
• fix(clickhousech@m-4619222763): fix alter materialized view core and view tables type mismatch
• fix(optimizer@m-4655303703): prepared statement support array type
• fix(clickhousech@m-4548795671): [cp] fix high cpu when attaching parts/partitions
• fix(clickhousech@m-4649517515): [cp] fix aeolus check exception
• fix(optimizer@m-4548778590): fix makeSetsForIndex don't support subcolumns cnch-2.2
• fix(clickhousech@m-4656089224): [CP to 2.2]disk cache & preload performace
• fix(clickhousech@m-4655971924): [cp] fix server core at unknown bg thread type
• fix(clickhousech@m-4505967287): [cp]core bug in destructor of LockHolder
• fix(optimizer@m-3010175307):prepared statement catalog
• fix(clickhousech@m-4502944525): [cp]minor fix and optimization about preattach partition
• fix(optimizer@m-4656096097): m...

Feature

feat(clickhousech@m-3672686692) [cp-cnch2.1] 1.small keys support agg two level 2.countD agg state memory size estimation
feat(clickhousech@m-3011045309) [CP to 2.1]CnchMergeTree support bytecool part move parser
feat(clickhousech@m-3460318692) make max_bytes_to_read_local respect max_bytes_to_read_leaf,See merge request:
feat(clickhousech@m-3000999997) 【CP】refine log,See merge request dp/ClickHouse!21098
feat(clickhousech@m-3086283635) [cp cnch-2.1] introduce sample consuming function for CnchKafka,See merge request:
feat(optimizer@m-3000286965) remove redundant cast,See merge request:
feat(clickhousech@m-3348298112) Ingest with bucket,See merge request dp/ClickHouse!20774
feat(clickhousech@m-3404807508) [CNCH] memory control on joined block
feat(clickhousech@m-11932130) ProfileEvent for prewhere
feat(clickhousech@m-3011597342) [cp]add function sparkHashSimple to align with Spark,See merge request:
feat(clickhousech@m-5301115) rpc client base brpc timeout should read config,See merge request dp/ClickHouse!20862
feat(clickhousech@m-17104648) send progress in optimizer mode
feat(clickhousech@m-3672686692) [cp-cnch2.1] 1.small keys support agg two level 2.countD agg state memory size estimation,See merge request:
feat(clickhousech@m-3156389534) filter delete bitmap with bucket number.,See merge request:
feat(clickhousech@m-3000207505) limit the size of or expressions to pushdown to prewhere,See merge request dp/ClickHouse!21189
feat(clickhousech@m-3460336453) [cp]support BitMap64 type with Parquet format,See merge request:
feat(clickhousech@m-3011045309) [CP to 2.1]CnchMergeTree support bytecool part move parser
feat(clickhousech@m-3460318692) make max_bytes_to_read_local respect max_bytes_to_read_leaf,See merge request:
feat(clickhousech@m-3000999997) 【CP】refine log,See merge request dp/ClickHouse!21098
feat(clickhousech@m-3086283635) [cp cnch-2.1] introduce sample consuming function for CnchKafka,See merge request:
feat(optimizer@m-3000286965) remove redundant cast,See merge request:
feat(clickhousech@m-3348298112) Ingest with bucket,See merge request dp/ClickHouse!20774
feat(clickhousech@m-3404807508) [CNCH] memory control on joined block
feat(clickhousech@m-11932130) ProfileEvent for prewhere
feat(clickhousech@m-3011597342) [cp]add function sparkHashSimple to align with Spark,See merge request:
feat(clickhousech@m-5301115) rpc client base brpc timeout should read config,See merge request dp/ClickHouse!20862
feat(clickhousech@m-17104648) send progress in optimizer mode
feat(clickhousech@m-3347623183) add udaf fastPrevAuc2 to handle the miduim results for fastAuc2,See merge request dp/ClickHouse!20731
feat(clickhousech@m-3265377520) do not show information for system tables without rbac check,See merge request dp/ClickHouse!20474
feat(clickhousech@m-3346761095) unique table support append mode
feat(clickhousech@m-3032987723) set default bsp max_disk_bytes to 500GB, cp to 2.1
feat(clickhousech@m-3086277560) Merge branch 'exchange_nullable_mr' into 'cnch-dev',See merge request dp/ClickHouse!20298
feat(clickhousech@m-3057426540) Handle data overflow [CP],See merge request:
feat(clickhousech@m-17242353) Bucket size check && support alias column,See merge request:
feat(clickhousech@m-3033040206) Add hdfs lock to concurrent outfile to the same file,See merge request dp/ClickHouse!20493
feat(clickhousech@m-3015140583) Close Lazy seek for hdfs,See merge request dp/ClickHouse!20064
feat(clickhousech@m-3001107627) [To cnch-dev] Support outfile into directory,See merge request dp/ClickHouse!19462
feat(clickhousech@m-3012525130) KV Rbac performance optimization for granting lots of query to one user. Also fix a coredump and dead lock,See merge request:
feat(clickhousech@m-3018479788) remove empty timezone check
feat(clickhousech@m-3012443441) [cp]enable write part parallel,See merge request dp/ClickHouse!20010
feat(clickhousech@m-3012490495) enable retry by default,See merge request dp/ClickHouse!19977
feat(clickhousech@m-3000222376) make columns nullable by default under mysql,See merge request dp/ClickHouse!19668
feat(clickhousech@m-3012443441) [cp]enable write part parallel
feat(clickhousech@m-3012490495) enable retry by default
feat(clickhousech@m-3000222376) make columns nullable by default under mysql
feat(clickhousech@m-3011135086) support state function no shuffle
feat(clickhousech@m-3011521757) Hive support cluster by filtering,See merge request dp/ClickHouse!19840
feat(clickhousech@m-3011528179) support additional-services for fulltext search.

Bug Fix

fix(clickhousech@m-3892779614) profile events are logged even exception is thrown,See merge request dp/ClickHouse!21513
fix(clickhousech@m-3106204787) [cp] add setting storage_dialect_type and use it for key expressions,See merge request:
fix(clickhousech@m-3813624009) block concurrent RBAC accesses for the same user,See merge request dp/ClickHouse!21473
fix(clickhousech@m-3856683587) Mysql Default Text Case Roll Back 2.1,See merge request dp/ClickHouse!21457
fix(clickhousech@m-3594280570) [cp]lock manager bug and support system commands,See merge request:
fix(clickhousech@m-3156347174) [TO CNCH2.1] Reduce S3 API invoke in merge process,See merge request:
fix(clickhousech@m-3460298109) gc scan in a round-robin way.,See merge request:
fix(optimizer@m-3265514516) close optimizer fallback,See merge request dp/ClickHouse!21350
fix(clickhousech@m-3813624009) Rbac notify fix 2.1,See merge request dp/ClickHouse!21425
fix(optimizer@m-3652546032) In func partition prune,See merge request:
fix(clickhousech@m-3260650011) [cp] fix cache inconsistency issues,See merge request:
fix(clickhousech@m-3359728725) Fix bug with LowCardinality in short-curcuit function evaluation Closes #1301,See merge request:
fix(clickhousech@m-3798655921) Remove constraint unique from unique key,See merge request dp/ClickHouse!21392
fix(clickhousech@m-3782687661) fix mybatis connection[cp],See merge request:
fix(clickhousech@m-3158825186) [cp] skip bad ttl when doing partition gc,See merge request:
fix(optimizer@m-3645281049) fix rm redundant distinct,See merge request dp/ClickHouse!21323
fix(optimizer@m-15069680) optimizer support final sample
fix(clickhousech@m-3671852025) forwarding once
fix(clickhousech@m-3000927742) fix lowCardinalityIsNoneEncoded in filter
fix(clickhousech@m-3000736999) close optimize_rewrite_sum_if_to_count_if
fix(optimizer@m-14637742) optimizer remove sample check
fix(clickhousech@m-3460291004) move setUser to async thread
fix(clickhousech@m-3671827753) [cp] Make sure cluster_status set to 0 after modify cluster by
fix(clickhousech@m-3671861263) fixed conjunct the where and prewhere in getFilterFromQueryInfo
fix(clickhousech@m-3595136086) skip access storage when enable_skip_non_cnch_tables_for_cnch_trash_items is enabled.
fix(clickhousech@m-3671907062) [cp] Fix cleanUndoBuffers logic for DaemonJobTxnGC to let it works well with write_undo_buffer_new_key,See merge request:
fix(clickhousech@m-3000662130) prevent from acquire RWlock recursively,See merge request:
fix(clickhousech@m-3460250027) not select partition key as prewhere cnch 2.1,See merge request:
fix(clickhousech@m-3651696533) fix toDateOrNull core cnch 2.1,See merge request dp/ClickHouse!21159
fix(clickhousech@m-3595066568) fix arrayjoin performance slow with optimizer,See merge request:
fix(clickhousech@m-3018479783) Allow extra argument for toString,See merge request:
fix(optimizer@m-3310530537) fix cte property explore with broadcast cnch-2.1,See merge request:
fix(clickhousech@m-3459432705) [cp] fix rollback of detach partition,See merge request:
fix(clickhousech@m-3595158575) fix report root cause,See merge request:
fix(clickhousech@m-3158769174) [cp cnch-dev] change the order of loading index to avoid unnecessary loading
fix(clickhousech@m-3348189669) add node info when read data part failed,See merge request dp/ClickHouse!20783
fix(optimizer@m-3459430016) delete legacy histogram when re-collect stats without histogram,See merge request dp/ClickHouse!21032
fix(clickhousech@m-3460279495) [cp cnch-2.1]minor fix edge case for PB consuming: Invalid number of rows in Chunk,See merge request:
fix(clickhousech@m-12459087) Suppress otel header parse exception[cp],See merge request:
fix(optimizer@m-3000537417) fix bitmap index not pushed down,See merge request:
fix(clickhousech@m-3033450748) [CP to 2.1]fix metrics2 not init and update hdfs to support more metrics,See merge request dp/ClickHouse!20981
fix(clickhousech@m-3856683587) Mysql Default Text Case Roll Back 2.1
fix(clickhousech@m-3594280570) [cp]lock manager bug and support system commands
fix(clickhousech@m-3156347174) [TO CNCH2.1] Reduce S3 API invoke in merge process
fix(clickhousech@m-3460298109) gc scan in a round-robin way.
fix(optimizer@m-3265514516) close optimizer fallback
fix(clickhousech@m-3813624009) Rbac notify fix 2.1
fix(optimizer@m-3652546032) In func partition prune
fix(clickhousech@m-3782687661) fix mybatis connection[cp]
fix(optimizer@m-15069680) optimizer support final sample,See merge request dp/ClickHouse!21334
fix(clickhousech@m-3671852025) forwarding once,See merge request dp/ClickHouse!21296
fix(clickhousech@m-3000927742) fix lowCardinalityIsNoneEncoded in filter,See merge request:
fix(optimizer@m-3695172707) fix offloading_with_query_plan don't set shuffle_with_order cnch_2.1,See merge request:
fix(clickhousech@m-3000736999) close optimize_rewrite_sum_if_to_count_if,See merge request:
fix(optimizer@m-14637742) optimizer remove sample check,See merge request:
fix(clickhousech@m-3033432511) fix prewhere selection when containing bitmap index functions,See merge request dp/ClickHouse!21181
fix(clickhousech@m-3671827753) [cp] Make sure cluster_status set to 0 after modify cluster by
fix(clickhousech@m-3671861263) ...

Feature

feat(clickhousech@m-3672686692) [cp-cnch2.1] 1.small keys support agg two level 2.countD agg state memory size estimation
feat(clickhousech@m-3011045309) [CP to 2.1]CnchMergeTree support bytecool part move parser
feat(clickhousech@m-3460318692) make max_bytes_to_read_local respect max_bytes_to_read_leaf,See merge request:
feat(clickhousech@m-3000999997) 【CP】refine log,See merge request dp/ClickHouse!21098
feat(clickhousech@m-3086283635) [cp cnch-2.1] introduce sample consuming function for CnchKafka,See merge request:
feat(optimizer@m-3000286965) remove redundant cast,See merge request:
feat(clickhousech@m-3348298112) Ingest with bucket,See merge request dp/ClickHouse!20774
feat(clickhousech@m-3404807508) [CNCH] memory control on joined block
feat(clickhousech@m-11932130) ProfileEvent for prewhere
feat(clickhousech@m-3011597342) [cp]add function sparkHashSimple to align with Spark,See merge request:
feat(clickhousech@m-5301115) rpc client base brpc timeout should read config,See merge request dp/ClickHouse!20862
feat(clickhousech@m-17104648) send progress in optimizer mode
feat(clickhousech@m-3672686692) [cp-cnch2.1] 1.small keys support agg two level 2.countD agg state memory size estimation,See merge request:
feat(clickhousech@m-3156389534) filter delete bitmap with bucket number.,See merge request:
feat(clickhousech@m-3000207505) limit the size of or expressions to pushdown to prewhere,See merge request dp/ClickHouse!21189
feat(clickhousech@m-3460336453) [cp]support BitMap64 type with Parquet format,See merge request:
feat(clickhousech@m-3011045309) [CP to 2.1]CnchMergeTree support bytecool part move parser
feat(clickhousech@m-3460318692) make max_bytes_to_read_local respect max_bytes_to_read_leaf,See merge request:
feat(clickhousech@m-3000999997) 【CP】refine log,See merge request dp/ClickHouse!21098
feat(clickhousech@m-3086283635) [cp cnch-2.1] introduce sample consuming function for CnchKafka,See merge request:
feat(optimizer@m-3000286965) remove redundant cast,See merge request:
feat(clickhousech@m-3348298112) Ingest with bucket,See merge request dp/ClickHouse!20774
feat(clickhousech@m-3404807508) [CNCH] memory control on joined block
feat(clickhousech@m-11932130) ProfileEvent for prewhere
feat(clickhousech@m-3011597342) [cp]add function sparkHashSimple to align with Spark,See merge request:
feat(clickhousech@m-5301115) rpc client base brpc timeout should read config,See merge request dp/ClickHouse!20862
feat(clickhousech@m-17104648) send progress in optimizer mode
feat(clickhousech@m-3347623183) add udaf fastPrevAuc2 to handle the miduim results for fastAuc2,See merge request dp/ClickHouse!20731
feat(clickhousech@m-3265377520) do not show information for system tables without rbac check,See merge request dp/ClickHouse!20474
feat(clickhousech@m-3346761095) unique table support append mode
feat(clickhousech@m-3032987723) set default bsp max_disk_bytes to 500GB, cp to 2.1
feat(clickhousech@m-3086277560) Merge branch 'exchange_nullable_mr' into 'cnch-dev',See merge request dp/ClickHouse!20298
feat(clickhousech@m-3057426540) Handle data overflow [CP],See merge request:
feat(clickhousech@m-17242353) Bucket size check && support alias column,See merge request:
feat(clickhousech@m-3033040206) Add hdfs lock to concurrent outfile to the same file,See merge request dp/ClickHouse!20493
feat(clickhousech@m-3015140583) Close Lazy seek for hdfs,See merge request dp/ClickHouse!20064
feat(clickhousech@m-3001107627) [To cnch-dev] Support outfile into directory,See merge request dp/ClickHouse!19462
feat(clickhousech@m-3012525130) KV Rbac performance optimization for granting lots of query to one user. Also fix a coredump and dead lock,See merge request:
feat(clickhousech@m-3018479788) remove empty timezone check
feat(clickhousech@m-3012443441) [cp]enable write part parallel,See merge request dp/ClickHouse!20010
feat(clickhousech@m-3012490495) enable retry by default,See merge request dp/ClickHouse!19977
feat(clickhousech@m-3000222376) make columns nullable by default under mysql,See merge request dp/ClickHouse!19668
feat(clickhousech@m-3012443441) [cp]enable write part parallel
feat(clickhousech@m-3012490495) enable retry by default
feat(clickhousech@m-3000222376) make columns nullable by default under mysql
feat(clickhousech@m-3011135086) support state function no shuffle
feat(clickhousech@m-3011521757) Hive support cluster by filtering,See merge request dp/ClickHouse!19840
feat(clickhousech@m-3011528179) support additional-services for fulltext search.

Fix

fix(clickhousech@m-3892779614) profile events are logged even exception is thrown,See merge request dp/ClickHouse!21513
fix(clickhousech@m-3106204787) [cp] add setting storage_dialect_type and use it for key expressions,See merge request:
fix(clickhousech@m-3813624009) block concurrent RBAC accesses for the same user,See merge request dp/ClickHouse!21473
fix(clickhousech@m-3856683587) Mysql Default Text Case Roll Back 2.1,See merge request dp/ClickHouse!21457
fix(clickhousech@m-3594280570) [cp]lock manager bug and support system commands,See merge request:
fix(clickhousech@m-3156347174) [TO CNCH2.1] Reduce S3 API invoke in merge process,See merge request:
fix(clickhousech@m-3460298109) gc scan in a round-robin way.,See merge request:
fix(optimizer@m-3265514516) close optimizer fallback,See merge request dp/ClickHouse!21350
fix(clickhousech@m-3813624009) Rbac notify fix 2.1,See merge request dp/ClickHouse!21425
fix(optimizer@m-3652546032) In func partition prune,See merge request:
fix(clickhousech@m-3260650011) [cp] fix cache inconsistency issues,See merge request:
fix(clickhousech@m-3359728725) Fix bug with LowCardinality in short-curcuit function evaluation Closes #1301,See merge request:
fix(clickhousech@m-3798655921) Remove constraint unique from unique key,See merge request dp/ClickHouse!21392
fix(clickhousech@m-3782687661) fix mybatis connection[cp],See merge request:
fix(clickhousech@m-3158825186) [cp] skip bad ttl when doing partition gc,See merge request:
fix(optimizer@m-3645281049) fix rm redundant distinct,See merge request dp/ClickHouse!21323
fix(optimizer@m-15069680) optimizer support final sample
fix(clickhousech@m-3671852025) forwarding once
fix(clickhousech@m-3000927742) fix lowCardinalityIsNoneEncoded in filter
fix(clickhousech@m-3000736999) close optimize_rewrite_sum_if_to_count_if
fix(optimizer@m-14637742) optimizer remove sample check
fix(clickhousech@m-3460291004) move setUser to async thread
fix(clickhousech@m-3671827753) [cp] Make sure cluster_status set to 0 after modify cluster by
fix(clickhousech@m-3671861263) fixed conjunct the where and prewhere in getFilterFromQueryInfo
fix(clickhousech@m-3595136086) skip access storage when enable_skip_non_cnch_tables_for_cnch_trash_items is enabled.
fix(clickhousech@m-3671907062) [cp] Fix cleanUndoBuffers logic for DaemonJobTxnGC to let it works well with write_undo_buffer_new_key,See merge request:
fix(clickhousech@m-3000662130) prevent from acquire RWlock recursively,See merge request:
fix(clickhousech@m-3460250027) not select partition key as prewhere cnch 2.1,See merge request:
fix(clickhousech@m-3651696533) fix toDateOrNull core cnch 2.1,See merge request dp/ClickHouse!21159
fix(clickhousech@m-3595066568) fix arrayjoin performance slow with optimizer,See merge request:
fix(clickhousech@m-3018479783) Allow extra argument for toString,See merge request:
fix(optimizer@m-3310530537) fix cte property explore with broadcast cnch-2.1,See merge request:
fix(clickhousech@m-3459432705) [cp] fix rollback of detach partition,See merge request:
fix(clickhousech@m-3595158575) fix report root cause,See merge request:
fix(clickhousech@m-3158769174) [cp cnch-dev] change the order of loading index to avoid unnecessary loading,See merge request:
fix(clickhousech@m-3348189669) add node info when read data part failed,See merge request dp/ClickHouse!20783
fix(optimizer@m-3459430016) delete legacy histogram when re-collect stats without histogram,See merge request dp/ClickHouse!21032
fix(clickhousech@m-3460279495) [cp cnch-2.1]minor fix edge case for PB consuming: Invalid number of rows in Chunk,See merge request:
fix(clickhousech@m-12459087) Suppress otel header parse exception[cp],See merge request:
fix(optimizer@m-3000537417) fix bitmap index not pushed down,See merge request:
fix(clickhousech@m-3033450748) [CP to 2.1]fix metrics2 not init and update hdfs to support more metrics,See merge request dp/ClickHouse!20981
fix(clickhousech@m-3856683587) Mysql Default Text Case Roll Back 2.1
fix(clickhousech@m-3594280570) [cp]lock manager bug and support system commands
fix(clickhousech@m-3156347174) [TO CNCH2.1] Reduce S3 API invoke in merge process
fix(clickhousech@m-3460298109) gc scan in a round-robin way.
fix(optimizer@m-3265514516) close optimizer fallback
fix(clickhousech@m-3813624009) Rbac notify fix 2.1
fix(optimizer@m-3652546032) In func partition prune
fix(clickhousech@m-3782687661) fix mybatis connection[cp]
fix(optimizer@m-15069680) optimizer support final sample,See merge request dp/ClickHouse!21334
fix(clickhousech@m-3671852025) forwarding once,See merge request dp/ClickHouse!21296
fix(clickhousech@m-3000927742) fix lowCardinalityIsNoneEncoded in filter,See merge request:
fix(optimizer@m-3695172707) fix offloading_with_query_plan don't set shuffle_with_order cnch_2.1,See merge request:
fix(clickhousech@m-3000736999) close optimize_rewrite_sum_if_to_count_if,See merge request:
fix(optimizer@m-14637742) optimizer remove sample check,See merge request:
fix(clickhousech@m-3033432511) fix prewhere selection when containing bitmap index functions,See merge request dp/ClickHouse!21181
fix(clickhousech@m-3671827753) [cp] Make sure cluster_status set to 0 after modify cluster by
fix(clickhousech...

What's Changed

• fix(clickhousech@m-3892779614): profile events are logged even exception is thrown by @nudles in #1692
• fix unit test failure from ansi_nullify_grouping.sql by @fanqi1909 in #1702
• Sync internal RBAC changes to ByConity by @liyinsg in #1713
• Fix error due to output buffer not finalized correctly by @nudles in #1724
• Fix blocker mat column bug [CP] by @nudles in #1729

New Contributors

• @liyinsg made their first contribution in #1713

Full Changelog: 0.4.1...0.4.2

What's Changed

• Merge branch 'profile-events-fix-2.1' into 'cnch-2.1' by @nudles in #1692
• fix unit test failure from ansi_nullify_grouping.sql by @fanqi1909 in #1702
• Sync internal RBAC changes to ByConity by @liyinsg in #1713
• Fix error due to output buffer not finalized correctly by @nudles in #1724
• Fix blocker mat column bug [CP] by @nudles in #1729

New Contributors

• @liyinsg made their first contribution in #1713

Full Changelog: 0.4.1...0.4.2-testonly-1

Features

• feat(clickhousech@m-11932130): ProfileEvent for prewhere
• feat(clickhousech@m-17104648): merge progress to cnch 2.1
• feat(clickhousech@m-3000207505): limit the size of or expressions to pushdown to prewhere
• feat(clickhousech@m-3011045309): [CP to 2.1]CnchMergeTree support bytecool part move parser
• feat(clickhousech@m-3011597342): [cp]add function sparkHashSimple to align with Spark
• feat(clickhousech@m-3015142595):[CP TO CHCH2.1]Adjust local and remote fs buffer size
• feat(clickhousech@m-3032987723): set default bsp max_disk_bytes to 500GB, cp to 2.1
• feat(clickhousech@m-3156389534): filter delete bitmap with bucket number.
• feat(clickhousech@m-3265377520): do not show information for system tables without rbac check
• feat(clickhousech@m-3346761095): unique table support append mode
• feat(clickhousech@m-3346761604): Separate user name for mysql protocol 2.1
• feat(clickhousech@m-3347623183): add udaf fastPrevAuc2 to handle the miduim results for fastAuc2
• feat(clickhousech@m-3348298112): Ingest with bucket pick 2.1
• feat(clickhousech@m-3404807508): [cp-cnch2.1] memory control on joined block
• feat(clickhousech@m-3460336453): [cp]support BitMap64 type with Parquet format
• feat(clickhousech@m-3672686692): [cp-cnch2.1] 1.small keys support agg two level 2.countD agg state memory size estimation
• feat(clickhousech@m-5301115): Merge branch 'rpc-client-base-brpc-timeout' into 'cnch-2.1'
• feat(optimizer@m-3000286965): remove redundant cast

Bug Fix

• ci(clickhousech@m-3877853060): fix 48037_tealimit_ansi unstable case
• fix(clickhousech@m-10100323): [CP to 2.1]use nnproxy access to replace nameservice style hdfs url
• fix(clickhousech@m-12459087):Suppress otel header parse exception[cp]
• fix(clickhousech@m-17322645): leader election improve
• fix(clickhousech@m-17441741): fix serveral mv with same target table insert in worker side report error
• fix(clickhousech@m-3000736999): close optimize_rewrite_sum_if_to_count_if
• fix(clickhousech@m-3000927742): fix lowCardinalityIsNoneEncoded in filter
• fix(clickhousech@m-3001047433): Fixed Unexpected Integer conversion 2.1
• fix(clickhousech@m-3011112771): [CP TO CNCH2.1] Fix bug when prefetching data into CachedCompressedReadBuffer
• fix(clickhousech@m-3011577263): make delete bitmap cache immutable.
• fix(clickhousech@m-3033432511): fix prewhere selection when containing bitmap index functions
• fix(clickhousech@m-3033450748): [CP to 2.1]fix metrics2 not init and update hdfs to support more metrics
• fix(clickhousech@m-3047443070): fix too deep recursion cnch 2.1
• fix(clickhousech@m-3105053835): push down aggregation op to metastore.
• fix(clickhousech@m-3106204787): [cp] add setting storage_dialect_type and use it for key expressions
• fix(clickhousech@m-3156347174):[TO CNCH2.1] Reduce S3 API invoke in merge process
• fix(clickhousech@m-3158769174): [cp cnch-2.1] change the order of loading index to avoid unnecessary loading
• fix(clickhousech@m-3158825186): [cp] skip bad ttl when doing partition gc
• fix(clickhousech@m-3260650011): [cp] fix cache inconsistency issues
• fix(clickhousech@m-3284060938): refactor move comment from storage to astcreate[cp]
• fix(clickhousech@m-3284084166): not do constant folding for complex literals cnch 2.1
• fix(clickhousech@m-3298001072): add obsolete setting
• fix(clickhousech@m-3298014142): fix the wrong logic when parallel size is worker number + 1
• fix(clickhousech@m-3323373157): [cp] fix duplicate create cloud table for s3/hdfs table
• fix(clickhousech@m-3347546554): Merge branch 'fix-bsp-scheduler-hung' into 'cnch-2.1'
• fix(clickhousech@m-3347547143): apply settings via mysql client [cp]
• fix(clickhousech@m-3347641016): enhancement for MySQL DDL and DQL 2.1
• fix(clickhousech@m-3347646011): Merge branch 'fix-instance-id-less' into 'cnch-2.1'
• fix(clickhousech@m-3347651074): Merge branch 'disable_bsp_shuffle_reduce_locality_enabled' into 'cnch-2.1'
• fix(clickhousech@m-3348176173): fix connection reuse
• fix(clickhousech@m-3348189669): [CP to 2.1]add node info when read data part failed
• fix(clickhousech@m-3348198742): support mysql dual table [cp]
• fix(clickhousech@m-3348236069): [cp]lock bugs
• fix(clickhousech@m-3359728725): Fix bug with LowCardinality in short-curcuit function evaluation Closes #1301
• fix(clickhousech@m-3386615999): add aggregate function bitmap* to push partial blacklist cnch-2.1
• fix(clickhousech@m-3386703027): [cp] fix perf of detach partition and hdfs disk
• fix(clickhousech@m-3388077045): [cp] cnch 2.1 remove unnecessary getChecksums calls in loadDataParts
• fix(clickhousech@m-3388089557): [cp] Does not change server_vw_name for IStorage::renameInMemory to avoid affected by QueryAnalyzer etc
• fix(clickhousech@m-3459432705): [cp] fix rollback of detach partition
• fix(clickhousech@m-3460279495): [cp cnch-2.1]minor fix edge case for PB consuming: Invalid number of rows in Chunk
• fix(clickhousech@m-3460291004): move setUser to async thread
• fix(clickhousech@m-3460298109): gc scan in a round-robin way.
• fix(clickhousech@m-3594280570): [cp]lock manager bug and support system commands
• fix(clickhousech@m-3595103553): [manual cp] fix toCNCHDataPart lost commit time and add some catalog debug log
• fix(clickhousech@m-3595136086): skip access storage when enable_skip_non_cnch_tables_for_cnch_trash_items is enabled.
• fix(clickhousech@m-3595158575): fix report root cause
• fix(clickhousech@m-3671827753): [cp] Make sure cluster_status set to 0 after modify cluster by
• fix(clickhousech@m-3671852025): forwarding once
• fix(clickhousech@m-3671861263): fixed conjunct the where and prewhere in getFilterFromQueryInfo
• fix(clickhousech@m-3782687661): fix mybatis connection[cp]
• fix(clickhousech@m-3798655921): Remove constraint unique from unique key
• fix(clickhousech@m-3813624009): block concurrent RBAC accesses for the same user
• fix(clickhousech@m-3813624009): Rbac notify fix 2.1
• fix(clickhousech@m-3856683587): Mysql Default Text Case Roll Back 2.1
• fix(optimizer@m-15069680): optimizer support final sample
• fix(optimizer@m-16951867): fix distinct to agg
• fix(optimizer@m-3000537417): fix bitmap index
• fix(optimizer@m-3000935223): fix pushdown projection symbol mapping cnch-2.1
• fix(optimizer@m-3159498150): fix memory leak in statistics
• fix(optimizer@m-3179121605): Refactor sql binding
• fix(optimizer@m-3265473722):fix predicate pushdown ineffective bug
• fix(optimizer@m-3265514516): close optimizer fallback
• fix(optimizer@m-3347557629): fix runtime filter core dump in runtime for date type date cnch-2.1
• fix(optimizer@m-3348236068): Fix bitmap index check
• fix(optimizer@m-3348274178): fix explain error info
• fix(optimizer@m-3386699280): make offloading_with_query_plan take effect in cascades
• fix(optimizer@m-3459430016): delete legacy histogram when re-collect stats without histogram
• fix(optimizer@m-3645281049): fix rm redundant distinct
• fix(optimizer@m-3652546032): In func partition prune
• fix(optimizer@m-3695172707): fix offloading_with_query_plan don't set shuffle_with_order cnch_2.1
• fix(optimizer@m-3766375001): optimizer remove sample check
• ci(clickhousech@m-3877853060): fix 48037_tealimit_ansi unstable case.