Skip to content

Comments

Fix delete files partition#12

Open
vamsikarnika wants to merge 3278 commits intoonehouseinc:masterfrom
vamsikarnika:fix_delete_files_partition
Open

Fix delete files partition#12
vamsikarnika wants to merge 3278 commits intoonehouseinc:masterfrom
vamsikarnika:fix_delete_files_partition

Conversation

@vamsikarnika
Copy link

Change Logs

Describe context and summary for this change. Highlight if any code was copied.

Impact

Describe any public API or user-facing feature change or any performance impact.

Risk level: none | low | medium | high

Choose one. If medium or high, explain what verification was done to mitigate the risks.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

wangyinsheng and others added 30 commits March 27, 2025 12:39
…chIdxField' (apache#13023)

Co-authored-by: wangyinsheng <wangyinsheng@jd.com>
…ile inserting into hudi table (apache#13044)

Co-authored-by: wangyinsheng <wangyinsheng@jd.com>
…3007)

Co-authored-by: sivabalan <n.siva.b@gmail.com>
Co-authored-by: Y Ethan Guo <ethan.guoyihua@gmail.com>
Co-authored-by: danny0405 <yuzhao.cyz@gmail.com>
…m version 7 to 8 and back (apache#13046)

Update the upgrade/downgrade logic for merge mode related configs. 

---------

Co-authored-by: Lin Liu <linliu.code@gmail.com>
Co-authored-by: sivabalan <n.siva.b@gmail.com>
* Support totalLogRecord metric

* Add test for the compaction stats

* Address comments

* Address all comments

* Address comments

* Fix a failed test

* Add support for numWrites

* Address the comments

* Fixing inserts with log files

---------

Co-authored-by: sivabalan <n.siva.b@gmail.com>
… of HoodieRecordMerger (apache#13059)

Co-authored-by: wangyinsheng <wangyinsheng@jd.com>
…pache#13079)

---------

Co-authored-by: sivabalan <n.siva.b@gmail.com>
… additional files (apache#13088)

* Fixing marker reconciliation for failures during deleting additional files

* Addressing feedback
…13086)

* Disable global index for merge into query

* Fix import styles

* Add flag and test

* Fix schema usage

* Fix compilation

* remove custom merge mode validation

---------

Co-authored-by: Lokesh Jain <ljain@apache.org>
Co-authored-by: Sagar Sumit <sagarsumit09@gmail.com>
cshuo and others added 30 commits June 12, 2025 09:10
* fix include= in DFSPropertiesConfiguration

* fix storage path
* [HUDI-9334] optimize parallelism of show_invalid_parquet

* solve type mismatch

* introduce customParallelism

* rm invalid imports

* switch parallelism to optional

* fix scalastyle

* fix scalastyle

---------

Co-authored-by: fhan <yfhanfei@jd.com>
…ort for SPARK engine (apache#13402)

* Adding end to end streaming writes to metadata table support for SPARK engine 

---------

Co-authored-by: Lokesh Jain <ljain@apache.org>
Co-authored-by: danny0405 <yuzhao.cyz@gmail.com>
…3464)

* use blocking instant generation in Flink writer for COW table
* update default value for commit ack timeout and add test

---------

Co-authored-by: danny0405 <yuzhao.cyz@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.