Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

current_length value in split_list_to_chunks! #1736

Open
Smitspeed29 opened this issue Nov 1, 2024 · 2 comments
Open

current_length value in split_list_to_chunks! #1736

Smitspeed29 opened this issue Nov 1, 2024 · 2 comments
Labels
Bug Something isn't working Triage 👀

Comments

@Smitspeed29
Copy link

Smitspeed29 commented Nov 1, 2024

Describe the bug
Looks like the value of current_length not getting set properly in split_list_to_chunks.sql

Reason for flagging, we are unable to split the query properly wrt query_max_size

https://github.com/elementary-data/dbt-data-reliability/blob/master/macros/utils/list_utils/split_list_to_chunks.sql

Also I am new to Jinja, so If I said something stupid please ignore. Thanks

@Smitspeed29 Smitspeed29 added Bug Something isn't working Triage 👀 labels Nov 1, 2024
@MikaKerman
Copy link
Contributor

Hi @Smitspeed29!
To better understand what's going on, could you let me know where you noticed that current_length isn’t being set correctly? Any specific part of the code execution or output where this issue shows up would be really helpful.

@Niteeshkanungo
Copy link

@MikaKerman I think we found the bug, the chunk length is not set properly with iterations, wanted to see if this PR can be reviewed and tested? Link - elementary-data/dbt-data-reliability#763

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working Triage 👀
Projects
None yet
Development

No branches or pull requests

3 participants