-
Notifications
You must be signed in to change notification settings - Fork 7
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add retry logic for COPY operation in SnowflakeCopyBatchInsert with c…
…onfigurable max retries - Introduced a new configuration parameter max_copy_retries to specify the maximum number of retries for the COPY operation in Snowflake. - Updated SnowflakeOutputPlugin to include max_copy_retries configuration. - Modified SnowflakeCopyBatchInsert to handle retries for the COPY operation using the newly added parameter. - Added a method isRetryableForCopyTask to determine whether a COPY error is retryable. - Adjusted constructor and method signatures to include maxCopyRetries where necessary. - Ensured proper resource cleanup and retry handling for the COPY task. - Improved logging for retries to provide more context during errors.
- Loading branch information
1 parent
b7ab45d
commit 76dc706
Showing
2 changed files
with
59 additions
and
23 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters