Test: creating a PR #1
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Co-authored-by: BInwei Yang <binwei.yang@intel.com>
…oin (apache#408) * support both build left and right * for test * prefer agg and filter as build side * change back build side for vanilla spark * fix ut * fix gluten-it, for test * annotations * Revert "fix gluten-it, for test" This reverts commit 15d6489. * Revert "for test" This reverts commit f012905. Co-authored-by: rui-mo <rui-mo@intel.com>
…pache#454) * [CH-120] Unify cross-JNI memory management for ClickHouse backends Unify cross-JNI memory management for ClickHouse backends. Refer to: 1. [PR-251](apache#251); 2. [PR-311](apache#311); 3. [PR-325](apache#325); 4. [PR-344](apache#344); 5. [PR-440](apache#440); * commit
…pache#458) * Use reversed order to release TaskMemoryResourceManager * Warning "Outstanding Arrow child allocator" when JVM flag -ea is set
…tenSessionExtensions (apache#461) Support adding other external SparkSessionExtensions when integreting with Gluten. Close apache#460.
…he#451) * Support string functions for Gluten, including length, lower and upper. apache#436 * Support string functions for Gluten, including ascii, concat, replace and coalesce. apache#436 * Add UT for String Functions. apache#436
… Backend (apache#462) * [CH-169] Exception handling when memory reserve failed for ClickHouse Backend Exception handling when memory reserve failed for ClickHouse Backend. * modify logs * fixup * fixup Co-authored-by: Hongze Zhang <hongze.zhang@intel.com>
* Fixes hdfs short-circuit read By default libhdfs3 does not set the default hdfs domain socket path, this patch sets a default value for hdfs short-circuit read, align with apache HDFS "/var/lib/hadoop-hdfs/dn_socket" https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html Signed-off-by: Yuan Zhou <yuan.zhou@intel.com> * adding docs for HDFS short-circuit read Signed-off-by: Yuan Zhou <yuan.zhou@intel.com> * fix sed script Signed-off-by: Yuan Zhou <yuan.zhou@intel.com> Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
…Pspark-3.2 (apache#477)" (apache#488) This reverts commit 8dc6ac3.
* hbm allocator refactor add test * update doc & compile * refine doc
…uation for literal input (apache#476)
Revert the test velox branch
* support limit operator * fixed bugs for CollectLimitExec * spark.gluten.sql.columnar.limit = true at default * update relnode api * remove config * update transform action for CollectLimitExec * remove collect limit exec * format style * delete CollectLimitTransformer.scala * updated
Co-authored-by: liuneng1994 <neng.liu@kyligence.io>
This patch adds S3 support, below is the command to build the package: mvn clean package -Pbackends-velox -Pspark-3.2 -DskipTests -Dcheckstyle.skip -Dbuild_cpp=ON -Dbuild_velox=ON -Dbuild_velox_from_source=ON -Dbuild_arrow=ON -Dvelox_enable_s3=ON below S3 configures are required in spark-defaults.conf spark.hadoop.fs.s3a.impl org.apache.hadoop.fs.s3a.S3AFileSystem spark.hadoop.fs.s3a.aws.credentials.provider org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider spark.hadoop.fs.s3a.access.key xxxx spark.hadoop.fs.s3a.secret.key xxxx spark.hadoop.fs.s3a.endpoint https://s3.us-west-1.amazonaws.com spark.hadoop.fs.s3a.connection.ssl.enabled true spark.hadoop.fs.s3a.path.style.access false This patch also did some cleanup on the HDFS connector, if it's not required then Gluten will not build/include the dependencies Signed-off-by: Yuan Zhou yuan.zhou@intel.com
…ache#495) * add shuffle micro * format
…che#493) * Support chr() and abs() * Fix ScalaStyle * Add change based on comment * Add match functions * Fix run error * Fix UT typo * Remove println * [OPPRO-277] Support round(),greatest(),least() functions in Gluten * Clean code * Support hash(), get_json_object() * Remove duplicate class * enbale HashExpressionsSuite * adjust UTs * Remove duplicated class * Remove duplicated UTs
…pressions with specific input type. (apache#558)
… degrees(), log10() functions in Gluten (apache#535) * Support chr() and abs() * Fix ScalaStyle * Add change based on comment * Add match functions * Fix run error * Fix UT typo * Remove println * [OPPRO-277] Support round(),greatest(),least() functions in Gluten * Clean code * Use unified check interfaces * Add functions * Add new functions support * move UTs to new Suite
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
This reverts commit e38fcd5.
This reverts commit 064a904.
|
Thanks for opening a pull request! Could you open an issue for this pull request on Github Issues? https://github.com/oap-project/gluten/issues Then could you also rename commit message and pull request title in the following format? See also: |
|
This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days. |
|
This PR was auto-closed because it has been stalled for 10 days with no activity. Please feel free to reopen if it is still valid. Thanks. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is a test!