Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Marge treasure data v0.6.26 #23

Merged
merged 29 commits into from
Jan 29, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
9a20b85
Create codeql-analysis.yml
NirmalaY12 Nov 23, 2020
3aa023e
Merge pull request #105 from treasure-data/CodeQL
kietdo360 Jun 22, 2022
aac02ab
Extract method
xuantuan58 Sep 21, 2022
beac285
Should shutdown ThreadPoolExecutor in any situation
xuantuan58 Sep 21, 2022
1b89183
Added unit test and update CHANGELOG.md
xuantuan58 Sep 21, 2022
f17c4f5
Set daemon thread for executor
xuantuan58 Sep 21, 2022
f3056fa
Also make sure client is closed
xuantuan58 Sep 21, 2022
7dcc07b
Merge pull request #114 from treasure-data/fix-resource-leak-program-…
xuantuan58 Sep 22, 2022
9bb4b9f
Bump up v0.6.25
xuantuan58 Sep 23, 2022
e618a73
Merge pull request #115 from treasure-data/fix-resource-leak-program-…
xuantuan58 Sep 26, 2022
1e48ea1
Get ready for Maven Central by adding sources and javadoc JARs
dmikurube Sep 27, 2022
8455367
Merge pull request #116 from treasure-data/ready-for-maven-central
dmikurube Sep 27, 2022
4442e45
Update CodeQL actions to v2 and enable Dependabot for GitHub Actions
cspicer Mar 1, 2023
fe2026d
Update codeql
minidragon88 May 19, 2023
808295f
Merge pull request #117 from treasure-data/codeql-dependabot-update
minidragon88 May 19, 2023
615576f
Bump actions/upload-artifact from 2 to 3
dependabot[bot] May 19, 2023
7941925
Bump actions/checkout from 2 to 3
dependabot[bot] May 19, 2023
b319786
Merge pull request #118 from treasure-data/dependabot/github_actions/…
minidragon88 May 19, 2023
768f228
Merge pull request #119 from treasure-data/dependabot/github_actions/…
minidragon88 May 19, 2023
c344f10
Bump actions/setup-java from 1 to 3
dependabot[bot] May 19, 2023
aa36cd5
update java distribution
minidragon88 May 19, 2023
00bf61a
Merge pull request #120 from treasure-data/dependabot/github_actions/…
minidragon88 May 19, 2023
fcc8cae
Update coverage location
minidragon88 May 19, 2023
2b765ec
Merge pull request #121 from treasure-data/update_action_artifacts
minidragon88 May 19, 2023
6b40048
Catch up to Java 11
vietnguyen-td Jan 10, 2024
e3283d1
Merge pull request #124 from treasure-data/catch-up-java-11
vietnguyen-td Jan 18, 2024
42a1d13
update-to-v0.6.26
pn-koshikawa Jan 23, 2024
0936314
update compileClasspath
pn-koshikawa Jan 23, 2024
ffb524a
fix build error
pn-koshikawa Jan 23, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
---
version: 2
updates:
# Enable workflow version updates for GitHub Actions
- package-ecosystem: "github-actions"
directory: "/"
schedule:
interval: "daily"
13 changes: 7 additions & 6 deletions .github/workflows/build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,20 +8,21 @@ jobs:
runs-on: ubuntu-latest

steps:
- uses: actions/checkout@v2
- uses: actions/checkout@v3

- name: Set up JDK 1.8
uses: actions/setup-java@v1
uses: actions/setup-java@v3
with:
java-version: 1.8
java-version: 8
distribution: "zulu"

- name: Grant execute permission for gradlew
run: chmod +x gradlew

- name: Build with testing
run: ./gradlew check --console rich --info

- uses: actions/upload-artifact@v2
- uses: actions/upload-artifact@v3
if: always()
with:
name: tests
Expand All @@ -31,8 +32,8 @@ jobs:
if: success()
run: ./gradlew jacocoTestReport

- uses: actions/upload-artifact@v2
- uses: actions/upload-artifact@v3
if: success()
with:
name: jacoco
path: ./build/reports/jacoco/test
path: ./build/reports/coverage
35 changes: 35 additions & 0 deletions .github/workflows/codeql.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
---
name: "CodeQL SAST"

on:
push:
branches: [master]
pull_request:
branches: [master]
schedule:
- cron: '0 0 1 * *'

jobs:
analyze:
name: Analyze
runs-on: ubuntu-latest

strategy:
fail-fast: false
matrix:
language: [java]

steps:
- name: Checkout repository
uses: actions/checkout@v3

- name: Initialize CodeQL
uses: github/codeql-action/init@v2
with:
languages: ${{ matrix.language }}

- name: Autobuild
uses: github/codeql-action/autobuild@v2

- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@v2
6 changes: 6 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,9 @@
## 0.6.26
- Catch up to Java 11

## 0.6.25 - 2022-09-21
- Properly shutdown ThreadExecutor when an unexpected error occurs

## 0.6.24 - 2021-10-19
- Add retryable in case response data invalid json format

Expand Down
54 changes: 32 additions & 22 deletions build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ plugins {
id "checkstyle"
id "jacoco"
id "signing"
id "org.embulk.embulk-plugins" version "0.4.2"
id "org.embulk.embulk-plugins" version "0.5.5"
id "com.palantir.git-version" version "0.12.3"
}

Expand All @@ -15,7 +15,7 @@ repositories {
group = "com.treasuredata.embulk.plugins"
description = "Loads records from Marketo."
version = {
def baseVersion = "0.6.24"
def baseVersion = "0.6.26"
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ベースを変更しています

def troccoVersion = "0.1.0"
def tag = "${baseVersion}-trocco-${troccoVersion}"
def vd = versionDetails()
Expand All @@ -34,11 +34,16 @@ targetCompatibility = 1.8

def embulkVersion = '0.10.29'

java {
withJavadocJar()
withSourcesJar()
}

dependencies {
compileOnly "org.embulk:embulk-api:$embulkVersion"
compileOnly "org.embulk:embulk-spi:$embulkVersion"

compile('org.embulk:embulk-util-config:0.3.1') {
implementation('org.embulk:embulk-util-config:0.3.2') {
// Conflict with Embulk Core
exclude group: 'com.fasterxml.jackson.core', module: 'jackson-annotations'
exclude group: 'com.fasterxml.jackson.core', module: 'jackson-core'
Expand All @@ -47,33 +52,38 @@ dependencies {
exclude group: 'javax.validation', module: 'validation-api'
}

compile "org.embulk:embulk-util-json:0.1.1"
compile "org.embulk:embulk-util-text:0.1.1"
compile "org.embulk:embulk-util-timestamp:0.2.1"
implementation "org.embulk:embulk-util-json:0.1.1"
implementation "org.embulk:embulk-util-text:0.1.1"
implementation "org.embulk:embulk-util-timestamp:0.2.1"

// Explicit dependencies for embulk-util-* that matches with Embulk
compile 'com.fasterxml.jackson.core:jackson-core:2.6.7'
compile 'com.fasterxml.jackson.core:jackson-annotations:2.6.7'
compile 'com.fasterxml.jackson.core:jackson-databind:2.6.7'
compile 'com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.6.7'
compile 'javax.validation:validation-api:1.1.0.Final'
compile('org.apache.bval:bval-jsr303:0.5'){
exclude group: 'org.apache.commons', module: 'commons-lang'
}

compile 'org.embulk:embulk-base-restclient:0.10.1'
compile 'org.embulk:embulk-util-retryhelper-jetty92:0.8.2'
implementation 'com.fasterxml.jackson.core:jackson-core:2.6.7'
implementation 'com.fasterxml.jackson.core:jackson-annotations:2.6.7'
implementation 'com.fasterxml.jackson.core:jackson-databind:2.6.7'
implementation 'com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.6.7'
implementation 'javax.validation:validation-api:1.1.0.Final'
implementation 'org.apache.bval:bval-jsr303:0.5'
implementation 'org.embulk:embulk-base-restclient:0.10.1'
implementation 'org.embulk:embulk-util-retryhelper-jetty94:0.9.0'

implementation 'com.google.guava:guava:18.0'
implementation "com.google.code.findbugs:annotations:3.0.1"
implementation 'org.apache.commons:commons-lang3:3.12.0'
implementation "javax.xml.bind:jaxb-api:2.2.11"
implementation "com.sun.xml.bind:jaxb-core:2.2.11"
implementation "com.sun.xml.bind:jaxb-impl:2.2.11"
implementation "javax.activation:activation:1.1.1"

compile 'com.google.guava:guava:18.0'
compile "com.google.code.findbugs:annotations:3.0.1"
compile 'org.apache.commons:commons-lang3:3.4'
compile 'org.apache.commons:commons-csv:1.8'

testCompile "junit:junit:4.+"
testCompile "org.embulk:embulk-core:$embulkVersion:tests"
testCompile "org.embulk:embulk-junit4:$embulkVersion"
testCompile "org.embulk:embulk-deps:$embulkVersion"
testCompile "org.mockito:mockito-core:2.+"
testImplementation "junit:junit:4.+"
testImplementation "org.embulk:embulk-core:$embulkVersion:tests"
testImplementation "org.embulk:embulk-junit4:$embulkVersion"
testImplementation "org.embulk:embulk-deps:$embulkVersion"
testImplementation "org.mockito:mockito-core:2.+"
}

embulkPlugin {
Expand Down
37 changes: 37 additions & 0 deletions gradle/dependency-locks/compileClasspath.lockfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# This is a Gradle generated file for dependency locking.
# Manual edits can break the build and are not advised.
# This file is expected to be part of source control.
com.fasterxml.jackson.core:jackson-annotations:2.6.7
com.fasterxml.jackson.core:jackson-core:2.6.7
com.fasterxml.jackson.core:jackson-databind:2.6.7
com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.6.7
com.google.code.findbugs:annotations:3.0.1
com.google.code.findbugs:jsr305:3.0.1
com.google.guava:guava:18.0
com.sun.xml.bind:jaxb-core:2.2.11
com.sun.xml.bind:jaxb-impl:2.2.11
commons-beanutils:commons-beanutils-core:1.8.3
javax.activation:activation:1.1.1
javax.validation:validation-api:1.1.0.Final
javax.xml.bind:jaxb-api:2.2.11
net.jcip:jcip-annotations:1.0
org.apache.bval:bval-core:0.5
org.apache.bval:bval-jsr303:0.5
org.apache.commons:commons-csv:1.8
org.apache.commons:commons-lang3:3.12.0
org.eclipse.jetty:jetty-client:9.4.51.v20230217
org.eclipse.jetty:jetty-http:9.4.51.v20230217
org.eclipse.jetty:jetty-io:9.4.51.v20230217
org.eclipse.jetty:jetty-util:9.4.51.v20230217
org.embulk:embulk-api:0.10.29
org.embulk:embulk-base-restclient:0.10.1
org.embulk:embulk-spi:0.10.29
org.embulk:embulk-util-config:0.3.2
org.embulk:embulk-util-file:0.1.3
org.embulk:embulk-util-json:0.1.1
org.embulk:embulk-util-retryhelper-jetty94:0.9.0
org.embulk:embulk-util-retryhelper:0.9.0
org.embulk:embulk-util-text:0.1.1
org.embulk:embulk-util-timestamp:0.2.1
org.msgpack:msgpack-core:0.8.11
org.slf4j:slf4j-api:1.7.30
Original file line number Diff line number Diff line change
Expand Up @@ -8,23 +8,27 @@ com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.6.7
com.google.code.findbugs:annotations:3.0.1
com.google.code.findbugs:jsr305:3.0.1
com.google.guava:guava:18.0
com.sun.xml.bind:jaxb-core:2.2.11
com.sun.xml.bind:jaxb-impl:2.2.11
commons-beanutils:commons-beanutils-core:1.8.3
javax.activation:activation:1.1.1
javax.validation:validation-api:1.1.0.Final
javax.xml.bind:jaxb-api:2.2.11
net.jcip:jcip-annotations:1.0
org.apache.bval:bval-core:0.5
org.apache.bval:bval-jsr303:0.5
org.apache.commons:commons-csv:1.8
org.apache.commons:commons-lang3:3.4
org.eclipse.jetty:jetty-client:9.2.14.v20151106
org.eclipse.jetty:jetty-http:9.2.14.v20151106
org.eclipse.jetty:jetty-io:9.2.14.v20151106
org.eclipse.jetty:jetty-util:9.2.14.v20151106
org.apache.commons:commons-lang3:3.12.0
org.eclipse.jetty:jetty-client:9.4.51.v20230217
org.eclipse.jetty:jetty-http:9.4.51.v20230217
org.eclipse.jetty:jetty-io:9.4.51.v20230217
org.eclipse.jetty:jetty-util:9.4.51.v20230217
org.embulk:embulk-base-restclient:0.10.1
org.embulk:embulk-util-config:0.3.1
org.embulk:embulk-util-config:0.3.2
org.embulk:embulk-util-file:0.1.3
org.embulk:embulk-util-json:0.1.1
org.embulk:embulk-util-retryhelper-jetty92:0.8.2
org.embulk:embulk-util-retryhelper:0.8.2
org.embulk:embulk-util-retryhelper-jetty94:0.9.0
org.embulk:embulk-util-retryhelper:0.9.0
org.embulk:embulk-util-rubytime:0.3.2
org.embulk:embulk-util-text:0.1.1
org.embulk:embulk-util-timestamp:0.2.1
Binary file modified gradle/wrapper/gradle-wrapper.jar
Binary file not shown.
3 changes: 1 addition & 2 deletions gradle/wrapper/gradle-wrapper.properties
Original file line number Diff line number Diff line change
@@ -1,6 +1,5 @@
#Mon Mar 27 16:55:11 ICT 2021
distributionBase=GRADLE_USER_HOME
distributionPath=wrapper/dists
distributionUrl=https\://services.gradle.org/distributions/gradle-6.9.4-bin.zip
zipStoreBase=GRADLE_USER_HOME
zipStorePath=wrapper/dists
distributionUrl=https\://services.gradle.org/distributions/gradle-6.2.2-all.zip
2 changes: 1 addition & 1 deletion gradlew
Original file line number Diff line number Diff line change
Expand Up @@ -180,4 +180,4 @@ APP_ARGS=`save "$@"`
# Collect all arguments for the java command, following the shell quoting and substitution rules
eval set -- $DEFAULT_JVM_OPTS $JAVA_OPTS $GRADLE_OPTS "\"-Dorg.gradle.appname=$APP_BASE_NAME\"" -classpath "\"$CLASSPATH\"" org.gradle.wrapper.GradleWrapperMain "$APP_ARGS"

exec "$JAVACMD" "$@"
exec "$JAVACMD" "$@"
2 changes: 1 addition & 1 deletion gradlew.bat
Original file line number Diff line number Diff line change
Expand Up @@ -100,4 +100,4 @@ exit /b 1
:mainEnd
if "%OS%"=="Windows_NT" endlocal

:omega
:omega
Loading
Loading