forked from qubole/kinesis-sql
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathCHANGELOG
191 lines (148 loc) · 6.69 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
Changelog
=========
kinesis_2.11-1.2.0-spark_2.4
------------
- Switch to use Kinesis list-shards API (#89) [Chad Lagore]
- Fix issue with slow kinesis sink. [Vikram Agrawal]
- Remove lastReadSequenceNumber.isEmpty condition (#90) [Chad Lagore]
- Fixing latency in kinesis sink (#81) [abhishekd0907]
kinesis_2.11-1.1.4-spark_2.4
----------------------------
- Fix retries while making Kinesis API calls (#79) [Vikram Agrawal]
- Adding ability to set exact Kinesis position to start reading from
(#78) [Stanislav Norochevskyi]
* Adding ability read initial Kinesis position from checkpoint JSON representation.
* Adding a unit test for InitialKinesisPosition parser
- Apply retries to kinesis exceptions with status code >= 500 (#76)
[Arne Huang]
- Make DefaultAWSCredentialsProviderChain available to choose (#71)
[Hyeonseop Lee]
* Add option to use instance profile credentials
* Update docs
* Add same option to producer
- Added session based authentication (#72) [guoming-xu]
- Add source and target java version to overwrite defaults; add nobootcp
option to scala compiler (#68) [Julian Keppel]
- Update the artifact of the new release. [Vikram Agrawal]
- [maven-release-plugin] prepare for next development iteration. [Vikram
Agrawal]
- Merge branch 'master' of github.com:qubole/kinesis-sql. [Vikram
Agrawal]
- Update README.md. [Vikram Agrawal]
- Update README.md. [Vikram Agrawal]
- Update README.md. [Vikram Agrawal]
kinesis_2.11-1.1.3-spark_2.4
--------------------------------
- [maven-release-plugin] prepare release spark-sql-
kinesis_2.11-1.1.3-spark_2.4. [Vikram Agrawal]
- GitChangelog RC file and changelog. [Vikram Agrawal]
- Add travis build config. [Vikram Agrawal]
- Create fat jar with dependencies shaded in the jar. [Vikram Agrawal]
- Handle deleted shards (#59) [Vikram Agrawal]
- [maven-release-plugin] prepare for next development iteration. [Vikram
Agrawal]
kinesis_2.11-1.1.2-spark_2.4
-----------------------------
- [maven-release-plugin] prepare release spark-sql-
kinesis_2.11-1.1.2-spark_2.4. [Vikram Agrawal]
- [maven-release-plugin] prepare for next development iteration. [Vikram
Agrawal]
- POM changes. [Vikram Agrawal]
- Update pom.xml. [Vikram Agrawal]
- [maven-release-plugin] prepare for next development iteration. [Vikram
Agrawal]
- [maven-release-plugin] prepare release spark-sql-
kinesis_2.11-1.1.0-spark_2.4. [Vikram Agrawal]
- Update Pom file for mvn release. [Vikram Agrawal]
- Fix Deserialisation/Serialisation of KinesisOffsets (#62) [Vikram
Agrawal]
* Fix incorrect metadata for batchId in the kinesis offsets
* Fix serialization and deserialization fo the kinesis offsets
- Fix issue with Reprocessing oldshards issue (#63) [Vikram Agrawal]
- 2.4.0 (#56) [Vikram Agrawal]
* Fix broken test suite and scalastyle error
* Fix issues with over-ridden Kinesis Source Options (#36)
* Fix issues with over-ridden Kinesis Source Options
* Update ReadMe
* Fix Review Comments
* Fix ambiguity with scala 2.12 (#37)
* Fix stylecheck errors
* Add retries to Handle EC issues in HDFS metadata committer (#41)
* Handle EC issues in HDFS MetaCommitter
* Avoid timestamp as Offset and avoid empty batches when there is no new data (#49)
- Changing protobuf version and fixing styling errors (#53)
[abhishekd0907]
- 2.4.0 (#45) [nhampiholi]
* Fix broken test suite and scalastyle error
* Fix issues with over-ridden Kinesis Source Options (#36)
* Fix issues with over-ridden Kinesis Source Options
* Update ReadMe
* Fix Review Comments
* Fix ambiguity with scala 2.12 (#37)
* Fix stylecheck errors
* Add retries to Handle EC issues in HDFS metadata committer (#41)
* Handle EC issues in HDFS MetaCommitter
* Avoid timestamp as Offset and avoid empty batches when there is no new data (#49)
- Avoid timestamp as Offset and avoid empty batches when there is no new
data (#49) [Vikram Agrawal]
- Add retries to Handle EC issues in HDFS metadata committer (#41)
[Vikram Agrawal]
* Handle EC issues in HDFS MetaCommitter
- Fix stylecheck errors. [Vikram Agrawal]
- Fix ambiguity with scala 2.12 (#37) [Marcin Szymański]
- Fix issues with over-ridden Kinesis Source Options (#36) [Vikram
Agrawal]
* Fix issues with over-ridden Kinesis Source Options
* Update ReadMe
* Fix Review Comments
- Fix broken test suite and scalastyle error. [anthony.may]
- Use latest DSv2 APIs for continuous processing. [Vikram Agrawal]
- Handle greater than 100 shard streams. [Vikram Agrawal]
- Fix for handling greater than 100 shard streams. [Siddhartha Jain]
- Update README.md. [Vikram Agrawal]
- Add AWSInstanceProfileCredentialsProviderWithRetries to handle issues
with instance profile provider. [Vikram Agrawal]
- Bump up spark version. [Vikram Agrawal]
- Support of Kinesis Connector for Continuous streaming (#15) [Vikram
Agrawal]
- Fixed aws sdk and kpl versions (#18) [Georgios]
- Bump up Kinesis Client version. [Vikram Agrawal]
- Support of AWS roles / instance profile for Authentication (#13)
[Vikram Agrawal]
* Support of AWS roles / instance profile for Authentication
* InstanceProfileCredentials should be case object instead of case class
* Fix unit tests
* clean up
- Update README. [Vikram Agrawal]
- Merge branch '2.3.0' [Vikram Agrawal]
- Fixes to support build against SPARK 2.3.0. [Vikram Agrawal]
- Merge pull request #8 from ggeorgiadis/master. [Vikram Agrawal]
Fixed issue with closed child process caused by the cache timeout
- Cleanup. [Georgios Georgiadis]
- Fixed bug in parameters validation and cache timeout. [Georgios
Georgiadis]
- Merge pull request #5 from ggeorgiadis/master. [Vikram Agrawal]
Added Kinesis Sink support
- Removed duplicate awsSecretKey option. [Georgios]
- Remove kinesis sink from roadmap. [Georgios Georgiadis]
- Enable record aggregation by default. [Georgios Georgiadis]
- Added kinesis.executor.aggregationEnabled and
kinesis.producer.cache.timeout parameters Also we flush the producer
before we destroy. [Georgios Georgiadis]
- Updated configuration naming. [Georgios Georgiadis]
- Updated Readme. [Georgios Georgiadis]
- Improved validation and removed region param. [Georgios Georgiadis]
- Added tests and cleaned up. [Georgios Georgiadis]
- Clean up and use specific aws creds for sink. [Georgios Georgiadis]
- Added Kinesis Sink support. [Georgios Georgiadis]
- Merge branch 'master' of github.com:qubole/kinesis-sql. [Vikram
Agrawal]
- Update README.md. [mayankahuja]
- Update README.md. [Vikram Agrawal]
- Shade Jackson Dataformat Jar. [Vikram Agrawal]
- Update README file and remove filter for ShardEnd in getOffset.
[Vikram Agrawal]
- Update Gitignore file. [Vikram Agrawal]
- Support for Kinesis Source in Spark Structured Streaming. [Vikram
Agrawal]
- Initial commit. [Rajat Venkatesh]