Skip to content

Amoro-0.6.0
Compare
Choose a tag to compare
@shidayang shidayang released this 06 Nov 11:59
· 527 commits to master since this release
v0.6.0
2476e1d

Highlight:

  • Kubernetes Integration
    • Support running AMS in a Kubernetes environment
    • Support running Optimizer in a Kubernetes environment
  • Partition expiration
  • Paimon integration
    • Support viewing metadata information such as Schema, Properties, Files, Snapshots, Compactions, Operations of the Paimon table
    • Support executing Spark SQL supported by Paimon in the Terminal interface
  • Mixed format support ORC file format
  • Mixed format support flink-1.16 and flink-1.17

Features:

  • Integration with Kubernetes #1917

  • Support for expiring partitions in Iceberg tables #1758
  • Support integration with Apache Paimon #1269
  • Support ORC file format for Mixed format tables #740
  • Upgrading Flink version based on Mixed-format table #1983

  • Enrich the storage type registry when creating a catalog. #2007


Improvements:

  • Support s3:// and s3a:// protocols in the default distribution. #2009
  • Make health status checks available without logging in #2081
  • Separate local-optimizer and flink-optimizer into different modules and package them independently. #2008
  • Support list partitions via flink catalog #1940
  • Add conf/env.sh for jvm options configurations #2047
  • Change position delete index from set to bitmap of optimizing #2078
  • Critical vulnerabilities in the project dependencies need to be fixed #2040
  • Make AMS table sync with external catalogs multithreaded #2109
  • Change the default value of self-optimizing.major.trigger.duplicate-ratio #2225
  • Log4j 1.2 is a SocketServer class that is vulnerable to deserialization of untrusted data #1548
  • Fix the format of thread name in DefaultTableService #2163

BugFixes:

  • Failed to optimize Mixed Format KeyedTable with Timestamp(without zone) column as Primary key #2091
  • An infinite loop occurs in merge optimization, and the number of input files is equal to the number of output files. #2090
  • Get incorrect partition field name when refresh tables #2165
  • Catalog type always null in TerminalSession #2146
  • ams server can not initialized on HA mode #2083
  • Delete sync tables when drop external catalogs #2235
  • Data lost after optimizing in Mixed format #2253
Assets 11
Loading