Byzer-lang v2.3.2
Byzer-lang 2.3.2 发布声明
发布时间 2022-07-27
很高兴地宣布，今天我们正式发布了 Byzer（Byzer-lang） 2.3.2 版本，提供了更加灵活且稳定的 Byzer 引擎。
主要内容更新
在本次的版本中，我们对 Data Summary ET 进行了一些修复与能力扩充：
- 在计算 Quantile 数值的时候，支持对空值的过滤
- DataSummary ET 中唯一值（distinct count）比例的计算使用 approx_count_distinct 时会存在一定的误差。因此增加 approx 去计算唯一值，设置 approx 计算开关，即支持精确计算（大数据量会有数据瓶颈）。
- 更改 String 数据长度
- 增加非数据类型的列的 mode 值计算
- 优化了算子的聚合值的类型，对于 count 类的算子返回 int 类型
- 修复均值（Mean Values）的返回结果，需要根据 round_at 进行小数位数的保留
- 百分比展示默认保留两位小数 "xx.yy%"，计算时需要保留 round_at + 2 位。
- 重新实现 Quantile 计算，支持精准计算 Quantile 值（Hint：使用的时候注意数据性能瓶颈的问题）
详情见 byzer-extension/issues/31
优化改进
- [byzer-lang/issues/1796]（https://github.com/byzer-org/byzer-lang/issues/1793）
支持 runscript callbackHeader
缺陷修复
- byzer-lang/issues/1796
升级 Byzer All in One 2.3.1 产品包中 OpenJDK 的版本，当前版本 JDK 会导致写文件失败 - [byzer-lang/issues/1649]（https://github.com/byzer-org/byzer-lang/issues/1649）
为 ModelExplain 添加 pathPrefix，使其可以精确定位多组算法模型
下载使用
下载 Byzer-lang 2.3.2 安装包，请点击下方链接获取：
https://download.byzer.org/byzer/2.3.2/
安装部署指南请查看手册： Byzer引擎部署指引
反馈
如果您遇到疑问或者问题，请到 byzer-lang 项目的 Issue 里留言，
或通过邮件联系 PMC Member：pmc@byzer.org
欢迎大家积极反馈使用体验与遇到的问题，共同参与社区建设。
致谢
感谢在 Byzer-lang 2.3.2 版本中做出贡献社区小伙伴们（排名不分先后）：WilliamZhu，hellozepp，jiachuan.zhu，Zhengshuai PENG，ckeys，Lindsaylin
——————————————————————————————————————————————————
Byzer-lang 2.3.2 Release Note
Release Date: 2022-07—27
We are pleased to announce that today we officially released the Byzer（Byzer-lang） 2.3.2 version, which provides a more flexible and stable Byzer engine.
Major Changes
In this version, we have made some fixes and expanded the capabilities for Data Summary ET:
- Support filtering null values when calculating Quantile values
- When the proportion of unique value (distinct count) in DataSummary ET is calculated using approx_count_distinct, there is a certain error. Therefore, set the approx calculation switch to support the precise calculation (There may exist data bottleneck for large data).
- Change the String data length
- Add the mode value calculation for columns.
- Optimize the type of aggregate value of the operator, returning int for the operator of "count".
- To restore the return result of "Mean Values", the number of decimal places should be reserved according to round_at
- By default, two decimals "xx.yy %" are reserved for percentage display. Round_at + 2 decimals are reserved for calculation.
- Optimize Quantile calculations to support precise computation of Quantile values (Hint: be aware of data performance bottlenecks when used)
For more details please refer： [byzer - the extension/issues / 31] (byzer-org/byzer-extension#31)
Enhancement
- [byzer-lang/issues/1796]（https://github.com/byzer-org/byzer-lang/issues/1793）
Support runscript callbackHeader.
Bugfix - byzer-lang/issues/1796
Upgrade the OpenJDK version in Byzer All in One 2.3.1 product package . The current JDK version may cause file writing failure. - [byzer-lang/issues/1649]（https://github.com/byzer-org/byzer-lang/issues/1649）
Add pathPrefix for modelExplain
Downloads
To download the Byzer binary installation package, click the link below:
https://download.byzer.org/byzer/2.3.2/
Feedback
If you meet any problem, please submit an issue in project Byzer-lang
Or contact PMC Member：pmc@byzer.org
Welcome data developers to join and build community ecology.
Acknowledgments
Thanks to those who contributed code to Byzer-lang 2.3.1 (the following ranks are in no particular order): WilliamZhu，hellozepp，jiachuan.zhu，Zhengshuai PENG，ckeys，Lindsaylin
What's Changed
- change byzer package naming by @hellozepp in #1732
- MLSQLRest returns more informative response for different types of errors by @chncaesar in #1739
- change the log file naming by @hellozepp in #1748
- Optimize byzer script by @AdmondGuo in #1745
- fix script & assembly by @AdmondGuo in #1753
- Update LexerUtils.scala by @kaliGo-Li in #1727
- Support ut and it test script1 by @hellozepp in #1755
- Bump logback-core from 1.1.8 to 1.2.9 by @dependabot in #1743
- Add multi file upload support by @anan0120 in #1736
- fix the error of byzer log path by @hellozepp in #1763
- shell script improvement by @ZhengshuaiPENG in #1761
- remove mlsql-version-info.properties by @hellozepp in #1764
- Example prop by @AdmondGuo in #1762
- Mirror Fix about assembly by @AdmondGuo in #1766
- renaming mlsql web console to byzer web console by @ZhengshuaiPENG in #1767
- [Enhancement] Include plugin jars in driver and executor classspath by @chncaesar in #1769
- [BugFix] Fix pagination bug by @chncaesar in #1776
- Upgrade MLSQLRest test case by @chncaesar in #1777
- Adds an options to automatically clean MLSQLRest temp data by @chncaesar in #1778
- refine readme by @ZhengshuaiPENG in #1785
- Load/Train/Run 语法中的 where 条件参数默认被开启了 evaluateDynamicExpression 导致错误 by @allwefantasy in #1760
- Support runscript callbackHeader by @hellozepp in #1787
- Revert "Support runscript callbackHeader" by @allwefantasy in #1789
- Add pathPrefix for modelExplain by @chncaesar in #1794
New Contributors
- @dependabot made their first contribution in #1743
Full Changelog: v2.2.2...v2.3.2
