Improve clarification in v13.0.0 release notes

[rzmk]

@jqnatividad from the v13.0.0 pre-release notes:

Local Data - Its "zero-copy"" inspired approach allows you to wrangle very large datasets - WITHOUT sending raw data, only sending statistical metadata to Claude! This is not only good for security and privacy reasons ...

I'd suggest clarifying and also improving the initial label of "Local Data" if the data is being sent to an LLM provider such as Anthropic. The "statistical metadata" can definitely include "raw data", such as entire string column values for min and max from qsv stats. I'm not too concerned about the specifics of how much or little data should be sent as that's per each person's usage but I'd rather not have a label "Local Data" and "WITHOUT sending raw data, only sending statistical metadata to Claude" along with other phrasing as those with data privacy and training concerns would have to look further to understand better exactly what data would be sent.

If I have NYC 311 data the stats output may look like this (click here):

If a dataset had PII imagine the max and min column values or other cases we may not realize.

field                           type     is_ascii  sum          min                                                                                                   max                                                                                                                                                       range       sort_order  sortiness  min_length  max_length  sum_length  avg_length  stddev_length  variance_length  cv_length  mean          sem             geometric_mean   harmonic_mean    stddev           variance             cv       nullcount  n_negative  n_zero  n_positive  max_precision  sparsity
Unique Key                      Integer            185042907    20520945                                                                                              47976463                                                                                                                                                  27455518    Unsorted    0.5                                                                                                   37008581.4    4152662.837     35597336.8032    33941925.2688    9285636.3912     86223043188743.4531  25.0905  0          0           0       5                          0
Created Date                    String   true                   03/30/2019 04:06:23 AM                                                                                10/31/2016 11:07:15 PM                                                                                                                                                Unsorted    0.5        22          22          110         22          0              0                0                                                                                                                         0                                                         0
Closed Date                     String   true                   03/30/2019 04:15:23 AM                                                                                10/31/2016 11:25:37 PM                                                                                                                                                Unsorted    0.3333     0           22          88          17.6        8.8            77.44            0.5                                                                                                                       1                                                         0.2
Agency                          String   true                   DEP                                                                                                   NYPD                                                                                                                                                                  Unsorted    0          3           4           18          3.6         0.4899         0.24             0.1361                                                                                                                    0                                                         0
Agency Name                     String   true                   Department of Environmental Protection                                                                New York City Police Department                                                                                                                                       Unsorted    0          31          50          181         36.2        7.4135         54.96            0.2048                                                                                                                    0                                                         0
Complaint Type                  String   true                   Noise - Residential                                                                                   Water System                                                                                                                                                          Unsorted    0.5        12          23          88          17.6        3.7736         14.24            0.2144                                                                                                                    0                                                         0
Descriptor                      String   true                   Banging/Pounding                                                                                      WALLS                                                                                                                                                                 Unsorted    0          5           21          70          14          5.3292         28.4             0.3807                                                                                                                    0                                                         0
Location Type                   String   true                   RESIDENTIAL BUILDING                                                                                  Street/Sidewalk                                                                                                                                                       Unsorted    0.3333     0           26          87          17.4        9.625          92.64            0.5532                                                                                                                    1                                                         0.2
Incident Zip                    Integer            52691        10025                                                                                                 11373                                                                                                                                                     1348        Unsorted    0                                                                                                     10538.2       278.5963        10520.0739       10502.2747       622.9602         388079.36            5.9114   0          0           0       5                          0
Incident Address                String   true                   117 EAST 118 STREET                                                                                   52 PINEHURST AVENUE                                                                                                                                                   Unsorted    0.5        14          19          88          17.6        1.9596         3.84             0.1113                                                                                                                    0                                                         0
Street Name                     String   true                   91 PLACE                                                                                              WEST 105 STREET                                                                                                                                                       Unsorted    0          8           16          68          13.6        2.8705         8.24             0.2111                                                                                                                    0                                                         0
Cross Street 1                  String   true                   48 AVENUE                                                                                             W 179 ST                                                                                                                                                              Unsorted    0          8           17          62          12.4        3.8781         15.04            0.3128                                                                                                                    0                                                         0
Cross Street 2                  String   true                   50 AVENUE                                                                                             W 180 ST                                                                                                                                                              Unsorted    0.5        8           16          63          12.6        3.4409         11.84            0.2731                                                                                                                    0                                                         0
Intersection Street 1           NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Intersection Street 2           NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Address Type                    String   true                   ADDRESS                                                                                               ADDRESS                                                                                                                                                               Ascending   1          7           7           35          7           0              0                0                                                                                                                         0                                                         0
City                            String   true                   BROOKLYN                                                                                              NEW YORK                                                                                                                                                              Unsorted    0.5        8           8           40          8           0              0                0                                                                                                                         0                                                         0
Landmark                        NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Facility Type                   String   true                   N/A                                                                                                   Precinct                                                                                                                                                              Unsorted    0.3333     0           8           27          5.4         3.3226         11.04            0.6153                                                                                                                    1                                                         0.2
Status                          String   true                   Closed                                                                                                Open                                                                                                                                                                  Unsorted    0.5        4           6           28          5.6         0.8            0.64             0.1429                                                                                                                    0                                                         0
Due Date                        String   true                   03/30/2019 12:06:23 PM                                                                                11/01/2016 07:07:15 AM                                                                                                                                                Unsorted    0          0           22          66          13.2        10.7778        116.16           0.8165                                                                                                                    2                                                         0.4
Resolution Description          String   true                   The Department of Environmental Protection investigated this complaint and shut the running hydrant.  The following complaint conditions are still open.HPD may attempt to contact you to verify the correction of the condition or may conduct an inspection.              Unsorted    0          88          152         576         115.2       24.1611        583.76           0.2097                                                                                                                    0                                                         0
Resolution Action Updated Date  String   true                   03/30/2019 04:15:23 AM                                                                                10/31/2016 11:25:37 PM                                                                                                                                                Unsorted    0.5        22          22          110         22          0              0                0                                                                                                                         0                                                         0
Community Board                 String   true                   04 QUEENS                                                                                             12 MANHATTAN                                                                                                                                                          Unsorted    0          9           12          56          11.2        1.1662         1.36             0.1041                                                                                                                    0                                                         0
BBL                             Integer            10089360216  1017670005                                                                                            4018500012                                                                                                                                                3000830007  Unsorted    0.5                                                                                                   2017872043.2  565133580.5127  1665669820.3428  1418840259.3841  1263677102.3942  1596879819115518976  62.6242  0          0           0       5                          0
Borough                         String   true                   BROOKLYN                                                                                              QUEENS                                                                                                                                                                Unsorted    0          6           9           41          8.2         1.1662         1.36             0.1422                                                                                                                    0                                                         0
X Coordinate (State Plane)      Integer            5012120      995106                                                                                                1019446                                                                                                                                                   24340       Unsorted    0                                                                                                     1002424       3940.7491       1002385.551      1002347.3822     8811.7828        77647516.4           0.879    0          0           0       5                          0
Y Coordinate (State Plane)      Integer            1100842      181752                                                                                                248966                                                                                                                                                    67214       Unsorted    0                                                                                                     220168.4      10251.2686      218919.8194      217618.5165      22922.5334       525442535.44         10.4114  0          0           0       5                          0
Open Data Channel Type          String   true                   MOBILE                                                                                                UNKNOWN                                                                                                                                                               Unsorted    0.5        6           7           31          6.2         0.4            0.16             0.0645                                                                                                                    0                                                         0
Park Facility Name              String   true                   Unspecified                                                                                           Unspecified                                                                                                                                                           Ascending   1          11          11          55          11          0              0                0                                                                                                                         0                                                         0
Park Borough                    String   true                   BROOKLYN                                                                                              QUEENS                                                                                                                                                                Unsorted    0          6           9           41          8.2         1.1662         1.36             0.1422                                                                                                                    0                                                         0
Vehicle Type                    NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Taxi Company Borough            NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Taxi Pick Up Location           NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Bridge Highway Name             NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Bridge Highway Direction        NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Road Ramp                       NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Bridge Highway Segment          NULL                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         5                                                         1
Latitude                        Float              163.1893     40.7415066                                                                                            40.85001341890072                                                                                                                                         0.1085      Unsorted    -0.3333                                                                                               40.7973       0.0192          40.7973          40.7973          0.0384           0.0015               0.0941   1          0           0       4           14             0.2
Longitude                       Float              -295.715     -73.960791                                                                                            -73.8729882                                                                                                                                               0.0878      Unsorted    -0.3333                                                                                               -73.9288      0.0166                                            0.0332           0.0011               -0.045   1          4           0       0           14             0.2
Location                        String   true                   (40.7415066, -73.8729882)                                                                             (40.85001341890072, -73.93972316718485)                                                                                                                               Unsorted    -0.3333    0           39          113         22.6        12.5952        158.64           0.5573

If I have NYC 311 data the frequency output may look like this (click here):

field            value                                    count  percentage  rank
field            <ALL_UNIQUE>                             41     100         0
type             String                                   24     58.53659    1
type             NULL                                     10     24.39024    2
type             Integer                                  5      12.19512    3
type             Float                                    2      4.87805     4
is_ascii         true                                     24     58.53659    1
is_ascii         (NULL)                                   17     41.46341    2
sum              (NULL)                                   34     82.92683    1
sum              -295.715                                 1      2.43902     2
sum              10089360216                              1      2.43902     2
sum              1100842                                  1      2.43902     2
sum              163.1893                                 1      2.43902     2
sum              185042907                                1      2.43902     2
sum              5012120                                  1      2.43902     2
sum              52691                                    1      2.43902     2
min              (NULL)                                   10     24.39024    1
min              BROOKLYN                                 3      7.31707     2
min              03/30/2019 04:15:23 AM                   2      4.87805     3
min              (40.7415066, -73.8729882)                1      2.43902     4
min              -73.960791                               1      2.43902     4
min              03/30/2019 04:06:23 AM                   1      2.43902     4
min              03/30/2019 12:06:23 PM                   1      2.43902     4
min              04 QUEENS                                1      2.43902     4
min              10025                                    1      2.43902     4
min              1017670005                               1      2.43902     4
min              Other (19)                               19     46.34146    0
max              (NULL)                                   10     24.39024    1
max              10/31/2016 11:25:37 PM                   2      4.87805     2
max              QUEENS                                   2      4.87805     2
max              (40.85001341890072, -73.93972316718485)  1      2.43902     3
max              -73.8729882                              1      2.43902     3
max              10/31/2016 11:07:15 PM                   1      2.43902     3
max              1019446                                  1      2.43902     3
max              11/01/2016 07:07:15 AM                   1      2.43902     3
max              11373                                    1      2.43902     3
max              12 MANHATTAN                             1      2.43902     3
max              Other (20)                               20     48.78049    0
range            (NULL)                                   34     82.92683    1
range            0.0878                                   1      2.43902     2
range            0.1085                                   1      2.43902     2
range            1348                                     1      2.43902     2
range            24340                                    1      2.43902     2
range            27455518                                 1      2.43902     2
range            3000830007                               1      2.43902     2
range            67214                                    1      2.43902     2
sort_order       Unsorted                                 29     70.73171    1
sort_order       (NULL)                                   10     24.39024    2
sort_order       Ascending                                2      4.87805     3
sortiness        0                                        13     31.70732    1
sortiness        (NULL)                                   10     24.39024    2
sortiness        0.5                                      10     24.39024    2
sortiness        -0.3333                                  3      7.31707     3
sortiness        0.3333                                   3      7.31707     3
sortiness        1                                        2      4.87805     4
min_length       (NULL)                                   17     41.46341    1
min_length       0                                        5      12.19512    2
min_length       8                                        4      9.7561      3
min_length       6                                        3      7.31707     4
min_length       22                                       2      4.87805     5
min_length       11                                       1      2.43902     6
min_length       12                                       1      2.43902     6
min_length       14                                       1      2.43902     6
min_length       3                                        1      2.43902     6
min_length       31                                       1      2.43902     6
min_length       Other (5)                                5      12.19512    0
max_length       (NULL)                                   17     41.46341    1
max_length       22                                       4      9.7561      2
max_length       16                                       2      4.87805     3
max_length       7                                        2      4.87805     3
max_length       8                                        2      4.87805     3
max_length       9                                        2      4.87805     3
max_length       11                                       1      2.43902     4
max_length       12                                       1      2.43902     4
max_length       152                                      1      2.43902     4
max_length       17                                       1      2.43902     4
max_length       Other (8)                                8      19.5122     0
sum_length       (NULL)                                   17     41.46341    1
sum_length       88                                       3      7.31707     2
sum_length       110                                      2      4.87805     3
sum_length       41                                       2      4.87805     3
sum_length       113                                      1      2.43902     4
sum_length       18                                       1      2.43902     4
sum_length       181                                      1      2.43902     4
sum_length       27                                       1      2.43902     4
sum_length       28                                       1      2.43902     4
sum_length       31                                       1      2.43902     4
sum_length       Other (11)                               11     26.82927    0
avg_length       (NULL)                                   17     41.46341    1
avg_length       17.6                                     3      7.31707     2
avg_length       22                                       2      4.87805     3
avg_length       8.2                                      2      4.87805     3
avg_length       11                                       1      2.43902     4
avg_length       11.2                                     1      2.43902     4
avg_length       115.2                                    1      2.43902     4
avg_length       12.4                                     1      2.43902     4
avg_length       12.6                                     1      2.43902     4
avg_length       13.2                                     1      2.43902     4
avg_length       Other (11)                               11     26.82927    0
stddev_length    (NULL)                                   17     41.46341    1
stddev_length    0                                        5      12.19512    2
stddev_length    1.1662                                   3      7.31707     3
stddev_length    0.4                                      1      2.43902     4
stddev_length    0.4899                                   1      2.43902     4
stddev_length    0.8                                      1      2.43902     4
stddev_length    1.9596                                   1      2.43902     4
stddev_length    10.7778                                  1      2.43902     4
stddev_length    12.5952                                  1      2.43902     4
stddev_length    2.8705                                   1      2.43902     4
stddev_length    Other (9)                                9      21.95122    0
variance_length  (NULL)                                   17     41.46341    1
variance_length  0                                        5      12.19512    2
variance_length  1.36                                     3      7.31707     3
variance_length  0.16                                     1      2.43902     4
variance_length  0.24                                     1      2.43902     4
variance_length  0.64                                     1      2.43902     4
variance_length  11.04                                    1      2.43902     4
variance_length  11.84                                    1      2.43902     4
variance_length  116.16                                   1      2.43902     4
variance_length  14.24                                    1      2.43902     4
variance_length  Other (9)                                9      21.95122    0
cv_length        (NULL)                                   17     41.46341    1
cv_length        0                                        5      12.19512    2
cv_length        0.1422                                   2      4.87805     3
cv_length        0.0645                                   1      2.43902     4
cv_length        0.1041                                   1      2.43902     4
cv_length        0.1113                                   1      2.43902     4
cv_length        0.1361                                   1      2.43902     4
cv_length        0.1429                                   1      2.43902     4
cv_length        0.2048                                   1      2.43902     4
cv_length        0.2097                                   1      2.43902     4
cv_length        Other (10)                               10     24.39024    0
mean             (NULL)                                   34     82.92683    1
mean             -73.9288                                 1      2.43902     2
mean             1002424                                  1      2.43902     2
mean             10538.2                                  1      2.43902     2
mean             2017872043.2                             1      2.43902     2
mean             220168.4                                 1      2.43902     2
mean             37008581.4                               1      2.43902     2
mean             40.7973                                  1      2.43902     2
sem              (NULL)                                   34     82.92683    1
sem              0.0166                                   1      2.43902     2
sem              0.0192                                   1      2.43902     2
sem              10251.2686                               1      2.43902     2
sem              278.5963                                 1      2.43902     2
sem              3940.7491                                1      2.43902     2
sem              4152662.837                              1      2.43902     2
sem              565133580.5127                           1      2.43902     2
geometric_mean   (NULL)                                   35     85.36585    1
geometric_mean   1002385.551                              1      2.43902     2
geometric_mean   10520.0739                               1      2.43902     2
geometric_mean   1665669820.3428                          1      2.43902     2
geometric_mean   218919.8194                              1      2.43902     2
geometric_mean   35597336.8032                            1      2.43902     2
geometric_mean   40.7973                                  1      2.43902     2
harmonic_mean    (NULL)                                   35     85.36585    1
harmonic_mean    1002347.3822                             1      2.43902     2
harmonic_mean    10502.2747                               1      2.43902     2
harmonic_mean    1418840259.3841                          1      2.43902     2
harmonic_mean    217618.5165                              1      2.43902     2
harmonic_mean    33941925.2688                            1      2.43902     2
harmonic_mean    40.7973                                  1      2.43902     2
stddev           (NULL)                                   34     82.92683    1
stddev           0.0332                                   1      2.43902     2
stddev           0.0384                                   1      2.43902     2
stddev           1263677102.3942                          1      2.43902     2
stddev           22922.5334                               1      2.43902     2
stddev           622.9602                                 1      2.43902     2
stddev           8811.7828                                1      2.43902     2
stddev           9285636.3912                             1      2.43902     2
variance         (NULL)                                   34     82.92683    1
variance         0.0011                                   1      2.43902     2
variance         0.0015                                   1      2.43902     2
variance         1596879819115518976                      1      2.43902     2
variance         388079.36                                1      2.43902     2
variance         525442535.44                             1      2.43902     2
variance         77647516.4                               1      2.43902     2
variance         86223043188743.4531                      1      2.43902     2
cv               (NULL)                                   34     82.92683    1
cv               -0.045                                   1      2.43902     2
cv               0.0941                                   1      2.43902     2
cv               0.879                                    1      2.43902     2
cv               10.4114                                  1      2.43902     2
cv               25.0905                                  1      2.43902     2
cv               5.9114                                   1      2.43902     2
cv               62.6242                                  1      2.43902     2
nullcount        0                                        24     58.53659    1
nullcount        5                                        10     24.39024    2
nullcount        1                                        6      14.63415    3
nullcount        2                                        1      2.43902     4
n_negative       (NULL)                                   34     82.92683    1
n_negative       0                                        6      14.63415    2
n_negative       4                                        1      2.43902     3
n_zero           (NULL)                                   34     82.92683    1
n_zero           0                                        7      17.07317    2
n_positive       (NULL)                                   34     82.92683    1
n_positive       5                                        5      12.19512    2
n_positive       0                                        1      2.43902     3
n_positive       4                                        1      2.43902     3
max_precision    (NULL)                                   39     95.12195    1
max_precision    14                                       2      4.87805     2
sparsity         0                                        24     58.53659    1
sparsity         1                                        10     24.39024    2
sparsity         0.2                                      6      14.63415    3
sparsity         0.4                                      1      2.43902     4

So overall I'd suggest adding at least a disclaimer maybe and phrasing that more accurately represent the implications of using the new feature.

[jqnatividad]

OK @rzmk , we'll include the clarification in the next release - v13.1.0 - which I'm pushing to release this weekend.

[jqnatividad]

@rzmk I added a link to this discussion on the v14.0.0 release notes.

[jqnatividad]

And I also added the same footnote to the 13.0.0 release.