forked from OPENDAP/olfs
-
Notifications
You must be signed in to change notification settings - Fork 0
/
NEWS
392 lines (251 loc) · 13.1 KB
/
NEWS
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
# OLFS Version 1.18.7 (27 April 2020)
## Features
* Added an ngap service endpoint in support of the NASA NGAP project.
## Bugs Fixed
* Improved content encoding/scrubbing on outbound error messages.
* Fixed bugs in bootstrap init and init for all the various init() components.
* Stabilized the order of output in WCS-2.0
# OLFS Version 1.18.6 (10 February 2020)
## Features
* Added (alpha) support support for server authentication credentials
* Environment injection support for besstandalone and besd
* A credentials configuration file for multiple sets, in which credentials are
associated with URL prefixes and multiple credentials can be defined in a
bes.conf environment.
* Combined Logs: The server can now be configured to add the OLFS request log content to the BES log.
* Earthdata Login User Authentication Support
* The Data Request Form requires data selection is now a configuration parameter,
<RequireUserSelection /> in the olfs.xml file.
* NoDynamicNavigation - Added a trial configuration parameter <NoDynamicNavigation/>
to the olfs.xml file. If this element is uncommented in the olfs.xml file then
all of the dynamically generated catalog/navigation pages will be disabled.
When enabled the server admin must either supply and maintain THREDDS
catalogs to be read by the server, or they have to provide their
own system of navigation and discovery to generate links to the
dataset endpoints (ex. Data Request Form)
## Performance Improvements
* No DAS construction for data response.
## Bugs Fixed
* Memory leak fixed and unneeded copy removed in awsv4 code
* CovJson patch.
* ncml_handler: When an NCML aggregation named a dataset that the server could not read... crsh. Fixed..
* Server cache stabilization
* hdf4_handler: Fixed memory leaks
* hdf5_handler: Fixed memory leaks
# OLFS Version 1.18.5 (08 July 2019)
## DMR++ Aggregations
## Bug Fixes
OPeNDAP Data Request Forms and catalgo pages.
- Corrected JSON-LD encoding in the IFH generated pages.
- Corrected javascript code generation problems.
Path construction bug (causing double "/" characters) in THREDDS catalog
presentation pages. (HK-338)
Security analysis and response.
- Sonar Scan
- Coverity Scan
# OLFS Version 1.18.4 (25 March 2019)
## Features
- Added in mempory LRU cache for BES showNode responses. This is a performance
enhancement. (HK-366)
- Added a site map cache file so that site maps for large instances of
Hyrax(>500k datasets) can be navigated in a few seconds and not hours.
(HK-375)
- Updated Docker containers so that Tomcat is producing compressed responses
when the requesting client indicates that this is acceptable. (HK-329)
- Added response size logging to all metadata and data responses. Error
responses do not have ssociated response size values in the log.
## Bug Fixes
- Added missing code to support all DAP2/4 atomic numeric types in WCS-2.0
(HK-372)
# OLFS Version 1.18.3 (25 February 2019)
## Features:
- Added a context/request sensitive message to all support email links.
- Added support email links to directory/collection pages in addition to error
pages.
- Decoupled support email configuration from site/server administrator
information.
- Added sitemap generation and an (optional) ROOT.war service that adds a
robots.txt service for said sitemap.
- Enable THREDDS catalog brokering for remote catalogs.
## Bug Fixes
- Corrected the CovJson response Content-Type headers
- Repaired incompatibility between IFH Request forms and CentOS-6
- Fixed odd port problem with redirect code.
- Repaired Viewers pages to correctly process encoded URL content.
# OLFS Version 1.18.2 (10 December 2018)
## Features:
- Added new (beta) dynamic siteMap and robots.txt service.
- Added confguration (to BES) for Site admin contact information that
also gets used in the JSON-LD DataCatalog content.
# OLFS Version 1.18.1 (21 November 2018)
- Minor changes mostly a release to support changes in the BES.
# OLFS Version 1.18.0 (26 September 2018)
## Features:
- NEW! Improved! The OPeNDAP Data Request Form!
- CovJson responses for compatible datasets.
- Simplified the OLFS configuration file, olfs.xml (If you are upgrading
you will need to replace your existing file with the new default one and
edit to recover your changes.)
- JSON-LD now in every contents.html page and in every Data Request Form.
- Hyrax now supports the browsing of remote THREDDS catalogs. This feature
is disabled by default, and when enabled will only be allowed to access
remote systems based on the Gateway.Whitelist in the BES.
- Added optional login controls and framework for adding URS (or other)
authentication and identification providers.
- Switched to the OWASP string encoder/decoder.
- Added an additional default configuration location '/use/share/olfs'
## Bug Fixes:
- Added URI encoding to requests generated by the Data Access Forms so that
special characters such as '[' and ']' are now encoded correctly.
- Applied a work-around patch to the THREDDS catalogs generated by Hyrax
to accomodate a java-netcdf problem in which no timezone abbreviations
other than Z (or none at all) are allowed. The patch maps known GMT
equivalents to Z and all other timzones are simpley dropped (which is
also an allowed representation by java-netcdf)
- Repaired Gateway Service UI so that both DAP2 and DAP4 response are
represented and functioning.
- Updated URS client implementation to work with current code base.
# OLFS Version 1.17.0 (16 October 2017)
- Added WCS service.
- Works using templates associated by regex.
- Made the OLFS authentication aware in its http
activities by having it utilize the ~/.netrc credentials
source or one of the same format specified in the configuration.
- Fixed bug in the generation of the "viewers" pages.
# OLFS Version 1.16.4 (09 August 2017)
- Repaired broken RDF responses.
- Updated dependecy Jars.
- Enabled ThreddsCatalogUtil to authenticate against Earthdata Login
- Merged eo-wcs features into master
# OLFS Version 1.16.3 (05 Jun 2017)
- Server timeout conditions now return HTTP status 504 (and not 418).
- Bug fixes in the DAP4 Data Request Form pages.
# OLFS Version 1.16.2 (10 Jan 2017)
- Improved logging, including log rotation.
- Fixed a null pointer exception in the AggregationServlet (the
component that performs user-specified aggregations).
- Repaired viewers.xml configuration for Godiva3
- Issues with the netcdf file response History attribute were fixed,
once again...
- Prompted by user requests we have changed the HTTP status returned when
the server encounters a BES timeout error from 418 (I'm a teapot) to 504
(Gateway Timeout) We really liked the teapot because we felt applying the
504 (Gateway Timeout) status to this error strains the formal definition
of the 504 status code and could lead to confusion down the road.
Time will tell...
# OLFS Version 1.16.1 (02 Nov 2016)
- Updated OLFS configuration defaults in viewers.xml file to reflect
changes for ncWMS2 and Godiva3
- Patched a problem with the way the XSL transforms are carried out
that could have left the process running in an unexpected directory.
# OLFS Version 1.16.0 (06 June 2016)
- Added code to ammend the CF "history" attribute so that
fileout_netcdf responses contain the ammended value that shows
that Hyrax produced it along withg the constraint and id
information of the dataset.
- Added new rules for the Content-Disposition header download file
names. Now the old behavior (add the netcdf file suffix to very
file's basename) can be replaced so that if the suffix will end up
as a duplicate (for example file.nc.nc or file.nc4.nc4), nothing
is appended.
- Added memory cache for BES Catalog responses. This allows the OLFS
to stop asking the same things over and over again. The size and
refresh interval are specified by the "<CatalogCache> element in
the olfs.xml file. If the element is missing then the memory cache
will be disabled.
- Increased the number of simultaneous requests from 10 to 200 ,
which is the default limit for Tomcat.
- Bug fixes
- Large file issues in w10n.
- Fixed build for WCS-2.0
# OLFS Version 1.15.0 (08 February 2016)
- The OLFS regression test harness has been migrated from DejaGnu to AutoTest. This makes writing and maintaining
tests much easier. All of the DejaGnu tests have been migrated and many additional tests added. To configure the
tests:
autoconf -vif
./configure
To run the tests:
make check
- Error handling has been refactored. Error messages from libdap and the BES are now correctly transmitted to the
user. Additionally the HTTP status codes and associated pages are now working correctly and there should be a
significant reduction in the number of "superman" (Internal Error) pages encountered in normal operation.
- The default size of the BES client pool has been increased from 10 to 200 in response to numerous performance
evaluators that failed to recognize that this could be done to increase performance in high traffic environments.
- The OLFS now keeps the BES on a timeout leash so that BES requests that take longer than the time out interval
stated in the olfs.xml will actually timeout and return an associated error to the OLFS.
- !!!!! The location of the OLFS configuration directory has changed !!!!
This change should resolve installation problems with Tomcat instances that are installed from RPM.
By default the OLFS will utilize it's bundled configuration in the directory
$CATALINA_HOME/webapps/opendap/WEB-INF/conf
In order to localize the configuration so that your configuration changes are persistent you will need to do
one of the following:
* For the user that will be running the OLFS (the Tomcat user), set the environment variable OLFS_CONFIG_DIR to
an existing directory to which the Tomcat user has both read and write privileges.
OR
* Create the directory /etc/olfs and set it's permissions/ownership so that the Tomcat user has both read and
write permission.
(If both of these steps are done then priority is given to the environment variable.)
Restart Tomcat. When it starts the OLFS will check these locations and then install a copy of its default
configuration into the new spot.
Edit the configuration files as needed.
If, for example, your beslistener is not running on localhost:10022 then you'll need to edit the olfs.xml
file in the configuration directory and adjust the <host> and <port> values to reflect your situation.
# OLFS Version 1.14.1 (28 October 2015)
Worked under the hood to ensure that Hyrax's character encoding is actually UTF-8.
# OLFS Version 1.14.0 (21 September 2015)
Rollback from Java 8 requirement. Now only Java 7 is needed for the OLFS and Hyrax.
Many bug fixes.
Removal of unused parts of the API.
# OLFS Version 1.13.2 (07 May 2015)
New patched bugs in datasetScan implementation.
# OLFS Version 1.13.1 (24 April 2015)
New datasetScan implementation for THREDDS catalogs provides for all datasetScan activities as described here:
http://www.unidata.ucar.edu/software/thredds/v4.6/tds/reference/DatasetScan.html
As of the day of this writing.
# OLFS Version 1.13.0 (07 April 2015)
New w10n navigation and data access service.
Updated ncWMS integration.
Bug fix in THREDDS catalog inherited metadata injection.
New Swath data aggregation service.
# OLFS Version 1.12.1 (05 January 2015)
Disabled bug in our viewers page that was preventing some valid WMS datasets from receiving WMS and Godiva links.
# OLFS Version 1.12.0 (03 December 2014)
Refactored OLFS configuration file. Installing into
an existing Hyrax instance will require installing
the new opendap.war file; restarting tomcat;
manually copying the file:
$CATALINA_HOME/opendap/initialContent/olfs.xml
to:
$CATALINA_HOME/content/opendap/olfs.xml
and restarting Tomcat again.
Added security patches.
# OLFS Version 1.11.5 (20 October 2014)
Repaired bug that was introducing whitespace
characters into the MIME Type strings extracted
from the clients Accept header, and thus causing '
the server to incorrectly return a HTTP status of 406
# OLFS Version 1.11.4 (14 August 2014)
Refactored OLFS configuration.
Added JSON and IJSN responses.
Added WMS support via ncWMS integration.
# OLFS Version 1.11.3 (02 July 2014)
Repaired bug that was breaking Hyrax's ability to
serve plain files (not otherwise recognized as
'data' by the BES)".
# OLFS Version 1.11.2 (06 June 2014)
Repaired broken nciso production rule.
# OLFS Version 1.11.1 (22 May 2014)
Fixed a bug in the WebStart system.
# OLFS Version 1.11.0 (1 April 2014)
Internal (but as yet not fully released support) for DAP4 responses,
along with stored_result/asynchronous behavior
Bug fixes.
Major changes to internal API.
# OLFS Version 1.10.0 (11 September 2013)
Support for geotiff and jpeg2000 responses.
Bug fixes.
Cruft code removal from code tree.
Support for constraint expressions as POST bodies.
# OLFS Version < 1.10 (06 January 2013)
I created the NEWS file with version 1.10.0 so no
prior versions are represented here.