What’s new in dCache 3.1
The release notes
Highlights
- Plenty of NFS door improvements
- Chimera can track file upload status
- OpenID connect support for WebDAV 3rd party copy
Incompatibilities
- Dropped support for regular expression matching in alarms
Acknowledgments
Thanks to Johan Guldmyr for his constributions.
Differences from dCache v3.0
The notes for release 3.1.0 detail the differences from dCache 3.0. Please read this section very carefully when upgrading from this version.
Release 3.1.35
scripts
The instructions that are printed out once dcache pool convert
completes successfully now correctly point to the
property that needs to be updated, namely pool.plugins.meta
.
Changelog 3.1.34..3.1.35
- fa2e48ddb7
- [maven-release-plugin] prepare release 3.1.35
- f254c2ef2c
- scripts: update reference to configuration property
- d24eeb72bc
- pool: fix metadata migration tool to use Path
- db246f71cf
- [maven-release-plugin] prepare for next development iteration
Release 3.1.34
dcache-resilience
There was a small regression in the way resilience computes the number of operations necessary to adjust copies when a storage unit definition changes.
The current rellease fixed computation of operation count when storage requirements change.
ftp
In order to aid diagnosing problems when FTP response being lost, now dcache logs failures to wrap/encrypt responses.
webdav
The current release improved error handling for client authentication with OpenID-Connect. A more complete set of information is now logged if OIDC delegation fails, supporting the ability to discover why the delegation failed.
Changelog 3.1.33..3.1.34
- d3d13fb
- [maven-release-plugin] prepare release 3.1.34
- 89b3a98
- scripts: add support for parsing ZooKeeper transaction logs
- f08a33d
- ftp: log failures to wrap/encrypt responses
- 7c323dc
- dcache-resilience: fix computation of operation count when storage requirements change
- 3701fb3
- webdav: log errors if OIDC delegation fails
- b6adcd9
- [maven-release-plugin] prepare for next development iteration
Release 3.1.33
ftp
Error reporting in the FTP service has been improved: in some mixed IPv4 / IPv6 scenarios, only unclear error messages were reported.
Changelog 3.1.32..3.1.33
- 18bdc90167
- [maven-release-plugin] prepare release 3.1.33
- 9d5ec21eaa
- ftp: returned error is too vague for meaningful investigation
- 7ec05b8f0f
- [maven-release-plugin] prepare for next development iteration
Release 3.1.32
gplazma
gplazma now supports a Fermilab-specific authorization data source in JSON format.
pool
During active ftp transfers, connection problems would lead to the rather unhelpful error message “451 General problem”. This error reporting was refactored, so that diagnosis of the cause is now greatly facilitated.
poolmanager
A potential NullPointerException (that was not observed in real-world usage until now) was fixed in Pool Manager.
resilience
A correction to resilience’s error handling results in no more reports on non-resilient (but corrupted) files.
skel
A set of old properties controlling alarms that have been marked as deprecated before are now forbidden.
spacemanager
In order to facilitate debugging, Space Manager now logs link-group related content in greater detail.
Changelog 3.1.31..3.1.32
- 3a2169d6d9
- [maven-release-plugin] prepare release 3.1.32
- 4a5f1cad02
- poolmanager: fix migration command if named pool is removed
- 67967f44ba
- dcache-resilience: repair over-aggressive handling of broken file messages
- 5cfec763db
- pool: fix error message for failed active FTP transfers
- 964a3a3187
- fix the project version in pom.xml
- a8215d2f72
- gplazma-fermi: fix last modified check in junit test
- 5b1c43982b
- spacemanager: add remote pool monitor debug logging
- f8c0363010
- gplazma-fermi: add mapping plugin to support VO group and username from file
- d85a87350f
- skel: make deprecated alarms properties forbidden
- 0bfdadac3b
- [maven-release-plugin] prepare for next development iteration
Release 3.1.31
resilience
Logging for cases where file replication was fatally aborted was improved. Previously, alarms messages pertained to the PNFSID of the affected files. In rare cases, like when facing network congestion, many hundreds of alarms could be created. With this change, alarms messages refer to the storage unit, and a suffix based on an hourly timestamp is added to the alarm message. The alarm will thus be incremented during the hour but a new alarm will be created (only) hourly; in this way, those receiving email alerts will receive them once an hour.
Changelog 3.1.30..3.1.31
- 099c5d2803
- [maven-release-plugin] prepare release 3.1.31
- d10d458c13
- alarms: fix broken path
- 94870ff83b
- [maven-release-plugin] prepare for next development iteration
- a6ce72058d
- substituted Calendar for Instance which was failing.
- 05383a7a36
- dcache-resilience: avoid spamming alarms with abort messages
Release 3.1.30
ftp
A bug (that was not observed in real-world settings yet) that might have caused NullPointerExceptions was fixed in the ftp service.
httpd
dCache will no longer log a stack-trace if HTTP requests are made asking for information from the info service when the info service is not running.
poolmanager
dCache 3.0 introduced a regression where a dCache domain does not start up if it hosts a poolmanager with poolmanager.conf containing either the “rc set sameHostCopy” or the “rc set sameHostRetry” command. This regression was fixed.
resilience
Error handling within the Resilience service was improved.
Changelog 3.1.29..3.1.30
- 13c13841ea
- [maven-release-plugin] prepare release 3.1.30
- d5d2b5d349
- dcache-resilience: handle properly RuntimeExceptions from tasks
- a2e92188c8
- ftp: ensure adapter is closed
- 1093e95890
- ftp: remove rare NullPointerException when proxying data
- d9a0e4a020
- httpd: do not log an exception if info cell not running
- 14a437035a
- poolmanager: fix poolmanager startup with certain poolmanager.conf content
- 758772c015
- [maven-release-plugin] prepare for next development iteration
Release 3.1.29
dcache-resilience
When a checksum or broken file message/error is generated, Resilience makes a best effort to (a) remove the broken copy and (b) make another replica. This, of course, is not always possible, particularly if the broken file is the only accessible copy. This resulted in faulty behavior particularly the thrashing noted in the case of a restaging operation which results in a checksum error. This is now fixed.
The current release improved error handling for resilience. It fixed unnecessary Migration Task exceptions resulting from source pools with no replica in the repository.
Now it should be possible for Resilience to use pools blocked only for writes from doors.
Changelog 3.1.28..3.1.29
- 9671b92
- [maven-release-plugin] prepare release 3.1.29
- 49f750f
- bad commit put DOWN twice
- 8b40d82
- dcache-resilience: define non-writable pool to mean p2p-client is disabled
- 582f231
- dcache: fix remote pool monitor wait bug
- 3dd8aa8
- dcache-resilience: repair handling of broken files*
- 51c2bfb
- [maven-release-plugin] prepare for next development iteration
- efe0d91
- dcache-resilience: fix bug in source handling with Clear Cache Location messages
Release 3.1.28
cells
The current release added explicit ZooKeeper/Curator monitoring. Events generated by ZooKeeper and Curator are now logged in a new, which may help diagnose problems that are suspected to come from bad ZooKeeper interaction.
frontend
The current release improved the error handling to work with Jackson exceptions.
Changelog 3.1.27..3.1.28
- f19d514
- [maven-release-plugin] prepare release 3.1.28
- 8e504a8
- dcache-resilience: fix wrong assumption about error type in Message
- b649d82
- cells: add explicit ZooKeeper/Curator monitoring
- 70cd7db
- frontend: Map requests with bad JSON to HTTP 400 Bad Request status code
- d9685d9
- [maven-release-plugin] prepare for next development iteration
Release 3.1.27
nfs
NFS door has been updated to return NFS4ERR_LAYOUTUNAVAILABLE for DOT files.
star
The current release improved documentation to help dCache admins to have a better understanding of how to generate StAR record.
The current release fixed fix printing exception error message for dcache-star script if there’s a problem when run with newer versions of Python.
Changelog 3.1.26..3.1.27
- 3c489d7
- [maven-release-plugin] prepare release 3.1.27
- ac06cd7
- nfs: return LAYOUTUNAVAILABLE for DOT files
- 844c0e4
- star: fix printing exception error message
- d913a42
- star: update documentation to provide better description of script
- e1b4fe4
- [maven-release-plugin] prepare for next development iteration
Release 3.1.26
info
The info service collects information about who is allowed to reserve space.
Since some of this information, like VOs, usernames and gids, may be considered
sensitive information, this update allows admins to control whether or not
to publish them. The default behaviour is unchanged from the previous behaviour,
i.e. info publishes everything. If a site admin wants to change this,
the info.limits.show-only-vo-authz
property can be set to true
.
scripts
The dcache script and manpage still refered explicitely to Java 6. This patch changes the phrasing of the respective text.
Changelog 3.1.25..3.1.26
- 1121bd4a3a
- [maven-release-plugin] prepare release 3.1.26
- f3f2d8f0c7
- scripts: update reference to JDK to avoid mentioning specific java version
- c2eff238db
- info: allow admin to control whether non-VO / non-FQAN identities are shown
- 769c72a044
- [maven-release-plugin] prepare for next development iteration
Release 3.1.25
chimera
The current release fixed previously introduced issues for lost+found
directory permissions.
Now, the lost+found
directory permissions is updated without causing
problems if that directory has been removed or permissions have been
modified.
Changelog 3.1.24..3.1.25
- d0d0dda
- [maven-release-plugin] prepare release 3.1.25
- 646a6f0
- chimera: correct previous attempt to fix ‘lost+found’ directory permission
- 794644b
- [maven-release-plugin] prepare for next development iteration
Release 3.1.24
nfs
The current release fixes transfer leak, if the door failed to start a mover.
pnfsmanager
The current release improves documentation for set log slow threshold
admin command help.
spacemanager
When trying to upload into dCache using a space-token where there is no selectable link for this operation then the user was presented with a generic error message; for example,
No write links configured for [net=131.169.71.98,protocol=GFtp/2,store=dot:user@osm,cache=,linkgroup=]
.
This behavior is changed now and an improved error message is returned to the user if they attempt an upload data into dCache using a space-reservation in a way where
poolmanager
configuration prevents the upload.
webdav
The current release improved error handling when dCache is full.
Changelog 3.1.23..3.1.24
- 710eed6
- [maven-release-plugin] prepare release 3.1.24
- 9d95040
- systemtest: work with new OpenSSL DN format
- e4a66f7
- spacemanager: provide space-specific error message on bad upload
- 425ed04
- webdav: return 507 Insufficient Storage when dCache is full
- 9cef515
- pnfsmanager: update slow logging admin command help
- ca2ff7b
- nfs: fix transfer leak, if the door failed to start a mover
- 1d4967c
- [maven-release-plugin] prepare for next development iteration
Release 3.1.23
cells
dCache no longer logs stack-traces when running multiple cells with the same name.
pool
For certain failures,the pool was logging transfer failures twice. This is now fixed.
rpm
dCache ensures now that user ‘dcache’ is a member of group ‘dcache’.
star
The current release Introduced new property star.db.*
, which makes possible now to run PostgreSQL on non-standard ports can use STAR.
statistics
Timeout in contacting PoolManager no longer results in a stack-trace being logged.
Changelog 3.1.22..3.1.23
- 71cf627
- [maven-release-plugin] prepare release 3.1.23
- 585ecb4
- [maven-release-plugin] prepare for next development iteration
- 6dc8c9f
- pool: fix double logging on remote FTP transfer error
- ebebb47
- pool: Fix how certain bugs are logged
- 8367510
- star: support PostgreSQL running on non-standard TCP ports
- da9d343
- rpm: don’t assume existing dcache user is member of dcache group
- 9d0b51c
- cells: don’t log stack-trace on starting cell with same name as running cell
- 1dde970
- statistics: avoid stack-trace on internal timeout
Release 3.1.22
admin
The admin interface reported an attempt to connect to an absent cell as a bug. The current release fixed the issue.
httpd
Requests to httpd targeting an unknown resource was returning 200 OK
response code. Nevertheless the 404 NOT FOUND
response would be closer fit. This is now fixed.
nfs
The current release corrects inaccurate documentation of nfs.enable.pnfsmanager-query-on-move
.
pool
Closing dcap mover connection no longer logs a stack trace.
Changelog 3.1.21..3.1.22
- 6dc76ac
- [maven-release-plugin] prepare release 3.1.22
- 41f5590
- nfs: fix documentation of nfs.enable.pnfsmanager-query-on-move
- 2dbd723
- admin: do not report attempts to connect to missing cell as a bug
- 0edf1de
- pool: fix stack-trace when closing dcap mover connection
- 510516c
- httpd: return 404 status code on an unknown page
- 9d6a1bc
- [maven-release-plugin] prepare for next development iteration
Release 3.1.21
Changes affecting multiple services
dCache no longer logs stack-traces if a Java VirtualMachineError occurs. This is unnecessary as dCache was (presumably) working fine until Java discovered a problem.
chimera
Sites updating to dCache 2.15 or later might observe that a lost+found directory with incorrect permissions was created during the update. This patch ensures correct permissions. Since we cannot know if the current permissions in lost+found are intended, this patch does not modify any existing lost+found directory permissions.
pool
The sweeper free
command no longer logs a stack trace if it is started with incorrect input information.
An irrelevant stack trace was logged by the pool. This release corrects that.
Changelog 3.1.20..3.1.21
- 60c00d59ab
- [maven-release-plugin] prepare release 3.1.21
- 067a924d47
- chimera: update schema migration when creating ‘lost+found’ directory.
- 615ecbf90b
- pool: fix stack-trace on bad command input
- 43bef5f47c
- pool: fix stacktrace on FaultEvent logging
- 4915654b99
- system: Don’t log stack-trace on fatal JVM error
- afe4f5e686
- [maven-release-plugin] prepare for next development iteration
Release 3.1.20
alarms
Until now, the sorting order of alarms did not provide a correct ordering for all types of alarms. With this release, alarms are now implicitly ordered by at least their latest modification timestamp.
resilience
One of the features of resilience is the enforcement of file partioning on pools according to pool tags. The pool tag restrictions are observed whenever a file is copied. In addition, it is rechecked when a storage unit is updated, in order to make sure the files are distributed correctly according to the new requirements. This is done by removing the offending copies and recopying them in a new location.
Should files get redistributed, however, by rebalancing or a migration job, it is possible that the partitioning will be violated, since only resilience observes it.
The resilience service now verifies that files are distributed according to the requirements specified by pool tags while doing periodic scans (or scans initiated through the admin command).
statistics
A possible race condition was removed from the implementation of the create stat
admin command.
Changelog 3.1.19..3.1.20
- 53f0a17c12
- [maven-release-plugin] prepare release 3.1.20
- fcb4faa929
- statistics: fix race in “create stat” admin command
- d5f34e89de
- srm: fix stacktrace on database failure
- 0748fe98a4
- alarms: revert LogEntry.compareTo() to throw NPE on null object
- ea90412a71
- resilience: force tag partition checking on scans from admin command and periodic checks
- 8df66795d7
- alarms: fix natural order comparator to use timestamp first
- 72563ffb16
- [maven-release-plugin] prepare for next development iteration
Release 3.1.19
dcap
A pool that has gone offline and comes back up again may become very slow to respond due to a large amount of superfluous error messages to dcap clients that disconnected in the meantime. This patch ensures a more responsive reaction to these cases by introducing a time-to-live value for such messages.
pool
Error reporting was improved for cases of IO errors in pools.
Changelog 3.1.18..3.1.19
- b40a7114b4
- [maven-release-plugin] prepare release 3.1.19
- 2eeddcc26d
- pool: avoid ‘null’ and other nondescript error messages
- 0c03b8888c
- [maven-release-plugin] prepare for next development iteration
- 761898927d
- dcap: add TTL information to dcap messages
Release 3.1.18
Changes affecting multiple services
Many dCache components use RemotePoolMonitor to provide fast access to the information that PoolManager has about pools. In order to facilitate system diagnosis, the ‘info’ admin command was augmented by information about the current status of the RemotePoolMonitor.
pool
A bug in gfal2 results in FTP transfers being aborted some 50 ms after being initiated. This results in the door killing the mover shortly after the pool received the PoolDeliverFile message. If the mover is not queued, but not yet fully started, this may lead to the pool disabling itself. This patch corrects that problem, ensuring that the pool continues to run despite any aborted transfers.
xrootd
In the 4.7 releases, the xrootd client started enforcing protocol requirements for kXR_login which, unfortunately, broke access to dCache. The xrootd client expects an answer with a 16-character session ID from the door and then the pool after the redirection. Without this ID, the client would retry (without success) repeatedly and appear to hang.
dCache’s xrootd implementation has been augmented with the session ID, enabling it to work with xrootd clients of version 4.7 and up.
Changelog 3.1.17..3.1.18
- 9c1b699547
- [maven-release-plugin] prepare release 3.1.18
- 98a3c6c43a
- many: add diagnostic information about remote pool monitor
- 9ea035f83d
- pool: dont disable pool if mover cancelled before open
- c669be7638
- [maven-release-plugin] prepare for next development iteration
- 4e791a9cd0
- dcache: fix bug in PoolSelectionUnitV2 match()
- 51159b2435
- dcache-xrootd: Fix login handshake to support xrootd clients (> 4.7.0)
- c9155d17a8
- dcache-xrootd: (WIP) Add support to the xrootd (kxr)posc flag in (kXR)open.
Release 3.1.17
cells
The current release improved some problematic error messages has better error reporting to ensure bugs are understood.
httpd
The curren release fixed the issue of change of format in transfers.txt after upgrading from 2.13 to 2.16.
pool
The current release fixed log and alarms duplication when rebuilding broken entry.
webdav
Regression fixed in OPTIONS output.
Changelog 3.1.16..3.1.17
- f16c05b
- [maven-release-plugin] prepare release 3.1.17
- c62d4ca
- httpd: restore millis to transfer time for transfers.txt
- 7564d4f
- chimera: fixed database query for storing multiple checksums for a file.
- 2a8fe83
- pool: fix log and alarms duplication when rebuilding broken entry
- 1fc84b8
- cells: better error reporting to ensure bugs are understood
- d1b1789
- webdav: fix regression in OPTIONS response
- 022840f
- chimerashell: use chimera.db.* options as defaults
- d8961f4
- [maven-release-plugin] prepare for next development iteration
Release 3.1.16
nfs
The nfs doors did not shut down cleanly. This slowed down the shutdown sequence. This is now fixed and dCache shutdown is faster and less likely to suffer problems.
pool
The current release fixed regression in GridFTP OPTS CKSM command and GridFTP OPTS CKSM
command is supported again.
The current release fixe regression with third-party pull transfers using GridFTP, with dCache acting as the GridFTP client that prevented data integrity checks.
resilience
When resilience tries to copy or remove a file, and it is no longer in the namespace, this should be a fatal error, differently from the discovery that a replica is no longer in cache. These two errors, however, were treated the same way. This is now fixed and the correct behavior is immediate abort of operation when file is not in namespace.
The current release improved error handling for file deletion during scan correctly it fixed bug in formatting and handling of cache exception types.
When doing a pool scan, the storage unit information must be recovered for each file. This is done from the chimera attributes. The code checks an internal map for an index number corresponding to the unit it knows about from the PoolMonitor.
However, if the pool selection unit configuration changes such that a storage unit is eliminated, that mapping will also be deleted from resilience. In the case that the attributes stored in Chimera still have the older storage class information, there will be a NoSuchElementException thrown.
This is fixed now and Pool scans that encounter this situation do not get stuck forever in the queue.
webdav
In RFC 7230, section 3.2, it states that HTTP header names should be case insensitive. Despite this, the standard milton mechanism for acquiring header information is case sensitive, which (in turn) means that several HTTP header values in dCache are similarly case sensitive. There were reports that this case sensitivity has caused problems with certain clients (e.g., go). The current release fixed this issue and headers that control third-party transfers are now case insensitive, so should work with more clients.
Changelog 3.1.15..3.1.16
- 67ced36
- [maven-release-plugin] prepare release 3.1.16
- d9fdbbe
- Update FileOperationHandler.java
- f0e6971
- pool: fix data integrity regression for 3rd-party GridFTP pull transfers
- 890ebb6
- pool: fix regression in GridFTP OPTS CKSM command
- d30f800
- resilience: handle file deletion during scan correctly
- 31dbeb0
- pool: ceph: ignore file-not-found on remove
- 260b555
- resilience: add pool operation logging
- c7764a8
- resilience: handle storage unit NoSuchElement failure
- 29625d7
- nfs: shutdown callback ScheduledExecutorService on shutdown
- b81786d
- webdav: adjust header parsing to be case insensitive
- bd02e6d
- resilience: handle all cases where no locations for file may be discovered
- c70583e
- resilience: distinguish correctly between file not in repository and file not found
- dce1a67
- resilience: fix bug in formatting and handling of cache exception types
- a070892
- srmclient: remove non-functioning script with BASH dependencies
- aa2ef59
- ftp: update exception logging to include context
- 27d0e67
- [maven-release-plugin] prepare for next development iteration
Release 3.1.15
cells
The current release improved handling of rogue domains with badly formatted dCache versions.
configuration
There are configuration options in zookeeper that may affect how well the zookeeper cluster will work with dCache. The lack of documentation of how dCache uses zookeeper prevents admins from tuning their zookeeper instance. This is now fixed and zookeeper configuration is updated with hints on how dCache uses zookeeper, along with the corresponding zookeeper configuration properties.
pool
The current release fixed loading setup
that requires queues created by pool.queues
.
webdav
The current release fixed the stack-traces on bad client input.
Changelog 3.1.14..3.1.15
- aa82c54
- [maven-release-plugin] prepare release 3.1.15
- 3dfcc64
- cells: better handling of rogue domains with badly formatted dCache versions
- 0dd102e
- configuration: update zookeeper configuration with hints
- ad3e9b0
- pool: fix loading ‘setup’ that requires queues created by ‘pool.queues’
- ca1667d
- webdav: avoid stack-trace on bad user requests
- ad54a1f
- alarms: guard against NPEs on LogEntry getters
- 265141c
- [maven-release-plugin] prepare for next development iteration
Release 3.1.14
admin
While migration move
tasks on pools were working correctly, for migration info
command an error occurred,
that the current user (root) wasn’t allowed to execute anything (due to missing ACLs). This is now fixed.
pool
The current release fixed fix regression in HTTP third-party transfer with redirection and third-party transfers work again when uploading to services that redirect-on-PUT (such as dCache, if so configured).
webdav
The current release several regressions with CredentialSource.NONE
.
The current release fixed regression in third-party copy with no delegation.
Changelog 3.1.13..3.1.14
- 21911f4
- [maven-release-plugin] prepare release 3.1.14
- 5f4a0b9
- admin: Fix Inconsistent ACL enforcement, RT 9207
- d1e8a12
- webdav: fix more regressions with CredentialSource.NONE
- 170d278
- pool: fix regression in HTTP third-party transfer with redirection
- f9d721f
- webdav: fix regression in third-party copy with no delegation
- 7d31759
- [maven-release-plugin] prepare for next development iteration
Release 3.1.13
configuration
For some services it was unclear what were the admin’s responsibilities in terms of consistent configuration. The current release updated the documentation describing what is needed to deploy redundant services.
resilience
The current relase improved configuration for namespace provider properties by making them immutable.
srm
The current release improved configuration for srmPing
responses.
Changelog 3.1.12..3.1.13
- 2bd7e5e
- [maven-release-plugin] prepare release 3.1.13
- 9132256
- configuration: update description for replicable
- 928749b
- resilience: remove reference to pnfsmanager property
- 9b00497
- srm/srmmanager: fix srmPing confusion
- 0675c6b
- [maven-release-plugin] prepare for next development iteration
- 3399e1b
- removed the conflict markers
- 17b3f2d
- resilience: make namespace provider properties immutable
Release 3.1.12
billing
The current release added documentation that describes how a CellAddress
and its fields
expand.
config
The current release improves documentation for dCache admins by adding obsolete|forbidden
annotation for dropped properties.
This helps admins to discover changes that might affect their dCache
instance. This is both through manual inspection and through the
dcache check-config
command.
ftp
It has been discovered that timestamp facts reported by dCache
GFTP server are expressed in local (to server) time.
This is now fixed. Timestamp facts are reported in GMT.
Clients like globus-url-copty -sync
work properly and ubefrtp -ls
returns correct timestamp.
srm
The current release added new configuration properties to allow easy modification.
It upstated as well srm/manager.properties
documentation to describe the relationship between srmmanager.root
and srm.loginbroker.root
properties.
Changelog 3.1.11..3.1.12
- 760f8ef
- [maven-release-plugin] prepare release 3.1.12
- 0f7291d
- srm/srmmanager: update documentation about root path
- 595d260
- ftp: convert timestamps to GMT (to follow RFC 3659)
- 3a0f6c0
- config: use consistent terminology
- eda1b59
- billing: update documentation to describe CellAddress
- 1299362
- srm,srmmanager: add configuration property to allow easy modification of srm root
- 1f9600d
- logback: make socket appender construction depend on log level
- 75c5b3a
- dcache: release dcache-view 1.2.2 for dcache 3.1
- 878dc3b
- config: add obsolete|forbidden annotation for dropped properties
- 3867d1f
- [maven-release-plugin] prepare for next development iteration
- 7f39fab
- config: add obsolete|forbidden annotation for dropped properties
- 4f4ed8f
- pnfsmanager: remove obsolete comments from properties file
Release 3.1.11
Changes affecting multiple services
Christoph Anton Mitterer submitted several corrections to the comment string in properties files.
srm
The ‘-version’ command-line option previously only returned information about which SRM specification version is supported, but not the srmclient version. This patch changes the srmclient version information string to include both client version and SRM compatibility.
zookeeper
A race condition in zookeeper caused irrelevant stacktraces to be logged on shutdowns. Since this problem is not easily solvable with Zookeeper 3.4, we decided to change the log-level threshold for NIOServerCnxnFactory. Note that the suppressed class is only used by ZooKeeper server (i.e., not the client). Therefore, only the ‘zookeeper’ service is affected.
Changelog 3.1.10..3.1.11
- a1aa2a9f55
- [maven-release-plugin] prepare release 3.1.11
- ad5be09e65
- use correct terminology
- d5fc3fc153
- fixed several typos in the documentation
- fa30bd0e02
- added hint that pnfsmanagers must use the same DB
- 75413984e0
- srmclient: give version of srmclient
- 84f55fb998
- zookeeper: work-around race-condition in zookeeper server shutdown
- 35722dbac3
- [maven-release-plugin] prepare for next development iteration
Release 3.1.10
admin
Fix idle timeout so that dCache honours the configuration properties
admin.ssh.idle-timeout
and admin.ssh.idle-timeout.unit
.
httpd
The “Disk Space Usage” webpage (/usageInfo
) contains a table showing
information about each pool in the dCache cluster. The “Layout”
column showed the capacity usage graphically, with different colours
showing how much of that pool’s capacity is being used for different
tasks. This release fixes the Layout heading to describe a previously
undocumented colour.
Changelog 3.1.9..3.1.10
- 6eb681a
- [maven-release-plugin] prepare release 3.1.10
- ed07ba5
- ssh: fix handling of ssh idle timeout
- 7fc55df
- system-test: add series of functional test for frontend service
- aa735b3
- [maven-release-plugin] prepare for next development iteration
- 53177d0
- httpd: Fixed table headers in usageInfo
Release 3.1.9
frontend
Several improvements are added to frontend such as restriction usage is improved and easily configurable JSON is now available via frontend.
poolmanager
The current improved unit-tests to make them more reliable.
srm
The current release enforced restrictions on srmSetPermission
operations.
zookeeper
The current release fixed race-condition when ZooKeeper server accepts requests before the server is fully initialised.
Changelog 3.1.8..3.1.9
- fa7ba27
- [maven-release-plugin] prepare release 3.1.9
- 63aeaf7
- frontend: refactor static (configuration) data
- 7a1b024
- spacemanager: dont try to release expired spaces
- 6aee043
- srmmanager: use path to support srmSetPermission operations
- 183e58d
- frontend: fix Restriction usage
- d3f2ed0
- poolmanager: fix unit-test to avoid race-condition
- 357de74
- zookeeper: work-around SessionTracker racy initialisation on startup
- d24abfa
- [maven-release-plugin] prepare for next development iteration
Release 3.1.8
Changes affecting multiple services
dCache previously shipped both log4j and log4j-over-slf4j libraries. This patch simplifies deployment and prevents possible problems due to non-deterministic library loading sequences by removing log4j dependencies.
frontend
If frontend was asked to create a directory listing while a file was being uploaded into the directory being listed, previously, an error would occur. This patch addresses that issue.
This release includes a new dCacheView version.
info
The info cell can occasionally send messages before it is properly registered. This can lead to Cannot send message with callback in state...
messages that
do not correspond to any valid error condition. This patch ensures that messages are only sent as soon as the cell is properly registered.
pool
If the communication between a pool and PnfsManager times out, the error message is not well suited to diagnosing the problem:
Failed to instantiate mover due to unsupported checksum type: Request to [>PnfsManager@local] timed out.
The checksum type is
not playing an important role here. Hence, this patch updates the error message.
zookeeper
Embedded Zookeeper instances would occasionally log stack-traces on startup. This patch adds a work-around.
Zookeeper logs a stack-trace in cases where the client disconnects unexpectedly. This is unnecessary and potentially confusing, so this patch changes Zookeeper’s behaviour to just logging the incident.
Changelog 3.1.7..3.1.8
- e5b9c6f94b
- [maven-release-plugin] prepare release 3.1.8
- a5939058d3
- dcache: release dcache-view 1.2.1 for dcache 3.1
- a2092a23a3
- zookeeper: work-around racy startup
- cc8cae2998
- zookeeper: silence ZK server errors
- 592d7ecb9f
- dependencies: remove log4j jar
- 61e49d91b7
- frontend: fix “Attribute is not defined: SIZE” bug
- b63a3e361f
- pool: fix error message on timeout
- 1a76715347
- info: avoid sending messages too early.
- c1d00aa457
- frontend,webdav: add supress-wwwauthenticate to allow headers
- b4cae3b794
- [maven-release-plugin] prepare for next development iteration
Release 3.1.7
frontend
Clients can now send a Suppress-WWW-Authenticate
header in order to avoid the native login dialog in browsers.
hsm
A potential space leak in staging requests has been mitigated.
pool
Since there are various reasons for why a mover may be terminated, the previous log message “Transfer was forcefully killed” is not detailed enough to deduce the reason behind the problem. This patch enables more detailed error messages both in the log files and in billing. Note, however, that the door’s report of the failed transfer may duplicate this information.
webdav
A recent update, commit 5abc0e1c, improved the behaviour of the Milton WebDAV libraries if an IOException occurs during an upload. That patch, unfortunately, did not address all issues, and when non-spec-conformant clients are used against dCache, stacktraces can be triggered.
This patch corrects that behaviour. Also, in case of errors, the error code returned in case of any problems was changed from 400 to 500, which should signal cliens that they are free to retry the transfer after a timeout.
In case of failing transfers, doors will log more accurate information.
Changelog 3.1.6..3.1.7
- 5a4f1135fc
- [maven-release-plugin] prepare release 3.1.7
- 759ea0e32f
- authentication: suppress WWW-Authenticate if requested
- ddbb94b2c3
- webdav: improve logging on transfer failures
- ee9dbc1848
- pool: log why a transfer was forcefully aborted
- a3eecab1d4
- webdav: make Milton work-around more robust
- 60942b1a88
- script-nearline-spi: fix space leak when polling script is used
- 3b21208792
- [maven-release-plugin] prepare for next development iteration
Release 3.1.6
http
In an HA setup with multiple pool managers, the httpd (old) service failed to fetch the list of restore requests from all instances. Instead the service would query one of the instances, possibly alternating depending on the grouping of services in domains. This behaviour has been corrected, so that the http interface now shows all restored entries even in HA configurations.
webdav
File transfers through WebDAV doors could potentially bypass any Restrictions checks in PnfsManager. This patch ensures that Restrictions are always checked and observed, and improves PnfsManager’s logging to give information in case a Restrictions check is not posssible.
Changelog 3.1.5..3.1.6
- c2ec867943
- [maven-release-plugin] prepare release 3.1.6
- 8e85ea4593
- webdav: Fix restriction check when downloading a file
- 716085c663
- [maven-release-plugin] prepare for next development iteration
- fd903fee0c
- httpd: Fix incomplete restore list in HA setup
Release 3.1.5
frontend
OpenID connect can now be enabled from dCacheView. This change introduces three new
properties in the frontend.properties
file,
frontend.dcache-view.oidc-provider-name-list
,
frontend.dcache-view.oidc-client-id-list
and
frontend.dcache-view.oidc-authz-endpoint-list
,
all of which are documented in the properties file.
pinmanager
Upgrades from dCache 2.13 could occasionally fail during the Liquibase update stage.
The database table pinsv3
can not be dropped if it is still referenced by foreign
keys of other tables. This modification adds a cascadeConstraints=true
modifier to
the dropTable command used during the conversion process. Thereby, updates are possible
without errors and PinManager starts without issues after an upgrade.
rest-api
Requests to /api/v1/user now include the username of the requestor. This is intended to make working with OpenID Connect tokens easier.
Changelog 3.1.4..3.1.5
- af98d898fa
- [maven-release-plugin] prepare release 3.1.5
- fef385d10b
- httpd, admin: Fix some hard-coded cell names
- f57cf0a61c
- frontend: expose open-id connect to dcache-view
- 2d0550e065
- rest-api: include username to the user attributes
- 1f0c8ad40a
- Add cascadeConstraints=“true” to liquibase dropTable action on pinsv3 table
- 801ca79374
- [maven-release-plugin] prepare for next development iteration
Release 3.1.4
nfs
Invalidation of VFS caches has been improved, so that there is no stale information left for dot files.
pool
Error handling in pools was improved for systems using CEPH backends.
Changelog 3.1.3..3.1.4
- 711ad6df22
- [maven-release-plugin] prepare release 3.1.4
- fcc95b32bc
- nfs: bind vfs cache invalidation with file’s layout
- c4266f72ce
- ceph: map RadosException to corresponding IOException
- f7d067ca03
- [maven-release-plugin] prepare for next development iteration
Release 3.1.3
nfs
Debugging of stuck transfers has been facilitated by adding the status of transfers to the output of the show transfers
command.
The assignment of movers to NFS doors has been made more robust.
system-test
The system-test module, used for demonstration or testing purposes, comes with a built-in X.509 infrastructure. With this release, expired certificates are replaced by new ones.
Changelog 3.1.2..3.1.3
- 1d031ae198
- [maven-release-plugin] prepare release 3.1.3
- 8d6a141f84
- nfs: show transfer status when displayed
- 14df6b8234
- system-test: update disposable-CA generated credentials
- e1ddd06f0f
- nfs: fix loosing movers due to short timeout
- 17579bc177
- [maven-release-plugin] prepare for next development iteration
Release 3.1.2
chimera
In order to improve IO performance, the way dCache updates atime
values was modified.
nfs
An internal change in the NFS door code helps reducing irrelevant exceptions being logged.
srm
SRM no longer times out file requests. This alleviates a rare race condition where timeouts for the file request and file access competed. Requests that time out now always return SRM_REQUEST_TIMED_OUT at request level and SRM_FAILURE for the SURLs in that request.
Changelog 3.1.1..3.1.2
- b08390f331
- [maven-release-plugin] prepare release 3.1.2
- 956da34325
- ceph: log repository IO error
- 809b7f43bf
- srm: remove file-level timeout
- b734aae1ba
- chimera: do not update inode generation on atime only update
- a68318b6a0
- nfs: do not add Origin to read-only subject
- c30c9c244c
- [maven-release-plugin] prepare for next development iteration
- c9baa6fa10
- parent/dcache: add mail jar to deployment
Release 3.1.1
pool
Current release improves handling of CEPH exceptions, so that pools can react appropriately when request for a missing file.
Fixes double close on p2p.
restful-api
Current release adds mime-type to file attributes.
Changelog 3.1.0..3.1.1
- ccb9e51
- [maven-release-plugin] prepare release 3.1.1
- e64219b
- [maven-release-plugin] prepare for next development iteration
- 562d467
- restful-api: add file mime-type to file attribute
- 671d35b
- pool: handle CEPH exceptions
- 10e8925
- pool: fix double close on p2p
Release 3.1.0
Chimera CLI can query access latency and retention policy
If you ever needed to query the access latency or retention policy of a file you will be delighted to learn the the Chimera shell now supports doing just that.
To support this, some configuration properties have been added.
Previously, the chimera
shell reused the pnfsmanager
properties.
With dCache v3.1, the chimera
shell has its own set of properties.
See the /usr/share/dcache/defaults/chimerashell.properties
file for
the details.
In addition, the configuration properties
dcache.default-access-latency
and dcache.default-retention-policy
have been added. These new properties are the default values for
chimerashell.default-access-latency
&
chimerashell.default-retention-policy
(respectively), and
pnfsmanager.default-access-latency
&
pnfsmanager.default-retention-policy
(respectively).
If you have configured pnfsmanager.default-access-latency
or
pnfsmanager.default-retention-policy
then dCache will continue to
work as before; however, the chimera
shell may show incorrect
information when querying access-latency or retention-policy
information of a directory.
To fix this, you should update your configuration so that
dcache.default-access-latency
and dcache.default-retention-policy
are adjusted instead. These dcache.
properties should be configured
on all nodes where you host a pnfsmanager service or intend to run the
chimera
client.
Fail fast on lack of stage permission
If you rely on the pool manager stage protection feature, know that you are a rare breed. We have not forgotten about you though and fixed a problem that would cause staging to be retried and fail repeatedly has been fixed. A user who lacks permission to stage a file is now told so right away.
Allow regular expression matching of storage units in resilience manager
Pool manager allows matching storage unit names by regular expressions. Resilience manager failed to mirror this feature in previous versions. Expect this to no longer be the case. As the developer put it: Resilience also supports what PoolManager supports.
Drop support for regular expression matching in alarms
Since we needed regular expression matching in resilience, we had to remove it from alarms…
Just kidding. We removed it because it limited scalability and greatly complicated the code and a poll among users showed nobody used it. Alarms can now be defined at any logging level without risk of denial of service on the server. In order to guarantee such alarms be sent, the remote logging property should be set to an adequately low level. Currently this would be WARN.
Storage URIs can be set through NFS dot commands
A dot command, .(suri)(<file>)
, has been added to NFS by which one
can store, retrieve and modify the URI string(s).
Chimera now tracks file state
Traditionally it was difficult to distinguish a file that is still being uploaded from one for which upload has completed. Chimera now holds this state information, which improves the reliability of detecting this state and reduces load on the database. The change is backwards compatible and does not require schema changes.
RESTful improvements
Now it is even easier to get rid of your files thanks to a new RESTful API for file deletion.
The MIME type of files can be queried. This is particularly useful for dcache-view which can now show a file type specific icon.
gPlazma can parse IGTF info files
The x509 gPlazma plugin can now parse IGTF info files and generate IGTF policy principals. These are currently unused.
Migration module can now define target pool by attached HSM
A new -target=hsm
option was added to the migration commands to
define target pools in terms of attached HSM system.
Option to disable h-flag update after upload
Pools set a flag in the level 2 name space entry after upload to indicate whether the file is uploaded to a tape connected area or not. This is mostly a historic flag and most sites do not use it. Pools now have an option to disable this update, which reduces latency upon upload, load on the namespace database and the namespace disk requirements.
Support for Third Party WebDAV copy for OpenID connect authenticated sesssions
The WebDAV door support third party copy for clients that authenticate
through OpenID connect. See configuration details in
/usr/share/dcache/defaults/webdav.properties
.
Somewhat related, the gPlazma multimap
plugin has gained support for mapping
OpenID connect groups.
NFS
The NFS support now has better support for the Mac OS NFS 4 client due much improved lock support.
The NFS door now detects when pools are disabled and informs NFS clients to no longer connect to such a pool. This means that read transfers can now survive pool restarts, and can possible be redirected to another pool containing another replica of the file. Disabling a pool in pool manager will trigger a p2p copy of open files to allow NFS clients to be redirected.
The NFS pool selection logic has been refined to avoid live lock in case of high latency pools (either because the pool is very busy or because of a high latency WAN connection).
Changelog from 3.0.0 to 3.1
- 26dc5c0a1f
- nfs: recall file layout on pool disable
- 1b7f246d42
- libs: update to bug fix release nfs4j–0.14.2
- 8112a3f116
- srmclient: fix handling of checksum options
- 9fe6a3ff0c
- srmclient: fix compatibility with castor
- 9e8ebba22c
- chimera : handle empty paths elements path2inumber stored procedure
- adcddbfa0e
- ftp: prevent execution of most commands when unwrapped
- 42e4098b36
- [maven-release-plugin] prepare branch 3.1
- 1ac8040457
- ftp: do not fail proxy transfer if read returns zero bytes
- b1339b3a85
- lm: Do not rely on thread interrupt for shutdown
- 364a089b89
- chimera-nfs: add get and set for storage uri
- ae1017c854
- migration:
migration copy
can filter target pools byhsm
values - 88aa842a79
- utils: add common place where default TCP port numbers are resolved.
- 1bc02c3a1c
- ftp: implement the MLSC command
- 4a22f6e939
- srm-client: use default GridFTP port if not specified
- 55c7b56ef6
- ftp: Add support for SITE WHOAMI command
- 0080ec5331
- resilience: restore inaccessible file handler interface
- 0076f80ba6
- ftp: update parsing of CLIENTINFO command
- d223ffb538
- srm: include remaining request lifetime in various responses
- e1692b7bb0
- srm: update srm request.*.lifetime configuration properties documentation
- ba6664d04f
- ftp: modify facts describing namespace ownership
- 5ba2dcdb11
- nfs: bind mover shutdown to open-state
- fb639a896c
- ftp: add support for SITE TASKID command
- 2604f72771
- ftp: add initial support for checksum performance markers
- 476018c6ab
- libs: update to bugfix release nfs4j–0.14.1
- cf35e28dfd
- Revert “lib: Update to liquibase 3.5.3”
- bb7e326ab2
- nfs: fix broken commit d2da5ba
- d2da5ba4ef
- libs: update to nfs4j–0.14.0
- 9d07a6d398
- lib: Update to liquibase 3.5.3
- 3a10b0bfdf
- pool: Port several commands to annotated command infrastructure
- 9e0ef1461c
- pool: Clean up logging in PoolV4
- a9c653871e
- pool: Allow concurrent replica updates in migration modules
- 0ee24c622b
- rest: add home directory to user info
- 60606a6321
- restful: support querying QoS through namespace
- 38238a40d0
- restful: improve error handling
- 51cfcea25c
- ftp: add support in OPTS RETR for specifying performance marker frequency
- 4ce227afd7
- ftp: show SIZE facts for directories
- 1c6d7cd7b7
- ftp: add support for paths relative to home directory
- f3590f018d
- xrootd : use lower case for checksum algorithm names when replying to checksum queries.
- 583477ac75
- dcache: update dcache-view version to 1.2.0
- c171139ba0
- nfs: move mover shutdown logic into NfsTransfer class
- fb30d68350
- gplazma: Support for OpenId Connect groups in MultiMap file
- 2fba197cd1
- common, gplazma: Added OpenId Connect Groups Principal
- 9d27520c5b
- dcache: canonicalize values in any-of properties
- 63a154e8b9
- cleaner: show delete notification targets
- dcf2dd9292
- systemtest: allow anonymous dcap activity
- 44dc08f1bd
- srm: use Jetty jar to supply DTD
- 389f43353a
- rest-api: remove restriction on delete
- ecf5d2607f
- pool: Fix race and nested transaction problem during deletion
- 2469be06e6
- pool: Fix transactional behaviour with Berkeley DB
- 0c13fa2fa6
- lm: Fix lost thread interrupt that prevents shutdown
- cb737383d2
- lm: Log when connectors are killed
- 5165e846c8
- cells: Schedule watcher notifications on cell event thread
- dd3d4894ff
- srm: fix recovery procedure in internal copy if source is deleted
- de3802e907
- gplazma-ldap: fix default properties for root and home
- 00fbe6d28d
- srmclient: consolidate credential expiry, don’t use RuntimeException
- 1deea832e6
- dcache: update dcache-view version to 1.1.2
- 721d6a35ca
- resilience: fix fairness algorithm bugs in file operation map
- 9324747ef6
- nfs: rework pool selection to get rid of too many retries
- 57e9f6b2a3
- minor typo corrections
- 66e218503b
- Fix botched commit
- 5e5a0f002a
- Never declare @Command callable to throw Exception
- 9f31f06508
- srmclient: avoid deprecated Guava API
- fc90079234
- srmclient: add lint checks, fix various minor issues
- eaa63192c9
- pool: make update of level2 with hsm flag optional
- 267b923f30
- chimera: fix file state initialization for non postgres backends
- 32324e6789
- chimera: introduce file state field
- 65c0b2614e
- Motivation:
- 896bf55950
- resful-api: add file’s MIME type to the file attributes
- 4e22dd0b6a
- gplazma-ldap: rewrite junit tests in java
- 4d4b45d142
- pool: fix URISyntaxException in ceph backend
- ead5889a46
- dcache: correct the output directory
- 9e08ca3a66
- dcache: update dcache-view version
- 12df63eb72
- PoolManager : stage protection add protocol to the list of discriminators
- 761f19b652
- dcache-restful-api: add restful call to delete files
- 2483b81204
- dcache-restful-api: Path mapping between client requested paths and corresponding dCache internal paths.
- 5a11546083
- correct chimerashell.db.url property
- 1aa72c0d6c
- pool: ‘hsm ls’ must show all configured hsm if no argument is provided
- db0a2b1490
- dcache-chimera: add get AccessLatency and ger RetentionPolicy command to CLI
- d9ec1e52f8
- srm-common: don’t retry when JVM runs out of memory
- ceb73be210
- transfermanager: tidy up output from ‘info’ ‘queue’ and the two ‘ls’ commands
- ed91fd0759
- cells: fix ‘This stopwatch is already stopped’ error
- ec7ac10845
- srmclient: use streaming deserialisation, allow more memory.
- 8d685bec46
- chimera-enstore: specify fields order on insert
- cf4ced3da0
- cells: do not fall-back to DEBUG if invalid log level provided
- c6c18c927f
- NFS: throw FileNotFoundHimeraFsException in case of fumbled “.(get)” command
- 7b9f49aa30
- nfs41: fix open-stateid leak introduced in 0702d73
- be2d292925
- srmclient: support srmfs with command on command-line
- d7c3d9d2aa
- srmclient: show SOAP response from server when debug enabled
- c6912edb27
- srmclient: percent-encode paths that require it
- bd93f70aec
- srmclient: fix stat/ls caching for glob expansion for DPM
- ef12033cc8
- srmclient: fix deploying srm-client in path with spaces
- 6d0044838b
- srmclient: fix Java 7 compatibility for srmfs
- 33c18788e2
- doors: add diagnostic information for NIC auto-discovery
- ece9982a98
- pool: Delete files concurrently
- c993db8124
- cleaner: Send notification more often
- 81af267c13
- pool: Fix csm check command in the pressence of broken files
- 0702d733bd
- nfs: discover open-stateid during layout return
- bbdd62cd58
- cells+dcache: fix Reply handling in batch processing
- d082578292
- ftpclient: fix compatibility with Globus FTP server
- ef74fd7b69
- pool: optimize checksum channel calculation
- 67915f657b
- srmclient: ensure a reasonable error message
- 067b39cede
- srmclient: fix DPM compatibility with SRM transfer requests
- 7186653283
- ftpclient: fix multiline ADAT reponses
- 4ac1cea2df
- ftpclient: encrypt SITE CLIENTINFO command
- 5c8fc8085e
- pool: add a possibility to control nfs movers threading policy
- f24bf0b18b
- nearline storage: remove masking of HSM return codes
- 3d1371a170
- nfs: remove deviceid to data server mapping when pool is removed
- f70172aefe
- PoolManager : set return code to CacheException.PERMISSION_DENIED if staging is not allowed due to stage protection.
- 0c0ee5b17b
- nfs: do not log NFS errors when creating proxy adapter
- a328fa64f4
- srmclient: avoid NPE when stat directory with DPM
- c8f219ef02
- pool: Use concurrent collections for high level parts of migration module
- 9570497848
- pom: Update third party dependencies
- 9692af7a8b
- pom: Update SMC to 6.6.0
- 522648c8fd
- pom: Update to Guava 20
- 720216df2f
- nfs: do not use AtomicInteger where access already protected by lock
- 74ae82647e
- srmclient: add glob support for lls and ls
- 5d75b18c2c
- resilience: python script for making database changes necessary for migration from old replica manager setup
- dbe2429b06
- pool: Reduce lock contention in migration module
- 2db55843f4
- srmmanager: Adjust semantics of concurrent upload detection
- 9e34beba62
- srmclient: by default show only CN of owner in ‘ls -l’ output
- 45a584b583
- spacemanager: Fix shutdown bug causing a file to leak from a reservation
- af7c8dce40
- spacemanager: Fixes a message bounce bug
- e3e293c9b8
- Change version to 3.1.0-SNAPSHOT
- 61264724d9
- srmclient: add SRM call statistics
- 5b327a5017
- srmclient: update command names in srmfs
- 2edc97bb1d
- srmclient: fix srmfs ‘get permission’ command
- b861be09a8
- gplazma: add IGTF policy princpals with X.509 login
- 40c3485f71
- srmclient: fix compatibility with Bestman
- 30d7604513
- srm: Sumbit token less releaseFiles requests to all backends
- 4a477c95a0
- srmmanager: Support upload detection in clustered environments
- d300515d4a
- srm: Redefine the semantics of active upload checks
- 7ab3f5e8f7
- srmmanager: Refactor how various operations handle active transfers
- bd75e3dc88
- srmclient: probe for SRM endpoint parameters that the user doesn’t specify
- f9eabd2666
- Resilience: Restore support for regex matching on storage unit names
- fab9727aab
- Resilience: separate out the data structures for handling storage units from those for pool groups
- 5d2aa238bd
- Resilience: Support matching the universal and class default storage unit expressions
- 7cb18615f8
- core: make it optional whether builder creates a readOnly subject
- 12fbe75fb8
- pool: simplify checksum channel logic
- 37bb8dc937
- core: update stage protection unit-tests
- f6a8284ca8
- dcap: don’t create stack-trace if tunnel fails due to bad client
- fa7b0fb8bd
- PoolManager : stage protection, fix error in stage.fragment
- e1c2aabb47
- alarms: shift alarm filtering to client side
- 154a1f65a1
- alarms: remove support for custom server-side regex alarm definitions
- 9d286e7142
- webdav: fix thrown NPE when CORS is set
- 002b13352a
- dcap: expose dcap client version limit
- b18a63fc02
- dcap: Register DCAP interpreter as a command listener
- efda7f2a4c
- dcap: fix Kerberos dcap if principal contains a ‘-’
- 4ee298e6c4
- dcap: fix regression in handling old version
- 93c0ec161e
- cells: Fix NPE in location manager
- df12c09d68
- srmmanager: Add interface to query and abort transfers
- f34c7f2734
- cells: Remove meaningless logging in location manager
- 2fb8d33e62
- cells: Log expanded cell name
- 26ce471a96
- cells: Remove resubmission to event thread in location manager
- ede86ad03a
- cells: Add safe guards to connector create and process update events
- 406df24882
- srmclient: fix ‘cd’ compatibility with StoRM
- 01efa18dc4
- poolmanager: Log pool name rather than SelectPool object id
- 0b782a5bed
- pool: Suppress two stack traces in nearline storage handling
- 73919be57a
- srm: Log correct request token in access log
- b1b2af95a1
- httpd: Enable X-Forwarded-For processing in httpd
- 431ae2f929
- httpd: Don’t insist on using http for unauthenticated webadmin pages
- 45f265354a
- nfs: allow dCache to start up without DNS
- 26d16f20d3
- billing: fix stacktrace and slow shutdown if in refresh
- 2bca29803b
- webdav: improved the description for the usage of 3rd-party transfer with OpenId Connect via Token Exchange
- e85ae7cd2b
- webdav: fix error during context initialization of webdav
- d132d86052
- webdav, dcache: Support for third party copy on the Webdav door using OpenId Credentials
- b8bc5b1553
- common: fix alignment of abbreviated byte column in ColumnWriter
- 14ac12415c
- srmclient: add initial support for glob expansion
- f02a23afc8
- cleaner: Send notifications concurrently
- 20fdc8130b
- poolmanager,spacemanager: Do not reply to pool manager query replies
- b78cb3a869
- dcache: Add column to
dcache services
for proxy-protocol - 9a83eb35cb
- doors: Allow setting an empty list of login broker tags
- 41fde87693
- common: update ColumnWriter to remove any trailing whitespace
- 245cc0bd08
- srmclient: add additional help text to srmfs
- 9d55e4d562
- spacemanger: Fix interception of PoolAcceptFileMessage
- 5484c3f7dd
- xrootd: Upgrade to xrootd4j 3.2.1
- e576407c42
- admin: Send requests to a fully qualified address once connected to a cell
- e8e729efaa
- dcache: Do not hide NoRouteToCellException behind a timeout
- 9204dc39fe
- webdav: Fix initialization of html template