dCache 7.0 Release Notes

Highlights

dCache internal copy triggerd by srmcp uses HTTP (was DCAP)

Incompatibilities

the argument of the kill client admin command for the NFS door accepts client session id
dropped support for pcells GUI

Acknowledgments

(tbd, this section uses markdown formatting)

Release 7.0.40

gplazma2-grid

An empty requires field in IGTF policy is now accepted. Files with invalid or unexpected policies are ignored.

webdav

A bug was fixed that caused a NullPointerException while sending Kafka messages.

Changelog 7.0.39..7.0.40

4a0a5ba588: [maven-release-plugin] prepare release 7.0.40
0a3053f9c4: dcache: NPE on removal via WebDAV and token
7fa0cfb3c6: gplazma2-grid: invalid IGTF policy file should fail with ParserException
127c85aad3: [maven-release-plugin] prepare for next development iteration

Release 7.0.39

xrootd4j

A potential for DOS in xrootd write was fixed.

Changelog 7.0.38..7.0.39

5a6f77513e: [maven-release-plugin] prepare release 7.0.39
f50b1f3c9b: pom.xml: update to latest xrootd4j bugfix
05e6a04ee2: [maven-release-plugin] prepare for next development iteration

Release 7.0.38

dcache-bulk

Runtime exceptions do not kill the queue thread now and do not leave the request in a stalled state.

Changelog 7.0.37..7.0.38

113733fba8: [maven-release-plugin] prepare release 7.0.38
893a316349: dcache-bulk: (version 1) handle unexpected exceptions in queue
b5f9f0bc09: [maven-release-plugin] prepare for next development iteration

Release 7.0.38

dcache-bulk

Runtime exceptions do not kill the queue thread now and do not leave the request in a stalled state.

Changelog 7.0.37..7.0.38

113733fba8: [maven-release-plugin] prepare release 7.0.38
893a316349: dcache-bulk: (version 1) handle unexpected exceptions in queue
b5f9f0bc09: [maven-release-plugin] prepare for next development iteration

Release 7.0.37

frontend, bulk

Both numeric and string values for PIN lifetime are valid now. Also, skipDirs for DELETE can be both boolean and string. All other current arguments are required to be strings, as before.

Changelog 7.0.36..7.0.37

812313e745: [maven-release-plugin] prepare release 7.0.37
ae71eaa25f: dcache-frontend,bulk: fix typing of argument values
fda7c37650: [maven-release-plugin] prepare for next development iteration

Release 7.0.36

frontend

Anonymous access receives a 401 error and doesn’t trigger a stack-trace when unlimitedVisibility is set to false.

clearOnSuccess, clearOnFailure and cancelOnFailure can have boolean and string values now.

pool

A bug is fixed where the checksum calculation would fail for empty files.

Changelog 7.0.35..7.0.36

56620b4c1c: [maven-release-plugin] prepare release 7.0.36
9a6c0a8ce0: dcache-frontend: protect against RuntimeError in case of denied anonymous access
5d5933b754: restore inadvertently removed ‘target’ extraction in toBulkRequest()
1653e01498: dcache-frontend: bulk-requests POST, allow either string or boolean for boolean values
99b66657d3: pool: don’t treat an empty file as a sparse file
d0dcd7a365: [maven-release-plugin] prepare for next development iteration

Release 7.0.35

debian

Added explicit dependency on rsyslog for debian packages so there are no errors during installation.

info

The delay between messages sent by info was increased to reduce log messages of “DGA {…} triggering too quickly”.

pool

If the scrubber state file is empty, scrubber will now log a more helpful error message and proceed scrubbing the pool.

Changelog 7.0.34..7.0.35

74a36d4a07: [maven-release-plugin] prepare release 7.0.35
02a5bd6ee3: pool: improve handling empty saved state by scrubber
8b80371c30: dcache-xroot,pom.xml: bump xrootd4j to 4.3.1
a3d487d527: dcache-xroot: flesh out channel inactive and exception caught
380bb8e7de: info: increase delay between messages
94b58cbd7e: deb: add explicit dependency on rsyslog package
25ff3ab9c1: [maven-release-plugin] prepare for next development iteration

Release 7.0.34

dcache

Improved documentation for kafka Producer properties.

Improved error message for inexistent statistics path.

dcache-xroot

The current relase Updated master xrootd4j to 4.3.0.

frontend

NPE is fixed when SRR when space information is not available yet.

xrootd

Rendezvous TPC without requiring a JWT token to be passed by the third-party client is possible (again).

Changelog 7.0.33..7.0.34

cb62fd12e7: [maven-release-plugin] prepare release 7.0.34
c45cb04006: dcache:improve documentation for kafka properties
4d87218ff8: dcache-xroot: update master xrootd4j to 4.3.0, and stable branches to next minor version
552471dd34: dcache-core: improve error message for inexistent statistics path
298769c978: [maven-release-plugin] prepare for next development iteration

Changelog 7.0.33..7.0.34

cb62fd12e7: [maven-release-plugin] prepare release 7.0.34
c45cb04006: dcache:improve documentation for kafka properties; frontend: fix NPE in SRR when space information is not available yet.
4d87218ff8: dcache-xroot: update master xrootd4j to 4.3.0, and stable branches to next minor version
552471dd34: dcache-core: improve error message for inexistent statistics path
298769c978: [maven-release-plugin] prepare for next development iteration

Changelog 7.0.33..7.0.34

cb62fd12e7: [maven-release-plugin] prepare release 7.0.34
c45cb04006: dcache:improve documentation for kafka properties
4d87218ff8: dcache-xroot: update master xrootd4j to 4.3.0, and stable branches to next minor version
552471dd34: dcache-core: improve error message for inexistent statistics path
298769c978: [maven-release-plugin] prepare for next development iteration

Changelog 7.0.33..7.0.34

cb62fd12e7: [maven-release-plugin] prepare release 7.0.34
c45cb04006: dcache:improve documentation for kafka properties
4d87218ff8: dcache-xroot: update master xrootd4j to 4.3.0, and stable branches to next minor version
552471dd34: dcache-core: improve error message for inexistent statistics path
298769c978: [maven-release-plugin] prepare for next development iteration
a92fa0cf2d: [maven-release-plugin] prepare release 8.0.6
d488867ee8: dcache:improve documentation for kafka properties
4389adec33: nfs: re-send kill only for write movers
cc04c4f5dd: dcache-xrootd: fix TPC rendezvous to work with token authorization
675302e989: dcache-core: improve error message for inexistent statistics path
2fe8b1446f: frontend: fix NPE in SRR when space information is not available yet.
b01c233ed6: dcache-xroot: update master xrootd4j to 4.3.0, and stable branches to next minor version
c5b07458ac: [maven-release-plugin] prepare for next development iteration

Release 7.0.33

Technical release

Release 7.0.32

pnfsmanager

Doors no longer allow a user to discover whether or not a file or directory exists within directories they cannot access.

pom

Updated spring libs to version 5.2.20, CVE–2022–22965

Changelog 7.0.31..7.0.32

c67b0e6580: [maven-release-plugin] prepare release 7.0.32
868b62ae65: pnfsmanager: avoid leaking whether or not file exists
2315a76d2b: pom: update spring libs to 5.2.20
87b83d7d02: [maven-release-plugin] prepare for next development iteration

Release 7.0.31

dcache-chimera

Cleaner batch delete exception has been fixed.

frontend

A bug is fixed that inverted the property frontend.srr.public=true. True means now allow public access and false does not.

Changelog 7.0.30..7.0.31

9fb85efcf1: [maven-release-plugin] prepare release 7.0.31
df44d5232f: nearline-storage: fix request count on error path in AbstractRequest#failed
cdf0801f74: nearline-storage: fix queued count when request initialization falied
049d0e87ba: pool: add bunch of unit tests for NearlineStorageHandlerTest
ee21055a2b: frontend: fix problem with making SRR resources public
1ac59ba001: dcache-chimera: fix cleaner batch delete exception
e5ce5ff260: [maven-release-plugin] prepare for next development iteration

Release 7.0.31

dcache-chimera

Cleaner batch delete exception has been fixed.

frontend

A bug is fixed that inverted the property frontend.srr.public=true. True means now allow public access and false does not.

Changelog 7.0.30..7.0.31

9fb85efcf1: [maven-release-plugin] prepare release 7.0.31
df44d5232f: nearline-storage: fix request count on error path in AbstractRequest#failed
cdf0801f74: nearline-storage: fix queued count when request initialization falied
049d0e87ba: pool: add bunch of unit tests for NearlineStorageHandlerTest
ee21055a2b: frontend: fix problem with making SRR resources public
1ac59ba001: dcache-chimera: fix cleaner batch delete exception
e5ce5ff260: [maven-release-plugin] prepare for next development iteration

Release 7.0.30

frontend

The property frontend.srr.public=true|false is added to frontend to control SRR resource restriction. The default value is false.

ftp

The FTP cell is killed asynchronously now after the session terminates so the door will remain responsive when many clients terminate their FTP session concurrently.

pool

HTTP-TPC transfers now prefer IPv6 address, if both endpoints support it.

Changelog 7.0.29..7.0.30

7b72e83c8c: [maven-release-plugin] prepare release 7.0.30
7b629782bf: frontend: make srr resources public
9bc70f0c37: ftp: kill cell asynchronously
ac537a3d75: pool: http-tpc prefer IPv6 address
775f297c91: [maven-release-plugin] prepare for next development iteration

Release 7.0.29

common

A bug was fixed where dCache will no longer accept certificates issued by a trusted CA after that CA updates their CA certificate while keeping the public/private key-pair the same. This is typically done to change something in CA’s certificate.

There are places where dCache configuration requires an absolute path. In some places attempting to use a relative path will yield an unhepful null in the log file. This is now fixed, so a meaningful error message is logged instead.

pool

An NPE on attempt by client to read from a broken replica is fixed now.

webdav

The current release fixed handling of webdav.authz.allowed-paths so it no longer triggers a NullPointerException.

Changelog 7.0.28..7.0.29

e78e047486: [maven-release-plugin] prepare release 7.0.29
f0473acaeb: pool: fix NPE on attempt by client to read from a broken replica
b5d6ffefc2: webdav: fix NPE if ‘webdav.authz.allowed-paths’ disallows a request
e1abc5ba77: libraries: upgrade version of canl
dba6c0d781: common: provide reasonable error message if path is not absolute
f38e28bedb: [maven-release-plugin] prepare for next development iteration

Release 7.0.28

Pool

The current relase fixed a problem where a file’s tape location that used to exist in the namespace and was subsequently removed can reappear if the file made precious and flushed to tape.

TransferManager

TransferManager now logs bugs with the corresponding stack-trace, making fixes any such bug easier.

Changelog 7.0.27..7.0.28

b9244d1ec5: [maven-release-plugin] prepare release 7.0.28
374874d77e: pool: only send new URLs when flushing file
690a60c4d8: TransferManager: log bugs with corresponding stack-trace
a6d480d918: [maven-release-plugin] prepare for next development iteration

Release 7.0.27

gplazma

dCache will now reject WLCG-AuthZ-JWT profile tokens with a ‘wlcg.ver’ claim that it does not support. Other tokens (e.g., SciTokens) are unaffected by this change.

loginbroker

This patch fixes SRM based upload or download where the client requests an xroot-based transfer. The SRM door will now also consider any xroot door with xrootd.security.tls.mode configured to OPTIONAL when building a TURL targeting either xroot or xroots protocols.

pnfsmanager

PnfsManager now has two commands, ‘reset chimera stats’ and ‘reset stats’, to support resetting the gauge and counter statistics available through the ‘info’ command.

dCache no longer leaks information about whether or not files exist when using macaroons or Scitokens / WLCG AuthZ JWT profile tokens.

webdav

The WebDAV door cannot send the HTTP response to some HTTP request if the client has already disconnected. dCache no longer logs an error that it cannot send the HTTP response.

A client that disconnects during a proxied HTTP transfer (GET or PUT) is no longer logged in the WebDAV door’s log file; instead, it is logged in the cell’s pinboard. The billing message is updated to make it clearer what went wrong.

Changelog 7.0.26..7.0.27

00946f48ce: [maven-release-plugin] prepare release 7.0.27
4408f186a3: skel: bump logback to 1.2.10
3a483f0b57: pnfsmanager: add support for resetting gauge and counter statistics
14a4bd0fc3: loginbroker: add support for multiple protocol families
5f3eaec55e: webdav: better logging if client disconnects during proxied transfer
b7c6fd0b5c: webdav: don’t log an error if client disconnects before response sent
1be1b15e39: PnfsManager: check restrictions before resolving path to PNFS-ID
082c8dac41: gplazma: scitoken validate ‘wlcg.ver’ claim
2554063b6e: [maven-release-plugin] prepare for next development iteration

Release 7.0.26

common-security

A better error message is logged when attempting to use a password-protected credential: java.io.IOException: Error decrypting private key: the password is incorrect or the PEM data is corrupted.

pool

This patch introduces the flag -noheader for use with rep ls -s that produces output similiar to what we used to see in previous dCache releases. In addition, a bug is fixed that prevented printing of precious and sticky file counts.

webdav

The HTTP-TPC should have fewer failed transfers when faced with many short-lived transfers.

It’s now possible to access a summary of HTTP-TPC transfers and configuration information via the WebDAV door’s info admin command.

Changelog 7.0.25..7.0.26

668e8e308b: [maven-release-plugin] prepare release 7.0.26
db29849a38: common-security: prevent NPE on password protected cert
be4b78ee00: webdav: http-tpc update heuristics for failing transfer
76afc8b04f: Remove double whitespaces
915588d535: webdav: http-tpc provide status information in ‘info’ admin command
b01928e780: pool: fix rep ls formating
f722aa856e: [maven-release-plugin] prepare for next development iteration

Release 7.0.25

dcache

The RemoteTransferManager now better describes the current state of a transfer.

gplazma

The scitoken gplazma plugin now supports extracting the sub and wlcg.groups claims in the same fashion as the oidc plugin.

pool

The current release fixed open queue flag when template defined by queue define class.

The current release fixed open queue flag when template defined by queue define class issue.

webdav

The WebDAV door’s http-tpc ls command now has the possibility to show the current state of the transfer. This may be useful diagnosing transfers spending a lot of time deciding on which pool to transfer should take place.

Changelog 7.0.24..7.0.25

8e889089d1: [maven-release-plugin] prepare release 7.0.25
51675a94fc: RemoteTransferManager: update state description
8072e370a2: webdav: http-tpc add “prep” duration to ‘http-tpc ls’ command
220c264298: webdav: http-tpc show whether transfer is queued on pool
ca8c6ac8f8: webdav: http-tpc update ‘http-tpc ls’ command to include state
769a52b335: glazma: scitoken add support for additional principals
7d55df2eba: srr: limit publisched endpoints to GLOBAL scope
0c77844e8d: Revert “frontend: fix handling of SRR requests over IPv6”
b4270dce77: pool: adjust StorageClassContainerTest for dcache pre- 7.1
4630b7de82: pool: fix open queue flag when template defined by queue define class
7b401f1792: [maven-release-plugin] prepare for next development iteration

Release 7.0.24

dcache-core

The current release fixed NPE in TransferManager when no pool was selected before transfer is cancelled.

frontend

The current release fixed handling of SRR requests over IPv6.

gplazma

The scitoken plugin now supports OPs that publish their public keys without any corresponding ID (i.e., no kid value).

nfsv

nfs can write into space reservations now.

pinmanager

A more detailed pinmanager log entry is provided for pin requests that are caught in a retry loop, and eventually time out.

resilience

A runtime exception triggered by side effect of logging has been fixed.

storagedescriptor

The script for generating SRR records (from the info service output) has been updated. The field lastupdated has been adjusted to the correct name latestupdate.

webdav

A bug is fixed where HTTP-TPC PULL request can fail (under heavy load) with the downloaded file being deleted, but dCache reports the transfer as successful.

dCache now provides a faster respones to the HTTP-TPC client (typically FTS) should the door decide to fail a transfer.

The WebDAV door should be now faster at accepting new transfers and faster at handling transfer completions when handling many small transfers.

The HTTP-TPC support in the WebDAV door is now e more robust to high number of transfers finishing concurrently.

xroot

Now it is possible to support kXR_delete as a write request on the pool.

xrootd4j

Library updates for xrootd4j which contains fix for Unix Protocol.

Changelog 7.0.23..7.0.24

84a64622d3: [maven-release-plugin] prepare release 7.0.24
0cde68a7d5: webdav: http-tpc improve throughput with short transfers
146e3eff6b: frontend: fix handling of SRR requests over IPv6
6f3de19fc6: webdav: http-tpc don’t wait if door fails transfer
8553f3cd86: webdav: http-tpc avoid resetting transfer state
faa5c5c0c9: dcache-core: fix NPE in TransferManager when no pool was selected before transfer is cancelled
1de238b324: resilience: fix runtime exception triggered by side effect of logging
523bc1947c: gplazma: scitoken add support for OPs that advertise keys without kid
4994fae87b: nfsv: convert UnixNumericXxxPrincipal into dCache analogs
4d1f3859e4: webdav: http-tpc move transfer finalisation off of message queue
6fcb288fef: pom.xml: update xrootd4j dependencies to 4.2.5/4.1.6/4.0.11
1efccdb8bd: CanlContextFactory: throw FileNotFound for missing ca certs dir
8fa5f54f32: pinmanager: provide more details information on timeout
be6acb3727: storagedescriptor: fix element name to ‘latestupdate’
617ce6874c: dcache-xroot: support kXR_delete as a write request on the pool
f3fc267df1: [maven-release-plugin] prepare for next development iteration

Release 7.0.23

ftp

The FTP door now provides more succinct information on pinboard, should use less CPU and take better advantage of the available cores.

pnfsmanager

Attempts to create a file where the parent directory is either missing or not a directory now provide clearer error messages.

pool

The pool now provides more information for bugs reported as java.lang.IllegalStateException: Handle is closed.

webdav

The HTTP-TPC response is improved if a client attempts to pull a file into a non-existing directory, or attempts to use an existing file as an ancestor directory.

xrootd

Improved exception handling for Xrootd.

Changelog 7.0.22..7.0.23

ce7aabc449: [maven-release-plugin] prepare release 7.0.23
104e7a6df6: dcache-frontend: support different attribute styles for bulk request
10c3f64e23: pool: provide more information when handle is double-closed
8e6dded13b: dcache-xrootd: Alternate fix for client write to closed checksum channel
f57cf49e7c: pnfsmanager: fix confusing error message.
56f0bfc7f8: webdav: fix error handling for bad paths
0cd25c99d7: ftp: switch to more reasonable logging of Subject
03c699c7ab: [maven-release-plugin] prepare for next development iteration

Release 7.0.22

chimera

A bug is fixed that triggered downstream errors when getUid() is called.

universal-spring-cell

This patch fixes a problem where a call to api/PoolManager returned 404 not found. The JSON serialized object is returned now as before.

xrootd

The xrootd4j version was updated to 4.0.10

Changelog 7.0.21..7.0.22

eaf27ff842: [maven-release-plugin] prepare release 7.0.22
7f2eb19f6d: dcache-chimera: add Unix principal conversion to AccessControlContext subject
602eee40c3: pom.xml: bump to xrootd4j 4.0.10
6a355b64d7: universal-spring-cell: allow for serialization of Optional
2d53a49c89: [maven-release-plugin] prepare for next development iteration

Release 7.0.21

billing

Billing will no longer throw a NullPointerException with certain information from an NFS door serving an NFSv3 client.

ftp

Now file sizes for LIST output in bytes is displayed.

The FTP door should be more robust against a (currently unknown) bug that results in the ftp session attempting to send progress queries to the pool after that is no longer possible.

gplazma

The banfile and scitoken plugins, and the two admin commands test login and explain login are updated to accept the username: prefix (e.g., username:paul). The prefix user: continues to work but is now deprecated.

nfs

An exception for access check in ChimeraVfs has been fixed.

Tag update regression was fixed.

pool

The current release improved error messaging if a setup file badly configures an HSM instance.

A bug is fixed where removing a create hsm statement in a pool’s setup file and running the reload command kills the pool.

xroot

The documentation concerning TLS properties has been fixed.

Changelog 7.0.20..7.0.21

578377fdfa: [maven-release-plugin] prepare release 7.0.21
97dafdb437: nfs: fix tag update regression
e2c0b446b6: dcache-xroot, book, skel: fix documentation concerning TLS properties
e1af2e8856: bootstrap: fix two problems with how bugs are reported on startup
8efa6545e0: ftp: try harder to ensure any timer tasks are cancelled
b60bf17333: pool: removing hsm with reload command kills pool
ac2a5189f1: gplazma: switch from user: to username:
9b554fa9d7: ftp: show file sizes for LIST output in bytes
19f260a8fe: util/frontend: change transfer rate to double
ba338bfa5a: bootstrap: don’t hide bugs in ‘create’ command
e68710872b: ftp: ensure cell is killed even if shutdown triggers a bug
de432b4856: nfs-vfs: fix access check in ChimeraVfs (fixes 19fa7cf2425)
c8b5d284ca: billing: fix NPE in billing from NFSv3 message
c1ae57fc1c: pool: improve error message on badly configured hsm instance
4e75d12e5c: [maven-release-plugin] prepare for next development iteration

Release 7.0.20

acl

The group ACEs now apply to desired group instead of to a users with the same numeric id.

gplazma

The WLCG Common JWT Profiles (v1.0) describes the wlcg.groups claim for expressing group-membership. We are increasingly seeing this being used as the OIDC equivalent to the group-membership expressed through the VOMS extension.

During the auth phase of the login process, the group membership information contained in a wlcg.groups claim from the OP is now available as OpenIdGroupPrincipal principals. Subsequent plugins (e.g., multimap) may be used to convert these principals to more directly useful principals.

webdav

dCache now responds with a 507 (Insufficient Storage) on GET request if dCache must do a pool-to-pool internal-transfer or stage the file but no pools have sufficient free capacity to support this.

The current release fixed ASCII error response and Non-HTML error responses from the WebDAV door (for non-webbrowsers) are no longer truncated.

Changelog 7.0.19..7.0.20

04fd523cb1: [maven-release-plugin] prepare release 7.0.20
1b361aa2a2: all: reformat code using Google Style Sheet
d66b23bfb0: acl: set IDENTIFIER_GROUP flag if WHO is GROUP or OWNER_GROUP
65714da50c: webdav: return 507 if insufficient space on GET request
08b81e3431: gplazma: scitoken make ExemptFromNamespaceChecks principal optional
14f20190a5: gplazma/pnfsmanager: update namespace so scitoken ‘scope’ takes priority
9115df444b: webdav: fix ASCII error response
c8733ad8cc: [maven-release-plugin] prepare for next development iteration

Release 7.0.19

chimera

When moving from dcache.db.password to dcache.db.password.file (pgpass), the dcache.conf is world readable. This had the unfortunate side effect that the “chimera” shell command throwed an Exception. This is fixed now and the shell interface works with a password file.

gplazma

During the auth phase of the login process, the group membership information contained in a ‘wlcg.groups’ claim from the OP is now available as OpenIdGroupPrincipal principals. Subsequent plugins (e.g., multimap) may be used to convert these principals to more directly useful principals.

pool

A rare NullPointerException for HTTP-TPC transfers is fixed.

Changelog 7.0.18..7.0.19

f2696c64ab: [maven-release-plugin] prepare release 7.0.19
93cad5299b: gplazma: oidc add support for the ‘wlcg.groups’ claim
79ef222177: pool: http-tpc fix NPE when monitoring network traffic
6119773845: chimera: adding password.file to chimera
2a9715fb1e: [maven-release-plugin] prepare for next development iteration

Release 7.0.18

frontend

SRR returns data now with official json schema

webdav

Fix how sym-links are shown in the static HTML (web-browser) view from the WebDAV door.

Changelog 7.0.17..7.0.18

63bf70887a: [maven-release-plugin] prepare release 7.0.18
e6e25ab6b1: frontend: add service to provide Storage resource reporting
f5541353e5: webdav: update representation of symbolic links in HTML page
7e9f49aa1b: [maven-release-plugin] prepare for next development iteration

Release 7.0.17

dcache-xroot

The next release of xrootd4j is used now, which improves handling TPC read requests.

namespace-chimera

There are less operations on the database now as the filesize doesn’t get updated after a file was flushed to tape.

pool, webdav

The webdav admin interface has been extended to include monitoring information about on-going transfers. The command can optionally show pool information if transfer-manager is update; updating transfer-manager is not required by this change. Percent transfer progress for PULL requests is optionally available if pools are updated; updating pools is not required by this change.

Changelog 7.0.16..7.0.17

d7f36f8954: [maven-release-plugin] prepare release 7.0.17
805615dd52: namespace-chimera: ignore file size update on file flush
3e400e5a9e: webdav: add ‘http-tpc ls’ admin command
6aa7bccbf9: pool/webdav: http-tpc add RemoteConnections perfmarker metadata
ab2824932c: dcache-xroot: bump dependency to next xrootd4j release
456abe3097: [maven-release-plugin] prepare for next development iteration

Release 7.0.16

pnfsmanager

Fixed a problem where dCache accepts a HSM script that, when called to flush a file, returns successfully but without providing any URIs on stdout. Such requests are considered failed, with the flush request blocked until retried explicitly with the queue activate PNFSID admin command.

pool

The Kafka message emitted when a file is flushed to tape or staged back from tape now includes the locations field: a JSON array of JSON Strings, where each JSON String is a tape-location URL. For flush operations, this is the (potentially empty, potentially multiple) list of URLs returned by the HSM instance. For stage operations, this is the (potentially empty, potentially multiple) URLs that match the selected HSM instance. Both messages now also describe a hsm JSON Object that contain the HSM type, HSM instance name, and HSM provider.

srmmanager

A race condition is fixed that, if triggered, results in a memory leak. This leak can also affect the TURLs returned by SrmManager, where out-of-date information about doors is used.

Changelog 7.0.15..7.0.16

8b576c0327: [maven-release-plugin] prepare release 7.0.16
4fac4f2af0: srmmanager: fix race condition in LoginBrokerSubscriber
a67cf4b9e1: pool/pnfsmanager: don’t accept a non-Enstore flush without locations
928638e5c7: pool: update Kafka tape events to include additional information
4a348895e2: [maven-release-plugin] prepare for next development iteration

Release 7.0.15

alarms

Clearer documentation for billing/alarms services regarding HA requirements.

gplazma

dCache has a new session gPlazma plugin that is designed to be a viable alternative to the StorageAuthzDB and KPWD plugins but with shorter (hopefully less confusing) configuration, while also being more flexible.

To support the removal of authzdb plugin, we should provide an easy way for sites to migrate their existing configuration from using authzdb (as a session plugin) to omnisession.

Sites now have a utility to help them migrating from authzdb to omnisession.

Note: it is also possible to use the authzdb plugin as a mapping plugin. This utility does not help in migrating that use to some alternative solution.

To support the removal of authzdb plugin, we should provide an easy way for sites to migrate their existing configuration from using authzdb (as a session plugin) to omnisession.

Sites now have a utility to help them migrating from authzdb to omnisession.

Note: it is also possible to use the authzdb plugin as a mapping plugin. This utility does not help in migrating that use to some alternative solution.

skel

Whether a cell/service supports HA or not can now be derived from the properties file (except for doors).

Please see <name>.cell.replicable.

srm

The access log file for SRM requests now includes the client-supplied list of protocols, if any were provided.

Changelog 7.0.14..7.0.15

5139f13b34: [maven-release-plugin] prepare release 7.0.15
ffc89baa3d: rpm: add dcache-convert-authzdb-to-omnisession into list of packaged files
f5d7cef4e2: gplazma: add util to convert authzdb file to omnisession
d6e34a911a: alarms, billing: specify shared rdbms in the case of replicated service
7d3b72460e: skel: add explicit replicable property even when value is false
d64b1da12d: gplazma: add omnisession plugin
c613763ae2: srm: log transfer protocols in access log
048d880253: [maven-release-plugin] prepare for next development iteration

Release 7.0.14

dcache-core

The old web pages claim the transfer size and speed are reported in KB and KB/s, although the actually used units are KiB and KiB/s. Reporting the correct unit is important for monitoring. This is now fixed.

frontend

The current release fixed regression in generating swagger JSON for frontend’s REST API.

gplazma

dCache may now be configured so that the multimap oidc predicates match the sub claim value from a specific OAuth2 Provider using the format SUBVALUE@OP, where OP is the dCache-internal alias for the OP. Existing multimap configuration continues to work, but admin is warned to update the multimap configuration.

Changelog 7.0.13..7.0.14

dc755f9b16: [maven-release-plugin] prepare release 7.0.14
f986df95f8: gplazma: multimap now supports OP in ‘oidc’ predicate
e448f9a196: frontend: bump swagger version to 1.6.2
37eab5a06e: dcache-core: correct reported units of transfer size and speed
482525f97c: [maven-release-plugin] prepare for next development iteration

Release 7.0.13

chimera

Chimera shell now supports the -R option in the chown command.

Changelog 7.0.12..7.0.13

d4b9d20875: [maven-release-plugin] prepare release 7.0.13
42fa5ad64b: chimerashell: add recursive option to ‘chown’ command
13145fd557: [maven-release-plugin] prepare for next development iteration

Release 7.0.12

checksum

The policies map is now added to the JSON info object that is returned for checksum module information.

Changelog 7.0.11..7.0.12

e80831a541: [maven-release-plugin] prepare release 7.0.12
e161cb2315: checksum-module: add missing map to JSON info
dae6e789c0: [maven-release-plugin] prepare for next development iteration

Release 7.0.11

xroot

The current release fixed the parsing to account for host/error pairs.

Upload transfer checksum failure is fixed and the gfal scenario now works.

xrootd

xrootd4j is updated to new version which fixed problem with netty LogHandler slowing down TPC client (cutting bandwidth by a factor of 10).

Changelog 7.0.10..7.0.11

8860999c50: [maven-release-plugin] prepare release 7.0.11
3410f5daa5: dcache-xrootd: upgrade xrootd4j to 4.0.8
b0091a2163: dcache-xroot: parsing of ‘triedrc’ CGI lacks separation by optional comma
d90b65521d: dcache-xroot: fix upload transfer checksum failure (stable branches)
e06cf542d8: [maven-release-plugin] prepare for next development iteration

Release 7.0.10

ftp

Globus transfer agent is now able to create symbolic links.

nfs

The current release introduced nfs.clientdb.config property prefix to populate the BerkeleyDB configuration and now the nfs door is not picky about free disk space in /var/lib/dcache/nfs and the BerkeleyDB used as client store by nfs door can be configured with properties.

pool

dCacheView now works for redirected transfers for non-anonymous data access, provided the WebDAV door is using TLS encryption and is configured with ‘webdav.redirect.allow-https’ set to ‘true’.

poolmanager

A very rare race-condition is fixed that could be triggered if a pool completes a stage or pool-to-pool request (to satisfy a client’s read request) immediately before dying.

webdav

dCacheView is able to view and download files when authenticated and when the WebDAV door proxies the transfer.

Changelog 7.0.9..7.0.10

a945dca687: [maven-release-plugin] prepare release 7.0.10
3b29d2f158: nfs: add possibility to configure BerkeleyDB client store
19b859edf8: webdav: use Jetty’s built-in support for CORS
6588502fb4: poolmanager: fix _waitingFor access outside of synchronized block
56040773c9: ftp: add support for the SITE SYMLINK command
aafc2a6127: pool: http allow client to send credentials when TLS is used
c2b910bc7a: dcache-chimera: use RemotePoolMonitor to discover file locality
64bd5d009b: [maven-release-plugin] prepare for next development iteration

Release 7.0.9

frontend

frontend/api readers and writers always zero issue is fixed now

gplazma

The LDAP plugin behaviuor now more closely follows that of other mapping plugins. This allows deployments where LDAP is tried first and, if that fails to identify the user, fall-back strategies are used.

pool

The pool size reporting when static/runtime config is not defined now is improved.

Changelog 7.0.8..7.0.9

7ae177fb95: [maven-release-plugin] prepare release 7.0.9
9e9125c973: gplazma: ldap throw exception if no principal is added
e6087754cb: poolV4: fix reader/writer counts
023e383a70: pool: remove invalid test case of configured space
3a7c4a3e45: pool: fix pool size reporting when static/runtime config is not defined.
d64e64df21: [maven-release-plugin] prepare for next development iteration

Release 7.0.8

dcache-xroot

The cirrent release fixed memory leak, race and other small issues with reconnect to pool.

frontend

The dcache-view.endpoints.webdav property now overrides any auto-discovered WebDAV endpoint, making explicit configuration easier.

A client may now request that the permissions of a file or directory is modified through the frontend.

A file or directory’s `mode (Unix permission) is now available through frontend.

pnfsmanager

A regression is fixed the prevents creating a symbolic link.

Users with a UPLOAD-only macaroon are now able to create subdirectories within their allowed upload subtree.

systemd

dcache-generator now successfully runs after restart.

webdav

dCache WebDAV door now provides simple text error messages for clients (such as rclone) that cannot consume error responses that are HTML web-pages. Web-browser based browsing and access in unaffected.

xrootd

xrootd4j is updated to 4.0.6.

The current relase has updated to xrootd4j library to 4.0.6.

The correct subject is used to access the path for both GSI and SciToken protocols.

Changelog 7.0.7..7.0.8

ee51beb626: [maven-release-plugin] prepare release 7.0.8
002bf89ae3: frontend: always report ‘mode’ Unix permissions
e995f02fb4: pnfsmanager: filter high-order bits from POSIX mode
230b768ca4: frontend: allow a user to change Unix permissions
2f8791a2e6: pool: make sure that RepositoryChannel when createChannel detects error
39a998cc25: webdav: generate short error messages for non-web clients
5849f0d41f: update to xrootd 4.0.7
6fefa7a4f9: dcache-xrootd: update to xrootd4j 4.0.6
6dd4b8d9b6: frontend: bump version of dCacheView
56322f3a28: pnfsmanager: fix NPE regression from 3dfed7e8b0
7fbd834dc7: pnfsmanager: allow UPLOAD users to create sub-directories
3feefb5941: dcache-xroot: fix memory leak, race and other small issues with reconnect to pool
fb866e9676: dcache-xroot: store most recent login subject in door
eb067ec817: frontend: bump dCacheView to v1.6.2
bee1d2b821: systemd: fix generator run after reboot
fff5313877: [maven-release-plugin] prepare for next development iteration

Release 7.0.7

nearline-storage

The current release fixed store cancel regression.

pool

As in distributed system packet loss (due to timeout or re-connects) can’t be avoid, dCache retries many of requests. However, this is not the case for mover redirects. If a door did not receive reqirect information, then transfer will never happen. This is now fixed and re-send redirect if client is not connected within 5sec.

poolmanager

The current release fixed a (vanishingly small) likelihood of a pool-manager suspending transfers if a read request triggers staging or pool-to-pool and the pool responds amazingly quickly.

When poolmanager requests that a pool stage a file, the pool may return the special error code HSM_DELAY_ERROR (10013). On receiving this error, poolmanager suspends the request.

This is now fixed.

Changelog 7.0.6..7.0.7

6f018a97e0: [maven-release-plugin] prepare release 7.0.7
2ab2677a7b: poolmanager: fix rogue ‘null’ value in _fifo from commit 1501f056ce
257ba14348: nearline-storage: fix store cancel regression
6e4dfca2a1: pool: re-send redirect if client is not connected within 5sec
db8bc2af5c: poolmanager: fix NPE if pool delays stage without giving a reason
da6af7e414: nearline-storage: introduce FlushRequest#getReplicaCreationTime
71ec930d83: [maven-release-plugin] prepare for next development iteration

Release 7.0.6

pool

There are several cases when pool scans the various hsm queus: on mover start, to check load assumptions, on heartbeat, to populate pool manager with load information, on info command, to report load numbers to admin interface of dcache-view collectors

As this is O(n) operation, in case of a large queues those scans might take seconds, which is unacceptable, especially wen starting a new mover.

This is now fixed and getting hsm start is O(1) and doesn’t impact pools operation

xrootd

Now the door will ignore xrootd.enable.tried-hosts property if property false instead of returning errror.

Changelog 7.0.5..7.0.6

26b5e779f2: [maven-release-plugin] prepare release 7.0.6
29af66f70d: pool: don’t scan flush/restore/remove queue to get stats
80d7559ba5: dcache-xroot: (door) ignore tried if property false instead of returning error
cd318fcb77: [maven-release-plugin] prepare for next development iteration

Release 7.0.6

pool

As this is O(n) operation, in case of a large queues those scans might take seconds, which is unacceptable, especially wen starting a new mover.

This is now fixed and getting hsm start is O(1) and doesn’t impact pools operation

xrootd

Now the door will ignore xrootd.enable.tried-hosts property if property false instead of returning errror.

Changelog 7.0.5..7.0.6

26b5e779f2: [maven-release-plugin] prepare release 7.0.6
29af66f70d: pool: don’t scan flush/restore/remove queue to get stats
80d7559ba5: dcache-xroot: (door) ignore tried if property false instead of returning error
cd318fcb77: [maven-release-plugin] prepare for next development iteration

Release 7.0.5

nfs

Fixes regression introduced in 6.2.15.

Changelog 7.0.4..7.0.5

782cd8dcea: [maven-release-plugin] prepare release 7.0.5
dccd058e85: nfs: fix access to path before namespace info available
558492cee0: [maven-release-plugin] prepare for next development iteration

Release 7.0.4

Changes affecting multiple services

Sometimes file checksums are missing in namespace. Transfer requiring checksum verification fails then with an error saying that “No checksums found”, but doesn’t log a stack trace server side anymore.

dcache-xroot

During periods of heavy usage on a pool node, if I/O stalls during read, the xroot client may try to reconnect and continue reading. This release fixes a bug which fails the transfer on the attempted reconnect with a “uuid no longer valid” error (because the file mover has already been closed and removed). Clients should now be able to resume reading the file on retry.

Changelog 7.0.3..7.0.4

ad05f7ede6: [maven-release-plugin] prepare release 7.0.4
137d639b98: dcache-xroot: Allow client to reattempt open on pool when I/O stalls
5591adbcef: check if checksums are present and throw CacheException if they are not
7269d08172: [maven-release-plugin] prepare for next development iteration

Release 7.0.3

admin

The current release fixed doors login dump cache admin command to show the information sent by the door along with the login result.

common

Printing of bearer tokens is improved to provide better assurance that bearer tokens are not leaked.

gplazma

All login failures are now recoreded in pinboard as a single-line summary, explaining why the login attempt failed.

namespace

Now Path information available for all transfers.

webdav

The current release fixed a regression where dCache would complain about badly formatted IPv6 addresses, preventing those addresses from being included in the access log files.

xroot

The current relase updated xrootd4j to 4.0.5 which fixes improper use of destination token when contacting source server during third-pary transfer.

Changelog 7.0.2..7.0.3

73d46a8ec3: [maven-release-plugin] prepare release 7.0.3
d9c9835a14: dcache-xroot: update to xrootd4j–4.0.5
ba533a26ed: webdav/frontend: fix IPv6 address logging
81acb053be: common: update how BearerToken is shown in Subjects#toString
dac8e11ea4: authn: add missing hashCode and equals methods for PasswordCredential
8b1ee224e3: authn: fix “login dump cache” admin command output
243db3d569: gplazma: provide single-line summary in pinboard for each login failure
5cfad134d8: authn: add missing hashCode and equals methods for BearerTokenCredential
0adbbd788f: common: Update BearerToken representation to include some information
152bcb41e2: namespace: ensure that file’s path always set on GetAttributes
e536672911: authn: log failures in UnionLoginStrategy
5d949b937a: [maven-release-plugin] prepare for next development iteration

Release 7.0.2

chimera

The DiskCleaner has been observed to cause high memory loads, even crash if the trash table is very large. This is now fixed and the DiskCleaner does not run out of memory due to large numbers of trash table entries.

gplazma

dCache now supports OPs that assert group-membership with eduPersonEntitlement claims (as described by AARC guideline G002). The multimap plugin may be used to map these to corresponding group/gid values

webdav

Restarting transfermanager while there are ongoing HTTP-TPC transfers no longer results in an endless loop, with transfermanager logging a message every ~5 seconds per ongoing HTTP-TPC transfer.

Changelog 7.0.1..7.0.2

455482d077: [maven-release-plugin] prepare release 7.0.2
8712352a7b: Revert “pool: do not update file size on flush”
265c2d4e54: gplazma: add support for eduPersonEntitlement assertions
5c1d745ac6: build(deps): bump version.jackson from 2.10.1 to 2.12.1
e5dec6ce08: webdav-transfermanager: fail gracefully if transfermanager restarted
f22a8994a5: dcache-chimera: chunking disk cleaner’s trash table access
c9bb2ec389: [maven-release-plugin] prepare for next development iteration

Release 7.0.1

biiling

The current relase fixed unit info for bandwidth measurements in billing.properties (bytes/sec, not MiB/sec).

frontend

Frontend now logs any time it returns 500 Internal Server Error to the client.

dcache-view Previously displayed MB/sec for transfer rate, but the value is the old KB/sec. This is now improved and pages display the values advertised.

pool

Less memory consumption by pool, especially on startup.

The current release assures now that checksum scanner wiill mark files broken and sends alarm.

webdav

An HTTP-TPC transfer will abort automatically if transfer-manager is restarted, without waiting for the client (FTS) to time-out.

Changelog 7.0.0..7.0.1

58013c124f: [maven-release-plugin] prepare release 7.0.1
926593db81: dcache-pool: Assure checksum scanner marks files broken and sends alarm
36d1ecb8b4: pool: do not re-read storage info when creating CacheRepositoryEntry
76ee34de41: webdav/transfermanager: fail gracefully on restart, for perf marker
9b40626893: default: fix unit info for bandwidth measurements in billing.properties
52be56e3a8: frontend: create a log entry when we return 500 Internal Server Error
b977d966eb: pool: do not update file size on flush
b9f9f93b6d: dcache-frontend: change transfer rate to compute what it advertised
e97dd2115e: pool: use soft reference to storage info object
bfc41bed21: [maven-release-plugin] prepare for next development iteration

Release 7.0.0

Admin

The pcells GUI was abandoned a while ago. With version 7.0 dCache has dropped the corresponding components in the admin door.

Cleaner

The HsmCleaner regularly fetches HSM locations for deletion from the trash table and caches them locally for batched dispatch. The maximum number of cached delete locations can now be limited in order to prevent running out of memory if the trash table is too large. The default value is cleaner.limits.hsm-max-cached-locations = 12000

HA Services

The high available services PinManager and Cleaner have acquired new debug commands in the admin interface related to their HA participation starting with ha [...]. When using ha get role or ha release leaderhip it is usually most sensible to explicitly specify the fully qualified cell@domain name it should be sent to, especially in the case of the well-known PinManager cell.

NFS

With the addition of external attributes support into NFS, some magic dot files can be exposed through standard tools. With dCache 7.0.0 the directory tags can be in read-only mode accessed with getfattr of with attr command line tools:

$ getfattr  -L .
user.dcache.tag.AccessLatency
user.dcache.tag.OSMTemplate
user.dcache.tag.RetentionPolicy
user.dcache.tag.sGroup

$ getfattr -n user.dcache.tag.OSMTemplate .
user.dcache.tag.OSMTemplate="StoreName test\012"

With attr:

$ attr -q -l .
dcache.tag.AccessLatency
dcache.tag.OSMTemplate
dcache.tag.RetentionPolicy
dcache.tag.sGroup

$ attr -q -g dcache.tag.OSMTemplate .
StoreName test

This functionality requires a xattr-capable NFS client, which is linux kernel 5.9 or later.

The admin interface for NFS doors has been updated to remove redundant information from the output of the show clients command:

    [dcache-lab000] (NFS-dcache-lab007@core-dcache-lab007) admin > show clients
        /11.19.15.23:967:Linux NFSv4.1 ani:v4.1
            5f4ccad3000300010000000000000001 max slot: 15/0
    
    [dcache-lab000] (NFS-dcache-lab007@core-dcache-lab007) admin >

The argument of kill client accepts the client’s session id. For instance, to kill the client from example above:

[dcache-lab000] (NFS-dcache-lab007@core-dcache-lab007) admin > kill client 5f4ccad3000300010000000000000001

The NFS door has also been updated to support secure/insecure export options specifying whether clients are required to use a privilaged port. This option typically is used to disallow user-space NFS clients, as they might spoof request credentials. The default is insecure.

Pool

Removed admin/setup command set duplicate request. The correspoding behaviour had been dropped since dcache 3.0.

Changelog from 6.2.0 to 7.0.0

(tbd as soon as the branching is done)

bfc41bed21: [maven-release-plugin] prepare for next development iteration
61614a57f8: [maven-release-plugin] prepare release 7.0.0
493c629f07: ftp: do not leak sockets when calculating checksums dynamically
0dfb6e95e9: ftp: add work-around to calculate MD5 for Globus
d42c1df107: ftp: add place-holder file size work-around for Globus directory listing
2215a8fd6b: rpm take build directory path into quotes
6bd7517b49: ftp: fix MLSC support for medium-length directories
d407ffe83e: ftp: fix on-the-fly checksum calculation
816f2b4f3e: book: document host alias issue with xroot TPC
070b50d3be: TransferManager: choose better pool query message TTL
7fb112950f: webdav/frontend: ensure cancelled HTTP-TPC transfers are logged
8384b5220f: xrootd/pool: improve access log to record more details of kXR_query
573dbe8b30: vehicles: internalize common strings in StorageInfo
1ad9936841: pool: sort flush queue only if we going to use the result
f1391f72b5: libs: use nfs4j–0.22.2
07d9109a75: pool: https avoid sharing SSLEngine between TCP connections
69f0e0850d: removing commit-msg file
f5ae0350fe: updated alice-plugin version to 1.2.0
d3a3123674: pom.xml:update xrootd4j-authz-plugin-alice version to 1.2.0
bf6cf29e5a: dcap: always set Subject when talking to PnfsManager
3fae52b016: pnfsmanager: for chgrp, add check whether user is member of target group
db8ffdbe87: srm-client: prevent unhelpful NullPointerException
83f8562216: logging: add an option to control logger destination
479a0cf43b: pom: update to xrootd4j 4.0.4
158e202156: [maven-release-plugin] prepare branch 7.0
92ab8645dd: pool: fix async shutdown of NettyTransferService
2a8fb86f7f: cells: drop pcells support
5bfb490fe9: p2p: don’t query namespace to flags stored in level–2
b74be94378: pool: accept ‘xroot’ as protocol name
ed93e28d06: docs: update many references of xrootd to xroot
ec03649073: frontend: add support for ‘chgrp’ action
fd2427547e: webdav:HTTPS PUT req issue
7ba8ba1913: pool: preserve CDC on p2p transfer
38f76f6941: cells: drop jni code to access pam module
0d46526454: gplazma: drop unsed ClassTypePredicate
32620e4c82: acl: drop weird singletons in utility classes
0ac5d095c3: pool: http-tpc do not loop if HEAD ‘Content-Length’ response is missing
89c3f26f2d: pool: http-tpc drop ‘Accept-Encoding’ on HEAD requests
b780b706ad: book: link to and briefly describe pinmanager in component overview
888c71b293: nfs: use UnixSubjects when extracting uid/gids if an RPC request
267d1c2f8c: common-auth: mark UidPrincipal as In/Out principal
81a8296eff: srm: don’t create credentials directory object in a loop
41393c0b74: test: fix regression introduced in 00c29fc
00c29fc770: pom: migrate to nfs4j–0.22.0
7765b1eaf6: pool: update statistics model for IO use
0db93719a6: pool: remove unusued constructor
f046e12bcb: bulk: move queue synchronization to object
243978fece: ftp-client: remove confusing field member
993fd47b5d: bulk: noramlise LOGGER usage
369d4aa484: dcache-srm: remove unused fields
9375c71dc3: build(deps-dev): bump junit from 4.12 to 4.13.1
642d2853f4: build: fix spotbugs exclusion configuration
8e74987a6b: srmclient: avoid code duplication
54515b8d7d: dcache-chimera: remove redundant cleaner info output
61fa7546b4: pool: refactor code to make it more DRY
a87b64cc97: dcache-core: specify the role of HAServiceLeadershipManager
df420af350: pool: include BerkeleyDB error into log message
2d69236a87: dcache-chimera: remove spring circular dependency of cleaner and HA manager
5c71647083: pool: update default configuration to drop ‘set duplicate’
e0dbedb666: pool: update xrootd-tpc authenication default
726f471949: build: fix PMD’s CPD exclude configuration
6fc49f453f: dcache-frontend: add REST api support for aggregated space by storage unit in pool group
f440fea025: dcache (pool): modify StatisticsListener to be shared and produce JSON object for StorageUnit
c243c9e4da: pnfsmanager: fix broken commit
f3a7b7a43a: pnfsmanager: refactor Chimera(Osm|Enstore)StorageInfoExtractor
947216b894: pnfsmanager: drop support for LEGACY file in ChimeraEnstoreStorageInfoExtractor
69adffc842: pool: remove handling of mover start duplicate requests
baece52065: pnfsmanager: drop support for LEGACY new files in ChimeraOsmStorageInfoExtractor
34b7251b3a: chimera: update EnstoreStorageInfoExtractor to use FileState
57f55caa6c: chimera: use UTF–8 constant instead of string in ChimeraEnstoreStorageInfoExtractor
be85181a70: nfs: drop internal mover re-start loop
3ee4a97a84: pool: support removing MongoDB storage-info entry
2c1b68309c: pool: http-tpc remove hard-coded Checksum
71c0f39cfb: transfermanager: fix Integer vs Long bug in CopyManager
afac62ff02: space: document method argument as Nullable
2290595111: pool: detach IO thread when mover finished
872f0cba26: util: use Futures.scheduleAsync to drop dependency on ListeningScheduledExecutorService
882e162750: pool: http-tpc minor code simplication
b4a4e543cd: srm: drop final SRMv1 fossils
b4fbc95049: gplazma: SciToken add extra unit test
4cca5802a8: gplazma: scitoken combined authorisation targeting same path
8a0bd70bd1: common: avoid double ‘[’ in MultiTargetedRestriction toString
632ef0c93d: pool: http-tpc PUT request are repeatable
a6dd1890f6: pool: http better handling of malformed input
cd8eac91df: dcap: fix automatic door retry on transient errors
73a7a7ce39: srm-client: support srm operations with bearer token
c39689b75a: chimera: create/update/remove of xattrs must update inodes generation
66bc0d7b0f: srm-client: refactor command-specific code
1251bbcfdd: srm-client: drop legacy C++ srm client
7fd6dba64a: srm-client: drop support for SRM v1.1
5d0c8c972c: build: silence more unit tests
28e3821dcb: build: suppress junit logging output by default
d0ccd8b699: srm: update srm-server to use new client API
a247d58e26: srm-common: make X509 client authn optional, support bearer tokens
0bc8ce57a7: srm: add support for OIDC, SciToken and macaroon authentication
3732711343: srm-server: factor out HttpServletRequest handling
8e4596b4d5: srm: avoid logging ‘user.dn’ field if user has no DN
06e3b175c1: httpd: fix pool usage color scheme css
53d9ba85fa: xrootd: populate ‘xdg.origin.url’ xattr with source location
cbcd02b773: dcache-core: fix PinManager not scheduling unpinning
b063a340ae: webdav: only log that transfer is proxied with expect–100 negotiation
288df06dbb: frontend: update namespace entry JSON mimetype to use ‘mime_type’ xattr
3cde96acd7: webdav: http-tpc populate ‘xdg.origin.url’ xattr with remote location
3d5759eed4: nfs: make output of show clients user friendly
3ced502263: frontend: refactor how MIME-Type is returned to client
0154d434c0: nfs: make argument of kill client to match output of show clients
45c79bf291: pool: http-tpc adjust GET and HEAD request timeouts
8854d55703: pool: http-tpc increase timeout waiting for remote server post-processing
94971c5590: webdav: support custom Content-Type values
998ec7b91e: gplazma: include additional algorithm in LoginResultPrinter
fb7808a862: pool: http-tpc add work-around for Dynafed
d4cd2080ca: pool: allow movers to update a new file’s extended attributes
52d9b2a51e: core: update FileAttributes to facilitate modify extended attributes
108a99a923: book: added PinManager chapter
5e7b474bf1: pool: http-tpc set expect–100 timeout to much larger value
121f904741: webdav/frontend: log time to process request
77e1eb3145: webdav: do not redirect upload if client has started sending data
5d613ef945: book: fixed HA cleaner description
17477b6efd: book: added cleaner description to HA services
630e2cb588: nfs-proxy: op WRITE must use the same verifier as COMMIT
b60ba4cbe3: nfs-proxy: don’t create an intermediate byte array on write
0431fe2676: pool: remove dead code in NearlineStorageHandler
a11c316f4c: pool: fix javadoc typo in FileRepositoryChannel
c7202b766d: acl: remove commented out code
e614150b31: acl: remove unused ACE|ACL#toNFSv4String
afd0236059: dcache:make srmcp http based to make it https in the second iteration
3252c20ea9: nfs: expose directory tags as extended attributes
4495824c41: dcache-chimera: fix setting HSM cleaner timeout via admin command
f601cef15c: dcache-core: fix embedded ZooKeeper persisting stale ephemeral nodes
136f3b29d1: dcache-chimera: limit the number of cached hsm locations in Cleaner
ee5858d9db: dcache-resilience: do not cache/remove broken replicas
82b453877e: dcache-resilience: ignore broken cached files
383c3cb0b3: statistics: use Files.copy to copy files
61f0dcc556: poolmanager: fix typo in a comment
f76543e5e3: chimera-vfs: ensure that we check file type before setting size.
60ca70e522: poolmanager: fix infinite loop in request container state machine
19fa7cf242: chimera-vfs: return OK on write ACCESS check for existing files
712177cfc4: dcache-resilience: protect access of pool info map against NoSuchElementException
41c3cbd791: dcache-resilience: avoid NPE in file operation cancel
118516cf5c: dcache-chimera: fix setting hsm batch size via admin command
ceaf2b8747: ldap: fix inverted assertion
05faf1433a: ldap: relax number of threads that can remain after test
f9ec002012: macaroons: verifyCaveat should return false for unprocessed caveats
12da1f5c31: rpm: make dcache package depend on java–11
1501f056ce: poolmanager: refactor/simplify request container state machine
97ecbe6cea: poolmanager: reduce number of log statements
6528716d87: nfs: simplify filtering of elements in cli
47f1850cd0: nfs: replace single statement lambda block with a statement
55a855c5d5: systemd: add option to enforce systemd
669749b241: chimera: modernize Cleaner admin commands
5ad9b9e3ea: pool: fix issue #5491 NoSuchFileException
2c1a467a27: chimera: Cleaner formatting
16c6cb46b1: archetype: configure maven-compiler-plugin to use java11
342ec3672f: poolmanager: simplify request container by taking out common parts
83ff4b6ada: dcache-core: make PinManager use independent HA coordinator
ce8b186e97: ldap: add connection leak test
e449c39abf: pool: do not fail transfer if RFC3230 is badly formed.
39b2a1bb53: nfs: don’t attempt to select online-only pools when file on HSM
64fec26ecd: cleaner: add support for db password file
e0a3eef7e5: util: fix pgpass support for jdbc urls with options
9bda0ec3d2: documentation: fix markdown error
3bd21463d9: Added documentation for the bulk service:
402e0844a5: dcache-bulk: add delete plugin
02aadc897e: dcache-bulk: add QoS plugin
f4662037e6: dcache-bulk: add pin/unpin SPI plugin
baceb14cac: nfs: fix typos in comments
1783000744: dcache-frontend: add bulk service resource and utils
62ca0946fb: dcache-bulk (10): add configuration files
0d8f5e19f8: dcache-core: format brackets consistently in HAServiceLeadershipManager
86a103dcc8: pool.properties comment: load distribution with sweeper-margin
49945d84c1: pool: http-mover distinguish two upload failure modes
cda8dc284f: pool: http-mover refactor file release on channel close code
6716389603: dcache-bulk (09): add admin commands
6d1e939f77: dcache-bulk (08): add service and messages
f8c7fb25cf: dcache-bulk (07): add the request handler
5795783d10: dcache-bulk (06): add queue, statistics and callback interface
f17f280dfb: pool: rework interrupt processing on p2p
b1442851a0: systemd: convert dcache.service into dcache.target
5437dc67b9: change 6.3.0-SNAPSHOT to 7.0.0-SNAPSHOT
986b5420b7: [maven-release-plugin] prepare for next development iteration

What’s new in dCache 7.0 Release notes

Highlights

Incompatibilities

Acknowledgments

Release 7.0.40

gplazma2-grid

webdav

Changelog 7.0.39..7.0.40

Release 7.0.39

xrootd4j

Changelog 7.0.38..7.0.39

Release 7.0.38

dcache-bulk

Changelog 7.0.37..7.0.38

Release 7.0.38

dcache-bulk

Changelog 7.0.37..7.0.38

Release 7.0.37

frontend, bulk

Changelog 7.0.36..7.0.37

Release 7.0.36

frontend

pool

Changelog 7.0.35..7.0.36

Release 7.0.35

debian

info

pool

Changelog 7.0.34..7.0.35

Release 7.0.34

dcache

dcache-xroot

frontend

xrootd

Changelog 7.0.33..7.0.34

Changelog 7.0.33..7.0.34

Changelog 7.0.33..7.0.34

Changelog 7.0.33..7.0.34

Release 7.0.33

Release 7.0.32

pnfsmanager

pom

Changelog 7.0.31..7.0.32

Release 7.0.31

dcache-chimera

frontend

Changelog 7.0.30..7.0.31

Release 7.0.31

dcache-chimera

frontend

Changelog 7.0.30..7.0.31

Release 7.0.30

frontend

ftp

pool

Changelog 7.0.29..7.0.30

Release 7.0.29

common

pool

webdav

Changelog 7.0.28..7.0.29

Release 7.0.28

Pool

TransferManager

Changelog 7.0.27..7.0.28

Release 7.0.27

gplazma

loginbroker

pnfsmanager

webdav

Changelog 7.0.26..7.0.27

Release 7.0.26

common-security

pool

webdav

Changelog 7.0.25..7.0.26

Release 7.0.25

dcache

gplazma

pool

What’s new in dCache 7.0
Release notes