What’s new in dCache 10.1
Release notes
Highlights
- Experimental support for NFS-over-TLS
Incompatibilities
- starting with dcache–10.1.0 Java 17 is required for runtime.
- Transfer managers database functionality has been removed.
Acknowledgments
(tbd, this section uses markdown formatting)
Release 10.1.10
bulk
Restore the ability to use absolute paths when using bulk REST API.
cells
Cells will always try to re-establish dead tunnel connections.
qos
This fix will take care of the ‘Attribute is not defined: QOS_POLICY’ error in logs.
Changelog 10.1.9..10.1.10
- 0e6a949ef2
- [maven-release-plugin] prepare release 10.1.10
- 439b9574ac
- bulk: handle absolute/relative paths in uniform fashion
- 4471cb99ce
- qos: QOS fails with ’Attribute is not defined: QOS_POLICY’
- 73ac1a868b
- cells: always try to re-establish dead tunnel, unless stopped
- 313cbd44ad
- [maven-release-plugin] prepare for next development iteration
Release 10.1.9
jvm
Removed default JVM option UseCompressedOops so dCache works with large heap size.
Changelog 10.1.8..10.1.9
- 035d137fc0
- [maven-release-plugin] prepare release 10.1.9
- 1534d9f25a
- jvm: drop UseCompressedOops JVM option
- ce8c4e74f6
- [maven-release-plugin] prepare for next development iteration
Release 10.1.8
cells
When Zookeeper updates core domain infos, dCache will first kill the existing cell tunnels and then later try to read and parse the new value. If the new value is an empty string (for whatever reason), parsing will fail, but a new connection will not be established. This now fixed.
Changelog 10.1.7..10.1.8
- e494001961
- [maven-release-plugin] prepare release 10.1.8
- 34eade2da9
- cells: ignore empty core domain uris propagated by zk
- e5d19865f5
- [maven-release-plugin] prepare for next development iteration
Release 10.1.7
tape
Users reported 2 day pin lifetime on staged files (which is a default) despite specifying different values. This is now fixed.
Changelog 10.1.6..10.1.7
- 9680a2df66
- [maven-release-plugin] prepare release 10.1.7
- b83bc855fb
- tape REST api: additional fix tohandling of prefixed paths
- 96a1e89c6a
- [maven-release-plugin] prepare for next development iteration
Release 10.1.6
xroot
Return destination address (that is, the haproxy address) if xrootd.enable.proxy-protocol=true
is set, instead of the actual door address.
Changelog 10.1.5..10.1.6
- 0c3e0e1b16
- [maven-release-plugin] prepare release 10.1.6
- 17b85cc015
- xroot: handle haproxy and checksum command
- 13cca9a829
- [maven-release-plugin] prepare for next development iteration
Release 10.1.5
CI
Pipeline optimizations.
pool
Fix double decrement on active hsm requests. This addresses the issue of pools stopping flushing to tape with “Negative number of active requests”.
When a thread performing I/O gets interrupted, then an InterruptedIOException might be thrown. A DCAP mover will treat and propagate such an exception as a disk I/O error, thus disabling the pool. This fix reduces false positive disk I/O errors.
Changelog 10.1.4..10.1.5
- 19915761ec
- [maven-release-plugin] prepare release 10.1.5
- 297eac0550
- pool: don’t treat InterruptedIOException as a disk IO error
- 8c9ff6bd4a
- pool: fix double decrement of hsm requests
- 927d9a1a6d
- ci: split container image registry and repository
- cc5a438b55
- [maven-release-plugin] prepare for next development iteration
Release 10.1.4
bulk
The current release fixed broken command activities
.
Changelog 10.1.3..10.1.4
- 51e9ab1acc
- [maven-release-plugin] prepare release 10.1.4
- 991e26ec09
- ci: run spotbugs only on master branch
- 082d2d55c8
- bulk: fix broken command
activities
- 90199cf135
- [maven-release-plugin] prepare for next development iteration
Release 10.1.3
bulk
When specifying an empty target, bulk proceeded to process the request instead of failing fast. This is now fixed.
ci
Release process improvements.
gplazma
Fixed the tokenExchange plugin in gplazma so that there is no error on start.
A previous commit, leading to the last bugfix releases being blacklisted, introduced a regression in the multimap plugin. Where the ‘op’ principal type is used, logins will fail with dCache logging a stacktrace like
java.lang.RuntimeException: Failed to create principal: java.lang.NoSuchMethodException: org.dcache.auth.OAuthProviderPrincipal.<init>(java.lang.String)
.
This is now fixed.
Changelog 10.1.2..10.1.3
- dfb446f695
- [maven-release-plugin] prepare release 10.1.3
- a89c5034bc
- gplazma: multimap fix op regression
- c9d8b092d1
- bulk: check targets for empty strings
- b29c463b73
- gplazma2-oidc-te: fix invalid initialization of plugin
- a6fffd4069
- ci: use llm to generate release notes
- b368ef45e2
- [maven-release-plugin] prepare for next development iteration
Release 10.1.2
doc
Better documentation clarifying OIDC provider ID and issue claim.
Changelog 10.1.1..10.1.2
- 9d84bef8eb
- [maven-release-plugin] prepare release 10.1.2
- 47ee70a323
- github: add action for atumatic github-release
- 248292f1ed
- gplazma alise initial version of plugin
- 2e68af57ca
- common: add issuer URI to OAuthProviderPrincipal
- 1cb8f34c5f
- docs: clarify OIDC provider ID and issue claim
- 03cda0e37c
- [maven-release-plugin] prepare for next development iteration
Release 10.1.1
CI
Improve our CI pipleline.
TAPE-API
Release by relative path works.
Changelog 10.1.0..10.1.1
- a1c95c3d48
- [maven-release-plugin] prepare release 10.1.1
- 6a98d68906
- WLG TAPE REST API: fix handling of frontend.root in release API
- 0bb8a782ed
- gitlab: mirror tags
- 45a2e32c3d
- [maven-release-plugin] prepare for next development iteration
Release 10.1.0
gplazma
-
storage.stage
OIDC claims are now supported.
httpd
Fixed links to dCache documentation.
NFS
dCache NFS door supports RPC-over-TLS protocol extension for data-in-transit protection. To work
with pNFS, host certificates must be installed on NFS doors and pools. As pNFS uses multipath addresses
for client redirection, the host certificates must include the IPv4/IPv6 records
in Subject Alternative Name
.
To enable the RPC-over-TLS capability on pools and nfs doors, the following properties must be enabled:
pool.mover.nfs.enable.rpc-over-tls=true
nfs.enable.rpc-over-tls=true
or
dcache.enable.rpc-over-tls=true
To mount with TLS, clients need to run Linux kernel 6.5 or newer.
mount -o xprtsec=tls nfs-door:/data /mnt/
Known issues: NFS-over-TLS is not enforced by export options. The door/pool must be restarted on certificate updates.
Pool
- Adding PNFSID argument to st ls and rh ls commands to retrieve by specific ID.
Poolmanager
- Staging requests now take account of restrictions due to
storage.stage
claims, where present.
Transfer Managers
- Database functionality is removed.
Changelog from 10.0.0 to 10.1.0
- 45a2e32c3d
- [maven-release-plugin] prepare for next development iteration
- 289660b28d
- [maven-release-plugin] prepare release 10.1.0
- c5301935a6
- libs: update mina-sshd to version 2.13.1
- 91d61a6e98
- github: change mirroring action
- 46bebd2785
- ci: use shorter k8s namespace names
- dfabdbb393
- ci: drop centos–7 based wn. drop cvmfs
- ea976307ef
- ci: split el9 wn initialization from s2 tests
- 2fc65adf42
- [maven-release-plugin] prepare branch @{releaseLabel}
- 7d0973cc87
- http (old): fix links to docu page
- 218dbe01f7
- Fix issue with infinite replicas when replicas > 1
- 9cad174570
- Revert “Fix issue with infinite replicas when replicas > 1”
- 6e0bd00c0d
- Fix issue with infinite replicas when replicas > 1
- fdc37638e5
- book: add perf example
- d8e5a89eb7
- ci: use desy nims repo for CentOS7
- 6ac5de5586
- dcache: refactor DiskSpaceAllocatorTest
- 922ea440d9
- frontend: handle frontend.root variable properly
- 63ae8dd213
- add standard Fermilab license/copyright header neglected in the commit 741a27b19c0458bdd2abc0b0b9affdee681c16ed
- 741a27b19c
- chimera: add CTA HSM StorageInfo extractor
- 3464b9cbad
- ci: start dcache with old pools
- d321e7e24f
- pom: compile code in the same jvm as maven
- 99cf65a4b7
- transfermanager: remote JDO and datanucleaus leftovers
- 5a0a09e152
- tpc: Remove remote transfer manager’s database (#7598)
- 72b593ad33
- Update bulk.properties: add comment
- d772420706
- Revert “Get rid of persistanceManager, persistanceMAnagerFactory and Transaction”
- 1f1ab1d729
- Get rid of persistanceManager, persistanceMAnagerFactory and Transaction inside TransferManager class.
- d6ed35753b
- pool: add PNFSID to
st ls
andrh ls
commands (#7596) - de2f2681ac
- gplazma: oidc more descriptive offline verification failures
- 9c12ffdb1a
- nearline-storage: update copy n-s-p to respect c:puts, c:gets, c:remove properties
- 100e7d1cc1
- chimera: fix uri_encode to handle special characters
- 17e52201ee
- gplazma token exchange plugin (#7521)
- 6a8dc218cf
- ci: add comments to various pipeline stages
- a473929c65
- ci: add property to control upload options
- fb1f525e38
- ci: disable srmcp test
- ffee5e0a8c
- ci: use python3 for robot test
- 01a2f778af
- ci: pinpoint postgres helm version
- 839fd3e4d4
- Update dcache-minimal-installation.md
- 455885658c
- Update dcache-minimal-installation.md
- e236630e30
- Update dcache-minimal-installation.md
- 2b9783d20c
- Update dcache-minimal-installation.md
- 8a666a6e48
- Update dcache-minimal-installation.md
- 3d8d644500
- Update dcache-minimal-installation.md
- 2531962400
- Update dcache-minimal-installation.md
- ebbd182309
- Update dcache-minimal-installation.md
- a98b0ccf93
- bulk: do not truncate target paths
- 79ea5f837c
- Update dcache-minimal-installation.md
- c38556ba46
- Update dcache-minimal-installation.md
- bc24b22a24
- Update dcache-minimal-installation.md
- 062ae07e81
- Update dcache-minimal-installation.md
- 462e5c92ef
- Update dcache-minimal-installation.md
- 23553513f0
- Update dcache-minimal-installation.md
- 16cf66414a
- Update dcache-minimal-installation.md
- 0a87d50b80
- Update dcache-minimal-installation.md
- c238c6a33f
- Update dcache-minimal-installation.md
- 22eb51d2f9
- Update dcache-minimal-installation.md
- 0b99890982
- Update dcache-minimal-installation.md
- 495a8eaa52
- Update dcache-minimal-installation.md
- 84ac6b24e8
- Update dcache-minimal-installation.md
- 0597b1f47a
- pool: fix miscalculation of offset on short read.
- adce9368f1
- The Kafka bean must be optional for SRM manager.
- 72da8e9592
- chimera: fix loop creation on directory move
- 73366d2e65
- build(deps): bump org.bouncycastle:bcprov-jdk18on from 1.77 to 1.78
- bf4e865732
- chimera: don’t update file mtime on hard links creation
- 2db51de545
- ci: drop –ftp-create-dirs option (as we switch to https)
- 052d56b970
- Support
storage.stage
restriction checking for staging operations - c8f4fdfd64
- common, gplazma-oidc: Add
storage.stage
to activities - 17e7038602
- common: Add debug logging to
Restriction
classes - 5a4669cb18
- common: Avoid redundant path resolution
- 58aa320d22
- common: Improve DenyActivityRestriction tests
- cf8b19ec41
- ci: use almalinux9 for rpm install test
- 5cbe754b81
- rpm: require java–17
- 05b00cd9c2
- ci: take s2 rpm from nexus yum repo
- 2bfe4fae26
- ci: eplocitly specify kubernetes namespace
- 59b6acfabe
- ci: fix typo
- 412bfe2a33
- webdav: use transfermanager+id to identify TPC transfer
- e3bde268d1
- docs: update oidc chapter to explain trust anchors
- cff333d1ef
- nfs,pool: expose NFS-over-TLS capability of dCache
- 8f1a8aa8f6
- Book: Move HA transfer-man. section out of srm-man.
- 16daf3347f
- Add Kafka producer to transfer manager.
- e5386d33a9
- Add Kafka producer to SRM manager.
- aff6ed2097
- ci: log job statup time
- 3b028b7721
- docs: update BUILDING.md
- afd9270893
- pom: use java17 for compilation
- daae5d5292
- libs: update bouncycastle to 1.77, canl to 2.8.3
- b03dd5ad5c
- ci: generate xunit report for s2
- 358bb3b997
- ci: drop sha1 workaround for rhel9 hosts
- 7648539bf0
- common-security: add custom version of ProxyCSRGenerator#generate
- dae9682c42
- webdav: httptpc percent-decode local path
- a1403cb023
- enable all s2 tests
- cd0f95a8a6
- ci: show s2 test case error if failed
- 1154f5a543
- ci: fix s2 test root directory
- 3682618966
- ci: enable s2 tests
- 40e53dfc7a
- build(deps): bump io.netty:netty-codec-http
- d26b9ae031
- qos: add flag to enable/disable role based authorization for transitions
- 51f932083c
- multiple: separate ha command prefix from zk path
- 111b700084
- chimera: make list method to support virtual directory listing
- cbed2f0b93
- Initial cells docu
- 8b9fb33eca
- [maven-release-plugin] prepare for next development iteration