Part II. Configuration of dCache

This part contains descriptions of the components of dCache, their role, functionality within the framework. In short, all information necessary for configuring them.

Table of Contents

Individual services:

• The Admin Service

  • First Steps
  • Access With SSH
  • How to use the Admin Interface
  • Creating a new user
  • Direct command execution
  • Use of the SSH Admin Interface by scripts

• The Alarms Service

• The Basic Setup
• Configure where the alarms service is Running
• Types of Alarms
• Alarm Priority
• Working with Alarms: Shell Commands
• Working with Alarms: Admin Commands
• Advanced Service Configuration: Enabling Automatic Cleanup
• Advanced Service Configuration: Enabling Email Alerts
• Miscellaneous Properties of the alarms Service
• Alarms SPI
• Alarms and Kakfa

• The Billing Service

• The billing log files
• The billing database
• Billing Histogram Data
• Billing Records
• Upgrading a Previous Installation

• The Bulk Service

• Configuring
• Requests
• Activities
• Container Design
• Storage and Recovery
• Admin Commands

• The Cleaner Service

  • Configuration
  • Disk Cleaner
  • HSM Cleaner

• The Frontend Service

  • Configuring the Frontend service
  • Properties controlling monitoring data collection
  • Properties controlling monitoring data access
  • Configuring and using the admin role

• The FTP Service

  • Introduction
  • The Control channel
  • Data transfers
  • Configuration examples

• dCache History Service

• The Info Provider Service

  • Internal collection of information
  • Configuring
  • Testing
  • Publishing dCache information
  • Troubleshooting BDII problems
  • Updating information

• The Missing Files Service

  • Introduction
  • Setting up

• dCache as NFSv4.1 Server

  • Setting up
  • Configuring NFSv4.1 door with GSS-API support
  • Configuring principal-id mapping for NFS access
  • Managing group ids
  • Accessing directory tags

• The PinManager Service

  • The (Un-)Pinning Concept
  • The pin life cycle
  • Configuring

• The PoolManager Service

  • The Pool Selection Mechanism
  • Links
  • Examples
  • The Partition Manager
  • Overview
  • Managing Partitions
  • Using Partitions
  • Classic Partitions
  • Link Groups

• The Resilience Service

  • Configuring the Resilience Service
  • Resilience Home
  • Admin Commands
  • Tuning
  • Resilience’s View of Pool Status
  • Automatic Staging of Missing CUSTODIAL Replicas
  • Handling of QoS Transitions for Resilient Files
  • Some typical scenarios part - what happens when …?
  • Some typical scenarios part - how do I …?

• dCache QoS Service

  • Introduction to the qos service
  • Configuring the qos service
  • QoS Definitions
  • QoS Home
  • Admin Commands
  • Tuning
  • QoS’s View of Pool Status
  • Automatic Staging of Missing CUSTODIAL ONLINE replicas
  • Some typical scenarios part 1 - what happens when …?
  • Some typical scenarios part 2 - how do I …?

• dCache SpaceManager Service

  • Utilization of space reservations for data storage
  • Properties of space reservation
  • Activating Spacemanager
  • Explicit and implicit space reservations for data storage in dCache
  • Spacemanager configuration

• dCache Storage Resource Manager

  • Configuring the srm service
  • Utilization of Space Reservations for Data Storage
  • Configuring the PostgreSQL Database
  • General SRM Concepts (for developers)

• dCache SRM Manager Service

  • Configuring the srm manager service
  • Tape recall scheduling

• The Statistics Service

  • The Basic Setup
  • The Statistics Web Page
  • Explanation of the File Format of the xxx.raw Files

• dCache as XRoot-Server

  • Setting up
  • Quick tests
  • Pool memory requirements
  • Xroot security
  • Third-party transfer

Overarching concepts:

• ACLs in dCache
• Introduction
• Configuring ACL support
• Setting and getting ACLs
• Accessing ACL over NFS mount

• Chimera

• Mounting Chimera through NFS
• Using dCap with a mounted file system
• Communicating with Chimera
• IDs
• Directory Tags
• Create, List and Read Directory Tags if the Namespace is not Mounted
• Create, List and Read Directory Tags if the Namespace is Mounted
• Directory Tags and Command Files
• Directory Tags for dCache
• Storage Class and Directory Tags

• Cell Message Passing

• Naming and addressing
• Routing
• Configuration

• The dCache Tertiary Storage System Interface

• Scope of this chapter
• Requirements for a tertiary storage system
• How dCache interacts with a Tertiary Storage System
• Details on the TSS-support executable
• Configuring pools to interact with a Tertiary Storage System
• How to Store-/Restore files via the Admin Interface
• How to monitor what’s going on

• File Hopping

• File Hopping on arrival from outside dCache
• File mode of replicated files
• File Hopping managed by the PoolManager
• File Hopping managed by the HoppingManager

• gPlazma: Authorization in dCache

• Basics
• Configuration
• Plug-ins
• Using X.509 Certificates
• CA Certificates
• User Certificate
• Host Certificate
• VOMS Proxy Certificate
• Configuration files
• storage-authzdb
• The gplazmalite-vorole-mapping plug-in
• Authorizing a VO
• The kpwd plug-in
• The gridmap plug-in
• gPlazma specific dCache configuration
• Enabling Username/Password Access for WebDAV
• Roles

• Kafka

• What do you need to download to enable Kafka in dCache?
• Apache Kafka Installation.

• User and Group Quota

• Stage Protection

• Configuration of Stage Protection
• Definition of the White List

• Using Space Reservations without SRM

  • The Space Reservation
  • The WriteToken tag
  • Copy a File into the WriteToken

• Storage Descriptor / SRR

  • How the file is generated
  • Setting up dCache for Storage Descriptor
  • Configurable properties of dCache Storage Descriptor

• ZooKeeper

  • Deployment scenarios
  • Configuration
  • Inspecting ZooKeeper through dCache