REANA-Job-Controller 0.9.3

0.9.3 (2024-03-04)

Build

• certificates: update expired CERN Grid CA certificate (#440) (8d6539a), closes #439
• docker: non-editable submodules in "latest" mode (#416) (3bdda63)
• python: bump all required packages as of 2024-03-04 (#442) (de119eb)
• python: bump shared REANA packages as of 2024-03-04 (#442) (fc77628)

Features

• shutdown: stop all running jobs before stopping workflow (#423) (866675b)

Bug fixes

• database: limit the number of open database connections (#437) (980f749)

Performance improvements

• cache: avoid caching jobs when the cache is disabled (#435) (553468f), closes #422

Code refactoring

• db: set job status also in the main database (#423) (9d6fc99)
• docs: move from reST to Markdown (#428) (4732884)
• monitor: centralise logs and status updates (#423) (3685b01)
• monitor: move fetching of logs to job-manager (#423) (1fc117e)

Code style

• black: format with black v24 (#426) (8a2757e)

Continuous integration

• commitlint: addition of commit message linter (#417) (f547d3b)
• commitlint: allow release commit style (#443) (0fc9794)
• commitlint: check for the presence of concrete PR number (#425) (35bc1c5)
• pytest: move to PostgreSQL 14.10 (#429) (42622fa)
• release-please: initial configuration (#417) (fca6f74)
• release-please: update version in Dockerfile/OpenAPI specs (#421) (e6742f2)
• shellcheck: fix exit code propagation (#425) (8e74a85)

Documentation

• authors: complete list of contributors (#434) (b9f8364)

REANA-Job-Controller 0.9.2

• Adds metadata labels to Dockerfile.
• Adds automated multi-platform container image building for amd64 and arm64 architectures.
• Changes CVMFS support to allow users to automatically mount any available repository.
• Fixes container image building on the arm64 architecture.
• Fixes the creation of Kubernetes jobs by retrying in case of error and by correctly handling the error after reaching the retry limit.
• Fixes job monitoring in cases when job creation fails, for example when it is not possible to successfully mount volumes.

REANA-Job-Controller 0.9.1

• Adds unique error messages to Kubernetes job monitor to more easily identify source of problems.
• Changes Paramiko to version 3.0.0.
• Changes HTCondor to version 9.0.17 (LTS).
• Changes Rucio authentication helper to version 1.1.1 allowing users to override the Rucio server and authentication hosts independently of VO name.
• Fixes intermittent Slurm connection issues by DNS-resolving the Slurm head node IPv4 address before establishing connections.
• Fixes deletion of failed jobs not being performed when Kerberos is enabled.
• Fixes job monitoring to consider OOM-killed jobs as failed.
• Fixes Slurm command generation issues when using fully-qualified image names.
• Fixes location of HTCondor build dependencies.
• Fixes detection of default Rucio server and authentication host for ATLAS VO.
• Fixes container image names to be Podman-compatible.

REANA-Job-Controller 0.9.0

• Adds support for Rucio authentication for workflow jobs.
• Adds support for specifying slurm_partition and slurm_time for Slurm compute backend jobs.
• Adds Kerberos sidecar container to renew ticket periodically for long-running jobs.
• Changes reana-auth-vomsproxy sidecar to the latest stable version to support client-side proxy file generation technique and ESCAPE VOMS.
• Changes default Slurm partition to inf-short.
• Changes to PostgreSQL 12.13.
• Changes the base image of the component to Ubuntu 20.04 LTS and reduces final Docker image size by removing build-time dependencies.

REANA-Job-Controller 0.8.1

• Adds support for specifying kubernetes_job_timeout for Kubernetes compute backend jobs.
• Adds a new condition to allow processing jobs in case of receiving multiple failed events when job containers are not in a running state.

REANA-Job-Controller 0.8.0

• Adds database connection closure after each REST API request.
• Adds labels to job and run-batch pods to reduce k8s events to listen to for job-monitor.
• Fixes auto-mounting of Kubernetes API token inside user jobs by disabling it.
• Changes job dispatching to use only job-specific node labels.
• Changes to PostgreSQL 12.8

REANA-Job-Controller 0.7.5

• Changes HTCondor to 8.9.11.
• Changes myschedd package and configuration to latest versions.
• Fixes job command formatting bug for CWL workflows on HTCondor.

REANA-Job-Controller 0.7.4

• Adds configuration environment variable to set job memory limits for the Kubernetes compute backend (REANA_KUBERNETES_JOBS_MEMORY_LIMIT).
• Fixes Kubernetes job log capture to include information about failures caused by external factors such as OOMKilled.
• Adds support for specifying kubernetes_memory_limit for Kubernetes compute backend jobs.

REANA-Job-Controller 0.7.3

• Adds new configuration to toggle Kubernetes user jobs clean up.
• Fixes HTCondor Docker networking and machine version requirement setup.
• Fixes HTCondor logs and workspace files retrieval on job failure.
• Fixes Slurm job submission providing the correct shell environment to run Singularity.
• Changes HTCondor myschedd to the latest version.
• Changes job status succeeded to finished to use central REANA nomenclature.
• Changes how to deserialise job commands using central REANA-Commons deserialiser function.

REANA-Job-Controller 0.7.2

• Fixes minor code warnings.
• Changes CI system to include Python flake8 and Dockerfile hadolint checkers.