Skip to content

GridFTP HDFS with "CVMFS" checksums
Compare
Choose a tag to compare
@bbockelm bbockelm released this 26 Oct 15:29
· 15 commits to master since this release
v1.1
681a654

This release adds some exciting new improvements to the GridFTP checksum code. A new checksum type, CVMFS is added, which provides a checksum per fixed-sized block within the file. As the name suggests, this is precisely the checksum type used internally within CVMFS (see https://cernvm.cern.ch/portal/filesystem), providing an easy mechanism for publishing the contents of a GridFTP server into CVMFS.

Additionally, special thanks goes out to @JasonAlt who provided several useful bugfixes for this release:

  • Edge cases around zero-sized files are handled correctly.
  • Deadlocks around the separate HDFS log monitor thread are now avoided.
  • Additionally, Jason found and fixed a few memory and file permission issues in the CVMFS code prior to its release.
Assets 2
Loading