Skip to content

Releases: Percona-Lab/mongodb_consistent_backup

1.4.1

05 Dec 15:56
a3b02b5
Compare
Choose a tag to compare
  1. Oplog/Resolver/Resolver.py: De-duplicating code closing the pool (#280)
  2. Fix building on macOS (#285)
  3. Add --archive.tar.binary parameter (#286)
  4. Option to Allow skipping bucket validation (#287)
  5. Add support for mongodb+srv:// seed list as 'host' option (#289)
  6. Pin Pex to version <=1.4 at build-time (#289)

1.4.0

08 Oct 14:09
1dbc983
Compare
Choose a tag to compare
  1. Rotate: Wrapping the rotate removal under a try-catch block. (#278)
  2. Configuring all Task sub-classes to use their respected threads configuration item and using the Task threads() functionality (#273)
  3. Upload/Rsync/Rsync: Adding a function get_dest_dir() to work like in RsyncUploadThread (#270)
  4. Feature: Add Zabbix Server notification support (#264)
  5. Fixing rpm filename expression for CentOS 7 (#269)
  6. Fixes for S3 IAM role authentication (#260)

Thanks to @corey-hammerton for the bugfixes!

1.3.0

22 Feb 17:48
7c6690a
Compare
Choose a tag to compare
  1. Fix new flake8 'E722 do not use bare except' errors (#238)
  2. Fix: 'MongodumpThread' object has no attribute 'client_cert_file' (#237)
  3. Fix S3 upload bug (#226)
  4. Explicit S3 key (#224)
  5. Update to Pymongo 3.6.0 (MongoDB 3.6 support) and latest GCE (#247)
  6. S3 Upload Fixes v1 (#249)
  7. Dockerhub URL update (#246)
  8. Log regular console output to stdout, only use stderr for errors (#252)

1.2.0

25 Sep 13:37
Compare
Choose a tag to compare
  1. MongoDB SSL connection support (#60)
  2. Support Replica Set Read Preference tag sets (#219)
  3. Support backup rotation/retention by number of days or backups (#221)
  4. Support threaded Rsync upload method (to resolve #147)
  5. Bug fix for zero node score in Replication/Replset.py when max lag >= 10 seconds (#218)
  6. Default to backup.name 'default' if not provided (#227)
  7. Use Docker persistent volume maps for docker container (#214)
  8. Default to backup.location '/var/lib/mongodb-consistent-backup' (#227)
  9. Make 'threads' and 'retries' vars are upload-component-wide (#190)
  10. Return more-descriptive error for missing required fields (#186)
  11. Ensure openssl-libs are required in RPM (for SSL support), add missing BuildRequires (#213)
  12. Check if Backup/Mongodump.py 'auto' compress mode can actually support compression (#193)
  13. Raise OperationError instead of unclean exit if gzip unsupported in mongodump (#191)
  14. Update PyPi requirements (#205)
  15. Make code adhere to flake8/pep8 standards (#198, #199)
  16. Build binary+rpm in Docker under the correct OS (#189, #201)
  17. Support Travis-ci Continuous Integration testing (#197)
  18. README updates for 1.2.0 changes (#207, #228, #229)

1.1.0

04 Aug 15:39
Compare
Choose a tag to compare
  1. GCS (Google Cloud Storage) upload method w/threading (#178, #181, #182, #185).
  2. Fabric and Boto requirements updates (to latest) (#183).
  3. New feature to disable cluster oplog tailing (ie: cluster-wide consistency) (#175).
  4. Fsync mechanism added to oplog tailing, 1 x fsync every 1 sec or 100 oplog writes (by default) (#174).
  5. Allow failures in oplog tailing to stop backup and dump method (#174).
  6. Ensure Resolver consistent timestamp is not before end of mongodump (Issue #164, fix: #171).
  7. Only apply quorum checking to electable nodes (#169).
  8. Default replication delay maximum raised to 10 secs from 5.
  9. Display more mongodump version information (#170).
  10. Handle mongodump errors properly (#176).
  11. Hide GCS secret keys in logging.
  12. 'make docker' must depend on the bin/mongodb-consistent-backup build in Makefile (#176).

1.0.3

09 Jun 16:02
Compare
Choose a tag to compare
  1. #149 make s3 upload work (thanks @islue!)
  2. #150 Send CRITICAL state to NSCA on backup failure
  3. #152 Handle mkdir in State.py properly
  4. #155 missing another decode_file_iter (thanks @islue!)
  5. #157 Makefile 'make install' breaks (thanks @dagoaty!)
  6. #159 Add ipv6 support (thanks @OmAsana!)
  7. #161 tail oplog.rs with unicode_decode_error_handler="ignore" (thanks @islue!)
  8. #162 MultiPartUpload.get_all_parts return 1,000 multipart uploads max (thanks @islue)
  9. Simplify "make docker" in Makefile to get release number from VERSION file (vs manual update every release)

1.0.2

16 May 16:39
Compare
Choose a tag to compare
  1. Fixed 'username' vs 'user' typo for command-line flag. Resolves #120.
  2. Updated scripts/build.sh for new Pip 9+ cache flag. Resolves #119.
  3. Close oplog tailer files cleanly and raise Resolver thread errors. Resolves #121 and #143.
  4. Support new 3.4 balancer state commands. Resolves #136.
  5. Fix for ignored 'none' value for 'backup.mongodump.compression', new default: 'auto' for auto-discovering gzip. Merges/resolves PR #126.
  6. Ignore bson errors for UTF-8 fields in tailed-oplog documents, merges/resolves PR #127.
  7. Send mongodump password via stdin (if mongodump 3.0.2+) to prevent password leak.
  8. Set readPreference to 'secondary' if mongodump is 3.4+. This will cause an error if an oplog-tailing Secondary becomes Primary (due to failover after choosing a Secondary).
  9. Dockerfile updated to use mongodump 3.4.x.
  10. Fix for replicaset-scoring quorum count problem.
  11. Fix for creating log directory if it doesn't exist.
  12. Fix for creating a log file when process is locked.
  13. Updated 'links' in README.

1.0.1

02 May 12:31
Compare
Choose a tag to compare
  1. Raise exception if Oplog/Tailer/TailThread.py exits before starting oplog tailing
  2. Fix for '[Errno 39] Directory not empty' when mongodump dump dir already exists (never happens, really)
  3. Return correct existing-backup count in State:load_backups log-line
  4. Use lockfile to prevent concurrent access to ZBackup storage dir (ZBackup isn't really concurrent)
  5. README updates
  6. Dockerfile update to add 'zbackup' dependency to image
  7. Added script to run Docker container with persistent data volumes

1.0.0

26 Apr 14:33
Compare
Choose a tag to compare
  1. Move to dynamic code “Submodules” and subclassing of repeated components
  2. Restructuring of YAML config to nested config
  3. Safe start/stopping of oplog tailer threads, additional checking on all thread states
  4. File-based logging with gzip of old log
  5. Oplog tailer performance optimisation
  6. Fixes to oplog durability to-disk
  7. Live mongodump output to stdout in realtime
  8. Oplog tailer status logging
  9. ZBackup archive method: supporting deduplication, compression and option AES encryption
  10. Support for list discovery/seed hosts
  11. Support configdb servers as cluster seed hosts
  12. Fewer (reused) database connections
  13. Database connections to use strong write concern
  14. Consider replication operational lag in secondary scoring
  15. Backup metadata written for future functionality and troubleshooting
  16. mongodb_consistent_backup.Errors custom exceptions for proper exception handling
  17. PyPi support added
  18. Dockerfile support for running under containers
  19. Additional log messages
  20. Support for MongoDB 3.4 datatypes
  21. Significant reworking of existing code for efficiency, reliability and readability
  22. README and VERSION file updates for changes
  23. Resolves Issues:
  24. Duplicates (Resolves) PR:

0.3.5

19 Jan 06:12
Compare
Choose a tag to compare
  1. #72 - Default to port 27019 for config servers if no port is provided.
  2. #77 - Adjust mongodump parallel workers based on system CPU count to reduce high context switching and system load avg.