checksum issue with /info/GEM

[one-m1nd]

Hi I'm using an internal setup(Sonatype Nexus they just pushed support for /info) and I keep running into the following for a private gem:

Retrying fetcher due to error (2/4): Bundler::HTTPError The checksum of /info/GEM does not match the checksum provided by the server! Something is wrong (local checksum is "\"VALUE\"", was expecting "\"VALUE-gzip\"").

Where VALUE is the checksum string.

I tried digging into the bundler code but could not find anything myself, my question is do you think bundler is adding that trailing -gzip?

The ETag when I curl the url that is hit by bundler manually is VALUE without the -gzip so I am confused as to where it is coming from ... I got the URL from running bundler with verbose flag.

I already tried nuking ~/.bundler/cache for what it is worth.

I am using

• ruby-3.1.4
• bundler 2.4.12
• rubygems 3.3.26

Appreciate the help.

[one-m1nd]

Backtrace if it helps

Bundler::HTTPError: The checksum of /info/GEM does not match the checksum provided by the server! Something is wrong (local checksum is "\"VALUE\"", was expecting "\"VALUE-gzip\"").
/usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/fetcher/compact_index.rb:17:in `rescue in block in compact_index_request'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/fetcher/compact_index.rb:15:in `block in compact_index_request'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/fetcher.rb:133:in `block in specs'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/fetcher.rb:132:in `drop_while'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/fetcher.rb:132:in `specs'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/fetcher.rb:119:in `block in specs_with_retry'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/retry.rb:40:in `run'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/retry.rb:30:in `attempt'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/fetcher.rb:118:in `specs_with_retry'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/source/rubygems.rb:416:in `block in fetch_names'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/source/rubygems.rb:413:in `each'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/source/rubygems.rb:413:in `fetch_names'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/source/rubygems.rb:408:in `block in remote_specs'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/index.rb:9:in `build'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/source/rubygems.rb:396:in `remote_specs'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/source/rubygems.rb:129:in `specs'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:40:in `block in setup_solver'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:232:in `all_versions_for'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:49:in `block in setup_solver'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:151:in `versions_for'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:333:in `block in prepare_dependencies'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:328:in `each'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:328:in `map'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:328:in `prepare_dependencies'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:53:in `setup_solver'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/resolver.rb:28:in `start'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/definition.rb:554:in `start_resolution'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/definition.rb:289:in `resolve'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/definition.rb:507:in `materialize'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/definition.rb:197:in `specs'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/installer.rb:231:in `ensure_specs_are_compatible!'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/installer.rb:83:in `block in run'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/process_lock.rb:12:in `block in lock'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/process_lock.rb:9:in `open'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/process_lock.rb:9:in `lock'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/installer.rb:71:in `run'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/installer.rb:23:in `install'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/cli/install.rb:62:in `run'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/cli.rb:261:in `block in install'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/settings.rb:131:in `temporary'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/cli.rb:260:in `install'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/vendor/thor/lib/thor/invocation.rb:127:in `invoke_command'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/vendor/thor/lib/thor.rb:392:in `dispatch'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/cli.rb:34:in `dispatch'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/vendor/thor/lib/thor/base.rb:485:in `start'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/cli.rb:28:in `start'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/exe/bundle:45:in `block in <top (required)>'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/lib/bundler/friendly_errors.rb:117:in `with_friendly_errors'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/gems/bundler-2.4.12/exe/bundle:33:in `<top (required)>'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/bin/bundle:25:in `load'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/bin/bundle:25:in `<main>'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/bin/ruby_executable_hooks:22:in `eval'
  /usr/share/rvm/gems/ruby-3.1.4@some_gem/bin/ruby_executable_hooks:22:in `<main>'

[segiddins]

I would reach out to the provider of your private gem server and see if they are appending -gzip to the etag, which bundler is not expecting

[one-m1nd]

Hi so I reached out to them and indeed they are appending it... however...

In Bundler::Fetcher::Downloader#request net/http can inject default headers, which it does and one of them is

Accept-Encoding: gzip;q=1.0,deflate;q=0.6,identity;q=0.3

This header led to my problems, removing it results in the correct behavior...maybe such a header should be overridden for this request?

If this is an acceptable change I'd like to submit a PR ... would be cool to contribute 😁

[one-m1nd]

Ah didn't realize there are use cases for this endpoint and that header 👍

I've opened a ticket with our repo provider for this 🙏

[simi]

Would you mind to share who's your repo provider @one-m1nd?

[one-m1nd]

Sonatype Repository Manager 3

[simi]

Is that another name for Nexus?

[one-m1nd]

yes

[fozboz]

For me, this was resolved by updating bundler from 2.1.4 to 2.3.7.

[deivid-rodriguez]

Closing since it was reported as resolved.