Skip to content

1.2.0
Compare
Choose a tag to compare
@redapple redapple released this 24 Apr 12:52
· 499 commits to master since this release
1.2.0
a396b36

The highlight of this release is the long-awaited Python 3 support.

The new scrapy requirement is version 1.0 or higher.
Python 2.6 is no longer supported by scrapyd.

Some unused sqlite utilities are now deprecated
and will be removed from a later scrapyd release.
Instantiating them or subclassing from them
will trigger a deprecation warning.

These are located under scrapyd.sqlite:

  • SqliteDict
  • SqlitePickleDict
  • SqlitePriorityQueue
  • PickleSqlitePriorityQueue

Added

  • Include run's PID in listjobs webservice.
  • Include full tracebacks from scrapy when failing to get spider list.
    This will lead to more noisy webservice output
    but will make debugging deployment problems much easier.
  • Include start/finish time in daemon's joblist page
  • Twisted 16 compatibility
  • Python 3 compatibility
  • Make console script executable
  • Project version argument in the schedule webservice
  • Configuration option for website root class
  • Optional jobid argument to schedule webservice
  • Contribution documentation
  • Daemon status webservice

Removed

  • scrapyd's bind_address now defaults to 127.0.0.1 instead of 0.0.0.0
    to listen only for connection from the local host
  • scrapy < 1.0 compatibility
  • python < 2.7 compatibility

Fixed

  • Poller race condition for concurrently accessed queues
Assets 2
Loading