- Enabled heartbeat by default, so long-running tasks don't time out. Thanks to John Pugliesi for the bug report.
- The PySpark kernel uses Python 3 lexer, instead of Python 2. Python 2 support is going away in the near future.
- Fixed papermill support; there's a different option now you need to use,
all_errors_are_fatal
. See the README for details. Thanks to Devin Stein for the patch.
- Fixed silly mistake in the tests.
- Added two configuration options that make it easier to run Sparkmagic notebooks with Papermill. Thanks to Michael Diolosa for the patch.
- Support
text/html
messages from the Livy server; currently Livy/Spark itself don't really do this, but some experimental tools can benefit from this. Thanks to Steve Suh.
- Support server-side rendering of images, so you don't have to ship all the data to the client to do visualization—see the
%matplot
usage in the example notebook. Thanks to wangqiaoshi for the patch. - Progress bar for long running queries. Thanks to @juliusvonkohout.
- Work correctly with newer versions of the Jupyter notebook. Thanks to Jaipreet Singh for the patch, Eric Dill for testing, and G-Research for sponsoring Itamar Turner-Trauring's time.
- Switch to Plotly 3.
- Updated code to work with Livy 0.5 and later, where Python 3 support is not a different kind of session. Thanks to Gianmario Spacagna for contributing some of the code, and G-Research for sponsoring Itamar Turner-Trauring's time.
- Fixed
AttributeError
onNone
, thanks to Eric Dill. recovering
session status won't cause a blow up anymore. Thanks to G-Research for sponsoring Itamar Turner-Trauring's time.