54 Commits (6.x)

Author	SHA1	Message	Date
Kevin Bates	6e9256b064	Culling: ensure last_activity attr exists before use (#5355) ... KernelManager's last_activity attribute is added following the instance's creation. Culling (independently) uses this attribute and should ensure it exists prior to its use, else skip the culling check for that instance. Fixes #5345	6 years ago
Pinar Kavak	8c063c2a61	Added notebook name to the logs	6 years ago
Kevin Bates	53d4d08813	Fix detection of unsupported config, prevent async on 3.5	6 years ago
Kevin Bates	99b0afd16e	Apply changes per review ... Add comments and rename self.super to self.pinned_superclass to clarify intent. Add run_sync() util method to clean up shutdown_all() invocation.	6 years ago
Kevin Bates	72d44c58cf	Switch class hierarchy to not use mixin base ... This commit uses the approach used in jupyter_server #191 first proposed by David Brochart. This reduces code duplication and alleviates redundancy relative to configurable options. Also, the startup message now includes the version information. Co-authored-by: David Brochart <david.brochart@gmail.com>	6 years ago
Kevin Bates	788bb0ebe0	Update all coroutine/yield methods to async/await, share another method	6 years ago
Kevin Bates	570986282e	Move duplicated methods to mixin, fix mixin order	6 years ago
Kevin Bates	8a4beb0d15	Convert to async/await and apply touch ups	6 years ago
Kevin Bates	7abd4bee27	Indicate that async kernel management is configured	6 years ago
Kevin Bates	3226b07345	Add support for AsyncMappingKernelManager ... Supports running against incompatible jupyter_client so long as the desired kernel_manager_class is not `AsyncMappingKernelManager`.	6 years ago
Kevin Bates	677ccc3d7a	Refactor buffering, culling and activity monitoring into classes ... Use composition in preparation for AsyncMappingKernelManager.	6 years ago
sasaki takeru	dcef16a5be	typo (#4946)	6 years ago
Min RK	efc0f0089e	Allow ?no_track_activity=1 to opt-out of activity tracking (#4235) ... * Don't track API requests with `?no_track_activity=1` in the activity counter allows external idle-culling scripts to avoid updating the activity counter * Don't track kernel shutdown as kernel activity this causes idle-kernel shutdowns to restart the idle-shutdown timer user-requested shutdowns will still be tracked as api activity * test ?no_track_activity=1 tracking * Changelog for activity	7 years ago
Min RK	e908edf171	Fix return value for async restart_kernel ... gen.Return shouldn't be passed the Future, the future should be awaited	7 years ago
Min RK	729183b148	use our own maybe_future ... instead of the monkeypatch we did to keep the backport patch small requiring tornado 5 simplifies things a ton because tornado.concurrent.Future is asyncio.Future	7 years ago
Kevin Bates	2c526fb60b	Enable restart_kernel for async usage ... Converted `MappingKernelManager.restart_kernel` to a coroutine so that projects that take advantage of async kernel startup can also realize appropriate behavior relative to restarts.	7 years ago
Sylvain Corlay	4a7151448c	Enable kernel message filtering	7 years ago
Kevin Bates	23e74dcdfa	Include status types when logging activity ... Recently I needed to troubleshoot kernel responses and found it helpful to distinguish status types (busy vs. idle) - thought others might find it useful as well. Entries that previously appeared as... ``` activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status activity on 33383dcc-c054-4dc0-b842-16063ea160fe: execute_input activity on 33383dcc-c054-4dc0-b842-16063ea160fe: display_data activity on 33383dcc-c054-4dc0-b842-16063ea160fe: execute_result activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status ``` will now appear as... ``` activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status (idle) activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status (busy) activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status (idle) activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status (busy) activity on 33383dcc-c054-4dc0-b842-16063ea160fe: execute_input activity on 33383dcc-c054-4dc0-b842-16063ea160fe: display_data activity on 33383dcc-c054-4dc0-b842-16063ea160fe: execute_result activity on 33383dcc-c054-4dc0-b842-16063ea160fe: status (idle) ```	7 years ago
Maxim Vov	f2fdbf929e	Added metrics for number of kernels running labeled by type	7 years ago
Kevin Bates	2d688f2071	Prevent access through 'NoneType' when closing activity_stream ... Although I'm unable to reproduce the issue, its a safe change to prevent an AttributeError from occuring ('NoneType' object has no attribute 'close'). The user that reported this is attempting to launch a kernel and I believe the launch only partially completed such that `kernel._activity_stream` did not get established. (This occurred from Jupyter Enterprise Gateway where we deal with remote kernel launches across resource-managed clusters, so things are a bit more involved relative to kernel establishment.)	7 years ago
M Pacer	c6dd032bf8	add kernel_info_timeout traitlet to wait for slow kernel startups ... This affects both the MappingKernelManager and the ZMQChannelsHandler(by extension). This allows one setting to apply to both startup andrestarting.	8 years ago
Kevin Bates	550120906c	Fix leak of iopub object in activity monitoring ... After analyzing various leaked items when running either Notebook or Jupyter Kernel Gateway, one item that recurred across each kernel startup and shutdown sequence was the a zmq socket instance associated with the iopub port. The leaked instance occurs because the activity monitor and normal port creation logic both call `create_iopub`. Although this ens up creating a _wrapper_ around the same port, the object (i.e., wrapper) created by the activity monitor is leaked. By setting the kernel manager's `_activity_stream` member to `None` when the kernel is shutdown, cleanup of the iopub wrapper object will take place.	8 years ago
Min RK	a2f72da17f	Merge pull request #2963 from takluyver/shutdown-no-kernels ... Config option to shut down server after N seconds with no kernels	8 years ago
Min RK	1deb0aec16	tornado 5: PeriodicCallback loop arg will be removed (#3034) ... * tornado 5: PeriodicCallback loop arg will be removed PCs are always run with the current eventloop, which is what the explicitly passed loop always is for us already * Don't double-close socket & stream closing stream closes the socket * remove now-inaccurate comment	8 years ago
Thomas Kluyver	bfe012e507	Merge pull request #2910 from mheilman/cull_idle_timeout_minimum ... change cull_idle_timeout_minimum to 1 from 300	8 years ago
Thomas Kluyver	9ec57bfdf5	Config option to shut down server after N seconds with no kernels	8 years ago
Michael Heilman	b31194dfe3	removed extraneous cull_idle_timeout_minimum	8 years ago
Michael Heilman	f8ef573592	added warning about culling kernels with poor network connections	8 years ago
Min RK	e4186c47c0	allow disabling offline message buffering ... escape hatch if the new buffering is causing anyone trouble	8 years ago
Michael Heilman	241c7e162c	change cull_idle_timeout_minimum to 1 from 500	8 years ago
Kyle Kelley	43a97807fc	buffer messages when websocket connection is interrupted (#2871) ... * provide some top level comments * implement buffering of messages on last dropped connection - buffer is per-kernel - session_key is stored because only a single session can resume the buffer and we can't be sure - on any new connection to a kernel, buffer is flushed. If session_key matches, it is replayed. Otherwise, it is discarded. - buffer is an unbounded list for now * restore actual zmq channels when resuming connection rather than establishing new connections fixes failure to resume shell channel * hookup restart callbacks in open instead of in `create_stream`, which is not called on reconnect * improve handling of restored connections in js - dismiss 'connection lost' dialog on reconnect - set busy status on reconnect (if not busy, idle will come soon after via kernel_ready)	8 years ago
dhirschf	6bb89b717a	Workaround for Windows Containers ... On Windows `os.stat` treats host mapped volumes as broken symlinks	9 years ago
Peter Parente	c8ba55da21	Do not cull connected kernels by default	9 years ago
Peter Parente	85ba2bdabd	Fix help for cull_connected and cull_busy	9 years ago
Peter Parente	d9b4c99180	Do not cull kernels doing work by default	9 years ago
Peter Parente	1550a04848	Add cull_busy, cull_connected options ... Additional logic to support culling or skipping kernels that are busy or that have connections.	9 years ago
Min RK	f4d2c246d5	use dedicated Session for activity monitor ... instead of re-using kernel.session, which can cause hash collisions if other objects use `kernel.session`.	9 years ago
Kevin Bates	ff19c4cd7c	enforce minimum timeout, ensure exceptions don't prevent culling of others	9 years ago
Kevin Bates	c3f753faf8	incorporate review recommendations	9 years ago
Kevin Bates	2f787088d5	Validate culling interval.	9 years ago
Kevin Bates	4000838321	Cull idle kernels after specified period	9 years ago
Min RK	8b76de80be	move tz utils to top-level private module ._tz	9 years ago
Min RK	9f55a857f3	use Z isoformat in UTC timestamps ... instead of +00:00	9 years ago
Min RK	d45cb2ad80	track active kernel connections	9 years ago
Min RK	b472c55d9b	add activity watching to kernels ... adds to kernel REST model: - last_activity: datetime-aware timestamp - execution_state: from last recorded status message	9 years ago
Sylvain Corlay	a91af4d642	Update traitlets API	10 years ago
Min RK	1c47a3dbb5	channel.closed is a method ... since we weren't calling it, the restart channel was never closed, causing process teardown to hang *sometimes*, depending on garbage collection.	10 years ago
Diego Mesa	482ed8a5a3	updating log.warn to log.warning	10 years ago
Min RK	6024f04698	allow some KernelManager methods to be async ... Allows custom KernelManagers to do slower async operations as part of kernel startup/shutdown.	10 years ago
Min RK	0c5a3b6d04	wait for kernel to restart ... in API request to restart kernels by waiting for the kernel to respond to a kernel_info request.	10 years ago