RuntimeError: Task RemoteServiceDiscoveryService.close() got Future attached to a different loop #1031

HuaSheng2000 · 2024-05-26T02:38:13Z

Test environment

Host OS version is windows11
Target device model is IPad Pro and iOS version is 17.4.

Describe the bug
Cannot connect to device through tunnel

To Reproduce
Steps to reproduce the behavior:

Start the server by pymobiledevice3 remote tunneld.
use this command to connect device pymobiledevice3 developer dvt ls / --tunnel 'xxxxxx'.

Expected behavior
get files in root folder

Logs

Traceback (most recent call last):
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "D:\projects\dev-tools\.conda\envs\common-py310\Scripts\pymobiledevice3.exe\__main__.py", line 7, in <module>
    sys.exit(main())
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\pymobiledevice3\__main__.py", line 100, in main
    cli()
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 1686, in invoke
    sub_ctx = cmd.make_context(cmd_name, args, parent=ctx)
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 943, in make_context
    self.parse_args(ctx, args)
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 1408, in parse_args
    value, args = param.handle_parse_result(ctx, opts, args)
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\pymobiledevice3\cli\cli_common.py", line 58, in handle_parse_result
    return super().handle_parse_result(
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 2400, in handle_parse_result
    value = self.process_value(ctx, value)
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\click\core.py", line 2362, in process_value
    value = self.callback(ctx, self, value)
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\pymobiledevice3\cli\cli_common.py", line 250, in tunneld
    get_asyncio_loop().run_until_complete(rsd.close())
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\asyncio\base_events.py", line 649, in run_until_complete
    return future.result()
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\pymobiledevice3\remote\remote_service_discovery.py", line 116, in close
    await self.service.close()
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\pymobiledevice3\remote\remotexpc.py", line 61, in close
    await self.service_connection.aio_close()
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\pymobiledevice3\service_connection.py", line 108, in aio_close
    await self.writer.wait_closed()
  File "D:\projects\dev-tools\.conda\envs\common-py310\lib\asyncio\streams.py", line 343, in wait_closed
    await self._protocol._get_close_waiter(self)
RuntimeError: Task <Task pending name='Task-2' coro=<RemoteServiceDiscoveryService.close() running at D:\projects\dev-tools\.conda\envs\common-py310\lib\site-packages\pymobiledevice3\remote\remote_service_discovery.py:116> cb=[_run_until_complete_cb() at D:\projects\dev-tools\.conda\envs\common-py310\lib\asyncio\base_events.py:184]> got Future <Future pending> attached to a different loop

Additional context
In version 4.6.0, I could connect to the device via tunnel, but in version 4.7.0, I can no longer connect to the device via tunnel. According to the update log, it might be due to this commit because it is related to the loop.
2f39345
When I reverted the changes, the error disappeared.

The text was updated successfully, but these errors were encountered:

doronz88 · 2024-05-26T05:01:41Z

I wasn't able to reproduce the issue and this change was added because the old function is deprecated should not be used. Feel free to submit a PR that resolves this issue without using a deprecated API

doronz88 · 2024-05-26T05:04:09Z

Actually - I strongly believe this bug has something to do with this "conda-env" - try to execute it globally and verify

…o.run()` (#1031)

replace usages of `get_asyncio_loop().run()` with `asyncio.run()` Close #1031

doronz88 · 2024-05-26T05:19:14Z

Please verify if #1032 solves your issue. This removes all usages of this API entirely since it shouldn't really exist in the first place.

doronz88 · 2024-05-26T05:34:32Z

Feel free to reopen this if the issue persists

HuaSheng2000 · 2024-05-26T07:05:03Z

I recreated a clean python10 environment for pymobiledevice3 by conda create -n pymobiledevice3-py310 python=3.10

install the pymobiledevice3 by pip install pymobiledevice3

here is the pip list output

Package               Version
--------------------- --------------
aiofiles              23.2.1
annotated-types       0.7.0
ansicon               1.89.0
anyio                 4.3.0
arrow                 1.3.0
asn1                  2.7.0
asttokens             2.4.1
async-timeout         4.0.3
blessed               1.20.0
bpylist2              4.1.1
cached-property       1.5.2
certifi               2024.2.2
cffi                  1.16.0
charset-normalizer    3.3.2
click                 8.1.7
colorama              0.4.6
coloredlogs           15.0.1
construct             2.10.70
cryptography          42.0.7
daemonize             2.5.0
decorator             5.1.1
developer-disk-image  0.0.2
dnspython             2.6.1
editor                1.6.6
email_validator       2.1.1
enum-compat           0.0.3
exceptiongroup        1.2.1
executing             2.0.1
fastapi               0.111.0
fastapi-cli           0.0.4
gpxpy                 1.5.0
h11                   0.14.0
hexdump               3.3
httpcore              1.0.5
httptools             0.6.1
httpx                 0.27.0
humanfriendly         10.0
hyperframe            6.0.1
idna                  3.7
ifaddr                0.2.0
inquirer3             0.6.0
ipsw-parser           1.2.3
ipython               8.24.0
itsdangerous          2.2.0
jedi                  0.19.1
Jinja2                3.1.4
jinxed                1.2.1
la-panic              0.4.9
lzfse                 0.4.2
markdown-it-py        3.0.0
MarkupSafe            2.1.5
matplotlib-inline     0.1.7
mdurl                 0.1.2
nest-asyncio          1.6.0
opack                 0.1.0
orjson                3.10.3
packaging             24.0
parameter-decorators  0.0.2
parso                 0.8.4
pillow                10.3.0
pip                   24.0
plumbum               1.8.3
prompt-toolkit        3.0.43
psutil                5.9.8
pure-eval             0.2.2
pycparser             2.22
pycrashreport         1.2.3
pycryptodome          3.20.0
pydantic              2.7.1
pydantic_core         2.18.2
pydantic-extra-types  2.7.0
pydantic-settings     2.2.1
Pygments              2.18.0
pygnuutils            0.1.1
pyimg4                0.8.5
pykdebugparser        1.2.4
pylzss                0.3.8
pymobiledevice3       4.8.5
pyreadline3           3.4.1
python-dateutil       2.9.0.post0
python-dotenv         1.0.1
python-multipart      0.0.9
python-pcapng         2.1.1
pytun-pmd3            2.0.7
pyusb                 1.2.1
pywin32               306
PyYAML                6.0.1
qh3                   1.0.7
readchar              4.1.0
remotezip             0.12.3
requests              2.32.2
rich                  13.7.1
runs                  1.2.2
setuptools            69.5.1
shellingham           1.5.4
six                   1.16.0
sniffio               1.3.1
srptools              1.0.1
sslpsk-pmd3           1.0.3
stack-data            0.6.3
starlette             0.37.2
termcolor             2.4.0
tqdm                  4.66.4
traitlets             5.14.3
typer                 0.12.3
types-python-dateutil 2.9.0.20240316
typing_extensions     4.12.0
ujson                 5.10.0
urllib3               2.2.1
uvicorn               0.29.0
watchfiles            0.21.0
wcwidth               0.2.13
websockets            12.0
wheel                 0.43.0
wsproto               1.2.0
xmod                  1.8.1
xonsh                 0.16.0
zeroconf              0.132.2

here is the error.

Traceback (most recent call last):
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\Scripts\pymobiledevice3.exe\__main__.py", line 7, in <module>
    sys.exit(main())
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\pymobiledevice3\__main__.py", line 100, in main
    cli()
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 1686, in invoke
    sub_ctx = cmd.make_context(cmd_name, args, parent=ctx)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 943, in make_context
    self.parse_args(ctx, args)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 1408, in parse_args
    value, args = param.handle_parse_result(ctx, opts, args)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\pymobiledevice3\cli\cli_common.py", line 58, in handle_parse_result
    return super().handle_parse_result(
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 2400, in handle_parse_result
    value = self.process_value(ctx, value)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\click\core.py", line 2362, in process_value
    value = self.callback(ctx, self, value)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\pymobiledevice3\cli\cli_common.py", line 250, in tunneld
    asyncio.run(rsd.close(), debug=True)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\asyncio\runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\asyncio\base_events.py", line 649, in run_until_complete
    return future.result()
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\pymobiledevice3\remote\remote_service_discovery.py", line 121, in close
    await self.service.close()
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\pymobiledevice3\remote\remotexpc.py", line 61, in close
    await self.service_connection.aio_close()
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\site-packages\pymobiledevice3\service_connection.py", line 106, in aio_close
    self.writer.close()
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\asyncio\streams.py", line 337, in close
    return self._transport.close()
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\asyncio\proactor_events.py", line 109, in close
    self._loop.call_soon(self._call_connection_lost, None)
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\asyncio\base_events.py", line 753, in call_soon
    self._check_closed()
  File "D:\projects\dev-tools\.conda\envs\pymobiledevice3-py310\lib\asyncio\base_events.py", line 515, in _check_closed
    raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed

What information do you need to reproduce this issue?

HuaSheng2000 · 2024-05-26T07:13:01Z

I can't reopen this issue.
https://github.com/orgs/community/discussions/41926#discussioncomment-9125706

Do I need to new an issue?

doronz88 · 2024-05-26T08:30:43Z

Reopened myself - but as I'm not able to reproduce your issue using my own venv (not using coda) I pretty certain its conda specific.
Please verify

HuaSheng2000 · 2024-05-26T14:24:58Z

I tried not using conda, downloading python from python official website. Still the same error.

downloaded python3.10.11 from here.
https://www.python.org/downloads/release/python-31011/
Create venv environment

python -m venv ./venv

install pymobiledevice3(4.8.5). (The output of pip list is the same as in conda, except for pip, setuptool, wheel)
activate venv and start server.
connect device by pymobiledevice3 developer dvt ls / --tunnel 'xxxxxx'.
Same error

Traceback (most recent call last):
  File "D:\projects\dev-tools\python3.10\lib\runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "D:\projects\dev-tools\python3.10\lib\runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "D:\projects-path\venv\Scripts\pymobiledevice3.exe\__main__.py", line 7, in <module>
    sys.exit(main())
  File "D:\projects-path\venv\lib\site-packages\pymobiledevice3\__main__.py", line 100, in main
    cli()
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 1686, in invoke
    sub_ctx = cmd.make_context(cmd_name, args, parent=ctx)
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 943, in make_context
    self.parse_args(ctx, args)
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 1408, in parse_args
    value, args = param.handle_parse_result(ctx, opts, args)
  File "D:\projects-path\venv\lib\site-packages\pymobiledevice3\cli\cli_common.py", line 58, in handle_parse_result
    return super().handle_parse_result(
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 2400, in handle_parse_result
    value = self.process_value(ctx, value)
  File "D:\projects-path\venv\lib\site-packages\click\core.py", line 2362, in process_value
    value = self.callback(ctx, self, value)
  File "D:\projects-path\venv\lib\site-packages\pymobiledevice3\cli\cli_common.py", line 250, in tunneld
    asyncio.run(rsd.close(), debug=True)
  File "D:\projects\dev-tools\python3.10\lib\asyncio\runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "D:\projects\dev-tools\python3.10\lib\asyncio\base_events.py", line 649, in run_until_complete
    return future.result()
  File "D:\projects-path\venv\lib\site-packages\pymobiledevice3\remote\remote_service_discovery.py", line 121, in close
    await self.service.close()
  File "D:\projects-path\venv\lib\site-packages\pymobiledevice3\remote\remotexpc.py", line 61, in close
    await self.service_connection.aio_close()
  File "D:\projects-path\venv\lib\site-packages\pymobiledevice3\service_connection.py", line 106, in aio_close
    self.writer.close()
  File "D:\projects\dev-tools\python3.10\lib\asyncio\streams.py", line 337, in close
    return self._transport.close()
  File "D:\projects\dev-tools\python3.10\lib\asyncio\proactor_events.py", line 109, in close
    self._loop.call_soon(self._call_connection_lost, None)
  File "D:\projects\dev-tools\python3.10\lib\asyncio\base_events.py", line 753, in call_soon
    self._check_closed()
  File "D:\projects\dev-tools\python3.10\lib\asyncio\base_events.py", line 515, in _check_closed
    raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed

If there is no problem with the code, it may be related to the system. follow this link.
https://stackoverflow.com/a/70758881

HuaSheng2000 · 2024-05-26T14:27:28Z

I will try to reproduce this issue on manjaro later, please wait.

doronz88 · 2024-05-26T14:42:45Z

I wasn't able to reproduce on two different win11 systems

HuaSheng2000 · 2024-05-26T15:17:50Z

Sorry I left out an important detail, I'm using wifi. usbmux doesn't have this issue.

doronz88 added a commit that referenced this issue May 26, 2024

cli_common: replace usages of get_asyncio_loop().run() with `asynci…

10ad911

…o.run()` (#1031)

doronz88 added a commit that referenced this issue May 26, 2024

cli_common: remove inner usages of get_asyncio_loop().run()

e535513

replace usages of `get_asyncio_loop().run()` with `asyncio.run()` Close #1031

doronz88 mentioned this issue May 26, 2024

cli_common: remove inner usages of get_asyncio_loop().run() #1032

Merged

doronz88 closed this as completed in #1032 May 26, 2024

doronz88 reopened this May 26, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

RuntimeError: Task RemoteServiceDiscoveryService.close() got Future attached to a different loop #1031

RuntimeError: Task RemoteServiceDiscoveryService.close() got Future attached to a different loop #1031

HuaSheng2000 commented May 26, 2024 •

edited

Loading

doronz88 commented May 26, 2024

doronz88 commented May 26, 2024

doronz88 commented May 26, 2024

doronz88 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

doronz88 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

doronz88 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

RuntimeError: Task RemoteServiceDiscoveryService.close() got Future attached to a different loop #1031

RuntimeError: Task RemoteServiceDiscoveryService.close() got Future attached to a different loop #1031

Comments

HuaSheng2000 commented May 26, 2024 • edited Loading

doronz88 commented May 26, 2024

doronz88 commented May 26, 2024

doronz88 commented May 26, 2024

doronz88 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

doronz88 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

doronz88 commented May 26, 2024

HuaSheng2000 commented May 26, 2024

HuaSheng2000 commented May 26, 2024 •

edited

Loading