Diagnosing stuck Ansible moulti sessions #15

huyz · 2024-08-10T16:45:15Z

huyz
Aug 10, 2024

I used to have one host (out of about 8) that got stuck during one of the steps (always the same one). So I would exclude moulti for that host.
After some recent moulti updates, it now seems to work.

However, now I have two other hosts that used to work but now get stuck (always the same step for each of the hosts, although the steps are different between the hosts).

On the remote host, when I try to see what's going on by running a sort of "ansible watch":

while :; do clear; pstree -w -g 3 -s AnsiballZ_ | sed -n '/AnsiballZ/,$p'; sleep 2; done

… I see that nothing's going on at the remote host that I can detect.

Now, if I quit moulti with q t, then that seems to kickstart things up again as I see orphaned output spewing out in my terminal (and my "ansible watch" starts showing new steps again):

Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):                                                                                                                                                                                                                                                
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
    ~.ans    master *1 !8 ··········································································································································································································· ✔  21m 53s   ▼  system    
❯ Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
Traceback (most recent call last):
  File "/Users/huyz/bin/moulti", line 12, in <module>
    sys.exit(main())
             ^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/cli.py", line 167, in main
    func(args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 38, in send_no_none_to_moulti_and_handle_reply
    send_to_moulti_and_handle_reply(no_none_args)
  File "/Users/huyz/git/moulti/src/moulti/helpers.py", line 33, in send_to_moulti_and_handle_reply
    reply = cast(dict[str, Any], send_to_moulti(message))
                                 ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 248, in send_to_moulti
    with moulti_connect() as moulti_socket:
         ^^^^^^^^^^^^^^^^
  File "/Users/huyz/git/moulti/src/moulti/protocol.py", line 137, in moulti_connect
    client_socket.connect(address)
FileNotFoundError: [Errno 2] No such file or directory
object address  : 0x1200fa140
object refcount : 2
object type     : 0x102ff2fb0
object type name: ValueError
object repr     : ValueError('write to closed file')
lost sys.stderr

If I run the Ansible playbooks without moulti, I have no such freezing problem.

I'm trying to diagnose and collect more info about what could be going wrong. For each susceptible Ansible playbook, looking at the Ansible step that looks responsible for locking things up, I can't discern anything special about the step. They're very ordinary steps, e.g. am ansible.builtin.copy or

Any tips on how else I could diagnose this? Maybe run moulti in debugging mode?

xavierog · 2024-08-10T18:02:14Z

xavierog
Aug 10, 2024
Maintainer

Definitely sounds like a bug in Moulti. I may have overlooked something re: Ansible parallelism. It may also be an issue with the way Moulti reads data from moulti pass, but that is not my hunch so far.

Something that does not hurt and that you can try is setting export MOULTI_PASS_CONCURRENCY=400 -- this is 20 times the default value and essentially means "Moulti, do not skimp on threads".

Overall, that looks like a reproducible issue. Ideally, you should be able to turn your playbook into a minimal reproducible example that you could share without revealing anything relevant. I would also need your ansible-playbook command line since it may affect the way Ansible behaves.

Beyond that, what to look at to diagnose what happens:

list of processes and threads involved, e.g. pstree -napu $(pgrep -f 'moulti run') -- since moulti run launches ansible-playbook, this should show everything relevant.
the output of the Moulti console (keybinding: n) can be copied (keybinding: c), anonymized (look up 'answer': otherwise you risk leaking credentials) and shared.
Overall, inspecting the situation when things get stuck is more relevant than inspecting what happens when you quit Moulti because things got stuck.
Advanced inspection involves dtruss to determine what the various processes are doing and which ones are stuck on a read() syscall.

6 replies

xavierog Aug 31, 2024
Maintainer

Yeah, SIP is a PITA, I understand.

huyz Aug 31, 2024
Author

The lockup is always reproducible but very hard to isolate into a minimal reproducible example. When I create a small example, nothing goes wrong. So there is some sort of strange interaction that's dependent on previous steps (which number in the dozens and would take much more time to properly diagnose).

But here's what I have so far, which may be helpful.

This is what I'm invoking:

MOULTI_ANSIBLE=force MOULTI_INSTANCE=ansible-$$ moulti run -- ansible-playbook site.book.yml

and for one of my hosts, my playbook locks up on this rule:

    - name: Add apt repositories
      ansible.builtin.apt_repository:
        repo: "{{ item.repo }}"
        filename: "{{ item.sources_list_name | d(omit) }}"
      #become: true
      loop: "{{ apt_repository_packs }}"
      register: _apt_repository
      when: apt_repository_packs | d([]) | length > 0

Here's the interesting part: I looked at my apt_repository_packs which has 11 entries and looks like this:

[
        {
            "key_url": "https://packagecloud.io/ookla/speedtest-cli/gpgkey",
            "keyring": "/etc/apt/keyrings/ookla_speedtest-cli-archive-keyring.gpg",
            "package": "speedtest",
            "repo": "deb [signed-by=/etc/apt/keyrings/ookla_speedtest-cli-archive-keyring.gpg] https://packagecloud.io/ookla/speedtest-cli/ubuntu/ jammy main",
            "sources_list_name": "ookla_speedtest-cli"
        },
        {
            "key_url": "https://repo.charm.sh/apt/gpg.key",
            "keyring": "/etc/apt/keyrings/charm.gpg",
            "package": "glow",
            "repo": "deb [signed-by=/etc/apt/keyrings/charm.gpg] https://repo.charm.sh/apt/ * *",
            "sources_list_name": "charm"
        },
        {
            "key_url": "https://cli.github.com/packages/githubcli-archive-keyring.gpg",
            "keyring": "/usr/share/keyrings/githubcli-archive-keyring.gpg",
            "package": "gh",
            "repo": "deb [signed-by=/usr/share/keyrings/githubcli-archive-keyring.gpg\n  arch=arm64]\nhttps://cli.github.com/packages stable main",
            "sources_list_name": "github-cli"
        },
[…]
    ]

And the playbook locks up as long as there are 3 or more entries—i.e. the loop goes for 3 iterations or more. 1 or 2 works just fine. And it doesn't matter what the content of each loop iteration/item is: even if I have the same item 3 times, the lockup happens if the loop has to do 3+ iterations.
And if I create 2+ separate tasks, as long as each task only loops at most 2 iterations, everything works just fine.

Again if I try to isolate this in a minimal reproducible example, I can't trigger the lockup.

Btw, toggling become: true makes no difference because my apt repositories are already written out (so Ansible should not attempt to make any changes).

So there's some complex interaction going on that is hard to diagnose

xavierog Aug 31, 2024
Maintainer

Thank you -- this is very interesting. I will try to tinker with it.
Did you also set MOULTI_RUN_OUTPUT=harvest to gather any unexpected output?

xavierog Aug 31, 2024
Maintainer

Additionally, which exact version of these do you use?

macOS X
Python
Ansible

huyz Sep 1, 2024
Author

I hadn't enabled MOULTI_RUN_OUTPUT=harvest but I just did and re-ran. I don't see any extra input.

I'm running:

macOS 14.6.1 23G93 (Sonoma) MacBookPro18,2 (Apple M1 Max, arm64)
Python 3.11.9
Ansible 2.17.2

❯ ansible-playbook --version
ansible-playbook [core 2.17.2]
  config file = /Users/huyz/.ansible.cfg
  configured module search path = ['/Users/huyz/.ansible/plugins/modules', '/opt/local/share/ansible/plugins/modules']
  ansible python module location = /opt/local/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/ansible
  ansible collection location = /Users/huyz/.ansible/collections:/opt/local/share/ansible/collections
  executable location = /Users/huyz/bin/ansible-playbook
  python version = 3.11.9 (main, Apr  3 2024, 23:19:16) [Clang 15.0.0 (clang-1500.1.0.2.5)] (/opt/local/Library/Frameworks/Python.framework/Versions/3.11/bin/python3.11)
  jinja version = 3.1.4
  libyaml = True

       └─┬= 69514 huy /opt/local/Library/Frameworks/Python.framework/Versions/3.11/Resources/Python.app/Contents/MacOS/Python /opt/local/Library/Frameworks/Python.framework/Versions/3.11/bin/moulti run -- ansible-playbook site.book.yml -vvv
         └─┬─ 69523 huy /opt/local/Library/Frameworks/Python.framework/Versions/3.11/Resources/Python.app/Contents/MacOS/Python /Users/huyz/bin/ansible-playbook site.book.yml -vvv
           ├─── 69525 huy /opt/local/Library/Frameworks/Python.framework/Versions/3.11/Resources/Python.app/Contents/MacOS/Python -c from multiprocessing.resource_tracker import main;main(10)
           ├─── 73306 huy /opt/local/Library/Frameworks/Python.framework/Versions/3.11/Resources/Python.app/Contents/MacOS/Python /opt/local/Library/Frameworks/Python.framework/Versions/3.11/bin/moulti pass ansible_69523_47
           └─── 73308 huy /opt/local/Library/Frameworks/Python.framework/Versions/3.11/Resources/Python.app/Contents/MacOS/Python /Users/huyz/bin/ansible-playbook site.book.yml -vvv

xavierog · 2024-08-11T17:57:28Z

xavierog
Aug 11, 2024
Maintainer

Not that simple to reproduce: I gave it a first try using 10 VMs and dummy tasks (like copying a small text file or sleeping a random number of seconds): everything went smoothly.
Any suggestion to make this test closer to your playbook?

moulti run -- ansible-playbook test-multi-machines.yaml

- name: 'Moulti + Ansible + multiple hosts'
  user: root
  hosts:
  - moulti0
  - moulti1
  - moulti2
  - moulti3
  - moulti4
  - moulti5
  - moulti6
  - moulti7
  - moulti8
  - moulti9
  gather_facts: false
  tasks:
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd0
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd1
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd2
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd3
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd4
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd5
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd6
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd7
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd8
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwd9
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwda
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdb
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdc
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdd
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwde
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdf
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdg
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdh
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdi
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdj
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdk
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdl
  - ansible.builtin.shell: sleep $(((RANDOM%10)))
    args:
      executable: /bin/bash
  - ansible.builtin.copy: src=/etc/passwd dest=/home/vagrant/passwdm

5 replies

huyz Aug 13, 2024
Author

Wow, thanks for trying to diagnose it even with the little information I gave you. I will try to give you more info. Just a bit busy these days. Please bear with me :)

xavierog Aug 27, 2024
Maintainer

Could there be a link between this discussion and issue #16? For instance, Ansible would ask a password through the tty, but the prompt would be erased by a screen refresh, leaving you with the feeling that the whole thing got stuck. A possible side-effect is that you would need to press q and t twice before Moulti detects those keypresses.

huyz Aug 31, 2024
Author

Ok let me take a look today and see if I can diagnose and gather more details. Thanks for your patience!

huyz Aug 31, 2024
Author

It doesn't look like a password prompt is related based on my tests

xavierog Aug 31, 2024
Maintainer

Fair enough. If you find some time for this matter, try to turn your playbook into a MRE.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Diagnosing stuck Ansible moulti sessions #15

{{title}}

Replies: 2 comments 11 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Diagnosing stuck Ansible moulti sessions #15

huyz Aug 10, 2024

Replies: 2 comments · 11 replies

xavierog Aug 10, 2024 Maintainer

xavierog Aug 31, 2024 Maintainer

huyz Aug 31, 2024 Author

xavierog Aug 31, 2024 Maintainer

xavierog Aug 31, 2024 Maintainer

huyz Sep 1, 2024 Author

xavierog Aug 11, 2024 Maintainer

huyz Aug 13, 2024 Author

xavierog Aug 27, 2024 Maintainer

huyz Aug 31, 2024 Author

huyz Aug 31, 2024 Author

xavierog Aug 31, 2024 Maintainer

huyz
Aug 10, 2024

Replies: 2 comments 11 replies

xavierog
Aug 10, 2024
Maintainer

xavierog Aug 31, 2024
Maintainer

huyz Aug 31, 2024
Author

xavierog Aug 31, 2024
Maintainer

xavierog Aug 31, 2024
Maintainer

huyz Sep 1, 2024
Author

xavierog
Aug 11, 2024
Maintainer

huyz Aug 13, 2024
Author

xavierog Aug 27, 2024
Maintainer

huyz Aug 31, 2024
Author

huyz Aug 31, 2024
Author

xavierog Aug 31, 2024
Maintainer