5.4 kernel show call trace with options=1,2,3

[ 1989.380330] apic_ipi: 1 NUMA node(s)
[ 1989.380332] apic_ipi: apic [flat]
[ 1989.380338] apic_ipi: apic->send_IPI[default_send_IPI_single+0x0/0x40]
[ 1989.380341] apic_ipi: apic->send_IPI_mask[flat_send_IPI_mask+0x0/0x20]
[ 1989.380923] apic_ipi: IPI[kvm_send_ipi_mask] from CPU[3] to CPU[0]
[ 1989.380931] invalid opcode: 0000 [#1] SMP NOPTI
[ 1989.380938] CPU: 3 PID: 6411 Comm: insmod Tainted: G OE 5.4.18-111-generic #100-KYLINOS
[ 1989.380940] Source Version: 9974aac68dd998a22cb418ecffe55fc1d7184f8f
[ 1989.380943] Hardware name: LENOVO 59083197/CF4620, BIOS VSBA26ZX 03/03/2020
[ 1989.380948] RIP: 0010:__send_ipi_mask+0x1c1/0x230
[ 1989.380951] Code: 8b 5c 24 20 48 89 c8 48 09 d8 75 11 48 8b 7c 24 10 57 9d 66 66 90 66 90 e9 a1 fe ff ff 48 63 74 24 1c 49 63 d4 b8 0a 00 00 00 <0f> 01 c1 48 85 c0 79 da 80 3d 0e da 99 01 00 75 d1 48 89 c6 48 c7
[ 1989.380954] RSP: 0018:ffffaac140e07af0 EFLAGS: 00010002
[ 1989.380957] RAX: 000000000000000a RBX: 0000000000000001 RCX: 0000000000000000
[ 1989.380960] RDX: 0000000000000000 RSI: 00000000000000fb RDI: ffffffff9824f820
[ 1989.380962] RBP: ffffaac140e07b58 R08: ffffffff9824f820 R09: 0000000000000000
[ 1989.380965] R10: 0000000000000004 R11: 0000000000000000 R12: 0000000000000000
[ 1989.380967] R13: 0000000000000000 R14: ffffffff9824f820 R15: 0000000000010364
[ 1989.380970] FS: 00007fac051f0540(0000) GS:ffff9a2838380000(0000) knlGS:0000000000000000
[ 1989.380973] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1989.380975] CR2: 0000556c9b5230c8 CR3: 000000018d7d2004 CR4: 0000000000160ee0
[ 1989.380977] Call Trace:
[ 1989.380983] ? vprintk_func+0x4c/0xbc
[ 1989.380989] kvm_send_ipi_mask+0xe/0x10
[ 1989.380994] apic_ipi_init.cold+0x275/0x2e2 [apic_ipi]
[ 1989.380998] ? kvm_send_ipi_mask_allbutself+0xa0/0xa0
[ 1989.381003] ? kfree_skbmem+0x4e/0x60
[ 1989.381007] ? vunmap_page_range+0x20d/0x390
[ 1989.381010] ? 0xffffffffc0bfd000
[ 1989.381015] do_one_initcall+0x4a/0x1fa
[ 1989.381018] ? _cond_resched+0x19/0x30
[ 1989.381023] ? kmem_cache_alloc_trace+0x163/0x230
[ 1989.381027] ? do_init_module+0x28/0x250
[ 1989.381031] do_init_module+0x62/0x250
[ 1989.381034] load_module+0x11a2/0x12a0
[ 1989.381040] __do_sys_finit_module+0xbe/0x120
[ 1989.381043] ? __do_sys_finit_module+0xbe/0x120
[ 1989.381048] __x64_sys_finit_module+0x1a/0x20
[ 1989.381052] do_syscall_64+0x57/0x190
[ 1989.381056] entry_SYSCALL_64_after_hwframe+0x5c/0xc1
[ 1989.381058] RIP: 0033:0x7fac0533589d
[ 1989.381061] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c3 f5 0c 00 f7 d8 64 89 01 48
[ 1989.381064] RSP: 002b:00007ffe3b5acff8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 1989.381067] RAX: ffffffffffffffda RBX: 0000556c9b5207d0 RCX: 00007fac0533589d
[ 1989.381069] RDX: 0000000000000000 RSI: 0000556c9b5202a0 RDI: 0000000000000003
[ 1989.381071] RBP: 0000000000000000 R08: 0000000000000000 R09: 00007ffe3b5ad1b8
[ 1989.381073] R10: 0000000000000003 R11: 0000000000000246 R12: 0000556c9b5202a0
[ 1989.381075] R13: 0000000000000000 R14: 0000556c9b520780 R15: 0000556c9b5202a0
[ 1989.381078] Modules linked in: apic_ipi(OE+) xt_conntrack xt_MASQUERADE nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc xfrm_user xfrm_algo vmw_vsock_vmci_transport vsock vmw_vmci l2tp_ppp l2tp_netlink l2tp_core ip6_udp_tunnel udp_tunnel pppox rfcomm aufs overlay nfnetlink bpfilter cmac algif_hash algif_skcipher af_alg bnep zhaoxin_sha zhaoxin_aes zhaoxin_cputemp zhaoxin_rng kvm_intel kvm crct10dif_pclmul crc32_pclmul ghash_clmulni_intel ath10k_pci btusb ath10k_core btrtl btbcm ath btmtk mac80211 uvcvideo btintel videobuf2_vmalloc aesni_intel videobuf2_memops videobuf2_v4l2 bluetooth crypto_simd cryptd glue_helper ecdh_generic ecc joydev pl2303 videobuf2_common usbserial snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio snd_hda_codec_hdmi cfg80211 snd_hda_intel snd_intel_nhlt r8169 snd_hda_codec snd_hda_core libarc4 realtek snd_hwdep ideapad_laptop sparse_keymap wmi
[ 1989.381115] sch_fq_codel vmwgfx ttm parport_pc ppdev lp parport ip_tables x_tables autofs4 raid10 raid456 libcrc32c async_raid6_recov async_memcpy async_pq async_xor xor async_tx raid6_pq raid1 raid0 multipath linear zx zx_core psmouse drm_kms_helper input_leds syscopyarea serio_raw sysfillrect sysimgblt ahci fb_sys_fops libahci drm video mac_hid [last unloaded: iptable_filter]
[ 1989.381137] ---[ end trace ee9274fd7193960a ]---
[ 1989.382656] RIP: 0010:__send_ipi_mask+0x1c1/0x230
[ 1989.382659] Code: 8b 5c 24 20 48 89 c8 48 09 d8 75 11 48 8b 7c 24 10 57 9d 66 66 90 66 90 e9 a1 fe ff ff 48 63 74 24 1c 49 63 d4 b8 0a 00 00 00 <0f> 01 c1 48 85 c0 79 da 80 3d 0e da 99 01 00 75 d1 48 89 c6 48 c7
[ 1989.382661] RSP: 0018:ffffaac140e07af0 EFLAGS: 00010002
[ 1989.382664] RAX: 000000000000000a RBX: 0000000000000001 RCX: 0000000000000000
[ 1989.382666] RDX: 0000000000000000 RSI: 00000000000000fb RDI: ffffffff9824f820
[ 1989.382668] RBP: ffffaac140e07b58 R08: ffffffff9824f820 R09: 0000000000000000
[ 1989.382670] R10: 0000000000000004 R11: 0000000000000000 R12: 0000000000000000
[ 1989.382672] R13: 0000000000000000 R14: ffffffff9824f820 R15: 0000000000010364
[ 1989.382674] FS: 00007fac051f0540(0000) GS:ffff9a2838380000(0000) knlGS:0000000000000000
[ 1989.382676] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1989.382678] CR2: 0000556c9b5230c8 CR3: 000000018d7d2004 CR4: 0000000000160ee0

Start by reproducing the kernel 5.4.18 crash while loading the apic_ipi module with options=1,2,3, then inspect the __send_ipi_mask and kvm_send_ipi_mask frames in the trace. The issue does not identify a source file, test, expected behavior, or clear completion condition, so reproduction and kernel debugging are needed before scope can be defined.

Written by the indexing model from the issue text.