pi-kernel 5.15 on UC22 is missing most staging modules

I checked on UC16, UC18 and UC20 and all of them have the staging dir fully populated, so this is UC22 only

Status changed to 'Confirmed' because the bug affects multiple users.

The pi-kernel snap is also missing a lot of modules required for running microk8s and microceph (rbd, vxlan, etc..) which are in linux-modules-extra.

@itrue please provide a complete list of missing modules in a separate bug.

@juergh filed here https://bugs.launchpad.net/ubuntu/+source/linux-raspi/+bug/2036747

This bug was fixed in the package linux-raspi - 6.5.0-1003.4

---------------
linux-raspi (6.5.0-1003.4) mantic; urgency=medium

  * mantic/linux-raspi: 6.5.0-1003.4 -proposed tracker (LP: #2036576)

  * Packaging resync (LP: #1786013)
    - debian/dkms-versions -- update from kernel-versions (main/d2023.09.14)

  * pi-kernel snap is missing modules for microk8s/microceph on UC22
    (LP: #2036747)
    - [Packaging] raspi: Include rbd and vxlan modules in linux-modules

  * Move nbd module into modules (from -extra) (LP: #2035373)
    - [Packaging] raspi: Include nbd module in linux-modules

  * pi-kernel 5.15 on UC22 is missing most staging modules (LP: #2024443)
    - [Packaging] raspi: Include r8188eu module in linux-modules

  * Miscellaneous Ubuntu changes
    - SAUCE wifi: brcmfmac: Replace 1-element arrays with flexible arrays
    - [Config] raspi: Sync configs with master
    - [Packaging] raspi: Add a temporary config check
    - SAUCE: usb: dwc_otg: Fix flexible array declarations

  * Miscellaneous upstream changes
    - gpio-fsm: Sort functions into a more logical order
    - gpio_fsm: Rework the atomic-vs-non-atomic split
    - ASoC: hdmi-codec: Fix broken channel map reporting

  [ Ubuntu: 6.5.0-6.6 ]

  * mantic/linux: 6.5.0-6.6 -proposed tracker (LP: #2035595)
  * Mantic update: v6.5.3 upstream stable release (LP: #2035588)
    - drm/amd/display: ensure async flips are only accepted for fast updates
    - cpufreq: intel_pstate: set stale CPU frequency to minimum
    - tpm: Enable hwrng only for Pluton on AMD CPUs
    - Input: i8042 - add quirk for TUXEDO Gemini 17 Gen1/Clevo PD70PN
    - Revert "fuse: in fuse_flush only wait if someone wants the return code"
    - Revert "f2fs: clean up w/ sbi->log_sectors_per_block"
    - Revert "PCI: tegra194: Enable support for 256 Byte payload"
    - Revert "net: macsec: preserve ingress frame ordering"
    - reiserfs: Check the return value from __getblk()
    - splice: always fsnotify_access(in), fsnotify_modify(out) on success
    - splice: fsnotify_access(fd)/fsnotify_modify(fd) in vmsplice
    - splice: fsnotify_access(in), fsnotify_modify(out) on success in tee
    - eventfd: prevent underflow for eventfd semaphores
    - fs: Fix error checking for d_hash_and_lookup()
    - iomap: Remove large folio handling in iomap_invalidate_folio()
    - tmpfs: verify {g,u}id mount options correctly
    - selftests/harness: Actually report SKIP for signal tests
    - vfs, security: Fix automount superblock LSM init problem, preventing NFS sb
      sharing
    - ARM: ptrace: Restore syscall restart tracing
    - ARM: ptrace: Restore syscall skipping for tracers
    - btrfs: zoned: skip splitting and logical rewriting on pre-alloc write
    - erofs: release ztailpacking pclusters properly
    - locking/arch: Avoid variable shadowing in local_try_cmpxchg()
    - refscale: Fix uninitalized use of wait_queue_head_t
    - clocksource: Handle negative skews in "skew is too large" messages
    - powercap: arm_scmi: Remove recursion while parsing zones
    - OPP: Fix potential null ptr dereference in dev_pm_opp_get_required_pstate()
    - OPP: Fix passing 0 to PTR_ERR in _opp_attach_genpd()
    - selftest...

This bug is awaiting verification that the linux-raspi/5.15.0-1040.43 kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-jammy-linux-raspi' to 'verification-done-jammy-linux-raspi'. If the problem still exists, change the tag 'verification-needed-jammy-linux-raspi' to 'verification-failed-jammy-linux-raspi'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

Downloaded the armhf and arm64 pi-kernel snaps:
https://dashboard.snapcraft.io/snaps/pi-kernel/revisions/687/download
https://dashboard.snapcraft.io/snaps/pi-kernel/revisions/688/download

Loop-mounted them and verified they both contain:
lib/modules/5.15.0-1040-raspi/kernel/drivers/staging/r8188eu/r8188eu.ko

This bug is awaiting verification that the linux-raspi/6.2.0-1016.18 kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed-lunar-linux-raspi' to 'verification-done-lunar-linux-raspi'. If the problem still exists, change the tag 'verification-needed-lunar-linux-raspi' to 'verification-failed-lunar-linux-raspi'.

If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed.

See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you!

Downloaded linux-modules-6.2.0-1016-raspi_6.2.0-1016.18_arm{64,hf}.deb from lunar-proposed, extracted them and verified the module is present:

$ find arm* -name r8188eu.ko
arm64/lib/modules/6.2.0-1016-raspi/kernel/drivers/staging/r8188eu/r8188eu.ko
armhf/lib/modules/6.2.0-1016-raspi/kernel/drivers/staging/r8188eu/r8188eu.ko

This bug was fixed in the package linux-raspi - 5.15.0-1040.43

---------------
linux-raspi (5.15.0-1040.43) jammy; urgency=medium

  * jammy/linux-raspi: 5.15.0-1040.43 -proposed tracker (LP: #2036570)

  * pi-kernel 5.15 on UC22 is missing most staging modules (LP: #2024443)
    - [Packaging] raspi: Include r8188eu module in linux-modules

  [ Ubuntu: 5.15.0-86.96 ]

  * jammy/linux: 5.15.0-86.96 -proposed tracker (LP: #2036575)
  * 5.15.0-85 live migration regression (LP: #2036675)
    - Revert "KVM: x86: Always enable legacy FP/SSE in allowed user XFEATURES"
    - Revert "x86/kvm/fpu: Limit guest user_xfeatures to supported bits of XCR0"
  * Regression for ubuntu_bpf test build on Jammy 5.15.0-85.95 (LP: #2035181)
    - selftests/bpf: fix static assert compilation issue for test_cls_*.c
  * `refcount_t: underflow; use-after-free.` on hidon w/ 5.15.0-85-generic
    (LP: #2034447)
    - crypto: rsa-pkcs1pad - Use helper to set reqsize

linux-raspi (5.15.0-1039.42) jammy; urgency=medium

  * jammy/linux-raspi: 5.15.0-1039.42 -proposed tracker (LP: #2033816)

  * Packaging resync (LP: #1786013)
    - [Packaging] update helper scripts

  [ Ubuntu: 5.15.0-85.95 ]

  * jammy/linux: 5.15.0-85.95 -proposed tracker (LP: #2033821)
  * Please enable Renesas RZ platform serial installer (LP: #2022361)
    - [Config] enable hihope RZ/G2M serial console
    - [Config] Mark sh-sci as built-in
  * Request backport of xen timekeeping performance improvements (LP: #2033122)
    - x86/xen/time: prefer tsc as clocksource when it is invariant
  * kdump doesn't work with UEFI secure boot and kernel lockdown enabled on
    ARM64 (LP: #2033007)
    - [Config]: Enable CONFIG_KEXEC_IMAGE_VERIFY_SIG
    - kexec, KEYS: make the code in bzImage64_verify_sig generic
    - arm64: kexec_file: use more system keyrings to verify kernel image signature
  * ubuntu_kernel_selftests:net:vrf-xfrm-tests.sh: 8 failed test cases on
    jammy/fips (LP: #2019880)
    - selftests: net: vrf-xfrm-tests: change authentication and encryption algos
  * ubuntu_kernel_selftests:net:tls: 88 failed test cases on jammy/fips
    (LP: #2019868)
    - selftests/harness: allow tests to be skipped during setup
    - selftests: net: tls: check if FIPS mode is enabled
  * A general-proteciton exception during guest migration to unsupported PKRU
    machine (LP: 2032164, reverted)
    - x86/kvm/fpu: Limit guest user_xfeatures to supported bits of XCR0
    - KVM: x86: Always enable legacy FP/SSE in allowed user XFEATURES
  * CVE-2023-4569
    - netfilter: nf_tables: deactivate catchall elements in next generation
  * CVE-2023-20569
    - x86/cpu, kvm: Add support for CPUID_80000021_EAX
    - x86/srso: Add a Speculative RAS Overflow mitigation
    - x86/srso: Add IBPB_BRTYPE support
    - x86/srso: Add SRSO_NO support
    - x86/srso: Add IBPB
    - x86/srso: Add IBPB on VMEXIT
    - x86/srso: Fix return thunks in generated code
    - x86/srso: Tie SBPB bit setting to microcode patch detection
    - x86: fix backwards merge of GDS/SRSO bit
    - x86/srso: Fix build breakage with the LLVM linker
    - x86/cpu: Fix __x86_return_thunk symbol type
    - x86/cpu: Fix up srso_safe_ret() and __x86_return_thunk(...

This bug was fixed in the package linux-raspi - 6.2.0-1016.18

---------------
linux-raspi (6.2.0-1016.18) lunar; urgency=medium

  * lunar/linux-raspi: 6.2.0-1016.18 -proposed tracker (LP: #2038070)

  * Include USB drivers in linux-modules (LP: #2037938)
    - [Packaging] raspi: Include most USB modules in linux-modules

  * Exclude DRM drivers from linux-modules (LP: #2037936)
    - [Packaging] raspi: Exclude unlikely DRM modules from linux-modules

  * pi-kernel snap is missing modules for microk8s/microceph on UC22
    (LP: #2036747)
    - [Packaging] raspi: Include rbd and vxlan modules in linux-modules

  * Move nbd module into modules (from -extra) (LP: #2035373)
    - [Packaging] raspi: Include nbd module in linux-modules

  * pi-kernel 5.15 on UC22 is missing most staging modules (LP: #2024443)
    - [Packaging] raspi: Include r8188eu module in linux-modules

  [ Ubuntu: 6.2.0-36.37 ]

  * lunar/linux: 6.2.0-36.37 -proposed tracker (LP: #2038076)
  * Regression for ubuntu_bpf test build caused by upstream bdeeed3498c7
    (LP: #2035181)
    - selftests/bpf: fix static assert compilation issue for test_cls_*.c
  * CVE-2023-4244
    - netfilter: nf_tables: don't skip expired elements during walk
    - netfilter: nf_tables: adapt set backend to use GC transaction API
    - netfilter: nft_set_hash: mark set element as dead when deleting from packet
      path
    - netfilter: nf_tables: GC transaction API to avoid race with control plane
    - netfilter: nf_tables: don't fail inserts if duplicate has expired
    - netfilter: nf_tables: fix kdoc warnings after gc rework
    - netfilter: nf_tables: fix GC transaction races with netns and netlink event
      exit path
    - netfilter: nf_tables: GC transaction race with netns dismantle
    - netfilter: nf_tables: GC transaction race with abort path
    - netfilter: nf_tables: use correct lock to protect gc_list
    - netfilter: nf_tables: defer gc run if previous batch is still pending
    - netfilter: nft_dynset: disallow object maps
    - netfilter: nft_set_rbtree: skip sync GC for new elements in this transaction
  * CVE-2023-4563
    - netfilter: nf_tables: remove busy mark and gc batch API
  * CVE-2023-42756
    - netfilter: ipset: Fix race between IPSET_CMD_CREATE and IPSET_CMD_SWAP
  * CVE-2023-4623
    - net/sched: sch_hfsc: Ensure inner classes have fsc curve
  * Fix unstable audio at low levels on Thinkpad P1G4 (LP: #2037077)
    - ALSA: hda/realtek - ALC287 I2S speaker platform support
  * Lunar update: upstream stable patchset 2023-09-21 (LP: #2037005)
    - Upstream stable to v6.1.41, v6.4.6
    - io_uring: treat -EAGAIN for REQ_F_NOWAIT as final for io-wq
    - ALSA: hda/realtek - remove 3k pull low procedure
    - ALSA: hda/realtek: Add quirk for Clevo NS70AU
    - ALSA: hda/realtek: Enable Mute LED on HP Laptop 15s-eq2xxx
    - maple_tree: set the node limit when creating a new root node
    - maple_tree: fix node allocation testing on 32 bit
    - keys: Fix linking a duplicate key to a keyring's assoc_array
    - perf probe: Add test for regression introduced by switch to
      die_get_decl_file()
    - btrfs: fix warning when putting transaction with qgroups enabled after...