Had I waited just a couple days, I would have saved myself the effort of designing this pico zero pcb I ordered just a couple days before the "official" one was posted on GitHub .
Made it according to the schematic for the regular pico so it uses different pins than the "official" one and I didn't add any resistors.
Works wonderfully using the regular pico image, with a mayflash magic ns I already had as a receiver for an xbox one controller. Only problem is that I can't seem to get rumble working with this config which is probably some compatibility issue with the mayflash adapter. I'll have to test it wired to confirm. Now to solder a few more of these and order those usb c cables!