Wow! haha, just found the most weirdest solution,
not sure if the USB port in the M5 stack is wired properly,
If I turn the USB C cable around then it works, so it seems like the cable has to be a certain direction for it to work, I have even tested this with multiple cables all with the same result!, so if it's not working try rotating your cable!
this doesnt always work for me and i tried another cabel