Thanks all for the insight. I've looked at the flowUI and at making an interface in the Arduino IDE. The flowUI is really easy with great looking results but I really doubt I can get the frame rates where I'd like them in an interpreted language. I also think that writing an interface natively in the Arduino IDE would have a big impact on the frame rates as well. I may have to look at some co-processor arrangement where flowUI Handles the higher level functions and issues commands to a procesessor handling the IO.
You would be correct with processing as the arduino allows access to all 3 of the esp32's cores where as micropython code runs on one core, the interpreter runs on the other and the 3rd, the ULP core is inaccessible.
Thanks again for your time and insight. I'm really impresses with the M5Stack, I have a lot of learning to do.