I doubt if appium can be useful for this purpose.
I would do this testing manually for each build, pick up P1 user stories and go through app on different devices and report bugs.
Anyways one can't do 100% automation and some manual testing is needed then why not cover this aspect as well ?
In my app I saw sometimes api itself respond slowly which makes app looks slower, you can do API performance testing separately with rest-assured, check if response is within X sec etc.
Regards,
Vikram