What’s the first thing you’d optimize on a slow site?

I’d start with the basics first.
Image sizes, unnecessary scripts, and caching usually give the biggest improvements.
A lot of people jump straight to hosting when the problem is actually front-end related.