Damnit, I always figure it out after I post the question. As if posting the question magically solves it.

It’s to do with the way Woo is set up, should anyone else run into this. You need to set up the Product Archive page in Woo Settings and in Permalinks.

Thanks for being magical.