It should go faster when some conditions are met:
- install a php accelerator (TurkMM cache if windows)
- it is not the first time you visit a page (first timers may be slow as the ez publish + php caches are created); the more you use it, the faster it should go.
- apache config: make sure you do not use DNS lookups for clients - ez caching is on (view caching, template compile)
On a 1Ghz server (Linux) I get delivery times around 0.2-0.5 sec per page with caches fully enabled and filled for a 3.2 install (live site, not too much "under pressure" from concurrent clients).