You will also need to make sure your webserver is configured to server these files directly.
In general I would recommend to use the <i>ezfilepasstrough</i> handler, unless you have some problems with it. The <i>ezfiledirect</i> handler cannot check user permissions for instance.