You need to use the design resource when including a template file.
Example:
{include uri="design:mytemplate.tpl"}
This will include the file mytemplate.tpl which must be inside design/<your-design>/templates/. eZ publish caches every available template, which means you must clear the template override cache everytime you create or override a template. Do this by running
