The search will return all hits which the user has access to. There's no way to remove the text file from the search result list other than to move or remove the text file.
You can however create a cronjob to do this for you. ( remove all text objects from Media->Files which does not have reverse relations to Content tree )