If you're going to remove these directories, you will probably get troubles with your svn client. As a result, you have to do a new checkout of your repository.
Instead of removing these directories, you could exclude these from uploading with a filter inside your FTP program. I'm using Trasmit 4, which has support for this kind of functionality.
