Good luck. Yes, the best way it to run all the upgrade sql scripts on all the sites, move the var and setting on the new install and it should be ok.
Moreover, if you update the mysql too from 4.0 to 4.1 and were using utf8, be sure back up, and have a look a Kristof script to upgrade a few of the fields.