You can leave your memory stick in and add the new stick in the empty slot. That should give you a nice boost.
To work on paring down un-needed programs that run every time you start your PC get a list of startup items. Click on the Start button and in the run box type in msconfig. Hit Ok and a small window will open. Click on the tab titled Start Up. Make a list of all the apps you see in there and come back.