Check to see if Internet Explorer was added as one of your startup items by going to Start, Run, then type MSCONFIG. If there is an entry in there for iexplore.exe, then uncheck it and restart your computer.
Also, check to see if there is an entry in Start > Programs > Startup.
Also, check to see if there is an entry in Start > Programs > Startup.