If you have a linksys, there is mod software available for them that may allow you to turn off the wan side of your router. If you cant do that, then you will need new hardware, wan routers won't share dial up. look here.
http://www.ezlan.net/DialUp.html
If I am wrong, please correct me, I would like to know how to do this also. Post a step by step.