Yes, routers can limit the Internet speed to/from wired connections as well as wireless.
The WRT54GL is quite old and my tests
found it had problems supporting high simultaneous up and downlink traffic.
Go get yourself a more current router and you will probably find the problem solved. Check the Router Charts
and make sure you get a router with at least 75 Mbps WAN to LAN throughput.
Go buy another router