Yes, routers can limit the Internet speed to/from wired connections as well as wireless.
The WRT54GL is quite old and
my tests found it had problems supporting high simultaneous up and downlink traffic.
Go get yourself a more current router and you will probably find the problem solved. Check the
Router Charts and make sure you get a router with at least 75 Mbps WAN to LAN throughput.
Go buy another router