Yes, you can do that.
In the router you are wanting to make a hub, turn off DHCP and NAT and just use the ports that are in the router part, not the internet/WAN port (leave that one unused). If it has an uplink port, use that to connect the routers. If it does not, it should auto-sense it.