This used to be a bustling port, and by visiting it, you can provide your child an insight into how New York as we know it today was built, with the help of ships coming from all over the world and successful trade. There are many vintage ships that are worth seeing, and they may serve as a short history lesson for your toddler. There are also early letterpress printing and examples of 19th-century crafts, and if your toddler needs a rest, there are plenty of shops and restaurants near the water.