You can just make out Gilmore's Garden written on the right side of the building.

The first Madison Square Garden was actually right on Madison Square Park at Madison Avenue and 26th Street in the heart of present-day NoMad neighborhood of New York. It was originally a passenger depot of the New York and Harlem Railroad owned by Commodore Vanderbilt before the terminal moved uptown to Grand Central Terminal.

The Madison Square depot building had a seating capacity of 10,000 and was covered over by a tent, making it cold in winter and hot in summer. It was first leased to P.T. Barnum who called it the Great Roman Hippodrome. Then it was leased to Patrick Gilmore, who name it Gilmore’s Garden and finally to W.M. Tileston. When Vanderbilt’s grandson inherited the site in 1879, he gave it the name Madison Square Garden. During the first years, the 10,000-seat arena had a wide range of activities from circuses, flower shows, beauty contests, music contests, ice carnivals, riding lessons, and temperance meetings to the first Westminster Kennel Club Dog Show.