James Francis Brown

James Francis Brown (c. 1793–1868) escaped slavery in Maryland in 1828 and purchased his own freedom by working for the Verplanck family in New York, eventually becoming their head gardener. His diaries document the daily lives of people who constructed and maintained the elaborate gardens and landscapes commissioned by wealthy residents of the Hudson Valley in the mid-nineteenth century.

History

James Francis Brown, also known as Anthony Chase and Anthony Fisher, was born in slavery around October 1, 1793, in northern Maryland. Little is known about his mother. His father, Robert Chase, was also enslaved, but died a free man on July 22, 1838. The historical evidence concerning James F. Brown’s early life is difficult to follow, and sometimes contradictory. Historian Myra Armstead convincingly argues that he learned how to read and write at one of the German Lutheran churches in Frederick County in his youth. She speculates that Brown may have been owned by Matthew Brown, a farmer and co-owner of a wool processing factory, before Brown was sold to the farmer William E. Williams (1797–1822). While working for the Williams family in 1818, James Brown was recorded on the Baltimore city tax list, residing on Frederick Street, where he may have enjoyed a “quasi-free” status. In 1826, in anticipation of his own promised manumission, Brown married and paid for the manumission of a woman named Julia Chase (also known as Julia Williams), but upon the death of Henry Lee Williams, Brown’s new mistress Susan F. Williams refused to free him. In 1827, Brown and his wife ran away from slavery.

By March of 1828, eight months after he fled Baltimore, Brown was living in New York City and working as a coachman and waiter for the judge and former congressman Daniel C. Verplanck (1762–1834). When Brown was recognized and his whereabouts made known to Susan Williams, Verplanck offered to pay her a security bond until Brown was able to purchase his own freedom for 300 dollars over the course of three annual installments. Brown earned this money working as a waiter, coachman, and gardener for Verplanck and his family, first in New York City, and later at their Hudson River estate Mount Gulian in Fishkill (modern Beacon). In 1829, he began a series of diaries that he would continue until 1866, which provide almost all of the surviving historical evidence for his life. Between 1831 and 1832, Brown took a year-long hiatus from his work for the Verplancks, during which he lived and worked in New York City with the lawyer and anti-slavery activist Peter A. Jay (1776–1843). Upon his return to the Verplancks in 1832, Brown dedicated himself to gardening, and was promoted to the position of head gardener at Mount Gulian in 1836. Daniel Verplanck had died in 1834, so Brown answered to his forty-three-year-old daughter Mary Anna Verplanck (1793–1856) in his new role. Brown’s duties always included tasks like running errands for the family and transporting them across the Hudson river to Newburgh, but as head gardener he also supervised other employees in the gardens and grounds of the estate.

The garden at Mount Gulian was already established by the time James F. Brown started work there in 1829. First laid out by Daniel Verplanck in 1804, it was about six acres in size, with formal flower beds near the main house, a wooded area, a brook, a pond, and long lawn providing a view across the Hudson. Although Brown never set out to describe Mount Gulian in his diaries, his records nevertheless constitute an valuable source for reconstructing its early design. One entry from 1836 notes “laying out walk round the brooke in the garden” while an 1838 entry records that “Doctor VP and Mrs. VP layed out a circular roade in front of the house and layed some grabel [gravel] on it” (view text). Another 1838 entry, one of only a few garden projects proudly included in the list of momentous occasions excerpted as a “Book of References” at the end of his final diary, records the completion of “a large dam in the garden” (view text). According to Brown’s entries from that year, the damming of the brook was a substantial project that ran from August 20th until September 20th, coinciding with the construction of a pond. Brown also installed and planted hotbeds, and “cleaned and fixed plants in the green house” (view text).

In addition to these horticultural responsibilities, Brown managed a budget for garden, which he used to make purchasing trips to New York City and to order seeds and plants from well-known seedsmen and nurseries of the period, including Parmentier’s, Prince’s, Thorburn’s (view text), Higg’s, and Bridgeman’s. Many of the plants listed in later descriptions of Mount Gulian are mentioned in Brown’s diaries, including magnolia from New York, Isabella grape vines, rose bushes, and peach, plumb, and apricot trees. Not all of the plants in the garden were purchased from seed catalogs or nurseries. One entry recounts how Brown “took a walk in the woods this day and found a very pretty bunch of water flowers, brought them home and gave them a place in the flower garden among the wild plants of our collection” (view text).

Thanks to Brown’s position on the Hudson River he met and worked with some of the most celebrated figures in early nineteenth-century American landscape gardening. Foremost among them was Andrew Jackson Downing, whose family nursery and botanic gardens was located just across the Hudson in Newburgh. Brown’s diaries contain many references to the Downing nursery, where he purchased fruit trees and other supplies for the garden at Mount Gulian, and where he attended a “Grand Gala” in 1836 (view text). Brown may also have acted as a representative of the Downing nursery when he attended the Pennsylvania Horticultural Society Show in Philadelphia during the autumn of 1840.

Brown’s acquaintances included other owners of great gardens and horticultural collections in the Hudson Valley. Mary Anna’s brother-in-law John W. Knevels (d. 1855) collected exotic and tropical plants, and Brown visited him frequently to store plants in his green houses and to obtain cuttings for Mount Gulian. In 1842 and 1845 Brown noted developments at Henry Winthrop Sargent’s estate Wodenethe, just a few miles away on the other side of Fishkill, including “a fine Grapery and a new Green House” Sargent built (view text). Brown also knew and visited gardeners who worked at nearby estates, including William Bennett at Wodenethe; B. Manning who gardened for Robert Bayard, a neighbor of the Verplancks; Michael Ross and William Lucas at the Downing nursery; and Mrs. Deacon, the wife of a gardener in Wappingers Falls. These gardeners exchanged plants with each other, and must also have shared gardening tips and social news when they met.

As Armstead has pointed out, Brown’s career in gardening anticipated later calls for African Americans to embrace the profession. Early African American newspapers such as the Colored American reprinted articles from agricultural newspapers, which praised the benefits of gardening “for health, for pleasure, and for profit.” In 1853, the abolitionist Lewis Woodson wrote a letter to Frederick Douglass’ Paper arguing that for African Americans, gardening was “an easy, practical, and certain means of bettering their condition, and increasing their happiness and respectability.” Extending the arguments of Barbara Mooney, Armstead suggests that African Americans like Brown may have associated early American garden theory and practice as they developed in northern states with freedom. Brown kept a small garden for his wife and himself in which he planted vegetables, fruit trees (view text), and a rose bush.

In addition to his work on the garden at Mount Gulian, James F. Brown also worked to establish a “coloured peoples burying place” in Fishkill (view text). In 1851, just one week after returning from a funeral for his friend Hester Purnell Thompson at the famed rural cemetery Greenwood in Brooklyn, New York, Brown organized a meeting to buy a plot of land adjacent to the local Methodist cemetery for the new burial place. The cemetery itself is a flat, rectangular grass lawn surrounded by trees at the corner of Walnut Street and Verplanck Avenue known as the Colored Peoples Union Burying Ground. Brown’s efforts to support the purchase and his role as a trustee may reflect how cemeteries like Greenwood and Mount Auburn inspired African American communities across the region. As a gardener, Brown must have been especially aware of the dignifying potential of landscapes for the dead.

While Brown’s salary as a master gardener is unknown, it afforded him a comfortable life. Based on figures for comparable skilled trades, Armstead speculates that he may have earned been between 490 and 630 dollars annually, which was between one third and one half of the White House gardener’s annual salary in 1840 (1200 dollars). With income from his job, Brown was able to buy a house and reserve a pew at the same local church as his employers. He voted in the New York elections of 1837, when full participation in the democratic process still hinged on property ownership. As a subscriber to the New York Sun and a reader of the Fishkill Standard, Brown was informed about both local and global events. He participated in celebrations for historic occasions, including the manumission of slaves on the West Indian Islands in 1856 and the completion of the transatlantic telegraph cable in 1858. Brown also enjoyed leisure activities like attending “Barnum’s Caravan,” the traveling circus of P.T. Barnum, which visited Newburgh in the fall of 1851 (view text).

Denied a formal education first by slavery in Maryland and then by prejudice in New York, Brown never received schooling in subjects like history or botany. His literacy and his experiences on the job, however, offered him opportunities to acquire knowledge in both areas. Brown’s diaries mention a copy of Richard and John Lander’s Travels that Mary Anna Verplanck gave him as a gift in 1833. Armstead focuses on the political significance of Lander’s abolitionist activism, but it may likewise be useful to consider how Brown would have imagined the African royal gardens that are briefly mentioned in the text. Other books could also have played an important role in mediating between the tastes and goals of garden owners like Mary Anna and literate gardeners like Brown. A list of recipes for remedies in the back of one of his diaries reveals that Brown’s botanical knowledge extended beyond purely horticultural applications to include practical medicine.

Racism posed professional challenges for Brown as a head gardener. African Americans were barred from official membership in most gardening and horticultural organizations, and, as a consequence, denied the benefits that such organizations could provide their members. Although it was unusual for women and black men to show plants at horticultural and botanical exhibitions, Brown displayed plants and produce on behalf of Mary Anna on several occasions: first in 1830 at an exhibition in Newburgh, then in 1839 at Downing’s Horticultural Association for the Valley of the Hudson show in Manhattan, and finally in 1949 at the Farmers and Gardeners Association.

Brown may have enjoyed the time he spent working and walking in the garden at Mount Gulian, but his diaries also records the physical toll of its maintenance. He injured his back moving a log in 1839, cut his hand while pruning grape vines in 1841 (view text), endured a skin infection in 1842, suffered a “very severe fall” in 1844, and sprained his ankle so badly that he required surgery in 1853. Brown finally retired from his position in 1864, and died in 1868. His tombstone, which has been re-erected [fig. __], reveals that he was buried not in the cemetery that he helped found, but across town at the congregation he attended with his employers, the Church of Saint Luke (founded as the Episcopal parish of Saint Anna). His wife Julia remained in Fishkill until her death in 1890.

Although the survival of the diaries detailing them is extraordinary, the daily tasks recounted by Brown may be typical of the experiences of other African-American gardeners employed at northern estates in the early nineteenth century, such as Alexander Gilson (1823–1889), the head gardener of Montgomery Place. Brown’s garden vocabulary, focused on individual species that he purchased from seedsmen and nurseries and collected in the wild, and physical facilities including the greenhouse, hotbeds, and dams he oversaw, is largely free of the aesthetic categories that structured early nineteenth-century literary debates about garden and landscape design. His attention to weather patterns and his planting experiments reflect the pragmatic concerns of someone responsible for the establishment and upkeep of a garden, while his participation in horticultural shows demonstrates the pride that he and the Verplanck’s took in his accomplishments. In the field of landscape studies, Brown’s diaries attest to the significance of African Americans who maintained early American gardens, as well as a range of experiences distinct from those of patrons, owners, and designers.

—Alexander Brey

---

Texts

• James F. Brown, May 3, 1829, recording the use of wild flowers in the garden at Mount Gulian (Brown, vol. 4) back up to History

“Sund 3rd All this day has been Raining. Went To the D.R. [Dutch Reformed] church at the Landing. Mr. Hyer’s Text was from 10th Chapter 19 verse of the Book of Numbers. Took A walk in the woods this day and found a Very pretty Bunch of water flowers brought them home and gave them a place in the flower garden among the wild plants of our collection.”

• James F. Brown, January, 1832, describing winter tasks for garden maintenance (Brown, vol. 1)

---