The clubhouse overlooks 163 acres of bucolic property in the Greenfield Hill section of Fairfield, Connecticut that includes an expansive clubhouse, an 18-hole Robert Trent Jones Sr. golf course, a newly renovated racquets viewing patio overlooking seven tennis courts and four pickleball courts, five paddle courts surrounding a modern paddle hut and deck with a stone fireplace, and a complete aquatics area with a heated pools, diving boards, lounging areas, snack bar and outdoor dining. As envisioned by the founding members, the mission of the Club is to promote good fellowship among kindred spirits.

The Patterson Club was first organized in 1929 by the General Electric Company as a dining and social club with 20 charter members. The Club's name was derived from Mr. Charles E. Patterson, Vice President & General Manager of the Appliance and Merchandise Department, as he was a great supporter in the formative years. The Club's original home was located at the beautiful Harral Homestead in Bridgeport, Connecticut. In 1945, a parcel of land known as Quassett Farm was purchased by General Electric Company and shortly after, Robert Trent Jones was retained as an architect to design a course with Scottish inspired rolling greens and fairways. The formal opening of the golf course took place on June 28, 1947.

The present clubhouse was completed in 2010 and provides expansive and enjoyable social settings for members and their guests. The Banks Dining Room, Grill, and multiple outdoor seating areas provide exceptional food and beverage service Wednesday - Sunday. A separate wing of the Club offers banquet facilities including a designated kitchen that serves the Fairfield Room and the Greenfield Room. The banquets area supports large member events as well as private events including weddings, business conferences, family celebrations and milestones, sports banquets, and bar mitzvahs and bat mitzvahs.