Jon-Marc; the Bennington Museum is in southern Vermont and as I drove by when I left, had signs out for a Rembrandt exhibit. I was running too late to stop, but have visited it before and seen it's wonderful collection. Art, history, a bit of everything.
If cityscape interests you, Burlington is awfully nice, especially the downtown area and waterfront. Sailing cruises, kayak or sailboat rental, a public beach, lots of cool stuff going on especially in the summer months. Shelburne is a beautiful place, and has the Shelburne Museum
To the northeast there is St. Johnsbury, a gorgeous "old city" with the Fairbanks Museum, and the St. Johnsbury Atheneum (a library and art gallery contributed by another Fairbanks decendant). (My wife is descended from the Fairbanks family, so I've been to the museum many times now; it's a beautiful building and a wonderful natural history museum, along with other collections of Vermont history. The Atheneum building is stunning in it's own right, and the paintings in the gallery have just been restored and are glorious!)
There are lots of "touristy" things to do as well, from touring Ben and Jerry's (free samples of what they're making) to riding the Alpine Slide at Stowe. I promise you that no matter where you drive in the Green Mountains, it will be one of the most beautiful places you've ever seen.
If you plan on being outside in the late afternoon, some kind of insect repellant is advisable, they've a pretty good crop of mosquitoes this year from all the rain!