For a quick stop in Petersburg, go see Old Blandford Church. It's just a small brick church that was built in 1735. So why go see it?
It had its ups and downs over the years, including being abandoned iirc, but then just after 1900 the Ladies Memorial Association of Petersburg commissioned 15 stained glass windows by Louis Comfort Tiffany. They're still there.