There is a good article on the fossils of the Bay in the Bay Quarterly today, with special emphasis on the whales:
The Chesapeake's Excellent Fossils: Discoveries in Bay cliff formations are yielding new insights into prehistoric creatures, including ancient whales
...not far away lived a paleontologist with a long-time interest in the cliffs, and he knew what to do next. Stephen Godfrey, the curator of paleontology at the Calvert Marine Museum in Solomons, Maryland, began the excavation of the jawbone — which turned out to be much more. Over several weeks, the team, which included a host of volunteers, unearthed from the cliff face an entire whale skull, measuring six feet from front to back. Along with it came many other bones: vertebrae, pieces of ribs, a humerus from right below the whale's shoulder, and part of a flipper bone. For paleontologists, to find so many fossilized pieces of a single whale in one place constituted a bonanza.I went out today again. Not as good as yesterday, I only found 45 shark's teeth, a Black Drums tooth, and some Bat Ray plates. Not a single whale skull, although I throw back a lot of small bone shards that could be whale skull for all I know.
The leviathan's remains may seem like an unusual thing to discover around the Chesapeake Bay, but the region has long been known for producing plentiful fossils of marine life, including whales. Most have come from the Calvert Cliffs, located in Maryland about 25 miles northeast of the Stratford features.
Part of the same geologic formation as the Stratford features, Calvert Cliffs run 30 miles down the Bay's western shore, beginning near the town of Chesapeake Beach and ending by Drum Point on the Patuxent River. The cliffs — which turn golden during sunrise — and their surrounding beaches in Calvert County are known for fossilized sharks' teeth and other prehistoric remains. Look closely, and you'll find an explosion of life recorded in stone: whale fossils, yes, but also ancient sand dollars, pecten scallops, and twisting shells from sea snails. These animals all lived during a geologic epoch called the Miocene, which lasted from about 23 to five million years ago. It was an important period in the evolution of whales.
The front page of the Bay Quarterly.