Is there a way to configure movabletype to only ping search engines if the post is in a particular category?

Sort of. You have to approach the question a little differently.
First, turn off the main ping options under blog settings.
Next, if you edit a category's properties, you'll see a field for specifying ping URLs for just that cat. Repeat as necessary.