In reference to the WebNS image version 7.40,
support for routing protocols like OSPF is some what limited and to answer your question straight it does NOT support the md5 auth however the simple password method is supported under the 'Config-->Circuit-->IP address' for LSA exchanges.
NSSA is not supported as far as I know.
thanks