Once there is no more data to decode then you should call the FinishDecoding method which will reset internal buffers and clean up.
Base64Stream Class