That is, the same difficulties exist when trying to extract key information from playback or rendering of multi-modal or multimedia type information signals, e.g., signals including both audio and video information portions, or text document-based or markup language-based signals, e.g., XML documents.