Neural net based video content semantic analysis