Skip to content

Importing Bidirectional LSTM model via ONNX shows an error #18076

@sjeongab

Description

@sjeongab
System information (version)
  • OpenCV => 4.4
  • Operating System / Platform => Mac OS 10.15
  • Compiler => PyCharm
Detailed description

Importing model from easyocr(https://github.com/JaidedAI/EasyOCR/blob/master/easyocr/model.py) via ONNX shows an error. The model itself works well with torch and ONNX, but the error occurs when the ONNX version file is imported through openCV, and especially BiLSTM is the part where the error occurs.

Also reported to openCV forum: https://answers.opencv.org/question/233370/importing-bidirectional-lstm-model-via-onnx-shows-an-error/

Below is the error code:

error msg is cv2.error: OpenCV(4.4.0) ../modules/dnn/src/layers/permute_layer.cpp:134: error: (-215:Assertion failed) (int)_numAxes == inputs[0].size() in function 'getMemoryShapes'

Below is the simplified model I made which reproduces error:

Steps to reproduce
import torch.nn as nn
import torch


class BidirectionalLSTM(nn.Module):
    def __init__(self, input_size, hidden_size, output_size):
        super(BidirectionalLSTM, self).__init__()
        self.rnn = nn.LSTM(input_size, hidden_size, bidirectional=True, batch_first=True)
        self.linear = nn.Linear(hidden_size * 2, output_size)

    def forward(self, input):
        self.rnn.flatten_parameters()
        recurrent, _ = self.rnn(input)
        output = self.linear(recurrent)
        return output


class Model(nn.Module):
    def __init__(self):
        super(Model, self).__init__()
        self.SequenceModeling = nn.Sequential(
            BidirectionalLSTM(512, 512, 512),
            BidirectionalLSTM(512, 512, 512))

    def forward(self, input):
        contextual_feature = self.SequenceModeling(input)
        return contextual_feature


x = torch.rand(1, 65, 512).float().cpu()
model = Model()
model.eval()
torch.onnx.export(model, x, "ocr0811_1.onnx")


import cv2
net = cv2.dnn.readNetFromONNX('ocr0811_1.onnx')
Issue submission checklist
  • I report the issue, it's not a question
  • I checked the problem with documentation, FAQ, open issues,
    answers.opencv.org, Stack Overflow, etc and have not found solution
  • I updated to latest OpenCV version and the issue is still there
  • There is reproducer code and related data files: videos, images, onnx, etc

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions