python.exe convert.py models\Aquila-7B --vocabtype bpe

        if self.vocabtype == "bpe":
          self.sentencepiece_tokenizer = json.loads(open(str(fname_tokenizer), encoding='utf-8').read())

Exception: Vocab size mismatch (model has 100008, but models\Aquila-7B\vocab.json has 100000).  Most likely you are missing added_tokens.json (should be in models\Aquila-7B).

  "added_tokens": [
    {
      "id": 0,
      "content": "<|endoftext|>",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": false,
      "special": true
    },
    {
      "id": 100000,
      "content": "<|startofpiece|>",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": true,
      "special": false
    },
    {
      "id": 100001,
      "content": "<|endofpiece|>",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": true,
      "special": false
    },
    {
      "id": 100002,
      "content": "<|LDWANG|>",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": true,
      "special": false
    },
    {
      "id": 100003,
      "content": "[MASK]",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": true,
      "special": false
    },
    {
      "id": 100004,
      "content": "[gMASK]",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": true,
      "special": false
    },
    {
      "id": 100005,
      "content": "[sMASK]",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": true,
      "special": false
    },
    {
      "id": 100006,
      "content": "[CLS]",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": true,
      "special": false
    },
    {
      "id": 100007,
      "content": "</s>",
      "single_word": false,
      "lstrip": false,
      "rstrip": false,
      "normalized": true,
      "special": false
    }
  ],

{
  "<|endoftext|>": 0,
  "<|startofpiece|>": 100000,
  "<|endofpiece|>": 100001,
  "<|LDWANG|>": 100002,
  "[MASK]": 100003,
  "[gMASK]": 100004,
  "[sMASK]": 100005,
  "[CLS]": 100006,
  "</s>": 100007
}

Exception: Expected added token IDs to be sequential and start at 9; got [0, 100000, 100001, 100002, 100003, 100004, 100005, 100006, 100007]