I seems to get jina embeddings convert successfully with
python bert_cpp/convert.py jinaai/jina-embeddings-v2-base-code models/jina-f16.gguf
Seems the only change to original bert is ALiBi, as described in https://huggingface.co/jinaai/jina-embeddings-v2-base-code
It'll be nice if we could adapt ggml_alibi into this repo for jina embedding support