Skip to content

Add support for BERT embedding models #5423

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 21 commits into from
Feb 11, 2024
+616 −52
Merged

Add support for BERT embedding models #5423

Changes from 1 commit
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
7286b83
BERT WIP
cebtenzzre Feb 6, 2024
ef10d78
merge from master
iamlemec Feb 7, 2024
0051c82
it runs; tokenization is messed up; pooling is wrong for multi batches
iamlemec Feb 8, 2024
59c1829
add in wordpiece tokenizer
iamlemec Feb 8, 2024
5f1c21d
put causal_attn flag in gguf
iamlemec Feb 8, 2024
e0e14e3
Merge remote-tracking branch 'origin/master' into bert
iamlemec Feb 8, 2024
7218c7b
Merge remote-tracking branch 'upstream/master' into bert
iamlemec Feb 8, 2024
e3efcf1
Update convert-hf-to-gguf.py
iamlemec Feb 8, 2024
96d37f8
add causal attention gguf key
iamlemec Feb 8, 2024
e78388d
use ctx_output for tok_norm of BERT and BLOOM
cebtenzzre Feb 9, 2024
b14c457
bert : add some missing graph callbacks
cebtenzzre Feb 9, 2024
6875808
fix up model sizing and result acquisition
iamlemec Feb 9, 2024
d080beb
hard-code token_type = 0
iamlemec Feb 9, 2024
3a1895d
Merge branch 'bert' of github.com:iamlemec/llama.cpp into bert
iamlemec Feb 9, 2024
961e98f
style fixes
iamlemec Feb 9, 2024
56afb2f
undo attempted type_embd simplify
iamlemec Feb 9, 2024
ab49e9e
bert : simplify token type embedding access
cebtenzzre Feb 9, 2024
6972e7e
flake8 : add W503 to ignore list
cebtenzzre Feb 9, 2024
8fbefed
minor : code style normalization
ggerganov Feb 11, 2024
e379e8c
avoid use of ggml_graph_get_tensor
iamlemec Feb 11, 2024
61bab47
Merge branch 'bert' of github.com:iamlemec/llama.cpp into bert
iamlemec Feb 11, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'upstream/master' into bert
  • Loading branch information
@iamlemec
iamlemec committed Feb 8, 2024
commit 7218c7b613e84aa54bf32b68e1d4b8229b5c3a25

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy