Skip to content

Added OpenSourceAI and conversational support in the extension #1206

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 22 commits into from
Dec 1, 2023
Merged
Changes from 1 commit
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
3ff2f07
Added OpenSourceAI and conversational support in the extension
SilasMarvin Nov 22, 2023
1ca5dc8
Clean up errors and guard rails around conversational api
SilasMarvin Nov 22, 2023
b6b7ec6
Not great, pivoting to better solution after talking with Santi
SilasMarvin Nov 28, 2023
be4788a
Working conversational everything
SilasMarvin Nov 28, 2023
719fdc5
Fixed typo
SilasMarvin Nov 28, 2023
23ef2a3
Working non streaming open source ai replacement
SilasMarvin Nov 28, 2023
dedf434
Remove outdated comment
SilasMarvin Nov 28, 2023
f3d8e1f
Working OpenSourceAI with both sync and async options
SilasMarvin Nov 29, 2023
2969c89
Cleaned up and tested well
SilasMarvin Nov 29, 2023
3b26743
Completely removed the GPTQ pipeline as it is no longer necessary
SilasMarvin Nov 29, 2023
cf1afc6
Removed unnecessary python imports
SilasMarvin Nov 29, 2023
accd159
Removed universal debugger output
SilasMarvin Nov 30, 2023
e5eccec
Finalized models in SDK for open source ai
SilasMarvin Dec 1, 2023
95e1e9a
Updated to work with hugging face tokens
SilasMarvin Dec 1, 2023
c80817b
Finalized models in SDK for open source ai
SilasMarvin Dec 1, 2023
9a3ca91
Removed unnecessary comment
SilasMarvin Dec 1, 2023
4eb88f8
Put back the GGML pipeline and removed the GPTQ pipeline earlier comm…
SilasMarvin Dec 1, 2023
93e7ffb
Changed some error messages
SilasMarvin Dec 1, 2023
73ee33a
Added migration for 2.8.1
SilasMarvin Dec 1, 2023
0201880
Working migration file
SilasMarvin Dec 1, 2023
47c18d6
Really working migration file
SilasMarvin Dec 1, 2023
fb3f7f7
Bumped version
SilasMarvin Dec 1, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Changed some error messages
  • Loading branch information
SilasMarvin committed Dec 1, 2023
commit 93e7ffbafc0a093626b586d46352224dd63f47fa
8 changes: 4 additions & 4 deletions pgml-extension/src/api.rs
Original file line number Diff line number Diff line change
Expand Up @@ -646,7 +646,7 @@ pub fn transform_conversational_json(
.is_some_and(|v| v == "conversational")
{
error!(
"ARRAY[]::JSONB inputs for transformer should only be used with a conversational task"
"ARRAY[]::JSONB inputs for transform should only be used with a conversational task"
);
}
match crate::bindings::transformers::transform(&task.0, &args.0, inputs) {
Expand All @@ -666,7 +666,7 @@ pub fn transform_conversational_string(
) -> JsonB {
if task != "conversational" {
error!(
"ARRAY[]::JSONB inputs for transformer should only be used with a conversational task"
"ARRAY[]::JSONB inputs for transform should only be used with a conversational task"
);
}
let task_json = json!({ "task": task });
Expand Down Expand Up @@ -725,7 +725,7 @@ pub fn transform_stream_conversational_json(
.is_some_and(|v| v == "conversational")
{
error!(
"ARRAY[]::JSONB inputs for transformer_stream should only be used with a conversational task"
"ARRAY[]::JSONB inputs for transform_stream should only be used with a conversational task"
);
}
// We can unwrap this becuase if there is an error the current transaction is aborted in the map_err call
Expand All @@ -747,7 +747,7 @@ pub fn transform_stream_conversational_string(
) -> SetOfIterator<'static, JsonB> {
if task != "conversational" {
error!(
"ARRAY::JSONB inputs for transformer_stream should only be used with a conversational task"
"ARRAY::JSONB inputs for transform_stream should only be used with a conversational task"
);
}
let task_json = json!({ "task": task });
Expand Down
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy