usc-ur
usc-ur OP t1_jd3o8te wrote
Reply to Smarty-GPT: wrapper of prompts/contexts [P] by usc-ur
I want to announce that we have released v1.1.0 which includes access for ChatGPT and GPT4 for Plus suscribers! :)
usc-ur OP t1_jd3nzab wrote
Reply to comment by farmingvillein in Smarty-GPT: wrapper of prompts/contexts [P] by usc-ur
The main purpose of this project is joining in a single environment all the resources (models, prompts, APIs, etc.) related to LLMs. Moreover, we also think from an end-user perspective. It is heavily unlikely that a user would introduce a complex context in a query to a model or searcher. In this project, we try to bias the different model responses to answer in different ways/behaviors, but hidding this to end-users.
usc-ur OP t1_jd3nx3w wrote
Reply to comment by Nezarah in Smarty-GPT: wrapper of prompts/contexts [P] by usc-ur
That's right :) Check the "purpose" in our readme
Submitted by usc-ur t3_11whc0s in MachineLearning
usc-ur OP t1_jcb5zvs wrote
Reply to Smarty Chat-GPT: A simple wrapper that tries to "hide" context information to end-users and enhance the performance of responses. by usc-ur
We have also connected this tool with the [Awesome ChatGPT Prompts dataset](https://huggingface.co/datasets/fka/awesome-chatgpt-prompts) and [repo](https://github.com/f/awesome-chatgpt-prompts) from Fatih Kadir Akın.
Our purpose is to connect all this data with the API and make the proccess **fully transparent** to the end user.
usc-ur OP t1_jcb5ykg wrote
Reply to Smarty Chat-GPT: A simple wrapper that tries to "hide" context information to end-users and enhance the performance of responses. by usc-ur
We have also connected this tool with the [Awesome ChatGPT Prompts dataset](https://huggingface.co/datasets/fka/awesome-chatgpt-prompts) and [repo](https://github.com/f/awesome-chatgpt-prompts) from Fatih Kadir Akın.
Our purpose is to connect all this data with the API and make the proccess **fully transparent** to the end user.
usc-ur OP t1_jca4ot7 wrote
Reply to comment by Aphix in Pyplexity: Useful tool to clean scraped text (better than BS4!) by usc-ur
Sure! The idea is that you create a language model from a given corpus (let's say BNC) and then you use a similarity measure, in this case, perplexity, but can be another one to test how well your sample (sentence) "fits" into the model distribution. Since we assume the distribution is correct, this allows us to identified malformed sentences. You can also check the paper here: https://www.cambridge.org/core/journals/natural-language-engineering/article/an-unsupervised-perplexitybased-method-for-boilerplate-removal/5E589D838F1D1E0736B4F52001150339#article
usc-ur OP t1_jca4ffj wrote
Reply to comment by Aphix in Smarty Chat-GPT: A simple wrapper that tries to "hide" context information to end-users and enhance the performance of responses. by usc-ur
Sorry, my bad, here you have: https://github.com/citiususc/Smarty-GPT :)
usc-ur OP t1_jc9ss05 wrote
Reply to comment by gargolito in Pyplexity: Useful tool to clean scraped text (better than BS4!) by usc-ur
A perplexity filter allows to remove sentences by likelihood to a given language model. In there you need to "play" with the parameter or threshold
usc-ur OP t1_jc7h77q wrote
Reply to comment by Aphix in Smarty Chat-GPT: A simple wrapper that tries to "hide" context information to end-users and enhance the performance of responses. by usc-ur
Sure, thanks for pointing this out :)
usc-ur OP t1_jc7guwj wrote
Reply to comment by Aphix in Pyplexity: Useful tool to clean scraped text (better than BS4!) by usc-ur
>All good, might want to link the other ones you posted in those other post comments, too (Smarty-GPT, etc) -- most of the time you can just link the GitHub directly from the post here.
My bad, quite a newbie: https://github.com/citiususc/Smarty-GPT
usc-ur OP t1_jc73mgl wrote
Reply to comment by Aphix in Pyplexity: Useful tool to clean scraped text (better than BS4!) by usc-ur
https://github.com/citiususc/pyplexity . My bad :)
Pyplexity: Useful tool to clean scraped text (better than BS4!)Submitted by usc-ur t3_11r45r8 in coolgithubprojects
Smarty Chat-GPT: A simple wrapper that tries to "hide" context information to end-users and enhance the performance of responses.
usc-ur OP t1_jd4ydfk wrote
Reply to comment by farmingvillein in Smarty-GPT: wrapper of prompts/contexts [P] by usc-ur
Thanks for the tips! Will consider them!