Commit graph

524 commits

Author SHA1 Message Date
D. Carpintero
54c34c79ac
Add notebook for NER using Functions (#807) 2023-11-14 13:52:28 -08:00
Stefano Lottini
d13dc3b557
Cassandra / Astra DB demo notebooks: adapt to OpenAI 1.0, add support for Astra DB HTTP API, and other upgrades (#853) 2023-11-14 13:37:27 -08:00
Gabor Cselle
988139d70e
Update embeddings_utils.py and related notebooks to API V1 (issue #855) (#857) 2023-11-14 13:31:55 -08:00
jhills20
bd58636a8a
Updating notebooks to use new Python SDK (#837) 2023-11-14 13:31:13 -08:00
royziv11
a1747ab388
Add parallel function calling (#838)
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-11-13 10:00:42 -08:00
Ilan Bigio
96d8f3b08e
Assistants API Overview: Rearrange intro text and image. (#851) 2023-11-12 21:24:36 -05:00
Ilan Bigio
5060a68179
Add overview diagram for Assistants API Overview. (#850) 2023-11-12 21:01:34 -05:00
Ilan Bigio
08a51a3ec5
Assistants API Overview: More Bug Fixes (#849) 2023-11-11 09:37:01 -05:00
simonpfish
c40506abcb Add images correctly 2023-11-10 16:43:44 -05:00
Ilan Bigio
57a727b72e
Bug fixes for Assistants API Overview (#846) 2023-11-10 16:26:59 -05:00
Ilan Bigio
e2be1f1850
Add assistants api overview for the Python SDK (#843) 2023-11-10 15:43:08 -05:00
Tad
736960806b
fix some typos (#829) 2023-11-10 12:32:51 -05:00
jhills20
3ea479481b
SDK fixes and slight clean up to Whisper pre/post processing recipe (#834) 2023-11-10 12:19:08 -05:00
jhills20
7044eecb98
Added embeddings_utils.py to utils directory, and updated references (#841) 2023-11-10 12:07:25 -05:00
jhills20
ac4cb3b163
Add notebook on fine tuning for function calling (#810)
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-11-09 17:36:51 -08:00
john
3b385db6ca
docs: fix typo (#827)
Co-authored-by: John Octubre <johnoctubre@Johns-MacBook-Pro.local>
2023-11-07 15:45:04 -08:00
Greg Richardson
90a3037045
Adds Supabase to list of vector databases (#819) 2023-11-07 14:37:46 -08:00
Kai Chen
7065abc046
Don't autoplay narration for GPT-V notebook (#823) 2023-11-06 13:31:26 -08:00
Simón Fishman
e8cd45acfd
Add video link and update paths (#822) 2023-11-06 13:05:53 -08:00
Simón Fishman
7313241a2b
Add examples and guides for DevDay releases (#820) 2023-11-06 12:48:12 -08:00
Guspan Tanadi
3902e880a5
Fix typos in Fine-Tuning RAG Qdrant (#806) 2023-10-31 11:39:09 -07:00
Yashwant Jodha
713b642d41
Add support for Azure deployment endpoints (#809) 2023-10-31 11:38:12 -07:00
Mayuresh Dharwadkar
354e4f243d
docs: fix typos (#811)
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-10-31 11:37:00 -07:00
Soonoh
73307542dd
Fix error and enhance multiclass classification notebook (#801) 2023-10-30 19:00:47 -07:00
pavlovp
683e5f5a71
Update Using_Pinecone_for_embeddings_search.ipynb (#803) 2023-10-19 10:42:13 -07:00
simonpfish
12f7c13b61 Add complete code 2023-10-18 18:21:20 -07:00
simonpfish
0efcfc3eb9 Rename file, polish code and generalize 2023-10-18 16:29:30 -07:00
Surav Shrestha
1e90380087
Fix typo in examples/book_translation/translate_latex_book.ipynb (#798) 2023-10-18 16:10:29 -07:00
simonpfish
23838145b9 Sync filename with registry 2023-10-18 11:18:50 -07:00
simonpfish
b20dd1ce10 Update title and filename 2023-10-18 11:03:09 -07:00
Shyamal H Anadkat
ac345ddd64
Chained functions using OpenAPI spec (#790) 2023-10-18 10:59:55 -07:00
simonpfish
3feb142694 Add ScrimPlayer component 2023-10-17 20:52:20 -07:00
simonpfish
5b0f79c21d Experiment with Scrimba embed 2023-10-17 20:48:08 -07:00
Shyamal H Anadkat
dc6ca0df6b
Update some cookbook titles (#795) 2023-10-17 17:39:42 -07:00
simonpfish
6d3db1374b Update title and reformat with prettier 2023-10-17 13:15:23 -07:00
simonpfish
ec414ee67b Fix image links 2023-10-17 11:05:28 -07:00
Ikko Eltociear Ashimine
109143f505
Fix typo in olympics-1-collect-data.ipynb (#787)
Co-authored-by: Shyamal H Anadkat <shyamal@openai.com>
2023-10-16 17:52:59 -07:00
Per Harald Borgen
b451a7b19e
Add notebook about functions and the node sdk (#762) 2023-10-16 17:19:16 -07:00
simonpfish
6c00ce2ff5 Remove unnecessary cell outputs 2023-10-16 12:03:12 -07:00
Roger Zurawicki
fc5af842a2
Add tiktoken-rs to third-party library (#791) 2023-10-16 10:21:24 -07:00
Simón Fishman
e0baca7fbf
Rename third party examples folder (#779) 2023-10-11 19:30:35 -07:00
Simón Fishman
e3d68f8843
Fix titles for wandb notebooks (#778) 2023-10-11 19:21:52 -07:00
simonpfish
b213d75bcd Move and rename embeddings W&B example 2023-10-11 19:12:51 -07:00
gusmally
a6100e80ff
Correct legacy fine-tuning note (#770) 2023-10-11 14:53:36 -07:00
simonpfish
f52ffdaca4 Fix more uneven title sizing 2023-10-06 17:14:58 -07:00
simonpfish
056ba72710 Fix uneven title sizing 2023-10-06 17:13:47 -07:00
Emil Sedgh
f05c2c9f8b
Consider function calling roles and messages valid (#765) 2023-10-06 17:12:04 -07:00
Kai Chen
2df818aca3
Fix link to .py file (#763) 2023-10-06 17:11:08 -07:00
Anish Shah
5591ff376f
Add Weights and Biases OpenAI MLOps examples to third_party_examples (#714) 2023-10-02 14:02:34 -07:00
Fayaz Rahman
24b7a8e9b9
Add Deep Lake vector database example (#455) 2023-10-02 11:20:03 -07:00
Daniel
b01738fa1c
Add Neon Postgres to the list of vector databases in the README (#746) 2023-09-29 18:23:01 -07:00
Daniel
63e966d69a
Update Neon cookbook README.md (#747) 2023-09-29 18:22:39 -07:00
Stefano Lottini
1ca286c180
new cassIO connect experience with the newest cassio.init (#745) 2023-09-28 18:00:04 -07:00
Jiří Hofman
8d329cf9a3
Fix typo in How_to_stream_completions.ipynb (#744)
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-09-28 17:53:36 -07:00
Dhruv Anand
f6260a013e
fix: typo in hallucination reduction stat (#742) 2023-09-28 17:50:32 -07:00
Daniel
c3f5e0cd7c
Add Neon Postgres vector database OpenAI cookbook (#690)
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-09-28 17:48:41 -07:00
Ikko Eltociear Ashimine
6efa2eca0b
Fix typo in Backtranslation_of_SQL_queries.py (#709) 2023-09-27 17:50:53 -07:00
Simón Fishman
c2959fd60b
[tiktoken_counting] fix tokenizer name (#741) 2023-09-27 16:12:31 -07:00
Saarika Bhasi
4631e1b74a
[elasticsearch] fix typo in signup url (#726)
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-09-27 16:02:50 -07:00
Albarqawi
bc78c9871c
Add a notebook for end to end automation example (#527) 2023-09-27 15:59:29 -07:00
Farzad Sunavala
552262ea89
Minor change to use SearchIndexingBufferedSender to support optimized batch indexing (#712) 2023-09-26 16:43:05 -07:00
ridrisa
c777f1025a
fix minor typo in financial_document_analysis_with_llamaindex (#733) 2023-09-26 16:25:55 -07:00
Chuong Ho
561efac6d3
Add Mongodb Atlas Vector Search (#734) 2023-09-26 16:22:58 -07:00
Simón Fishman
222a85fb17
Improve parallel processing script (#735) 2023-09-25 12:09:39 -07:00
gusmally
fde2a6474d
add note about legacy fine tuning (#729) 2023-09-22 10:49:07 -07:00
Stefano Lottini
ba1e6004c9
Fix spelling error + misplaced copypaste in the CQL notebook (#728) 2023-09-22 10:48:55 -07:00
Cathy Chen
8ab41ac370
Add description and rename Obtain_dataset, and throw error when fine tuned model not available (#727) 2023-09-20 14:50:59 -07:00
Will DePue
efcc78953d
Improve code_search and get_embedding notebooks. (#717)
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-09-15 16:54:29 -07:00
Nirant
fd4e31bb00
5x Error Reduction in RAG with gpt-3.5-turbo-0613 Finetuning (#678) 2023-09-12 09:09:23 +01:00
Farzad Sunavala
cb46cc46a6
Add Azure Cognitive Search vector database (#569)
* get started azuresearch

* master docs reference

* pablo comments

* replace placeholders with "_"

* azs latest sdk updates

* deep dive link

* openai feedback

* not print the whole vector in console

* cleanup outputs

* cleanup outputs pip
2023-09-11 16:34:15 -07:00
dongqqcom
d86a0381e6
Add Tair to examples of vector database (#609)
* Add Tair to examples of vector database

* remove hardcoding API keys

* Update examples/vector_databases/tair/Getting_started_with_Tair_and_OpenAI.ipynb

Co-authored-by: Simón Fishman <simonpfish@gmail.com>

* fix: input api key by getpass

* update: input api key by getpass

* update: Adding output of code cells

---------

Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-09-11 15:16:00 -07:00
Krista Pratico
240694fa32
[azure] bring your own data example (#654)
* initial commit for bring your own data notebook

* fix words

* add version

* add output from stream

* address review feedback

* edit intro
2023-09-11 15:12:37 -07:00
Puneet Dhiman
e4d0bc169c
Correct spelling mistake in Search_reranking_with_cross-encoders.ipynb (#675) 2023-09-11 15:10:17 -07:00
Stefano Lottini
59011825c3
Updates to CassIO notebook (#684) 2023-09-11 14:59:09 -07:00
Steven Pousty
857b592731
small typoe fix (#688) 2023-09-11 14:57:09 -07:00
Simón Fishman
5783656852
add descriptions to fine-tuning dataprep notebook (#673) 2023-09-02 08:26:55 -07:00
Simón Fishman
15f3fda4a3
clarify title (#672) 2023-09-01 10:14:11 -07:00
Will DePue
76448de0de
Update Customizing_embeddings.ipynb to be delete long cache output. (#667)
* patch

* remove print statement

---------

Co-authored-by: simonpfish <simonpfish@gmail.com>
2023-08-29 17:50:15 -07:00
Stefano Lottini
fae14ddb89
Add Cassandra/Astra DB to the vector databases README (#665)
* Add Cassandra/Astra DB to the vector databases overall README

* Linking to a basic quickstart instead
2023-08-29 15:20:51 -07:00
Liam Thompson
31b4de22a3
Add elasticsearch examples to vector databases folder (#622)
* Add Elasticsearch to vector databases, add notebooks

* Update prompt

* Make intro verbiage more neutral

* Add semantic search notebook outputs

* Add RAG notebook output

* Update query

* Remove unreadable vector output
2023-08-29 10:54:08 -07:00
Stefano Lottini
4d330b82d7
Add Astra DB (/Cassandra) to vector databases with example notebooks (#655)
* first commit for the Astra DB / Cassandra notebooks

* add json with quotes

* towards the final cassIO pilot notebook

* small changes to the copy

* cassIO pilot completed and its readme done

* fix silly markdown error

* fix silly markdown error 2

* astra vector link change and vector search picture improved

* added link to docs for connecting to Cassandra cluster

* CQL version of the flow

* revised readme

* final adjustments around metrics/distances

* links' final version assumes files in openai's main branch

* Add ref to QA+vector general guide; fix prompt; clarified conclusion paragraph; typos
2023-08-29 10:27:49 -07:00
recordcrash
1945bfe65c
Fix UTF-8 encoding in Chat_finetuning_data_prep.ipynb (#648) 2023-08-28 18:12:30 -07:00
Eliah Kagan
63f95154b1
Add Tiktokenizer link in "How to count tokens" (#604)
This adds a link to Tiktokenizer webapp as another tool, in
addition to the OpenAI Tokenizer.
2023-08-28 10:28:19 -07:00
Viet Hoang Tran Duong
1ae3bf631b
fix undefined variables in fine tune example (#660)
`create_user_message` and `test_df` are not defined.
2023-08-25 13:03:06 -07:00
Simón Fishman
35b7123faf
update titles (#653) 2023-08-22 16:32:43 -07:00
Simón Fishman
d534c85477
more fine-tuning improvements (#652)
* more fine-tuning improvements

* add links to other resources
2023-08-22 16:27:08 -07:00
Simón Fishman
8ed84645e8
small improvements to the fine-tuning cookbook (#651) 2023-08-22 15:30:03 -07:00
simonpfish
cbe292bd93 update fine-tuning cookbook 2023-08-22 13:48:39 -07:00
Michael Wu
a173325830
add ft data prep notebook (#647) 2023-08-22 12:24:42 -07:00
colin-openai
524949f9d1
Pushing cookbook for fine-tuning via ChatCompletion (#646)
* Pushing cookbook for fine-tuning via ChatCompletion

* Add correct file

* Fixed bug with create_prompt function and refactored files
2023-08-22 12:24:22 -07:00
aalmaksour82
a74a7a7940
Fixed JSON formatting bug in arxiv_functions (#562) 2023-08-18 09:26:04 +01:00
Ikko Eltociear Ashimine
6597537307
Fix typo in redis-hybrid-query-examples.ipynb (#642)
bellow -> below
2023-08-17 03:21:48 -07:00
Simón Fishman
b3a41db9da
fix date typo (#640) 2023-08-16 17:38:48 -07:00
Shyamal H Anadkat
9f63c4863e
Adds reference to SummEval (#639) 2023-08-16 14:20:22 -07:00
Simón Fishman
1d73635488
various minor improvements (#638) 2023-08-16 10:53:54 -07:00
Shyamal H Anadkat
346617e8fd
adds notebook on abstractive summarization eval (#637) 2023-08-16 10:25:42 -07:00
prestontuggle
4912564dc1
adds one function calling notebook (#629)
* adds one function calling notebook

* reordered imports and ran all cells

* fixed comma error
2023-08-11 20:34:29 -04:00
prestontuggle
0933dd1569
adds two Whisper guides (#628)
* adds two Whisper guides

* polishing

* fixes function argument misordering

---------

Co-authored-by: Ted Sanders <ted@openai.com>
2023-08-11 16:11:19 -04:00
Shantanu Nair
8e6e058c6a
Fix function description (#626) 2023-08-09 10:34:59 -07:00
Anton Troynikov
3115683f14
Update notebooks (#598) 2023-07-24 15:59:33 -07:00
richzw
964dd85ed3
add tiktoken-go to How_to_count_tokens_with_tiktoken.ipynb (#605) 2023-07-24 15:54:52 -07:00
Krista Pratico
5e050080ab
[azure] add functions notebook sample (#595)
* add azure functions notebook sample

* update api key to use env var + note use of env vars over config in code across azure samples
2023-07-21 16:38:49 -07:00
ancri
b5ea5f3b0e
consolidate Embedding.create calls into one (#543) 2023-07-20 20:20:04 -07:00
Tomas Dulka
4fd2b1a6d2
replace eval with safer literal_eval (#561) 2023-07-17 16:40:54 -07:00
Sebastian Witalec
3bd18cc07d
fix markdown typo on a link (#591) 2023-07-17 15:53:44 -07:00
Alex Dhillon
9dad13d05b
simplify pretty print (#575) 2023-07-16 14:22:46 -07:00
Yoav Farhi
5c1d46ade7
Update the actual number of results used in generating the final answer (#587)
The comment mentions 20, but it actually uses 5
2023-07-13 10:47:49 -07:00
Moiz Sajid
e4c4d3baa9
Updated README.md in examples/vector_databases (#581)
Added the links to the missing vector databases
2023-07-12 12:28:45 -07:00
Ikko Eltociear Ashimine
e983502569
Fix typo in QA_with_Langchain_AnalyticDB_and_OpenAI.ipynb (#582)
futher -> further
2023-07-12 12:28:14 -07:00
Jason M
cd62830788
Update How_to_call_functions_with_chat_models.ipynb (#545)
Updates "min" parameter to "multiplier". Should run the same.
2023-07-11 17:38:33 -07:00
liuchengshan-lcs
238ff54fce
Add getting started with PolarDB vector database and OpenAI example. (#489) 2023-07-11 17:13:26 -07:00
Douglas Blank
6d0ffe31a9
Added notebook example for visualizing embeddings in Kangas (#469)
* Added notebook example for visualizing embeddings in Kangas

Plots UMAP projection space, one per row, in open source Kangas DataGrid.

For more information about Kangas, see: https://github.com/comet-ml/kangas

* Moved notebook to third_party_examples
2023-07-11 17:11:16 -07:00
Eli
bd91363afa
Enhancements and Refactoring of Python Code Extraction Methods (#467)
* Refactor and enhance code extraction methods.

* Use f-strings to print filepaths, improving readability.
2023-07-11 17:08:37 -07:00
Ted Sanders
17858f204f
fixes token counting in translate_latex_book.ipynb (#579)
* fixes token counting in translate_latex_book.ipynb

* adds back comment
2023-07-11 17:00:38 -07:00
sun zhun
950246dd08
Update How_to_handle_rate_limits.ipynb (#554)
Replace deprecated model "code-cushman-001" with "gpt-3.5-turbo".
2023-06-29 22:23:39 -07:00
Kacper Łukawski
3ce532c03c
Refactor Qdrant notebooks (#556)
* Upgrade Qdrant to 1.3.0

* Adapt the descriptions and run the missing cells
2023-06-29 07:47:18 -07:00
colin-openai
bad59002d1
Splitting Vector Databases into individual cookbooks (#529)
* Initial commit of vector database cookbooks split out individually

* Moved notebooks to each provider's named folder and updated the README

* Removed vector DB overall cookbook in favour of individual directories
2023-06-28 01:37:01 -07:00
colin-openai
f53a22e29f
Initial commit of reranking with cross-encoder cookbook (#483)
* Initial commit of reranking with cross-encoder cookbook

* Added logit bias for Yes and No in this case

* Reran end-to-end

* Updated based on Ted's comments

* Rerun with Ted's comments
2023-06-28 00:59:23 -07:00
Filip Haltmayer
f4c67dff3c
update to token for zilliz (#552)
Signed-off-by: Filip Haltmayer <filip.haltmayer@zilliz.com>
2023-06-27 12:53:26 -07:00
prestontuggle
3170356cc2
Adds Whisper Prompting Guide (#551) 2023-06-27 14:24:26 -04:00
Elmira Ghorbani
28fef26cc9
create/check data dir for arxiv's papers (#531) 2023-06-26 03:53:55 -07:00
Michael Yuan
6798e1ca3a
Fix wget download updated parameters (#538) 2023-06-26 01:45:57 -07:00
Ted Sanders
de3bd58434
Ted/update token counting 0613 (#541)
* updates tiktoken counting function

* slight rewording

* updates ChatGPT guide with new models
2023-06-23 16:45:32 -07:00
Avery Khoo
26978e9ed1
Update How_to_count_tokens_with_tiktoken.ipynb (#511)
Add support for gpt-3.5-*-0613 models
2023-06-23 16:10:30 -07:00
Stéphane G
b587f9b3d5
Fix typo in Question_answering_using_a_search_API.ipynb (#539)
"This answer which will be used to..." --> "This answer will be used to..."
2023-06-22 16:46:08 -07:00
Simon Suo
411068e736
Add example notebook for financial document analysis with LlamaIndex (#481)
* add notebook

* add pypdf install

* move
2023-06-22 13:40:49 -07:00
Matthew
90ef0f25e5
fixed typo (#523) 2023-06-20 15:46:46 -07:00
Simón Posada Fishman
a0e7352649
Merge pull request #519 from openai/simon/search_aug
Add search augmentation notebook
2023-06-16 17:37:56 -07:00
simonpfish
af7239bfda rename image file 2023-06-16 17:37:40 -07:00
simonpfish
90863fe6d5 dummy key naming 2023-06-16 17:23:28 -07:00
simonpfish
c1946c66b7 deduplicate search results 2023-06-16 17:21:56 -07:00
Ted Sanders
38c5742ce6 renames dummy key 2023-06-16 17:03:29 -07:00
Ted Sanders
953c57af01 cleaned up notebook 2023-06-16 17:02:42 -07:00
Ted Sanders
3b37ded49c change embedding dimensions 2023-06-16 16:45:39 -07:00
Ted Sanders
6d7954806a polishes text 2023-06-16 16:37:32 -07:00
Ted Sanders
6d7f52fee5 removes extra period from et al. 2023-06-16 16:36:29 -07:00
Ted Sanders
8058562b75 changes search date to June 2023 2023-06-16 16:34:58 -07:00
Ted Sanders
9fabb7fa9f joins run-on sentence 2023-06-16 16:09:11 -07:00
Ted Sanders
224d845c0f adds missing apostrophe 2023-06-16 16:08:14 -07:00
Ted Sanders
08d2cd6732 cuts trailing spaces 2023-06-16 16:07:35 -07:00
Ted Sanders
3e997b3214 adds comment for openai package 2023-06-16 16:06:16 -07:00
Ted Sanders
a7d746a7f9 adds periods to list to be consistent with others 2023-06-16 16:03:54 -07:00
Ted Sanders
37746ff3ca rewrites intro points to be more consistent with one another 2023-06-16 16:02:01 -07:00
Ted Sanders
02833d22bb be -> feel 2023-06-16 15:48:36 -07:00
Ted Sanders
9ada754100 changes web URL to relative link 2023-06-16 15:47:18 -07:00
Ted Sanders
d6bb1fb146 the model -> GPT 2023-06-16 15:46:50 -07:00
Ted Sanders
842e71ef3a the -> an 2023-06-16 15:39:49 -07:00
Ted Sanders
dafd562811 makes title formatting consistent with other examples 2023-06-16 15:39:04 -07:00
Ted Sanders
cb0da816f9 fixes link and removes empty cell 2023-06-16 10:29:01 -07:00
colin-openai
71a2414134
Merge pull request #417 from michaelskyuan/main
Add notebook with Redis hybrid VSS queries examples
2023-06-16 08:41:40 +01:00