Commit graph

144 commits

Author SHA1 Message Date
LUIS NOVO
532e606a49 add parallel processing to embed 2024-11-11 18:16:42 -03:00
LUIS NOVO
817b1bc7f9 add initial embedding to the content graph 2024-11-11 17:47:50 -03:00
LUIS NOVO
01cf15e7d1 add check 2024-11-11 17:33:28 -03:00
LUIS NOVO
00f070a644 add async content processing 2024-11-11 17:32:35 -03:00
LUIS NOVO
ac2ea9e554 add x.ai support 2024-11-11 16:49:50 -03:00
LUIS NOVO
2e2a4947b3 separate source and content graph 2024-11-10 13:30:03 -03:00
LUIS NOVO
66edfc1e2b create record if doesnt exist 2024-11-10 13:27:30 -03:00
LUIS NOVO
d5be2b0d5b make rag async 2024-11-09 16:03:41 -03:00
LUIS NOVO
e589c7b8aa cleanup 2024-11-08 18:30:56 -03:00
LUIS NOVO
dc76d6b8d8 enable different text models for podcast 2024-11-08 18:29:51 -03:00
LUIS NOVO
183149014e change model provisioning parameters 2024-11-08 16:08:54 -03:00
LUIS NOVO
99b8ada280 new ask model strategy 2024-11-08 16:08:13 -03:00
LUIS NOVO
53da255801 improve search 2024-11-08 16:07:51 -03:00
LUIS NOVO
7978833473 enable gemini text to speech model for podcast generation 2024-11-07 19:45:56 -03:00
LUIS NOVO
3ea4e41a78 improve citations and add object page 2024-11-05 16:55:59 -03:00
LUIS NOVO
0f2216207b enable multiple chat sessions 2024-11-04 15:08:14 -03:00
LUIS NOVO
3be1ecae8a improve text splitter 2024-11-04 15:06:13 -03:00
LUIS NOVO
418c67f69f add search and rag functions in beta 2024-11-04 09:53:49 -03:00
LUIS NOVO
56e745d668 improve search functions 2024-11-04 09:53:09 -03:00
LUIS NOVO
8398539df8 add hybrid search to combine text and vector searches 2024-11-04 09:51:20 -03:00
LUIS NOVO
62cd5a9dfb add concept of tools model 2024-11-04 09:50:15 -03:00
LUIS NOVO
1f23ba5490 add autoload to recordmodel 2024-11-04 09:49:45 -03:00
LUIS NOVO
b4ba3ef4c8 change model provisioning strategy 2024-11-04 09:49:11 -03:00
LUIS NOVO
d9c0c93deb improved typing 2024-11-01 22:50:27 -03:00
LUIS NOVO
7dc37a3ac7 model fixes 2024-11-01 22:43:33 -03:00
LUIS NOVO
223f1bdaf5 improve default_models 2024-11-01 22:38:21 -03:00
LUIS NOVO
212d3a33b0 improve object typing 2024-11-01 22:29:59 -03:00
LUIS NOVO
3b36caceb9 typing fixes 2024-11-01 21:40:28 -03:00
LUIS NOVO
15048b0839 simplify model provisioning 2024-11-01 21:32:40 -03:00
LUIS NOVO
3b262a63f4 better model mgmt 2024-11-01 21:11:23 -03:00
LUIS NOVO
8734b1803c mm 2024-11-01 20:37:38 -03:00
LUIS NOVO
a9ac4a6dc8 model manager 2024-11-01 20:37:23 -03:00
LUIS NOVO
3b7dd5f25f remove load_default_models from models file 2024-11-01 20:16:34 -03:00
LUIS NOVO
feabfaed01 remove defaultmodel from config file 2024-11-01 19:56:27 -03:00
LUIS NOVO
a24faaba44 moved toc to a pattern 2024-11-01 19:08:47 -03:00
LUIS NOVO
edf839cd1b unused graphs 2024-11-01 19:08:33 -03:00
LUIS NOVO
0d4d9473b2 add transformation playground with model selection 2024-11-01 17:17:19 -03:00
LUIS NOVO
b89250d3ca temporary fix to config cache 2024-11-01 17:06:10 -03:00
LUIS NOVO
796012f716 rename to patterns 2024-11-01 13:08:18 -03:00
LUIS NOVO
3e11d9ba68 fix date parsing for save 2024-11-01 12:38:17 -03:00
LUIS NOVO
0876e94658 transformation folder change 2024-11-01 12:36:59 -03:00
LUIS NOVO
c65bf8ba12 rename model_name to model_id 2024-11-01 12:07:00 -03:00
LUIS NOVO
2f2cdabd2d Fix issue with model defaults and bump version 2024-10-30 18:28:29 -03:00
LUIS NOVO
68cd7d7dda setup text to speech models in Podcasts 2024-10-30 17:17:16 -03:00
LUIS NOVO
9390ea82f2 cleanup todos 2024-10-30 17:16:06 -03:00
LUIS NOVO
2de8520d0c refactor database module and migrations 2024-10-30 16:33:07 -03:00
LUIS NOVO
2aa453f73f enable support for large context fallback 2024-10-30 15:39:45 -03:00
LUIS NOVO
f64897fbf8 support ollama, vertex and gemini embedding models 2024-10-30 15:19:16 -03:00
LUIS NOVO
99f177044f prevent users from picking a model type not supported by the provider 2024-10-30 14:44:48 -03:00
LUIS NOVO
aca75221a7 remove optional model get 2024-10-30 14:36:59 -03:00
LUIS NOVO
859b7f6e7e simplify the model selector 2024-10-30 14:30:29 -03:00
LUIS NOVO
8bb5db158f implement model config 2024-10-30 14:09:24 -03:00
LUIS NOVO
63a568490e refactor domain into a module 2024-10-30 14:08:05 -03:00
LUIS NOVO
a66a8636fe add ordering and change date strategy 2024-10-29 10:42:41 -03:00
LUIS NOVO
70926afce6 fix issue with special spaces 2024-10-29 07:28:02 -03:00
LUIS NOVO
ab9824ebed default to bs4 for url processing 2024-10-28 16:32:38 -03:00
LUIS NOVO
ba4b8ad0f7 reorg content 2024-10-28 16:32:27 -03:00
LUIS NOVO
1f0c9c44b3 reorg content 2024-10-28 16:32:20 -03:00
LUIS NOVO
42b9b2da07 cleanup logs 2024-10-28 16:32:06 -03:00
LUIS NOVO
a2123d03b0 add office support 2024-10-28 16:31:43 -03:00
LUIS NOVO
432cfda5da add epub support 2024-10-28 16:31:35 -03:00
LUIS NOVO
669891617b reorg content graph 2024-10-28 16:31:22 -03:00
LUIS NOVO
3f997aa22c improve yt transcript and title 2024-10-28 16:30:39 -03:00
LUIS NOVO
1515507993 fix issue with pydantic date conversion 2024-10-28 09:21:53 -03:00
LUIS NOVO
424cb8b16a rename repo and add upgrade version check 2024-10-28 09:21:39 -03:00
LUIS NOVO
790d59547b improve handling of bad content types 2024-10-27 17:26:56 -03:00
LUIS NOVO
7ba43f25fa cleaning up logs 2024-10-26 18:56:28 -03:00
LUIS NOVO
1ecc7af0be aplit audio to prevent OpenAI limit 2024-10-26 18:56:21 -03:00
LUIS NOVO
8dac6dd2ac improve object validation 2024-10-26 18:55:56 -03:00
LUIS NOVO
1002c6b4eb organize data folders 2024-10-26 18:54:54 -03:00
LUIS NOVO
86eb9d7440 increase max_size to support larger files 2024-10-26 16:10:51 -03:00
LUIS NOVO
74f3e759ee add english as main default transcript language 2024-10-26 05:51:19 -03:00
LUIS NOVO
aaa7831ab1 add gemini support 2024-10-26 05:41:06 -03:00
LUIS NOVO
01f8eab10e add podcast support 2024-10-26 05:17:58 -03:00
LUIS NOVO
39fe547e61 Merge branch 'main' of github.com:lfnovo/open_notebook into podcastfy 2024-10-25 08:23:36 -03:00
LUIS NOVO
4f30f59382 fix encoding errors on content creation 2024-10-25 08:16:00 -03:00
LUIS NOVO
375b7dc56b archive notebooks, delete source artifacts and confirm before delete sources 2024-10-24 17:19:22 -03:00
LUIS NOVO
53d86e2e16 configurable language files 2024-10-24 16:45:12 -03:00
LUIS NOVO
6df77c5b92 add yaml config file mvp 2024-10-24 16:42:40 -03:00
LUIS NOVO
2f63cea105 edit note title and show delete warning 2024-10-24 16:30:28 -03:00
LUIS NOVO
8a5803a21a better title acquisition 2024-10-24 15:53:03 -03:00
LUIS NOVO
177d2c2b93 WIP: podcast feature 2024-10-24 13:25:01 -03:00
LUIS NOVO
10ec265a44 fix pdf encoding 2024-10-24 13:24:39 -03:00
LUIS NOVO
c3f3c9cb93 update docs to new release info 2024-10-23 15:40:28 -03:00
LUIS NOVO
9b9303d52f process table of contents for all sources 2024-10-23 15:09:40 -03:00
LUIS NOVO
795fd3bb9d improve surreal escaping 2024-10-23 14:13:22 -03:00
LUIS NOVO
02ff05b6fd v1 of transformations 2024-10-23 10:59:05 -03:00
LUIS NOVO
e020511876 replace surreal sdk with surreal-lite until they support v2 2024-10-23 10:58:21 -03:00
LUIS NOVO
5b1033fc11 . 2024-10-22 22:26:00 -03:00
LUIS NOVO
9042b08ae3 add model router and improve prompts 2024-10-22 18:24:24 -03:00
LUIS NOVO
f96fc580b3 make doc_query tool name consistent with prompt 2024-10-22 16:45:08 -03:00
LUIS NOVO
93f766f40d add support for vertex, anthropic, litellm, ollama and open router 2024-10-22 16:41:20 -03:00
LUIS NOVO
809ecb45e1 rename doc_query tool 2024-10-22 16:36:21 -03:00
LUIS NOVO
bcd260a28b Initial commit with all features 2024-10-21 14:56:10 -03:00