dependabot[bot]
9cf15c76e6
Bump ipython from 8.8.0 to 8.10.0 in /apps/web-crawl-q-and-a ( #707 )
...
Bumps [ipython](https://github.com/ipython/ipython ) from 8.8.0 to 8.10.0.
- [Release notes](https://github.com/ipython/ipython/releases )
- [Commits](https://github.com/ipython/ipython/compare/8.8.0...8.10.0 )
---
updated-dependencies:
- dependency-name: ipython
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:45:35 -07:00
dependabot[bot]
0a5948add2
Bump certifi from 2022.12.7 to 2023.7.22 in /apps/web-crawl-q-and-a ( #693 )
...
Bumps [certifi](https://github.com/certifi/python-certifi ) from 2022.12.7 to 2023.7.22.
- [Commits](https://github.com/certifi/python-certifi/compare/2022.12.07...2023.07.22 )
---
updated-dependencies:
- dependency-name: certifi
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:44:37 -07:00
dependabot[bot]
17446f97ab
Bump pygments from 2.14.0 to 2.15.0 in /apps/web-crawl-q-and-a ( #699 )
...
Bumps [pygments](https://github.com/pygments/pygments ) from 2.14.0 to 2.15.0.
- [Release notes](https://github.com/pygments/pygments/releases )
- [Changelog](https://github.com/pygments/pygments/blob/master/CHANGES )
- [Commits](https://github.com/pygments/pygments/compare/2.14.0...2.15.0 )
---
updated-dependencies:
- dependency-name: pygments
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:44:14 -07:00
dependabot[bot]
623f500905
Bump aiohttp from 3.8.3 to 3.8.5 in /apps/web-crawl-q-and-a ( #696 )
...
Bumps [aiohttp](https://github.com/aio-libs/aiohttp ) from 3.8.3 to 3.8.5.
- [Release notes](https://github.com/aio-libs/aiohttp/releases )
- [Changelog](https://github.com/aio-libs/aiohttp/blob/v3.8.5/CHANGES.rst )
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.8.3...v3.8.5 )
---
updated-dependencies:
- dependency-name: aiohttp
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:44:01 -07:00
dependabot[bot]
e4e8121e12
Bump requests from 2.28.1 to 2.31.0 in /apps/web-crawl-q-and-a ( #706 )
...
Bumps [requests](https://github.com/psf/requests ) from 2.28.1 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases )
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md )
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.31.0 )
---
updated-dependencies:
- dependency-name: requests
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:43:04 -07:00
dependabot[bot]
fc1860fa89
Bump transformers from 4.25.1 to 4.30.0 in /apps/web-crawl-q-and-a ( #704 )
...
Bumps [transformers](https://github.com/huggingface/transformers ) from 4.25.1 to 4.30.0.
- [Release notes](https://github.com/huggingface/transformers/releases )
- [Commits](https://github.com/huggingface/transformers/compare/v4.25.1...v4.30.0 )
---
updated-dependencies:
- dependency-name: transformers
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:42:17 -07:00
dependabot[bot]
3df3ab3df8
Bump pipreqs from 0.4.11 to 0.4.12 in /apps/web-crawl-q-and-a ( #703 )
...
Bumps [pipreqs](https://github.com/bndr/pipreqs ) from 0.4.11 to 0.4.12.
- [Release notes](https://github.com/bndr/pipreqs/releases )
- [Changelog](https://github.com/bndr/pipreqs/blob/master/HISTORY.rst )
- [Commits](https://github.com/bndr/pipreqs/compare/v0.4.11...v0.4.12 )
---
updated-dependencies:
- dependency-name: pipreqs
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:41:47 -07:00
dependabot[bot]
1d4fe3c70e
Bump tornado from 6.3.2 to 6.3.3 in /apps/web-crawl-q-and-a ( #694 )
...
Bumps [tornado](https://github.com/tornadoweb/tornado ) from 6.3.2 to 6.3.3.
- [Changelog](https://github.com/tornadoweb/tornado/blob/master/docs/releases.rst )
- [Commits](https://github.com/tornadoweb/tornado/compare/v6.3.2...v6.3.3 )
---
updated-dependencies:
- dependency-name: tornado
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:41:38 -07:00
dependabot[bot]
0f7d648975
Bump tornado from 6.2 to 6.3.2 in /apps/web-crawl-q-and-a ( #459 )
...
Bumps [tornado](https://github.com/tornadoweb/tornado ) from 6.2 to 6.3.2.
- [Changelog](https://github.com/tornadoweb/tornado/blob/master/docs/releases.rst )
- [Commits](https://github.com/tornadoweb/tornado/compare/v6.2.0...v6.3.2 )
---
updated-dependencies:
- dependency-name: tornado
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:05:37 -07:00
DevilsWorkShop
39b62a6c09
Catch the exception thrown by the With.Open and continue with the queue ( #155 )
...
Co-authored-by: Ashok Manghat <amanghat@rmplc.net>
2023-09-11 15:55:57 -07:00
ys64
7cda7e2df7
add the last chunk to the list of chunks in web-qa.ipynb ( #691 )
2023-09-11 14:54:40 -07:00
Simón Fishman
b2ca4d395c
Revert "File name sanitization ( #630 )" ( #668 )
...
This reverts commit 169f5e02c8 .
2023-08-29 17:45:47 -07:00
Safa Asgar
169f5e02c8
File name sanitization ( #630 )
...
* File name sanitization
URL containing reserved characters blocks file name creation.
* Regular Expression fix for Sanitized URL
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
---------
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-08-29 10:49:23 -07:00
Tomas Dulka
4fd2b1a6d2
replace eval with safer literal_eval ( #561 )
2023-07-17 16:40:54 -07:00
Darshan Panchal
e66613331a
Update requirements.txt
...
removed html since it was not required
2023-05-11 09:21:34 +05:30
Alexander Khapaev
ee9b6268d4
Updated the get_domain_hyperlinks function to include handling of tel: links in addition to mailto: links, to exclude them from the clean links list.
2023-04-07 18:28:44 +03:00
fabiofranco85
5a80ef2571
Improve regex
2023-03-27 07:38:35 -03:00
William Buck
ca9b9d485d
remove duplicate import of distances_from_embeddings
2023-03-20 13:02:37 -07:00
Sung Kim
3210b38e35
Add handling for last chunk in split_into_sentences function
...
I have added handling for the last chunk in the split_into_sentences function. Previously, the function did not account for the last chunk, which could lead to incomplete sentences in the output.
To solve this, I added a conditional statement to check if the last chunk is non-empty. If it is, I append it to the list of chunks with a period to ensure the last sentence is complete.
This change improves the accuracy of the split_into_sentences function and ensures that all sentences in the input text are properly segmented. Please review and let me know if you have any feedback or concerns.
2023-02-19 11:00:27 +09:00
Logan Kilpatrick
3826607431
Add comment on where to learn about rate limits
2023-02-17 06:16:14 -06:00
Daniel Zhukovsky
be9877edbf
Redefinition of unused 'pd'
2023-02-16 15:05:04 +00:00
isafulf
daf8e0d011
rename web crawl q and a
2023-02-11 16:37:29 -08:00