admin-valentin/openai-cookbook
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Updated the get_domain_hyperlinks function to include handling of tel: links in addition to mailto: links, to exclude them from the clean links list.

Browse source
This commit is contained in:
Alexander Khapaev 2023-04-07 18:28:44 +03:00
parent 1deea48511
commit ee9b6268d4
1 changed files with 5 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
apps/web-crawl-q-and-a/web-qa.py
View file

@ -87,7 +87,11 @@ def get_domain_hyperlinks(local_domain, url):
else: else:
if link.startswith("/"): if link.startswith("/"):
link = link[1:] link = link[1:]
elif link.startswith("#") or link.startswith("mailto:"): elif (
link.startswith("#")
or link.startswith("mailto:")
or link.startswith("tel:")
):
continue continue
clean_link = "https://" + local_domain + "/" + link clean_link = "https://" + local_domain + "/" + link