admin-valentin/openai-cookbook
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

add the last chunk to the list of chunks in web-qa.ipynb (#691)

Browse source
This commit is contained in:
ys64 2023-09-11 14:54:40 -07:00 committed by GitHub
parent 5783656852
commit 7cda7e2df7
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
apps/web-crawl-q-and-a/web-qa.ipynb
View file

@ -780,6 +780,10 @@
" chunk.append(sentence)\n", " chunk.append(sentence)\n",
" tokens_so_far += token + 1\n", " tokens_so_far += token + 1\n",
"\n", "\n",
" # Add the last chunk to the list of chunks\n",
" if chunk:\n",
" chunks.append(\". \".join(chunk) + \".\")\n",
"\n",
" return chunks\n", " return chunks\n",
" \n", " \n",
"\n", "\n",