This repository has been archived by the owner on Sep 12, 2024. It is now read-only.
Reading links in an endless loop #136
-
|
|
Beta Was this translation helpful? Give feedback.
Answered by
SeeknnDestroy
Nov 8, 2023
Replies: 1 comment
-
|
Hello @seoeaa, It is expected to take long time to parse all of the URL's with child uri's that your provided website has. If you want to only parse the provided website but not child links that website has, please use our WebPageReader class instead: from autollm.utils.web_page_reader import WebPageReader
reader = WebPageReader()
documents = reader.load_data('http://example.com/some-page') |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
SeeknnDestroy
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hello @seoeaa,
It is expected to take long time to parse all of the URL's with child uri's that your provided website has. If you want to only parse the provided website but not child links that website has, please use our WebPageReader class instead: