You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the AI Web Scraper (/GenAI/AiWebScraper) does not keep a log of the URLs it visits while retrieving information. To enhance verifiability and allow for a review of the sources, implement a feature that logs all visited URLs in a separate file.
Feature Requirements
Save each visited URL in a .txt or .csv file with a timestamp.
Ensure that duplicate URLs are not logged if they are visited more than once per session.
Log file should be stored within a logs or data subfolder inside the GenAI/AiWebScraper directory.
Acceptance Criteria
The feature successfully saves each unique URL visited during a session to the designated log file.
The log file is easy to read and structured for future reference.
Documentation for this feature is added to the README, explaining the purpose and file location for logged URLs.
The text was updated successfully, but these errors were encountered:
Description
Currently, the AI Web Scraper (/GenAI/AiWebScraper) does not keep a log of the URLs it visits while retrieving information. To enhance verifiability and allow for a review of the sources, implement a feature that logs all visited URLs in a separate file.
Feature Requirements
Acceptance Criteria
The text was updated successfully, but these errors were encountered: