Skip to content

Sub-page requesting - Requesting valid URLs #5

@jjackson37

Description

@jjackson37

After the intial homepage has been parsed and we have all the valid URLs from that page then we need to also ping these URLs and find the URLs found on them and so on.
This will mean that the main process should be moved into some sort of process that can be looped upon so we can re-run all the extraction and filtering for the sub-pages.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions