New to RapidMiner and hope someone can assist. I have a starting URL as such for web crawling:http://www.domain.com/search?attrs=&cflt=restaurants&find_desc=&find_loc=bigcity&rpp=40&start=100
follow_link_with_matching_url = .*dig.*
have also tried: follow_link_with_matching_url = .*+dig+.* and also .+dig.+
have tried it with all of the four rule applications and nothing is returned.
the link to access looks like this with copy and paste as text:http://www.domain.com/dig/hoopla
I know that the text "dig" is contained in the links I wish to access. I have copied and pasted the inspect element copy as html below, as well as copied and pasted the inspect element copy as xpath below for help (I would prefer to use xpath in regex but don't know how to use that with using rapidminer to select web data):
<a id="digLinkabc" href="/dig/hoopla">abc. Dig</a>