Twitter follower   Facebook follower   YouTube follower
 
  
     

Please share posts you like!
 

Author Topic: exlude/filter link  (Read 537 times)

sonosail

  • Newbie
  • *
  • Posts: 4
  • Karma: +0/-0
    • View Profile
exlude/filter link
« on: July 12, 2010, 01:52:48 PM »
My site has many page references that I wish to exclude from the crawl. Like http://mysite.com/mypage.asp?page=2.
So I would like to exclude any link that contains   ?page=   .  I've tried it a number of ways but can't manage to get to work.

I can't imagine that this would involve anthing to do with regex.  Just a simple string match. 

Thanks in advance.

Randy Browning

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • Posts: 563
  • Karma: +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: exlude/filter link
« Reply #1 on: July 12, 2010, 07:26:51 PM »
Hi,

You probably already have, but check the output filters help :: Do Not List URLs That Match Paths / Strings / Regex

(Also make sure you disable easy sitemap generator mode so you can see all the options.)


Have you tried adding:
Code: [Select]
:mypage.asp?page= (with the colon in front for a "path match")
?

Actually
Code: [Select]
?page= should work as well since that makes a "string/text match".

If it does not work, please email me with your website address, and I will be happy to create a project file for you!

sonosail

  • Newbie
  • *
  • Posts: 4
  • Karma: +0/-0
    • View Profile
Re: exlude/filter link
« Reply #2 on: July 13, 2010, 12:42:07 PM »
Easy mode is off.  I see where it should be entered. Syntax just never seemed to right or something.  Let me give your suggestion a try.

Thanks very much.

Randy Browning

Webhelpforums

  • Administrator
  • Hero Member
  • *****
  • Posts: 563
  • Karma: +6/-0
  • Shared between Microsys, WebHelpForums and helpers
    • View Profile
    • Webmaster and Website Help Forums
Re: exlude/filter link
« Reply #3 on: July 14, 2010, 10:42:12 AM »
In the article I linked arlier, there's also a demo project you can try that demonstrates output exclude filters using both regular expressions, string/text match and path match! :)

sonosail

  • Newbie
  • *
  • Posts: 4
  • Karma: +0/-0
    • View Profile
Re: exlude/filter link
« Reply #4 on: July 14, 2010, 12:54:45 PM »
Saw the file but haven't tried it. I'll load it and take a look.
Thanks again.

Randy Browning