<p class="lead" align="left">
Keyword/Phrase Filtering System (bad words)
</p>
<p align="left">
There is one (1) filter file for removing bad words and phrases, such as
adult oriented material. The primary bad word file is
wcb/linkslib/new_badwords.txt and contains 1 word/phrase per line. This
is used by the harvester, scraper, Reseller Club API and Wordze.com
API. This filters phrases out of scraped phrases and keyword phrases
from the Wordze.com API. Even though the Wordze.com API has built-in
filtering, it should not be relied upon for 100% filtering. The filter
file provides a way for you to customize filtering by adding variations
of keywords and phrases to be filtered. This system uses exact matching
anywhere within the phrase or you can specify wildcards. To use a
wildcard the first character on the line must be a colon : and then use
the % symbol for the wildcard. Examples: :gay%m%n
This would match gayman, gaymen, gay man, gay men, gay-man, gay-men,
etc.
:%xx%
This would match a large number of phrases containing any variation of
sexx, sexxy, xx, xxx, xxxx, etc.
</p>
<p>
There is also a redundant system built-in to the site side page generator
named wcb/asgen/templates/Template_name/_sitefiles/scripts/filters.txt
and should contain the same contents as the new_badwords.txt file
without the wildcards. The wildcards are not used on the site side to
increase cronjob speed and efficiency, so you should try to ensure the
primary filter file contains everything you want to filter.
</p>
<p>
The Reseller Club (registrar) API system uses the filter to prevent
inadvertent registration of domains that contain any of the bad words.
</p>
Note: The bad words file can be used to filter any text including names, company names, trademarks, etc.
