FAQ
My News Crawler: News Aggregator
Frequently Asked Questions
- Do I need programming experience to have my own MyNewsCrawler powered page?
You don’t. Of course, if you have that kind of experience, that may help you a lot.
If you have worked with CSS or HTML before, it should be easy for you to change the appearance of one of our templates or re-arrange the content.
We even offer to adapt the script to your favorite template.
- Can content from different RSS sources be merged and then shown in categories.
Yes, you can define categories that use all your sources or just a subset of them. You filter content that is relevant to you by assigning keywords to categories and feeds. Our boolean search algorithm does the rest.
- How often can be crawled from one specific site?
No general rule availalbe here. You should read the site’s policies for any restrictions.
MyNewsCrawler allows source specific crawl intervals so you can crawl frequenlty updating sites more often than others.
Use the “crawl now” functionality and “recently added articles” to adapt your crawl intervals. Helps saving bandwidth and server load without violation of site specific policies.
- How to filter out relevant content / improve signal to noise ration
Actually, this task is up to you. Your creativity in selecting the appropiate filters will ultimately define the success of your site. MyNewsCrawler offers you the tools you need to achieve your goal.
Define your keyword filters in categories and feeds according to the rules that mySQL establishes.
See this page for a complete description of how to get the most out of mySQL boolean fulltext search:
mySQL boolean fulltext search