Installation &Launch
Installer won’t run or “Windows protected your PC”
Problem:
While installing the app,Windows displays the following message:“Unknown publisher” or “Windows protected your PC”.
Solution:It doesn't mean the app is dangerous. Choose the official website KWT Spider. For which,click 'More Info' and then 'Run anyway' to install.
Antivirus blocks the app or installer
Problem:
The antivirus app may delete the installer,block the .exe file,and stop the app from opening. The app may look broken.
Solution:It is a common phenomenon. The solution is to add the KWT Spider installation folder to your antivirus exclusion list or turn the antivirus app off during installation.
Installation asks for administrator / “Access denied”
Problem:
During installation,you may notice access denied,permission from administrator,or run as administrator message. It occurs because you want to put files into a protected folder.
Solution:The solution for "run as administrator" is to right-click the installer file,select 'Run as administrator' and then Yes tab. The second option to install in your user folder,select a custom installation location and then choose a folder inside your user account.
App won’t start after install (no window,crash on launch)
Problem:
After installation,you click twice but the app doesn't open and an error message appears.
Solution:The program may not be starting completely. It doesn't mean the app is broken. For this,check the Windows version — 10,11,or 64-bit. Check the app requirements. If you notice .Net or runtime error,download the official installer from the website. Run the app as an admin. You can reinstall the app.
“Do I need Python / .NET?”
Problem:
Doubts about installation of extra apps like Python or .NET.
Solution:No,it doesn't need.
Licence &Activation
“License key not found” or activation failed
Problem:
After entering the licence key,the activation process fails.
Solution:Copy the key again without extra spaces,check the internet connection and firewall. If all the steps fail,contact us.
Export / Save / Compare / Sitemaps still disabled after activation
Problem:
The licence is activated but save session is not working,export option is greyed out,compare feature is disabled or Sitemap features are unavailable.
Solution:In this situation,restart the app,confirm the licence status (must be activated),re-enter the license key. In case,the status displays activated but features are not working. It may be due to technical issues.
Want to use the same licence on another PC
Problem:
You want to use the same license on another system,but the app fails to activate on another system.
Solution:The individual version allows one licence and one machine. In this situation,connect with our team. We may provide you with another key to activate the same license in the new system. Keep the key private.
Crawling
Crawl stops early (few URLs crawled)
Problem:
The crawl process stops early. For example,the site has thousands of pages but it crawls.
Solution:Increase the crawl limit through Configuration → Crawl Limits and increase max URLs and/or max depth. Use deep crawl preset — go to Configuration → Crawl Preset → Deep. Check the robots.txt — Configuration → Respect robots.txt — If the site has prevented some pages to be crawled,the tool will not crawl those pages.
App is slow or freezes during a large crawl
Problem:
While crawling is large,the app freezes or becomes slow.
Solution:For heavy crawling,consumption of RAM and CPU will be higher. The solution is shut down other apps. Ensure the RAM is at least 4 GB or 8 GB. Deep preset is recommended for large websites and the system with enough RAM. Reduce the crawl limit if the crawl is unnecessarily large.
No URLs discovered (Spider mode)
Problem:
As you start a crawl in Spider mode,you notice a few pages or no URL appears.
Solution:It may be due to incorrect URL. Click Configuration,then Respect robots.txt to ensure it is not blocking anything. Change the configuration. For which,go to Configuration and then User Agent to Googlebot or Default. Check the HTTP status for 403/429/5xx. If the site uses heavy JavaScript for links,the crawler may not execute JS. Here,use the other URLs that you have.
Many timeouts or connection errors
Problem:
Several pages fail to open and display "Timeout or Connection Failed" message.
Solution:The website might be slow. For this,access Configuration then the Speed option to increase timeout value and reduce the crawl speed. Establish the internet connection. Turn off the VPN and try again or set up a proxy.
Crawl Limits or Deep preset greyed out
Problem:
Fail to change the crawl limits or the Deep preset option is not clickable.
Solution:Convert the demo version into full version to increase the crawl limits.
Export &Reports
Export or “Generate report” is disabled (greyed out)
Problem:
Export All URLs,File → Export Issues Report,Bulk Export,or Generate HTML Report are not clickable.
Solution:Convert demo version into full version and restart the app to activate the features. If it is not yet activated,talk to the customer support team.
Export fails (error when saving file)
Problem:
While trying to export a CSV/Excel/HTML file,an error appears or the file is not created.
Solution:Try to save the file to a normal folder like desktop instead of program files or protected locations. Confirm the storage. Keep the file path shorter. Before exporting,close the file. RAM memory must be 8 or more GB if crawl is large.
Excel export not working or “Excel not found”
Problem:
When you try to export to .xlsx format,the export process is incomplete or the message 'Excel is not found' appears.
Solution:KWT Spider automatically creates .xlsx files without MS Excel installation. You should try to export in CSV format. Update the app. If the problem has not fixed,you can use the CSV format for now.
Save / Load Crawl Session
Save Crawl Session or Load Crawl Session is disabled
Problem:
In the File menu,the Save Crawl Session or Load Crawl Session is not working.
Solution:It means,you are using the demo version. The solution is to choose the full licensed version.
Loaded session is empty or shows wrong data
Problem:
As you click the Load Crawl Session,you notice empty tabs or incorrect data.
Solution:Confirm the app version you are using currently. The session file may be in the older app version or corrupted. Load a session with the current version. Avoid renaming or editing the session files. Try the backup file. If nothing works,save a new session file or run the crawl again.
Cannot open session file (error on load)
Problem:
When you access a saved Crawl Session — the file is unable to open or an error message appear.
Solution:Confirm first that the file you want to open is created by this app. Don't rename or change the location of the file. Access the file from your local system and don't use network drives or shared folders. Confirm the version and when the session was created. If the session is old,create a new session in the current version.
Performance &UI
UI is slow when scrolling or switching tabs
Problem:
After crawling a large website,the scrolling process and the grid response may get slow.
Solution:The process involves closing all the programs and check the speed settings. For which,in Configuration → Speed (if available). It is to reduce the crawl load. Next,restart the app and save the session. Again,open the app and load the saved session. Ensure to have enough RAM and better CPU performance.
Layout / panels messed up or missing
Problem:
Bottom panel,grid or side bar is missing.
Solution:For this,go to View → Show Report Sidebar to notice the sidebar. In View,hide the bottom details. Once again in View → Reset the layout.