About the Paglo Open Source Crawler

The Paglo Open Source Crawler is a supersearcher — an agent that looks across your network for devices and other IT assets, and discovers their characteristics. The Crawler securely delivers your information to the Paglo Search Index, in a separate and unassailable location that only you have access to. You then go to your Paglo Web account to search and analyze your data. The Crawler's software footprint is small: you can install it on a single computer or server to scan your entire network.

The Crawler stores data securely

The Crawler is installed on only one computer in your network, and does not install itself on any other systems. Initially, it scans every system that it detects. After detecting every device, it continues to run, listening passively for any new devices. Whenever it discovers a new device, the Crawler immediately gathers rich data about that device and adds it to your Search Index. (Note: If your network is divided, you can use multiple Crawlers to point at the same Search Index where your data will be intelligently aggregated.

Although it runs continually, it uses fewer network and system resources after it completes its first complete run. It does not leave any footprints on the machines that it scans. By default , the Crawler rescans your network every 24 hours for any changes such as new software installed, or configuration changes. You can easily reconfigure the Crawler to gather data more often from your key systems.

The Paglo Crawler securely transfers the data that it gathers throughout your network to your Search Index, which is in a separate and unassailable location in the server that only you have access to. The amount of data that it sends is minimized, since it remembers what has previously been sent to your Index. When you log in to your Web account, you have access to all the data that's yours, and only the data that's yours. You're the only one who has access to it. Your login is the key to your data — no one else can see it unless you give them your login password or invite them to join your account.

Getting a Crawler and Web account

You can get a Paglo Crawler to collect your data, and a Paglo Web account to view your data here:

Free Paglo Crawler

Setting up your Crawler

You can install and configure a Paglo Crawler, and register a Paglo Web account in just 3 easy steps:

Using your Crawler

In the lower right corner of the Status bar, you can click the Crawler icon to run a search directly from your Crawler to query your Search Index. Results are displayed via your Paglo Web account. You can also click this icon to check the status of your Crawler, reconfigure it, and more:

Extending your Crawler

You can find out about the plugins that extend your Crawler, write your own plugins, or utilize our code to build your own Crawler: