Please read this crawl policy ("policy", "bot policy") to understand how our automated system (the "crawler", "bot") operated by NativityWeb SRL ("we", "our", "us") behaves when accessing publicly available websites.

Policy Overview

Our bot accesses publicly available information on the internet for informational and indexing purposes only. This document outlines how we operate, what we respect, and what we avoid. It is not a request for permission, but a statement of our crawling standards.

Respect for robots.txt

Our bot fully respects the /robots.txt standard. If access to any section of a website is disallowed via robots.txt, our bot will not access it under any circumstance.

Identification

Every request made by our bot includes a clear and identifiable User-Agent string. This string includes the name of the bot, version number, and a link to this policy. ex: NativityWebServer/1.0 (compatible; NWRobot/1.0; +https://nativityweb.com/terms/robots)

Request Frequency

We crawl responsibly. Our bot sends requests at a controlled and polite rate, typically no more than one request per day crawling your domain. We do not perform aggressive or concurrent crawling that could affect server stability.

Scope of Crawling

Our bot only accesses publicly available pages that do not require login, authentication, or consent. We do not attempt to bypass access restrictions, forms, or technical controls. We avoid crawling pages with query parameters that may lead to duplicate or infinite loops.

Data Usage

Data collected is used internally for research, indexing, or enhancement of services provided by NativityWeb SRL. We do not store or redistribute personal data, and we do not use scraped content for commercial resale or competitive analysis.

Right to Withdraw

If a website owner wishes to prevent access by our crawler, they can simply disallow it via /robots.txt. We regularly check and immediately comply with such directives. No additional contact is required.

Policy Updates

We may update this policy from time to time to reflect improvements in our crawler’s behavior or changes in best practices. Continued operation of the bot reflects the most recent version of this policy.

Contact

If you have any questions or concerns about our crawling behavior, please contact us at [depustal@gmail.com].