Crawler policy · Updated September 4, 2026

Search is welcome. Private data is not crawlable.

FIUND permits conventional search indexing and answer-engine retrieval of public editorial and company pages. Contributor accounts, licensed deliveries, and API routes are excluded. Model-training crawlers receive narrower access to proprietary catalog, diligence, and downloadable research materials.

Public search and answer retrieval

Public pages may be indexed and retrieved by search and answer engines, including their user-initiated retrieval agents, subject to the published robots.txt. A citation or crawl does not grant a licence to the underlying media described on a page.

Model-training access

Named model-training crawlers may access general public company and editorial content but are excluded from catalog detail routes, diligence downloads, and the downloadable licensing index. This separates discoverability from permission to ingest FIUND’s proprietary structured materials.

Never public or crawlable

Contributor portal pages, administrative routes, signed-delivery pages, API endpoints, source media, contracts, participant records, and buyer-specific diligence material are not public web content. Authentication and access controls remain the enforcement boundary; robots rules are an additional instruction, not a security mechanism.

Confidential relationships

FIUND does not publish customer, supplier, contributor, partner, prospect, participant, contract, pricing, show, episode, file-name, or storage-path identities for discovery or answer-engine optimization. Public catalog pages use aggregates. Companies in FIUND market research are drawn only from cited public reporting and their appearance does not imply a relationship with FIUND.

Licensing

Search indexing, answer retrieval, and page access do not authorize AI training on licensed datasets or grant rights in contributor content. For data rights, use the diligence process and governing buyer licence.