# As a condition of accessing this website, you agree to abide by the following # content signals: # (a) If a Content-Signal = yes, you may collect content for the corresponding # use. # (b) If a Content-Signal = no, you may not collect content for the # corresponding use. # (c) If the website operator does not include a Content-Signal for a # corresponding use, the website operator neither grants nor restricts # permission via Content-Signal with respect to the corresponding use. # The content signals and their meanings are: # search: building a search index and providing search results (e.g., returning # hyperlinks and short excerpts from your website's contents). Search does not # include providing AI-generated search summaries. # ai-input: inputting content into one or more AI models (e.g., retrieval # augmented generation, grounding, or other real-time taking of content for # generative AI search answers). # ai-train: training or fine-tuning AI models. # use: how AI systems may consume the content (immediate, reference, or full). # ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF # RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT # AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET. # BEGIN Cloudflare Managed content User-agent: * Content-Signal: search=yes,ai-train=no,use=reference Allow: / # Training crawlers User-agent: Amazonbot Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Diffbot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: omgili Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: cohere-ai Disallow: / User-agent: MistralAI-Training Disallow: / User-agent: meta-externalagent Disallow: / User-agent: GoogleOther Disallow: / User-agent: Baiduspider Disallow: / User-agent: PetalBot Disallow: / User-agent: AwarioSmartBot User-agent: AwarioRssBot Disallow: / User-agent: Google-CloudVertexBot Disallow: / User-agent: QualifiedBot Disallow: / User-agent: Cotoyogi Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: atlassian-bot Disallow: / User-agent: FishBot Disallow: / User-agent: BorderxBot Disallow: / User-agent: NavuBot Disallow: / User-agent: SemrushBot-SWA Disallow: / User-agent: WARDBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: KimiBot Disallow: / User-agent: CitibotSiteCrawler Disallow: / # END Cloudflare Managed Content # danbit.no robots.txt, opdateret 17.11.2026. Serveres via .htaccess-blokken danbit-seo (hvert domæne sin egen fil). User-agent: * # ALLOW essential assets (PS8 needs JS/CSS to render pages correctly) Allow: /modules/*.css Allow: /modules/*.js Allow: /modules/*.png Allow: /modules/*.jpg Allow: /modules/*.svg Allow: /modules/*.webp Allow: /js/*.js Allow: /js/*.css Allow: /themes/*.css Allow: /themes/*.js Allow: /img/*.jpg Allow: /img/*.png Allow: /img/*.svg Allow: /img/*.webp # BLOCK only dangerous or private pages Disallow: */login Disallow: */cart Disallow: */order Disallow: */my-account Disallow: */address Disallow: */addresses Disallow: */identity Disallow: */guest-tracking Disallow: */discount Disallow: */order-history Disallow: */order-slip # Konto, handlevogn og bestilling paa norsk (reglerne ovenfor rammer kun de # engelske adresser). $ og ? saa en kategori der starter med samme ord ikke rammes. Disallow: /no/adresse$ Disallow: /no/adresse? Disallow: /no/adresser$ Disallow: /no/adresser? Disallow: /no/login$ Disallow: /no/login? Disallow: /no/handlevogn$ Disallow: /no/handlevogn? Disallow: /no/rabatt$ Disallow: /no/rabatt? Disallow: /no/gjestesporing$ Disallow: /no/gjestesporing? Disallow: /no/ordrehistorikk$ Disallow: /no/ordrehistorikk? Disallow: /no/identitet$ Disallow: /no/identitet? Disallow: /no/min-konto$ Disallow: /no/min-konto? Disallow: /no/ordre$ Disallow: /no/ordre? Disallow: /no/bestilling-mottatt$ Disallow: /no/bestilling-mottatt? Disallow: /no/ordre-f%C3%B8lger$ Disallow: /no/ordre-f%C3%B8lger? Disallow: /no/order-slip$ Disallow: /no/order-slip? Disallow: /no/glemt-passord$ Disallow: /no/glemt-passord? Disallow: /no/registrering$ Disallow: /no/registrering? # Filtrerede kategorisider (ps_facetedsearch). Hver kombination laver en # raekke i ps_layered_filter_block. Crawlere kan ellers generere hundredtusinder, # og siderne er alligevel duplikatindhold i Googles oejne. Disallow: /*?q= Disallow: /*&q= Disallow: /*?order= Disallow: */order-confirmation Disallow: */password-recovery # BLOCK realtime search pages Disallow: /*?search_query= Disallow: /*?s= Disallow: /*&s= # BLOCK PDF generator module (heavy endpoint) Disallow: /module/producttopdf/ Disallow: /*/module/producttopdf/ # BLOCK module controllers (dynamic endpoints) Disallow: /module/ Disallow: /*/module/ # BLOCK useless parameters (NOT pagination) Disallow: /*?orderby= Disallow: /*?orderway= Disallow: /*?back= Disallow: /*?id_currency= Disallow: /*&orderby= Disallow: /*&orderway= Disallow: /*&id_currency= Disallow: /*&back= # Dubletter: valuta og antal pr. side (17.11.2026) Disallow: /*?SubmitCurrency= Disallow: /*&SubmitCurrency= Disallow: /*?resultsPerPage= Disallow: /*&resultsPerPage= # Engelske konto-sider som de generelle regler ikke rammer Disallow: /en/credit-slip$ Disallow: /en/credit-slip? Disallow: /en/registration$ Disallow: /en/registration? # ALLOW pagination (critical!) Allow: /*?page= Allow: /*?p= # Filtre (?q=) er spaerret ovenfor. Skriv IKKE "Allow: /*?q=" her: lige lange # regler -> Google vaelger Allow, og saa er spaerringen virkningsloes (2026-10-13). Allow: /*?selected_filters= # BLOCK system-level folders Disallow: /vendor/ Disallow: /src/ Disallow: /var/ Disallow: /config/ Disallow: /override/ Disallow: /classes/ Disallow: /cache/ Disallow: /tools/ Disallow: /webservice/ # SITEMAP Sitemap: https://danbit.no/4_index_sitemap.xml