Scribd Logo
Încărcați

Bine ați venit la Scribd!

  • Project Fisika Pembangkit Listri

    Încărcat de

    elin melinda
    15 vizualizări9 pagini
    The document provides instructions for various search engine crawlers and bots on which parts of the Academia.edu website they can and cannot access. Specific URLs are listed that should be disallowed from indexing, while the root directory and sitemap URLs are allowed to be crawled. Over 30 sitemap URLs are also included to be indexed by the crawlers.

    Descriere originală:

    Pembangkit listrik

    Drepturi de autor

    © © All Rights Reserved

    Formate disponibile

    DOCX, PDF, TXT sau citiți online pe Scribd

    Vi se pare util acest document?

    Este necorespunzător acest conținut?

    Raportați acest document
    The document provides instructions for various search engine crawlers and bots on which parts of the Academia.edu website they can and cannot access. Specific URLs are listed that should be disallowed from indexing, while the root directory and sitemap URLs are allowed to be crawled. Over 30 sitemap URLs are also included to be indexed by the crawlers.

    Drepturi de autor:

    © All Rights Reserved
    Descărcați ca DOCX, PDF, TXT sau citiți online pe Scribd
    Indicator pentru conținut neadecvat
    15 vizualizări9 pagini

    Project Fisika Pembangkit Listri

    Încărcat de

    elin melinda
    The document provides instructions for various search engine crawlers and bots on which parts of the Academia.edu website they can and cannot access. Specific URLs are listed that should be disallowed from indexing, while the root directory and sitemap URLs are allowed to be crawled. Over 30 sitemap URLs are also included to be indexed by the crawlers.

    Drepturi de autor:

    © All Rights Reserved
    Descărcați ca DOCX, PDF, TXT sau citiți online pe Scribd
    Indicator pentru conținut neadecvat
    din 9

    # If you run a search engine and would like to index Academia.

    edu, please email


    support@academia.edu.

    User-agent: Googlebot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: Mediapartners-Google Disallow: attachmentsdownload_file Disallow:


    JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: msnbot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: bingbot
    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: Slurp

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: DuckDuckbot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: baiduspider

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search
    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: seznambot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: naverbot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: teoma

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: Yandex

    Disallow: attachmentsdownload_file Disallow: JobsSearch


    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: ScoutJet

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: GurujiBot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: Exabot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /


    User-agent: Solbot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: FAST

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: VoilaBot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: daumoa

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch
    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: ArchitextSpider Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: Twitterbot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: SocSciBot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: ia_archiver
    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: coccoc

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: Browsershots

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: SiteArc

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search
    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: Cliqzbot

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: proximic

    Disallow: attachmentsdownload_file Disallow: JobsSearch

    Disallow: peoplesearch

    Disallow: /ac_search

    Disallow: /users/search

    Disallow: ac_universities Disallow: ac_university_departments Allow: /

    User-agent: *

    Disallow: /

    Sitemap: http://sitemap.academia.edu/seo_test_sitemap.xml Sitemap:


    http://sitemap.academia.edu/seo_test_2_sitemap.xml Sitemap:
    http://sitemap.academia.edu/jobs_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_0_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_1_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_2_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_3_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_4_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_5_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_6_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_7_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_8_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_9_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_10_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_11_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_12_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_13_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_14_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_15_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_16_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_17_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_18_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_19_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_20_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_21_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_22_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_23_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_24_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_25_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_26_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_27_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_28_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_29_index.xml.gz Sitemap:
    http://sitemap.academia.edu/recent_30_index.xml.gz Sitemap:
    http://sitemap.academia.edu/ris_index.xml.gz Sitemap:
    http://sitemap.academia.edu/unis_index.xml.gz Sitemap:
    http://sitemap.academia.edu/scholar_index.xml.gz Sitemap:
    http://sitemap.academia.edu/static_index.xml.gz Sitemap:
    http://sitemap.academia.edu/works_index.xml.gz Sitemap:
    http://sitemap.academia.edu/profiles_index.xml.gz Sitemap:
    http://sitemap.academia.edu/portfolios_index.xml.gz Sitemap:
    http://sitemap.academia.edu/profiles_index_1.xml.gz Sitemap:
    http://sitemap.academia.edu/profiles_index_2.xml.gz

    S-ar putea să vă placă și