Giter Club home page Giter Club logo

robots-txt-demos's People

Stargazers

avatar

Watchers

avatar avatar avatar

robots-txt-demos's Issues

Get the X-Robots-Tag header working

https://robots-txt-demos.now.sh/disallowed-x-robots

This should have the X-Robots-Tag header in it, but it doesn't:

$ curl -i https://robots-txt-demos.now.sh/disallowed-x-robots
HTTP/2 200 
date: Thu, 26 Jul 2018 17:18:26 GMT
content-type: text/html; charset=utf-8
set-cookie: __cfduid=d5219dd0a6d66224e94eaf529ce684c311532625506; expires=Fri, 26-Jul-19 17:18:26 GMT; path=/; domain=.robots-txt-demos.now.sh; HttpOnly
last-modified: Thu, 26 Jul 2018 17:17:20 GMT
content-disposition: inline; filename="disallowed-x-robots.html"
etag: W/"2ef22f43d363341f066a80ef05bd68297f8f8792"
cache-control: s-maxage=86400
x-now-trace: sfo1
now: 1
x-now-cache: MISS
x-now-id: 3d9q1-1532625460599-6JqO7eshbfsCNDEIMHZNXprG
cf-cache-status: HIT
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
server: cloudflare
cf-ray: 44088685bd696c4c-SJC

<h1>Disallowed</h1>

The configuration that is meant to turn this in is in the now.json file but it's not working for some reason:

robots-txt-demos/now.json

Lines 3 to 12 in 0ef8264

"headers": [
{
"source": "disallowed-x-robots",
"headers": [
{
"key": "X-Robots-Tag",
"value": "noindex"
}
]
}

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.