Crawl and Search Bots Optimisation

HTTP Headers Example

Last-Modified

If-Modified-Since

ETag

If-None-Match

Keep-Alive

Setting Keep-alive to keep connection active.

In the “connection” header, set “Keep-alive” to keep the connection action.

Setting a cache Time period

Example Cache control for Images