Latest revision as of 09:14, January 1, 2015

Varnish

Tip

We welcome improvements to this page. To edit this page, Create a Funtoo account. Then log in and then click here to edit this page. See our editing guidelines to becoming a wiki-editing pro.

Varnish is a Web cache and HTTP accelerator. Varnish will either serve cached content, or retrieve content from the server, and cache it. Varnish cache will reduce I/O pressure on Web servers.

Install

Emerge

Install www-servers/varnish:

root # emerge www-servers/varnish

Configuration

Note

as your varnish is local to your server, your server needs to be aware that it is behind a proxy, and configured for x-forwarded-for or similar to fetch real users IP addresses instead of displaying 127.0.0.1 or localhost.

Configuration is controlled by /etc/varnish/default.vcl & /etc/conf.d/varnishd

/etc/varnish/default.vcl - varnish configuration file

vcl 4.0;
backend default {
    .host = "127.0.0.1";
    .port = "8080";
}

/etc/conf.d/varnishd - varnish configuration file

VARNISHD="/usr/sbin/varnishd"
VARNISHADM="/usr/bin/varnishadm"
CONFIGFILE="/etc/varnish/default.vcl"
VARNISHD_OPTS="-a 127.0.0.1:80"
VARNISHD_OPTS="${VARNISHD_OPTS} -u varnish -g varnish"

Varnish will fetch data from localhost:8080 and serve accelerated proxy data on localhost:80

Achieving a high hit rate

c10k

For 10,000 concurrent connections -- or not -- a few configuration settings control the power of varnish. If you're having varnish directly serve to the outside world, dial back concurrency to say 50 or 100 connections per IP. You must take into account corporations and universities hammering several connections from a singular IP. c10k is useful information for if varnish is behind a load balancer such as pound, nginx, or tengine, and all requests are internal and local.

/etc/conf.d/varnishd - varnish concurrency settings

VARNISHD_OPTS="-a 127.0.0.1:80 -p thread_pool_min=20 -p thread_pool_max=1000 -p thread_pool_add_delay=2 -s malloc,700M"

/etc/varnish/default.vcl - varnish concurrency settings

backend default {
    .host = "127.0.0.1";
    .port = "8080";
    .connect_timeout = 600s;
    .first_byte_timeout = 600s;
    .between_bytes_timeout = 600s;
    .max_connections = 10000;
    # .port = "80" led to issues with competing for the port with apache.
}

Boot Service

To start varnish immediately:

root # rc-service varnishd start

To start varnish at boot:

root # rc-update add varnishd default

Verification

To verify that your traffic is going through varnish, and see if you're getting hits or misses:

user $ curl -I http://www.funtoo.org/Welcome

Benchmarking

app-admin/apache-tools apache benchmark can show the power of varnish. The examples shown are running 500 requests with concurrency of 100 hits.

Example 1: ab against a 3 worker cluster mode puma server

root # ab -n 500 -c 100 http://127.0.0.1:3000/index.html | grep Request

Requests per second: 110.92 [#/sec] (mean)

Example 2: ab against the same server served through varnish

root # ab -n 500 -c 100 http://127.0.0.1/index.html | grep Request

Requests per second: 10268.42 [#/sec] (mean)

SSL support

Varnish does not support ssl. There are packages to get around this limitation:

No results
No results

Media

External Resources

https://www.varnish-software.com/static/book/index.html

@@ Line 2: / Line 2: @@
 |Summary=Varnish is a state-of-the-art, high-performance HTTP accelerator
 |CatPkg=www-servers/varnish
-|Maintainer=
+|Homepage=https://www.varnish-cache.org/
 }}
-__TOC__
+'''Varnish''' is a Web cache and HTTP accelerator.  Varnish will either serve cached content, or retrieve content from the server, and cache it.  Varnish cache will reduce I/O pressure on Web servers.
-'''Varnish''' is a webcache & http accelerator.  Varnish will either serve cached content, or retireve content from the server, and cache it.  Varnish will reduce I/O pressure from webservers.
 ==Install==
 ===Emerge===
-Install {{Package|www-servers/varnish}}
+Install {{Package|www-servers/varnish}}:
-<console>###i## www-servers/varnish</console>
+<console>###i## emerge www-servers/varnish</console>
 ==Configuration==
-Configuration is controlled by /etc/varnish/default.vcl
+{{note|as your varnish is local to your server, your server needs to be aware that it is behind a proxy, and configured for [http://en.wikipedia.org/wiki/X-Forwarded-For x-forwarded-for] or similar to fetch real users IP addresses instead of displaying 127.0.0.1 or localhost.}}
+Configuration is controlled by /etc/varnish/default.vcl & /etc/conf.d/varnishd
 {{file|name=/etc/varnish/default.vcl|desc=varnish configuration file|body=
-# backend default {
+vcl 4.0;
-#     .host = "127.0.0.1";
+backend default {
-#     .port = "8080";
+     .host = "127.0.0.1";
-# }
+     .port = "8080";
+}
+}}
+{{file|name=/etc/conf.d/varnishd|desc=varnish configuration file|body=
+VARNISHD="/usr/sbin/varnishd"
+VARNISHADM="/usr/bin/varnishadm"
+CONFIGFILE="/etc/varnish/default.vcl"
+VARNISHD_OPTS="-a 127.0.0.1:80"
+VARNISHD_OPTS="${VARNISHD_OPTS} -u varnish -g varnish"
 }}
-Any traffic pointed at port 8080 will be through varnish.
+Varnish will fetch data from localhost:8080 and serve accelerated proxy data on localhost:80
-== BootService ==
+=== [https://www.varnish-cache.org/docs/4.0/users-guide/increasing-your-hitrate.html Achieving a high hit rate] ===
+=== c10k ===
+For 10,000 concurrent connections -- or not -- a few configuration settings control the power of varnish.  If you're having varnish directly serve to the outside world, dial back concurrency to say 50 or 100 connections per IP. You must take into account corporations and universities hammering several connections from a singular IP.  c10k is useful information for if varnish is behind a load balancer such as pound, nginx, or tengine, and all requests are internal and local.
+{{file|name=/etc/conf.d/varnishd|desc=varnish concurrency settings|body=
+VARNISHD_OPTS="-a 127.0.0.1:80 -p thread_pool_min=20 -p thread_pool_max=1000 -p thread_pool_add_delay=2 -s malloc,700M"
+}}
+{{file|name=/etc/varnish/default.vcl|desc=varnish concurrency settings|body=
+backend default {
+    .host = "127.0.0.1";
+    .port = "8080";
+    .connect_timeout = 600s;
+    .first_byte_timeout = 600s;
+    .between_bytes_timeout = 600s;
+    .max_connections = 10000;
+    # .port = "80" led to issues with competing for the port with apache.
+}
+}}
+== Boot Service ==
 To start varnish immediately:
@@ Line 35: / Line 66: @@
 == Verification ==
-To verify that your traffic is going through varnish.
+To verify that your traffic is going through varnish, and see if you're getting hits or misses:
-<console>$##i## curl -I https://www.varnish-cache.org/</console>
+<console>$##i## curl -I http://www.funtoo.org/Welcome</console>
+== Benchmarking ==
+{{package|app-admin/apache-tools}} apache benchmark can show the power of varnish.  The examples shown are running 500 requests with concurrency of 100 hits.
+;Example 1: ab against a 3 worker cluster mode puma server
+<console>###i## ab -n 500 -c 100 http://127.0.0.1:3000/index.html | grep Request</console>
+Requests per second:    110.92 [#/sec] (mean)
+;Example 2: ab against the same server served through varnish
+<console>###i## ab -n 500 -c 100 http://127.0.0.1/index.html | grep Request</console>
+Requests per second:    10268.42 [#/sec] (mean)
+== SSL support ==
+Varnish does not support ssl.  There are packages to get around this limitation:
+* {{package|net-misc/stunnel}}
+* {{package|www-servers/pound}}
-[[Category:Server]]
+== Media ==
-[[Category:Daemons]]
+{{#widget:YouTube16x9|id=JEF6_XC-2ZU}}
+== External Resources ==
+https://www.varnish-software.com/static/book/index.html
 {{EbuildFooter}}

Difference between revisions of "Package:Varnish"