From des at linpro.no  Wed Aug  1 05:16:01 2007
From: des at linpro.no (=?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?=)
Date: Wed, 01 Aug 2007 07:16:01 +0200
Subject: Small varnish 1.1 test with openrealty and joomla.
In-Reply-To: <20070731171919.wsgne57as8okgow8@intranet.encontacto.net>
	(eculp@encontacto.net's message of "Tue\, 31 Jul 2007 17\:19\:19 -0500")
References: <20070730184833.vx2r1t487480o4w4@intranet.encontacto.net>
	<87ps29w1ce.fsf@des.linpro.no>
	<20070731054738.a4gp7ri2ow80gcok@intranet.encontacto.net>
	<87d4y8wo5c.fsf@des.linpro.no>
	<20070731121649.zjtnms5us0owwgo4@intranet.encontacto.net>
	<87sl74uyc5.fsf@des.linpro.no>
	<20070731171919.wsgne57as8okgow8@intranet.encontacto.net>
Message-ID: <87odhrvnqm.fsf@des.linpro.no>

eculp at encontacto.net writes:
> This is from the apache log:
>
> 127.0.0.1 - - [31/Jul/2007:16:33:22 -0500] "GET /favicon.ico HTTP/1.1"
> 404 209 "http://nuevo.ecomania.info/" "Opera/9.22 (X11; Linux i686; U;
> en)"

This shows that Apache gets the correct Host: header from Varnish.

> The varnishlog -r /var/log/varnish.log is attached (4k) and again my
> interpretation is the same.

The log you attached shows a cache hit and is therefore useless.

> If I change the default
>
> backend default {
>   set backend.host = "127.0.0.1";
>   set backend.port = "8080";
> }
>
> to
>
> backend nuevo {
>         set backend.host = "nuevo.ecomania.info";
>         set backend.port = "8080";
> }
>
> with all else the same, it works as expected because
> http://nuevo.ecomania.info is configured as an apache vhost.

No.  The value of backend.host is *not* used for the Host: header.
However, "nuevo.ecomania.info" and "127.0.0.1" are *not* equivalent.  My
conclusion is that Apache is misconfigured; you probably have
"NameVirtualHost 189.129.5.82" instead of "NameVirtualHost *", or your
VirtualHost entry starts with "<VirtualHost nuevo.ecomania.info>"
instead of "<VirtualHost *>".

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From chulmin2 at hotmail.com  Wed Aug  1 08:12:30 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Wed, 01 Aug 2007 08:12:30 +0000
Subject: several questions about varnishd..
Message-ID: <BAY101-F24D6217CABB3B0123828A985E80@phx.gbl>

Hello list.

I am a begineer and have several questions about varnish.


1. Does varnish saves hot objects in memory? if then any memory size limit?
   and if memory is full, that saves in hdd disk?


2. any object(caching) size limit which varnish can save?
   if then, any parameter that can be changed?


3. If I add or change main config file so often,
   any recommendation?
   how about killall -HUP varnishd?


4. If I restart varnishd daemon, all saved caches are deleted and 
initialized?


Thanks in advance for your help..

_________________________________________________________________
?? ?? ?? ??? ?????? MSN ???? ?????. 
http://fortune.msn.co.kr/ 



From kradziszewski at gmail.com  Wed Aug  1 11:21:53 2007
From: kradziszewski at gmail.com (Kamil Radziszewski)
Date: Wed, 1 Aug 2007 13:21:53 +0200
Subject: files in /var direcotry
Message-ID: <231965b00708010421v1f6fbe1bqca2c84954ff4734d@mail.gmail.com>

what file are created in var/varnish/{hostname}/..
Every time i run varnish there is created file like bin.XXtSu9IM ... after
30 restarts i have 30 files...
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070801/08a73fc3/attachment.html>

From eculp at encontacto.net  Wed Aug  1 11:50:19 2007
From: eculp at encontacto.net (eculp at encontacto.net)
Date: Wed, 01 Aug 2007 06:50:19 -0500
Subject: Small varnish 1.1 test with openrealty and joomla.
Message-ID: <20070801065019.m4vfgmsem8gsos04@intranet.encontacto.net>

Quoting Dag-Erling Sm?rgrav <des at linpro.no>:

> eculp at encontacto.net writes:
>> This is from the apache log:
>>
>> 127.0.0.1 - - [31/Jul/2007:16:33:22 -0500] "GET /favicon.ico HTTP/1.1"
>> 404 209 "http://nuevo.ecomania.info/" "Opera/9.22 (X11; Linux i686; U;
>> en)"
>
> This shows that Apache gets the correct Host: header from Varnish.
>
>> The varnishlog -r /var/log/varnish.log is attached (4k) and again my
>> interpretation is the same.
>
> The log you attached shows a cache hit and is therefore useless.
>
>> If I change the default
>>
>> backend default {
>>   set backend.host = "127.0.0.1";
>>   set backend.port = "8080";
>> }
>>
>> to
>>
>> backend nuevo {
>>         set backend.host = "nuevo.ecomania.info";
>>         set backend.port = "8080";
>> }
>>
>> with all else the same, it works as expected because
>> http://nuevo.ecomania.info is configured as an apache vhost.
>
> No.  The value of backend.host is *not* used for the Host: header.
> However, "nuevo.ecomania.info" and "127.0.0.1" are *not* equivalent.  My
> conclusion is that Apache is misconfigured; you probably have
> "NameVirtualHost 189.129.5.82" instead of "NameVirtualHost *", or your
> VirtualHost entry starts with "<VirtualHost nuevo.ecomania.info>"
> instead of "<VirtualHost *>".

Very true, I changed to the IP years ago and don't even remember why  
but that is much better than my solution, modifying default.vcl.

Thanks,

ed


From eculp at encontacto.net  Wed Aug  1 11:51:35 2007
From: eculp at encontacto.net (eculp at encontacto.net)
Date: Wed, 01 Aug 2007 06:51:35 -0500
Subject: Small varnish 1.1 test with openrealty and joomla.
Message-ID: <20070801065135.qfcq9epxwo88cwgc@intranet.encontacto.net>

Quoting Dag-Erling Sm?rgrav <des at linpro.no>:

> eculp at encontacto.net writes:
>> This is from the apache log:
>>
>> 127.0.0.1 - - [31/Jul/2007:16:33:22 -0500] "GET /favicon.ico HTTP/1.1"
>> 404 209 "http://nuevo.ecomania.info/" "Opera/9.22 (X11; Linux i686; U;
>> en)"
>
> This shows that Apache gets the correct Host: header from Varnish.
>
>> The varnishlog -r /var/log/varnish.log is attached (4k) and again my
>> interpretation is the same.
>
> The log you attached shows a cache hit and is therefore useless.
>
>> If I change the default
>>
>> backend default {
>>   set backend.host = "127.0.0.1";
>>   set backend.port = "8080";
>> }
>>
>> to
>>
>> backend nuevo {
>>         set backend.host = "nuevo.ecomania.info";
>>         set backend.port = "8080";
>> }
>>
>> with all else the same, it works as expected because
>> http://nuevo.ecomania.info is configured as an apache vhost.
>
> No.  The value of backend.host is *not* used for the Host: header.
> However, "nuevo.ecomania.info" and "127.0.0.1" are *not* equivalent.  My
> conclusion is that Apache is misconfigured; you probably have
> "NameVirtualHost 189.129.5.82" instead of "NameVirtualHost *", or your
> VirtualHost entry starts with "<VirtualHost nuevo.ecomania.info>"
> instead of "<VirtualHost *>".

Very true, I changed to the IP years ago and don't even remember why  
but that is much better than my solution, modifying default.vcl.

Thanks,

ed


From eculp at encontacto.net  Wed Aug  1 11:53:53 2007
From: eculp at encontacto.net (eculp at encontacto.net)
Date: Wed, 01 Aug 2007 06:53:53 -0500
Subject: Small varnish 1.1 test with openrealty and joomla.
In-Reply-To: <87odhrvnqm.fsf@des.linpro.no>
References: <20070730184833.vx2r1t487480o4w4@intranet.encontacto.net>
	<87ps29w1ce.fsf@des.linpro.no>
	<20070731054738.a4gp7ri2ow80gcok@intranet.encontacto.net>
	<87d4y8wo5c.fsf@des.linpro.no>
	<20070731121649.zjtnms5us0owwgo4@intranet.encontacto.net>
	<87sl74uyc5.fsf@des.linpro.no>
	<20070731171919.wsgne57as8okgow8@intranet.encontacto.net>
	<87odhrvnqm.fsf@des.linpro.no>
Message-ID: <20070801065353.i4ckmb5i9gkwosw0@intranet.encontacto.net>

Quoting Dag-Erling Sm?rgrav <des at linpro.no>:

> eculp at encontacto.net writes:
>> This is from the apache log:
>>
>> 127.0.0.1 - - [31/Jul/2007:16:33:22 -0500] "GET /favicon.ico HTTP/1.1"
>> 404 209 "http://nuevo.ecomania.info/" "Opera/9.22 (X11; Linux i686; U;
>> en)"
>
> This shows that Apache gets the correct Host: header from Varnish.
>
>> The varnishlog -r /var/log/varnish.log is attached (4k) and again my
>> interpretation is the same.
>
> The log you attached shows a cache hit and is therefore useless.
>
>> If I change the default
>>
>> backend default {
>>   set backend.host = "127.0.0.1";
>>   set backend.port = "8080";
>> }
>>
>> to
>>
>> backend nuevo {
>>         set backend.host = "nuevo.ecomania.info";
>>         set backend.port = "8080";
>> }
>>
>> with all else the same, it works as expected because
>> http://nuevo.ecomania.info is configured as an apache vhost.
>
> No.  The value of backend.host is *not* used for the Host: header.
> However, "nuevo.ecomania.info" and "127.0.0.1" are *not* equivalent.  My
> conclusion is that Apache is misconfigured; you probably have
> "NameVirtualHost 189.129.5.82" instead of "NameVirtualHost *", or your
> VirtualHost entry starts with "<VirtualHost nuevo.ecomania.info>"
> instead of "<VirtualHost *>".

Very true, I changed to the IP years ago and don't even remember why  
but that is much better than my solution, modifying default.vcl.

Thanks,

ed


From rad_kam at tlen.pl  Wed Aug  1 19:33:10 2007
From: rad_kam at tlen.pl (rad_kam at tlen.pl)
Date: Wed, 01 Aug 2007 21:33:10 +0200
Subject: =?UTF-8?Q?refresh_varnish_cache_?=
Message-ID: <36a24d27.2f3a6343.46b0dff6.385c4@o2.pl>

why every time if i try to refresh files from varnish cache it don't work.

I can HIT any file from varnish cache but not refresh ...why ??


From admin at adofms.com.au  Thu Aug  2 02:59:43 2007
From: admin at adofms.com.au (ADOFMS Admin, SteveOC)
Date: Thu, 02 Aug 2007 12:29:43 +0930
Subject: VARNISH_STATE_DIR undeclared
Message-ID: <46B1489F.90405@adofms.com.au>

Just building from latest svn update as of this morning ..

error compiling in trunk :

instance.c: In function `varnish_instance':
instance.c:58: error: `VARNISH_STATE_DIR' undeclared (first use in this
function)
instance.c:58: error: (Each undeclared identifier is reported only once
instance.c:58: error: for each function it appears in.)


Something I have done wrong?, or current svn repository halfway through
a work in progress ?

Thx



From ssm at linpro.no  Thu Aug  2 08:44:06 2007
From: ssm at linpro.no (Stig Sandbeck Mathisen)
Date: Thu, 02 Aug 2007 10:44:06 +0200
Subject: refresh varnish cache
In-Reply-To: <36a24d27.2f3a6343.46b0dff6.385c4@o2.pl> (rad kam's message of
	"Wed, 01 Aug 2007 21:33:10 +0200")
References: <36a24d27.2f3a6343.46b0dff6.385c4@o2.pl>
Message-ID: <7xk5sez5pl.fsf@iostat.e.linpro.no>

rad_kam at tlen.pl writes:

> why every time if i try to refresh files from varnish cache it don't
> work.
>
> I can HIT any file from varnish cache but not refresh ...why ??

What, exactly, do you mean by:

 * HIT any file from varnish cache

 * refresh files from varnish cache

 * "it don't work"


What are you trying to do?

How are you trying to do it?

What do you expect to see?

What happens instead?

How have you tried to fix the problem?

What does the Varnish log tell you?

What does the web server log tell you?

Take a look at http://www.catb.org/~esr/faqs/smart-questions.html, it
might be helpful.

-- 
Stig Sandbeck Mathisen, Linpro


From des at linpro.no  Thu Aug  2 08:49:03 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Thu, 02 Aug 2007 10:49:03 +0200
Subject: VARNISH_STATE_DIR undeclared
In-Reply-To: <46B1489F.90405@adofms.com.au> (ADOFMS Admin's message of "Thu,
	02 Aug 2007 12:29:43 +0930")
References: <46B1489F.90405@adofms.com.au>
Message-ID: <ujr4pjicoe8.fsf@false.linpro.no>

"ADOFMS Admin, SteveOC" <admin at adofms.com.au> writes:
> Just building from latest svn update as of this morning ..
>
> error compiling in trunk :
>
> instance.c: In function `varnish_instance':
> instance.c:58: error: `VARNISH_STATE_DIR' undeclared (first use in this function)
> instance.c:58: error: (Each undeclared identifier is reported only once
> instance.c:58: error: for each function it appears in.)
>
> Something I have done wrong?, or current svn repository halfway through
> a work in progress ?

You didn't run autogen.sh and configure.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From sharp_sniper at wp.pl  Wed Aug  1 19:29:18 2007
From: sharp_sniper at wp.pl (KKK RRR)
Date: Wed, 01 Aug 2007 21:29:18 +0200
Subject: Browser refresh and varnish
Message-ID: <46b0df0e17d54@wp.pl>

why every time i can't refresh my browser with files from varnish cache ?

for exapmle:
if i go to www.xxxxx.com/abcd.jpg     then is ok - varnish shows HIT
but if i refresh it don't work

----------------------------------------------------
Cathy Kelly - "Przyjaci??ki od serca". Ciep?a i wzruszaj?ca 
historia o czterech kobietach, kt?re w obliczu nieszcz??cia 
na nowo odkrywaj? sens ?ycia i warto?? ??cz?cej je przyja?ni. 
Zobacz! http://klik.wp.pl/?adr=http%3A%2F%2Fadv.reklama.wp.pl%2Fas%2Fprzyjaciolki.html&sid=1239




From des at linpro.no  Thu Aug  2 08:57:42 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Thu, 02 Aug 2007 10:57:42 +0200
Subject: files in /var direcotry
In-Reply-To: <231965b00708010421v1f6fbe1bqca2c84954ff4734d@mail.gmail.com>
	(Kamil Radziszewski's message of "Wed, 1 Aug 2007 13:21:53 +0200")
References: <231965b00708010421v1f6fbe1bqca2c84954ff4734d@mail.gmail.com>
Message-ID: <ujr8x8u9uux.fsf@false.linpro.no>

"Kamil Radziszewski" <kradziszewski at gmail.com> writes:
> what file are created in var/varnish/{hostname}/..

The C source generated from the VCL code; the resulting binary; the
backing file for the shared memory log; possibly the cache file.

> Every time i run varnish there is created file like bin.XXtSu9IM ... after
> 30 restarts i have 30 files...

I'll look into this.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Thu Aug  2 08:59:50 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Thu, 02 Aug 2007 10:59:50 +0200
Subject: several questions about varnishd..
In-Reply-To: <BAY101-F24D6217CABB3B0123828A985E80@phx.gbl> (Monty Ree's
	message of "Wed, 01 Aug 2007 08:12:30 +0000")
References: <BAY101-F24D6217CABB3B0123828A985E80@phx.gbl>
Message-ID: <ujr4pji9urd.fsf@false.linpro.no>

"Monty Ree" <chulmin2 at hotmail.com> writes:
> 1. Does varnish saves hot objects in memory? if then any memory size
> limit?  and if memory is full, that saves in hdd disk?

Varnish stores all objects in a memory-mapped file.  The kernel's VM
system decides what's in memory and what's on disk.

> 2. any object(caching) size limit which varnish can save?  if then,
> any parameter that can be changed?

There is no limit, but Varnish will probably crash if it tries to
cache a file which is larger than the total amount of cache it has.

> 3. If I add or change main config file so often, any recommendation?
> how about killall -HUP varnishd?

The man page explains this.

> 4. If I restart varnishd daemon, all saved caches are deleted and
> initialized?

Yes.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From rafailow at gmail.com  Thu Aug  2 09:20:33 2007
From: rafailow at gmail.com (rafailowski)
Date: Thu, 2 Aug 2007 11:20:33 +0200
Subject: varnish & cookies & multilanguage
Message-ID: <8e6064260708020220q2ae3fe98ia3fcb9d0a6f186b4@mail.gmail.com>

Hello,
I'm new to varnish and i have some problems with cookies.
I have to cache a website who use coookies to determine the language.

The cookies are:
15 TxHeader     b Cookie: _ZopeId="23273311A29b-he1CIg"; LOCALIZER_LANGUAGE="es"

The url used to change language on the  website is like that:
http://xxxx?lang=en
So i made this :

if (req.url ~ "=(en|es|de|fr|it|pt|pl|ru|el|ko|zh-CN|zh|ja|ar)$"){
    pipe;
}
But it didn't solve the problem.

The only way i found is :
if (req.http.Cookie ~ "LOCALIZER_LANGUAGE") {
    pipe;
}
Adn it works fine but now, nothing is cached :(

So my question :)
Is there's a way to cache a website like this, using cookies for language?

Thx in advance,
rafailowski


From phk at phk.freebsd.dk  Thu Aug  2 09:32:14 2007
From: phk at phk.freebsd.dk (Poul-Henning Kamp)
Date: Thu, 02 Aug 2007 09:32:14 +0000
Subject: varnish & cookies & multilanguage 
In-Reply-To: Your message of "Thu, 02 Aug 2007 11:20:33 +0200."
	<8e6064260708020220q2ae3fe98ia3fcb9d0a6f186b4@mail.gmail.com> 
Message-ID: <36253.1186047134@critter.freebsd.dk>

In message <8e6064260708020220q2ae3fe98ia3fcb9d0a6f186b4 at mail.gmail.com>, rafailowski writes
:
>Hello,
>I'm new to varnish and i have some problems with cookies.
>I have to cache a website who use coookies to determine the language.
>
>The cookies are:
>15 TxHeader     b Cookie: _ZopeId="23273311A29b-he1CIg"; LOCALIZER_LANGUAGE="es"

>Is there's a way to cache a website like this, using cookies for language?

I can think of one way that might work:

Hash that part of the cookie in addition to the URL and host, something like:

	vcl_hash {
		if (req.http.cookie) {
			set req.hash += regsub(
			    req.http.cookie, 
			    ".*LOCALIZER_LANGUAGE=\"(..)\".*",
			    "$1");
		}
	}

(If this work, please take a moment to add it to our FAQ!)

-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.


From ssm at linpro.no  Thu Aug  2 10:27:11 2007
From: ssm at linpro.no (Stig Sandbeck Mathisen)
Date: Thu, 02 Aug 2007 12:27:11 +0200
Subject: Browser refresh and varnish
In-Reply-To: <46b0df0e17d54@wp.pl> (KKK RRR's message of "Wed, 01 Aug 2007
	21:29:18 +0200")
References: <46b0df0e17d54@wp.pl>
Message-ID: <7x8x8uz0xs.fsf@iostat.e.linpro.no>

"KKK RRR" <sharp_sniper at wp.pl> writes:

> why every time i can't refresh my browser with files from varnish cache ?
>
> for exapmle:
> if i go to www.xxxxx.com/abcd.jpg     then is ok - varnish shows HIT
> but if i refresh it don't work

You don't run varnish on that domain, and the document does not exist.

ssm ~$ GET -Used http://www.xxxxx.com/abcd.jpg
GET http://www.xxxxx.com/abcd.jpg
User-Agent: lwp-request/2.07

404 Not Found
Connection: close
Date: Thu, 02 Aug 2007 10:23:26 GMT
Server: Apache/2.0.52 (Red Hat)
Content-Length: 288
Content-Type: text/html; charset=iso-8859-1
Client-Date: Thu, 02 Aug 2007 10:23:26 GMT
Client-Peer: 209.85.51.151:80
Client-Response-Num: 1
Title: 404 Not Found


Alternatively, you specified a domain of someone else's web site.
Please don't.

-- 
Stig Sandbeck Mathisen, Linpro


From rafailow at gmail.com  Thu Aug  2 14:02:26 2007
From: rafailow at gmail.com (rafailowski)
Date: Thu, 2 Aug 2007 16:02:26 +0200
Subject: varnish & cookies & multilanguage
In-Reply-To: <36253.1186047134@critter.freebsd.dk>
References: <8e6064260708020220q2ae3fe98ia3fcb9d0a6f186b4@mail.gmail.com>
	<36253.1186047134@critter.freebsd.dk>
Message-ID: <8e6064260708020702w541c5c70t7088de0c0ff205a@mail.gmail.com>

2007/8/2, Poul-Henning Kamp <phk at phk.freebsd.dk>:
> In message <8e6064260708020220q2ae3fe98ia3fcb9d0a6f186b4 at mail.gmail.com>, rafailowski writes
> :
> >Hello,
> >I'm new to varnish and i have some problems with cookies.
> >I have to cache a website who use coookies to determine the language.
> >
> >The cookies are:
> >15 TxHeader     b Cookie: _ZopeId="23273311A29b-he1CIg"; LOCALIZER_LANGUAGE="es"
>
> >Is there's a way to cache a website like this, using cookies for language?
>
> I can think of one way that might work:
>
> Hash that part of the cookie in addition to the URL and host, something like:
>
>         vcl_hash {
>                 if (req.http.cookie) {
>                         set req.hash += regsub(
>                             req.http.cookie,
>                             ".*LOCALIZER_LANGUAGE=\"(..)\".*",
>                             "$1");
>                 }
>         }
>
> (If this work, please take a moment to add it to our FAQ!)
>
> --
> Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
> phk at FreeBSD.ORG         | TCP/IP since RFC 956
> FreeBSD committer       | BSD since 4.3-tahoe
> Never attribute to malice what can adequately be explained by incompetence.
>
>         vcl_hash {
>                 if (req.http.cookie) {
>                         set req.hash += regsub(
>                             req.http.cookie,
>                             ".*LOCALIZER_LANGUAGE=\"(..)\".*",
>                             "$1");
>                 }
>         }

There's a little problem with these regexp
".*LOCALIZER_LANGUAGE=\"(..)\".*",
At the second \ ,varnish returns a "Syntax error".
I've tried different things around with regexp but i can't make it run.
What's wrong ?


From des at linpro.no  Thu Aug  2 14:41:17 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Thu, 02 Aug 2007 16:41:17 +0200
Subject: varnish & cookies & multilanguage
In-Reply-To: <36253.1186047134@critter.freebsd.dk> (Poul-Henning Kamp's
	message of "Thu, 02 Aug 2007 09:32:14 +0000")
References: <36253.1186047134@critter.freebsd.dk>
Message-ID: <ujrmyxa80du.fsf@false.linpro.no>

"Poul-Henning Kamp" <phk at phk.freebsd.dk> writes:
> Hash that part of the cookie in addition to the URL and host, something like:
>
> 	vcl_hash {
> 		if (req.http.cookie) {
> 			set req.hash += regsub(
> 			    req.http.cookie, 
> 			    ".*LOCALIZER_LANGUAGE=\"(..)\".*",
> 			    "$1");
> 		}
> 	}
>
> (If this work, please take a moment to add it to our FAQ!)

shouldn't

vcl_hash {
    req.hash += req.http.cookie[LOCALIZER_LANGUAGE];
}

work, or haven't you implemented subscripting yet?

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From phk at phk.freebsd.dk  Thu Aug  2 15:05:28 2007
From: phk at phk.freebsd.dk (Poul-Henning Kamp)
Date: Thu, 02 Aug 2007 15:05:28 +0000
Subject: varnish & cookies & multilanguage 
In-Reply-To: Your message of "Thu, 02 Aug 2007 16:02:26 +0200."
	<8e6064260708020702w541c5c70t7088de0c0ff205a@mail.gmail.com> 
Message-ID: <43456.1186067128@critter.freebsd.dk>

In message <8e6064260708020702w541c5c70t7088de0c0ff205a at mail.gmail.com>, rafailowski writes:


>There's a little problem with these regexp
>".*LOCALIZER_LANGUAGE=\"(..)\".*",
>At the second \ ,varnish returns a "Syntax error".

Yeah, I'm forgetting that I tried to make it easier for webmasters :-)

Try using %22 instead of \"

	".*LOCALIZER_LANGUAGE=%22(..)%22.*"

-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.


From phk at phk.freebsd.dk  Thu Aug  2 15:06:39 2007
From: phk at phk.freebsd.dk (Poul-Henning Kamp)
Date: Thu, 02 Aug 2007 15:06:39 +0000
Subject: varnish & cookies & multilanguage 
In-Reply-To: Your message of "Thu, 02 Aug 2007 16:41:17 +0200."
	<ujrmyxa80du.fsf@false.linpro.no> 
Message-ID: <43494.1186067199@critter.freebsd.dk>

In message <ujrmyxa80du.fsf at false.linpro.no>, =?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?= writes:
>"Poul-Henning Kamp" <phk at phk.freebsd.dk> writes:

>shouldn't
>
>vcl_hash {
>    req.hash +=3D req.http.cookie[LOCALIZER_LANGUAGE];
>}
>
>work, or haven't you implemented subscripting yet?

Not implemented yet.

-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.


From jean-marc.pouchoulon at ac-montpellier.fr  Thu Aug  2 15:40:33 2007
From: jean-marc.pouchoulon at ac-montpellier.fr (jean-marc pouchoulon)
Date: Thu, 02 Aug 2007 17:40:33 +0200
Subject: post request seems to be  broken in 1.1
Message-ID: <46B1FAF1.8010808@ac-montpellier.fr>

An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070802/c95c68f4/attachment.html>

From rafailow at gmail.com  Thu Aug  2 16:12:58 2007
From: rafailow at gmail.com (rafailowski)
Date: Thu, 2 Aug 2007 18:12:58 +0200
Subject: varnish & cookies & multilanguage
In-Reply-To: <43494.1186067199@critter.freebsd.dk>
References: <ujrmyxa80du.fsf@false.linpro.no>
	<43494.1186067199@critter.freebsd.dk>
Message-ID: <8e6064260708020912ld274f18n7fea9f636dd6a31@mail.gmail.com>

It doesn't work with this:

sub vcl_hash {
        if (req.http.cookie) {
                set req.hash += regsub(
                req.http.cookie,
                ".*LOCALIZER_LANGUAGE=%22(..)%22.*",
                "$1");
        }
}

So i investiguate the logs and i found this, it seems that it crash
the process childs.
with %22.

here's the varnish logs:
    0 CLI            Rd vcl.use boot
    0 CLI            Wr 0 200
    0 CLI            Rd start
    0 CLI            Wr 0 200
    0 WorkThread     0xb43e3830 start
   12 SessionOpen  c 72.18.0.221 35046
    0 CLI            Rd vcl.load boot ./bin.XXvU36Ya
    0 CLI            Wr 0 200 Loaded "./bin.XXvU36Ya" as "boot"

    0 CLI            Rd vcl.use boot
    0 CLI            Wr 0 200
    0 CLI            Rd start
    0 CLI            Wr 0 200
    0 WorkThread     0xb41fd830 start
   12 SessionOpen  c 72.18.0.221 35047
    0 CLI            Rd vcl.load boot ./bin.XXvU36Ya
    0 CLI            Wr 0 200 Loaded "./bin.XXvU36Ya" as "boot"

    0 CLI            Rd vcl.use boot
    0 CLI            Wr 0 200
    0 CLI            Rd start
    0 CLI            Wr 0 200
    0 WorkThread     0xb43e3830 start
   12 SessionOpen  c 72.18.0.221 35048
    0 CLI            Rd vcl.load boot ./bin.XXvU36Ya
    0 CLI            Wr 0 200 Loaded "./bin.XXvU36Ya" as "boot"

How can i fix this? Do you need more infos and which one to solve this
another problem :)
Thx


From phk at phk.freebsd.dk  Thu Aug  2 16:49:00 2007
From: phk at phk.freebsd.dk (Poul-Henning Kamp)
Date: Thu, 02 Aug 2007 16:49:00 +0000
Subject: varnish & cookies & multilanguage 
In-Reply-To: Your message of "Thu, 02 Aug 2007 18:12:58 +0200."
	<8e6064260708020912ld274f18n7fea9f636dd6a31@mail.gmail.com> 
Message-ID: <44045.1186073340@critter.freebsd.dk>

In message <8e6064260708020912ld274f18n7fea9f636dd6a31 at mail.gmail.com>, rafailowski writes:
>It doesn't work with this:
>
>sub vcl_hash {
>        if (req.http.cookie) {
>                set req.hash += regsub(
>                req.http.cookie,
>                ".*LOCALIZER_LANGUAGE=%22(..)%22.*",
>                "$1");
>        }
>}
>
>So i investiguate the logs and i found this, it seems that it crash
>the process childs.

It's not the %22 that causes the crash, it is a memory management
issue, and I don't have a 4 minute fix right now, I've opened a
ticket and will look at it.

You may be able to work around this for now by doing the substitution
into a pseudo header in vcl_recv and use that in vcl_hash, something like:

sub vcl_recv {
	[...]
        if (req.http.cookie ~ LOCALIZER_LANGUAGE) {
                set req.http.mylang = regsub(
			req.http.cookie,
			".*LOCALIZER_LANGUAGE=%22(..)%22.*",
			"$1");
		lookup;
        }
	[...]
}


sub vcl_hash {
	set req.hash += req.http.mylang;
}



-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.


From james at nyi.net  Thu Aug  2 16:44:41 2007
From: james at nyi.net (James Quacinella)
Date: Thu, 02 Aug 2007 12:44:41 -0400
Subject: Browser refresh and varnish
In-Reply-To: <46b0df0e17d54@wp.pl>
References: <46b0df0e17d54@wp.pl>
Message-ID: <46B209F9.5080304@nyi.net>

KKK RRR wrote:
> why every time i can't refresh my browser with files from varnish cache ?
>
> for exapmle:
> if i go to www.xxxxx.com/abcd.jpg     then is ok - varnish shows HIT
> but if i refresh it don't work
>   

Maybe because your browser is caching the image abcd.jpeg after the 
inital request ? Depending on your browser, you should either clear your 
local cache or don't cache at all for a certain domain (not sure if 
thats possible). Why not use something like wget?

-- james



From des at linpro.no  Fri Aug  3 08:40:28 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Fri, 03 Aug 2007 10:40:28 +0200
Subject: post request seems to be  broken in 1.1
In-Reply-To: <46B1FAF1.8010808@ac-montpellier.fr> (jean-marc pouchoulon's
	message of "Thu, 02 Aug 2007 17:40:33 +0200")
References: <46B1FAF1.8010808@ac-montpellier.fr>
Message-ID: <ujrabt9t3ib.fsf@false.linpro.no>

jean-marc pouchoulon <jean-marc.pouchoulon at ac-montpellier.fr> writes:
> I've just upgraded to 1.1 and post request seems to be broken
> It seems that  positionnal args are not relayed by varnish 1.1

See ticket #129.  I'll try to take a look at it this weekend.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From andrew at imeem.com  Fri Aug  3 21:41:20 2007
From: andrew at imeem.com (Andrew Knapp)
Date: Fri, 3 Aug 2007 14:41:20 -0700
Subject: varnishd fails under high load
Message-ID: <0A3A6EA86530E64EA3BEA603EC4401CAB8F79B@dexbe014-8.exch014.msoutlookonline.net>

Hey,

 

Sorry if this is the wrong place to be posting this, but I didn't see
any other lists that seemed to fit the question.

 

Basically, we are currently using varnish for some our photo caching,
and it's working perfectly. Here's the relevant portion of varnishstat
from a photo cache:

 

client_conn           4478824        49.86 Client connections accepted

client_req           10146386       112.96 Client requests received

cache_hit             9101426       101.32 Cache hits

cache_hitpass              27         0.00 Cache hits for pass

cache_miss            1044704        11.63 Cache misses

backend_conn          1044954        11.63 Backend connections success

backend_fail                0         0.00 Backend connections failures

backend_reuse          979195        10.90 Backend connections reuses

backend_recycle        985646        10.97 Backend connections recycles

backend_unused             39         0.00 Backend connections unused

 

We start varnishd up with this commandline:

/usr/local/sbin/varnishd -a :80 -f /etc/varnish/default.vcl -T
127.0.0.1:6082 -t 120 -w 1,1000,120 -s
file,/c01/varnish/varnish_storage.bin,40% -u varnish -g varnish -n
/var/varnish -P /var/run/varnish.pid

 

Varnish is working exactly as we expected with photos, and exceptionally
better than squid (which we also use). We have a problem when we use
varnish for serving audio and video files though. Using the same
commandline, varnish eats up all the memory in the system, and then
starts to eat into swap, which in turn makes the system unusable. During
our test, the load rose on the machine to ~950 (!), at which point we
shut it off and went back to using squid, where the load hovers around
~6.

 

The machine running squid is a dell pe1950, 8gb of ram, 1 xeon 2.33 ghz.
The pe1950 has 4 drives in the system formatted as a raid 10, and is
connected to a md1000 (external storage) consisting of 15 73gb 15k scsi
drives formatted in a raid 10+HS. This is formatted at /c01, which, as
you can see above, is where we keep the backend storage for varnish.

 

Unfortunately, I don't have the output from varnish on the audio/video
system. I'm just wondering if anyone has any suggestions on anything I
may be doing wrong. Is 40% (~190GB) too much for a backend storage? The
default.vcl file on the audio/video system is about as simple as you
get, with something added for TTL's. I know varnish is being used on
some pretty big sites out there, so I'm hoping people have some
pointers...

 

Thanks,

 

--

Andrew Knapp | systems engineer | imeem, inc. | 415.762.0135 o |
415.994.5752 m | 415.836.0088 f

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070803/a94101fc/attachment.html>

From sharp_sniper at wp.pl  Sat Aug  4 12:09:07 2007
From: sharp_sniper at wp.pl (KKK RRR)
Date: Sat, 04 Aug 2007 14:09:07 +0200
Subject: SYN_RECV
Message-ID: <46b46c63d39d4@wp.pl>

When i run varnish after 2 min just SYN_RECV connections non 
ESTABLISHED. I have allready set the syn flood protection and syn 
socekts but still nothing. What can be wrong ? (When i run squid this 
problem dosn't exists)

----------------------------------------------------
Najwa?niejsze koncertowe wydarzenie tego lata! METAL HAMMER FESTIVAL
TOOL, Chris Cornell, Dir en Grey, Coma i inni 
12.08.2007 - Katowice, Spodek. Start: godz.: 15:00
http://klik.wp.pl/?adr=http%3A%2F%2Fadv.reklama.wp.pl%2Fas%2Fmetalhammer.html&sid=1246




From sharp_sniper at wp.pl  Sat Aug  4 12:00:26 2007
From: sharp_sniper at wp.pl (KKK RRR)
Date: Sat, 04 Aug 2007 14:00:26 +0200
Subject: SYN_RECV
Message-ID: <46b46a5a29bad@wp.pl>

When i'm running varnish after 2 min i get lots of SYN_RECV connections 
non established. I have allready set the syn flood protection and 
syn_recv socets but still nothing. What can be wrong ?

----------------------------------------------------
Jedni przybyli na Ziemi?, by nas zniszczy?. Inni - by nas chroni?.
"Transformers" - pe?en akcji film Stevena Spielberga
i Michaela Baya w kinach od 17 sierpnia.
http://klik.wp.pl/?adr=http%3A%2F%2Fadv.reklama.wp.pl%2Fas%2Ftransformers.html&sid=1247




From optilude at gmx.net  Tue Aug  7 00:00:41 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Tue, 07 Aug 2007 01:00:41 +0100
Subject: Varnish on OS X and bug #118
Message-ID: <f98cna$s2h$1@sea.gmane.org>

Hi guys,

With Varnish 1.1, I'm able to get it to run on OS X after manually 
applying the patch in http://varnish.projects.linpro.no/ticket/118. Yay!

The funny thing is that someone else with the same version of OS X does 
*not* seem to have to apply the patch.

I've tried to use the most recent libtool from MacPorts, but to no avail.

Two questions:

  - Is there some workaround I can do to make this work without having 
to patch the source?

  - Is there some way Varnish's configure script could detect OS X and 
make this change as appropriate?

I can't work out what export_dynamic_flag_spec="-flat_namespace" 
actually *does, making it hard to explore the space.

Why do I care so much? I want to build varnish automatically as part of 
a server config, using zc.buildout and 
http://cheeseshop.python.org/pypi/plone.recipe.varnish. We could try to 
patch in that recipe, but I'd rather not.

Cheers,
Martin

-- 
Acquisition is a jealous mistress



From des at linpro.no  Tue Aug  7 08:00:35 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Tue, 07 Aug 2007 10:00:35 +0200
Subject: Varnish on OS X and bug #118
In-Reply-To: <f98cna$s2h$1@sea.gmane.org> (Martin Aspeli's message of "Tue, 07
	Aug 2007 01:00:41 +0100")
References: <f98cna$s2h$1@sea.gmane.org>
Message-ID: <ujrwsw7pye4.fsf@false.linpro.no>

Martin Aspeli <optilude at gmx.net> writes:
> Two questions:
>
>   - Is there some workaround I can do to make this work without having
> to patch the source?
>
>   - Is there some way Varnish's configure script could detect OS X and
> make this change as appropriate?
>
> I can't work out what export_dynamic_flag_spec="-flat_namespace"
> actually *does, making it hard to explore the space.

We link varnishd with -export-dynamic, which tells libtool that
symbols defined in varnishd should be available to libraries linked
with varnishd.  Otherwise, varnishd would be able to call VCL code but
the VCL code would not be able to call the VCL runtime (VRT_*) which
is contained partly in varnishd and partly in libvarnish.

The export_dynamic_flag_spec variable tells libtool how it should
translate -export-dynamic when invoking the native linker.  On systems
using the GNU toolchain, this is simply ld's --export-dynamic option
(or gcc's -Wl,--export-dynamic which tells it to invoke ld with the
--export-dynamic option).  On MacOS X, this is -flat_namespace, which
tells the linker to use a single namespace for program and libraries
instead of a two-level namespace where the program can look up symbols
in the libraries but not the other way around.  Note than until 10.3,
-flat_namespace used to be the default.

There is another option you might try instead of the libtool hack,
although I haven't tested it so I don't know if it will actually work:

Index: bin/varnishd/mgt_vcc.c
===================================================================
--- bin/varnishd/mgt_vcc.c      (revision 1808)
+++ bin/varnishd/mgt_vcc.c      (working copy)
@@ -182,7 +182,7 @@
        len = snprintf(buf, sizeof buf,
             "ln -f %s _.c ;"                   /* XXX: for debugging */
 #ifdef __APPLE__
-           "exec cc -dynamiclib -Wl,-flat_namespace,-undefined,suppress -o %s -x c - < %s 2>&1",
+           "exec cc -dynamiclib -Wl,-undefined,dynamic_lookup -o %s -x c - < %s 2>&1",
 #else
            "exec cc -fpic -shared -Wl,-x -o %s -x c - < %s 2>&1",
 #endif

The downside is that this will not work at all on pre-10.3 systems,
whereas -flat_namespace is simply a nop on pre-10.3.

Let me know how it works out...

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From optilude at gmx.net  Tue Aug  7 09:15:31 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Tue, 7 Aug 2007 10:15:31 +0100
Subject: Varnish on OS X and bug #118
In-Reply-To: <ujrwsw7pye4.fsf@false.linpro.no>
References: <f98cna$s2h$1@sea.gmane.org> <ujrwsw7pye4.fsf@false.linpro.no>
Message-ID: <5af21ed10708070215y4d9ec043hc21502cffa8d656d@mail.gmail.com>

Hi Dag,

Thanks for a detailed reply!

The problem, I suppose, is that your other solution still involves
patching the sources.

I do wonder why my MacPorts-installed libtool didn't work, though.
This ought to be the same as the GNU version. It installs as
'glibtool', but I symlinked to libtool and made sure /opt/local/bin
(where it gets installed) comes first.

Ah well, at least I understand why now.

Cheers,
Martin

On 8/7/07, Dag-Erling Sm?rgrav <des at linpro.no> wrote:
> Martin Aspeli <optilude at gmx.net> writes:
> > Two questions:
> >
> >   - Is there some workaround I can do to make this work without having
> > to patch the source?
> >
> >   - Is there some way Varnish's configure script could detect OS X and
> > make this change as appropriate?
> >
> > I can't work out what export_dynamic_flag_spec="-flat_namespace"
> > actually *does, making it hard to explore the space.
>
> We link varnishd with -export-dynamic, which tells libtool that
> symbols defined in varnishd should be available to libraries linked
> with varnishd.  Otherwise, varnishd would be able to call VCL code but
> the VCL code would not be able to call the VCL runtime (VRT_*) which
> is contained partly in varnishd and partly in libvarnish.
>
> The export_dynamic_flag_spec variable tells libtool how it should
> translate -export-dynamic when invoking the native linker.  On systems
> using the GNU toolchain, this is simply ld's --export-dynamic option
> (or gcc's -Wl,--export-dynamic which tells it to invoke ld with the
> --export-dynamic option).  On MacOS X, this is -flat_namespace, which
> tells the linker to use a single namespace for program and libraries
> instead of a two-level namespace where the program can look up symbols
> in the libraries but not the other way around.  Note than until 10.3,
> -flat_namespace used to be the default.
>
> There is another option you might try instead of the libtool hack,
> although I haven't tested it so I don't know if it will actually work:
>
> Index: bin/varnishd/mgt_vcc.c
> ===================================================================
> --- bin/varnishd/mgt_vcc.c      (revision 1808)
> +++ bin/varnishd/mgt_vcc.c      (working copy)
> @@ -182,7 +182,7 @@
>         len = snprintf(buf, sizeof buf,
>              "ln -f %s _.c ;"                   /* XXX: for debugging */
>  #ifdef __APPLE__
> -           "exec cc -dynamiclib -Wl,-flat_namespace,-undefined,suppress -o %s -x c - < %s 2>&1",
> +           "exec cc -dynamiclib -Wl,-undefined,dynamic_lookup -o %s -x c - < %s 2>&1",
>  #else
>             "exec cc -fpic -shared -Wl,-x -o %s -x c - < %s 2>&1",
>  #endif
>
> The downside is that this will not work at all on pre-10.3 systems,
> whereas -flat_namespace is simply a nop on pre-10.3.
>
> Let me know how it works out...
>
> DES
> --
> Dag-Erling Sm?rgrav
> Senior Software Developer
> Linpro AS - www.linpro.no
>
>


From des at linpro.no  Tue Aug  7 09:20:16 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Tue, 07 Aug 2007 11:20:16 +0200
Subject: Varnish on OS X and bug #118
In-Reply-To: <5af21ed10708070215y4d9ec043hc21502cffa8d656d@mail.gmail.com>
	(Martin Aspeli's message of "Tue, 7 Aug 2007 10:15:31 +0100")
References: <f98cna$s2h$1@sea.gmane.org> <ujrwsw7pye4.fsf@false.linpro.no>
	<5af21ed10708070215y4d9ec043hc21502cffa8d656d@mail.gmail.com>
Message-ID: <ujrps1zpupb.fsf@false.linpro.no>

"Martin Aspeli" <optilude at gmx.net> writes:
> The problem, I suppose, is that your other solution still involves
> patching the sources.

Yes, but if this solution works, I'll apply it in Subversion and it
will be in 1.1.1.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From optilude at gmx.net  Tue Aug  7 09:24:50 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Tue, 7 Aug 2007 10:24:50 +0100
Subject: Varnish on OS X and bug #118
In-Reply-To: <ujrps1zpupb.fsf@false.linpro.no>
References: <f98cna$s2h$1@sea.gmane.org> <ujrwsw7pye4.fsf@false.linpro.no>
	<5af21ed10708070215y4d9ec043hc21502cffa8d656d@mail.gmail.com>
	<ujrps1zpupb.fsf@false.linpro.no>
Message-ID: <5af21ed10708070224j23eae5baj8da232aa3d53ebab@mail.gmail.com>

Ah, I get you! Right, I'll try it tonight when I get home. Thanks! :)

Martin

On 8/7/07, Dag-Erling Sm?rgrav <des at linpro.no> wrote:
> "Martin Aspeli" <optilude at gmx.net> writes:
> > The problem, I suppose, is that your other solution still involves
> > patching the sources.
>
> Yes, but if this solution works, I'll apply it in Subversion and it
> will be in 1.1.1.
>
> DES
> --
> Dag-Erling Sm?rgrav
> Senior Software Developer
> Linpro AS - www.linpro.no
>
>


From optilude at gmx.net  Tue Aug  7 18:38:43 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Tue, 07 Aug 2007 19:38:43 +0100
Subject: Varnish on OS X and bug #118
In-Reply-To: <5af21ed10708070224j23eae5baj8da232aa3d53ebab@mail.gmail.com>
References: <f98cna$s2h$1@sea.gmane.org>
	<ujrwsw7pye4.fsf@false.linpro.no>	<5af21ed10708070215y4d9ec043hc21502cffa8d656d@mail.gmail.com>	<ujrps1zpupb.fsf@false.linpro.no>
	<5af21ed10708070224j23eae5baj8da232aa3d53ebab@mail.gmail.com>
Message-ID: <46B8BC33.9080006@gmx.net>

Martin Aspeli wrote:
> Ah, I get you! Right, I'll try it tonight when I get home. Thanks! :)
> 
> Martin
> 
> On 8/7/07, Dag-Erling Sm?rgrav <des at linpro.no> wrote:
>> "Martin Aspeli" <optilude at gmx.net> writes:
>>> The problem, I suppose, is that your other solution still involves
>>> patching the sources.
>> Yes, but if this solution works, I'll apply it in Subversion and it
>> will be in 1.1.1.

Alas, I have the exact same problem after making the change you suggested.

In bin/varnishd/mgt_vcc.c, I have:

#ifdef __APPLE__
	    "exec cc -dynamiclib -Wl,-undefined,dynamic_lookup -o %s -x c - < 
%s 2>&1",
#else
	    "exec cc -fpic -shared -Wl,-x -o %s -x c - < %s 2>&1",
#endif

Oh well :)

Martin

-- 
Acquisition is a jealous mistress



From admin at adofms.com.au  Wed Aug  8 08:10:02 2007
From: admin at adofms.com.au (ADOFMS Admin, SteveOC)
Date: Wed, 08 Aug 2007 17:40:02 +0930
Subject: post request seems to be  broken in 1.1
In-Reply-To: <ujrabt9t3ib.fsf@false.linpro.no>
References: <46B1FAF1.8010808@ac-montpellier.fr>
	<ujrabt9t3ib.fsf@false.linpro.no>
Message-ID: <46B97A5A.2080400@adofms.com.au>

An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070808/585beeba/attachment.html>

From janis.putrams at delfi.lv  Wed Aug  8 14:56:55 2007
From: janis.putrams at delfi.lv (Janis Putrams)
Date: Wed, 8 Aug 2007 17:56:55 +0300
Subject: master process dies
Message-ID: <200708081756.56100.janis.putrams@delfi.lv>

Hi!

I was using varnish-1.0.4 on a high load site (1.5k req/sec) for some time but 
i experienced frequent slave process restarts and master process died couple 
times a week so I gave version 1.1 a shoot.

Unfortunately it is not able to stand a minute for me.

I start it with prams
varnishd \
-f /etc/varnishd/varnishd.conf \
-T 127.0.0.1:81 \
-P /var/run/varnishd.pid \
-s file,/var/spool/varnishd/varnishd_storage.bin,80% \
-w1,1000,10

ulimit should not be problem. I was hitting 1024 open file limit before but I 
rised to 4k and now it should be ok.
09:52:48 root[pts/0]@slow install/varnish-1.0.4# ulimit -a

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
file size               (blocks, -f) unlimited
pending signals                 (-i) 71679
max locked memory       (kbytes, -l) 32
max memory size         (kbytes, -m) unlimited
open files                      (-n) 4096
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) unlimited
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited

Please let me know if I am doing anything wrong or if you need more 
information.
Thanks in advance.

Regards,
Janis Putrams


  591 TxHeader     c Cache-Control: max-age=604800
  591 TxHeader     c Expires: Wed, 15 Aug 2007 14:39:08 GMT
  591 TxHeader     c Last-Modified: Tue, 10 Jan 2006 14:39:11 GMT
  591 TxHeader     c ETag: "306822-41c-43c3c70f"
  591 TxHeader     c Content-Type: image/gif
  591 TxHeader     c Content-Length: 1052
  591 TxHeader     c X-Varnish: 1925192785 1925189572
  591 TxHeader     c Age: 7
  591 TxHeader     c Via: 1.1 varnish
  591 ReqEnd       c 1925192785 1186555449.238996983 1186555449.239022017 
0.033437967 0.000010967 0.000014067
    0 StatAddr       87.110.39.195 0 6 7 76 0 0 0 21657 266384
  613 Debug        c "/images/pix/file18649684_P1030658_m.jpg#g.delfi.lv#"
 1042 SessionOpen  c 212.59.5.226 13387
 1042 Debug        c "/images/pix/file18666723_stena_m.jpg#g.delfi.lv#"
 1042 ReqStart     c 212.59.5.226 13387 1925192787
 1042 RxRequest    c GET
 1042 RxURL        c /images/pix/file18666723_stena_m.jpg
 1042 RxProtocol   c HTTP/1.0
 1042 RxHeader     c Accept: */*
 1042 RxHeader     c Referer: http://rus.delfi.lv/
 1042 RxHeader     c Accept-Language: lt
 1042 RxHeader     c Accept-Encoding: gzip, deflate
 1042 RxHeader     c User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 
5.1; SV1; .NET CLR 1.1.4322; InfoPath.1)
 1042 RxHeader     c Host: g.delfi.lv
 1042 RxHeader     c Cookie: dcid=38689710,1,1216734222; spl1=t=1; spl2=t=1; 
FLY=t=1
 1042 RxHeader     c Via: 1.1 proxy.parex.lt:8080 (squid/2.6.STABLE13)
 1042 RxHeader     c Cache-Control: max-age=259200
 1042 RxHeader     c Connection: keep-alive
 1042 VCL_call     c recv
 1042 VCL_return   c lookup
 1042 VCL_call     c hash
 1042 VCL_return   c hash
 1042 Hit          c 1925190775
 1042 VCL_call     c hit
 1042 VCL_return   c deliver
 1042 Length       c 4044
 1042 VCL_call     c deliver
 1042 VCL_return   c deliver
 1042 TxProtocol   c HTTP/1.1
 1042 TxStatus     c 200
 1042 TxResponse   c OK
 1042 TxHeader     c Date: Wed, 08 Aug 2007 14:39:12 GMT
 1042 TxHeader     c Server: Apache/1.3.31 (Unix)
 1042 TxHeader     c Cache-Control: max-age=604800
 1042 TxHeader     c Expires: Wed, 15 Aug 2007 14:39:12 GMT
 1042 TxHeader     c Last-Modified: Wed, 08 Aug 2007 12:43:56 GMT
 1042 TxHeader     c ETag: "35345d-fcc-46b9ba8c"
 1042 TxHeader     c Content-Type: image/jpeg
 1042 TxHeader     c Content-Length: 4044
 1042 TxHeader     c X-Varnish: 1925192787 1925190775
 1042 TxHeader     c Age: 3
 1042 TxHeader     c Via: 1.1 varnish
 1042 ReqEnd       c 1925192787 1186555449.252010107 1186555449.252043962 
0.002454996 0.000012875 0.000020981
    0 StatAddr       212.59.5.226 0 2 2 2 0 0 0 561 9489
 1057 SessionOpen  c 87.110.110.235 2120
  764 Debug        c "/misc/spl.php?a=7#www.delfi.lv#"
  764 ReqStart     c 84.237.141.183 60187 1925192788
26490 (null)         ip, deflate
12084 (null)         .0 (compatible; MSIE 6.0; Windows NT 5.0; .NET CLR 
1.1.4322)
26725 (null)
14388 (null)         4; client_ID_2=3606747; session_ID_2=13156510;
29555 (null)         ion_expires_2=20070202115637; 
ASP.NET_SessionId=1k2qfa45slj2zj45c40z3vyd
25956 (null)         -Since: Wed, 08 Aug 2007 14:27:26 GMT
21037 (null)         1lapa.gif#g.delfi.lv#
18772 ExpKill        E_Vodafone_HR-1lapa.gif
28730 (null)         //www.delfi.lv/
12602 ObjStatus      02:10 GMT; length=1689
25455 ObjStatus      mpatible; MSIE 6.0; Windows NT 5.1; SV1;
17748 ExpPick         CLR 1.1.4322)
14643 (null)         63813,1,1203497503; __utma=113760658.1720421453.11
13873 Terminate      505.1177701718.1177704073.306; __utmz=113760658.117197791
14126 ExpPick        2.utmccn=(organic)|utmcsr=google|utmctr=lezbes|ut
25661 (null)         organic; FLY=t=4; spl1=t=1
27753 (null)         ver
11825 ObjStatus       varnish
14880 (null)         Wed, 20 Jun 2007 11:01:23 GMT
12336 WorkThread     10967 0.000028133
 8246 ObjStatus      273 0


From chulmin2 at hotmail.com  Thu Aug  9 11:01:55 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Thu, 09 Aug 2007 11:01:55 +0000
Subject: Any maximum object size limit?
Message-ID: <BAY101-F2426CDE7036E4BCFF4E60E85E00@phx.gbl>

Hello, all.

Is there any maximum object size limit at varnish which can save at cache?
I can't find any related option at the man page.

If there is no limit, one can download throught 1G file via varnish and 
then varnish would save that object(1G) at cache, right?
 

Thanks in advance.

_________________________________________________________________
?? ?? ?? ??? ?????? MSN ???? ?????. 
http://fortune.msn.co.kr/ 



From des at linpro.no  Thu Aug  9 12:21:28 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Thu, 09 Aug 2007 14:21:28 +0200
Subject: Any maximum object size limit?
In-Reply-To: <BAY101-F2426CDE7036E4BCFF4E60E85E00@phx.gbl> (Monty Ree's
	message of "Thu, 09 Aug 2007 11:01:55 +0000")
References: <BAY101-F2426CDE7036E4BCFF4E60E85E00@phx.gbl>
Message-ID: <ujrps1wsxtj.fsf@false.linpro.no>

"Monty Ree" <chulmin2 at hotmail.com> writes:
> Is there any maximum object size limit at varnish which can save at
> cache?

The size of the cache file.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From rafailow at gmail.com  Thu Aug  9 13:11:44 2007
From: rafailow at gmail.com (rafailowski)
Date: Thu, 9 Aug 2007 15:11:44 +0200
Subject: varnish & cookies & multilanguage
In-Reply-To: <44045.1186073340@critter.freebsd.dk>
References: <8e6064260708020912ld274f18n7fea9f636dd6a31@mail.gmail.com>
	<44045.1186073340@critter.freebsd.dk>
Message-ID: <8e6064260708090611raefe0cek61ada8ed719e4935@mail.gmail.com>

Hello, just a (late!) feed back...
It's works really fine.

sub vcl_recv {
        if (req.http.cookie ~ "LOCALIZER_LANGUAGE") {
                set req.http.mylang = regsub(
                        req.http.cookie,
                        ".*LOCALIZER_LANGUAGE=%22(..)%22.*",
                        "$1");
                lookup;
        }
        [...]
        lookup;
}

sub vcl_hash {
        set req.hash += req.http.mylang;
}

Thanks again :)


From des at linpro.no  Thu Aug  9 14:12:52 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Thu, 09 Aug 2007 16:12:52 +0200
Subject: 1.1.1 progress
Message-ID: <ujrk5s4ssnv.fsf@false.linpro.no>

I thought I'd let you know what's currently going on at our top-secret
underground Varnish R&D facility:

 - Poul-Henning has been working hard to resolve the stability issues
   and assertion failures some of you have reported (#136, #137, #138,
   #139, #140, #141 and #143 should be fixed, while #132, #142 and
   #144 are still being worked on) as well as working on 2.0 features.

 - I have been working on other bugs and build issues (#128, #130,
   #131 and #135 should be fixed, while #129 is still being worked on)
   as well as improving our test framework (and writing additional
   test cases) and trying to get Varnish to build and run reliably on
   Mac OS X and Solaris 10.

 - Cecilie will be back on Monday and resume work on 2.0 features.

 - I just merged a ton of bug fixes from trunk to branches/1.1.
   Please please *please*, if you are running 1.0.4 or 1.1 today, take
   the time to test branches/1.1 and let me know about any remaining
   bugs or regressions.  I would love to be able to close all
   outstanding tickets on 1.0.4 and 1.1 and release 1.1.1 on August
   20th.  Pretty please?  With sugar on top?

Thanks,

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From janis.putrams at delfi.lv  Thu Aug  9 15:47:48 2007
From: janis.putrams at delfi.lv (Janis Putrams)
Date: Thu, 9 Aug 2007 18:47:48 +0300
Subject: 1.1.1 progress
In-Reply-To: <ujrk5s4ssnv.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no>
Message-ID: <200708091847.49134.janis.putrams@delfi.lv>

Tnx for the fixes.

I have just installed latest svn from branches/1.1.
It's been running ok for 20min with arround 600req/sec with no slave process 
restarts.

I had to modify Makefiles manually for it to find curses.h but that could as 
well be problem on my side.

Thanks once again and will see if it holds till tomorrow.

Janis

On Thursday 09 August 2007 17:12, Dag-Erling Sm?rgrav wrote:
> I thought I'd let you know what's currently going on at our top-secret
> underground Varnish R&D facility:
>
>  - Poul-Henning has been working hard to resolve the stability issues
>    and assertion failures some of you have reported (#136, #137, #138,
>    #139, #140, #141 and #143 should be fixed, while #132, #142 and
>    #144 are still being worked on) as well as working on 2.0 features.
>
>  - I have been working on other bugs and build issues (#128, #130,
>    #131 and #135 should be fixed, while #129 is still being worked on)
>    as well as improving our test framework (and writing additional
>    test cases) and trying to get Varnish to build and run reliably on
>    Mac OS X and Solaris 10.
>
>  - Cecilie will be back on Monday and resume work on 2.0 features.
>
>  - I just merged a ton of bug fixes from trunk to branches/1.1.
>    Please please *please*, if you are running 1.0.4 or 1.1 today, take
>    the time to test branches/1.1 and let me know about any remaining
>    bugs or regressions.  I would love to be able to close all
>    outstanding tickets on 1.0.4 and 1.1 and release 1.1.1 on August
>    20th.  Pretty please?  With sugar on top?
>
> Thanks,
>
> DES


From des at linpro.no  Thu Aug  9 15:49:59 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Thu, 09 Aug 2007 17:49:59 +0200
Subject: 1.1.1 progress
In-Reply-To: <200708091847.49134.janis.putrams@delfi.lv> (Janis Putrams's
	message of "Thu, 9 Aug 2007 18:47:48 +0300")
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708091847.49134.janis.putrams@delfi.lv>
Message-ID: <ujr3aysso60.fsf@false.linpro.no>

Janis Putrams <janis.putrams at delfi.lv> writes:
> I had to modify Makefiles manually for it to find curses.h but that
> could as well be problem on my side.

What OS are you running on, and where is your curses.h installed?

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From optilude at gmx.net  Thu Aug  9 21:13:13 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Thu, 09 Aug 2007 22:13:13 +0100
Subject: 1.1.1 progress
In-Reply-To: <ujrk5s4ssnv.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no>
Message-ID: <f9g01f$tgi$1@sea.gmane.org>

Dag-Erling Sm?rgrav wrote:
> I thought I'd let you know what's currently going on at our top-secret
> underground Varnish R&D facility:
> 
>  - Poul-Henning has been working hard to resolve the stability issues
>    and assertion failures some of you have reported (#136, #137, #138,
>    #139, #140, #141 and #143 should be fixed, while #132, #142 and
>    #144 are still being worked on) as well as working on 2.0 features.
> 
>  - I have been working on other bugs and build issues (#128, #130,
>    #131 and #135 should be fixed, while #129 is still being worked on)
>    as well as improving our test framework (and writing additional
>    test cases) and trying to get Varnish to build and run reliably on
>    Mac OS X

Please allow me to cheer-lead: Woohooo! You rock! :-)

> and Solaris 10.
>
>  - Cecilie will be back on Monday and resume work on 2.0 features.
> 
>  - I just merged a ton of bug fixes from trunk to branches/1.1.
>    Please please *please*, if you are running 1.0.4 or 1.1 today, take
>    the time to test branches/1.1 and let me know about any remaining
>    bugs or regressions.  I would love to be able to close all
>    outstanding tickets on 1.0.4 and 1.1 and release 1.1.1 on August
>    20th.  Pretty please?  With sugar on top?

Are there any OS X fixes in the 1.1 branch? If so, I'll try to test this 
weekend.

Martin

-- 
Acquisition is a jealous mistress



From des at linpro.no  Fri Aug 10 09:11:10 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Fri, 10 Aug 2007 11:11:10 +0200
Subject: 1.1.1 progress
In-Reply-To: <f9g01f$tgi$1@sea.gmane.org> (Martin Aspeli's message of "Thu, 09
	Aug 2007 22:13:13 +0100")
References: <ujrk5s4ssnv.fsf@false.linpro.no> <f9g01f$tgi$1@sea.gmane.org>
Message-ID: <ujrvebnbvpt.fsf@false.linpro.no>

Martin Aspeli <optilude at gmx.net> writes:
> Are there any OS X fixes in the 1.1 branch?

Some, yes.  At least, I hope the -flat_namespace hack is no longer
required, but I don't have a Mac to test on right now.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From janis.putrams at delfi.lv  Fri Aug 10 12:41:33 2007
From: janis.putrams at delfi.lv (Janis Putrams)
Date: Fri, 10 Aug 2007 15:41:33 +0300
Subject: 1.1.1 progress
In-Reply-To: <ujr3aysso60.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708091847.49134.janis.putrams@delfi.lv>
	<ujr3aysso60.fsf@false.linpro.no>
Message-ID: <200708101541.33779.janis.putrams@delfi.lv>

07:37:04 root[pts/1]@slow ~# uname -a
Linux slow 2.6.16.52-1smp #1 SMP Thu May 31 19:32:54 CEST 2007 i686 Intel(R)_Xeon(R)_CPU____________5150__ at _2.66GHz PLD Linux
07:37:05 root[pts/1]@slow ~# locate curses.h
/usr/include/ncurses/ncurses.h
/usr/include/ncurses/curses.h
/usr/include/ncursesw/ncurses.h
/usr/include/ncursesw/curses.h
07:37:27 root[pts/1]@slow ~# rpm -qf /usr/include/ncurses/curses.h
ncurses-devel-5.5-2
07:37:38 root[pts/1]@slow ~#

when running ./configure from source package varnish-1.1.tar.gz in Makefile it set:
CURSES_LIBS = -lcurses

when I checked source out from svn, run autogen.sh and then ./configure it set:
CURSES_LIBS =

In the seccond case I had to add -lcurses and -I /usr/include/ncurses. In the first case just the -I /usr/include/ncurses


Currently varnish from svn has been running for a day. Master process does not die but slave process still does restarts approximately once in hour.
Will try to get logs from those moments when slave does restarts.

janis


On Thursday 09 August 2007 18:49, Dag-Erling Sm?rgrav wrote:
> Janis Putrams <janis.putrams at delfi.lv> writes:
> > I had to modify Makefiles manually for it to find curses.h but that
> > could as well be problem on my side.
>
> What OS are you running on, and where is your curses.h installed?
>
> DES


From des at linpro.no  Fri Aug 10 13:40:04 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Fri, 10 Aug 2007 15:40:04 +0200
Subject: 1.1.1 progress
In-Reply-To: <200708101541.33779.janis.putrams@delfi.lv> (Janis Putrams's
	message of "Fri, 10 Aug 2007 15:41:33 +0300")
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708091847.49134.janis.putrams@delfi.lv>
	<ujr3aysso60.fsf@false.linpro.no>
	<200708101541.33779.janis.putrams@delfi.lv>
Message-ID: <ujrabszbj9n.fsf@false.linpro.no>

Janis Putrams <janis.putrams at delfi.lv> writes:
> On Thursday 09 August 2007 18:49, Dag-Erling Sm?rgrav wrote:
> > Janis Putrams <janis.putrams at delfi.lv> writes:
> > > I had to modify Makefiles manually for it to find curses.h but that
> > > could as well be problem on my side.
> > What OS are you running on, and where is your curses.h installed?
> [...]

You still haven't told me what OS you're running.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From fragfutter at gmail.com  Fri Aug 10 13:49:43 2007
From: fragfutter at gmail.com (C. Handel)
Date: Fri, 10 Aug 2007 15:49:43 +0200
Subject: 1.1.1 progress
In-Reply-To: <ujrabszbj9n.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708091847.49134.janis.putrams@delfi.lv>
	<ujr3aysso60.fsf@false.linpro.no>
	<200708101541.33779.janis.putrams@delfi.lv>
	<ujrabszbj9n.fsf@false.linpro.no>
Message-ID: <3d62bd5f0708100649pb215cf9o6c872e42d397b454@mail.gmail.com>

> > > What OS are you running on, and where is your curses.h installed?
> > [...]
>
> You still haven't told me what OS you're running.

GNU/LInux (there is a uname in the last post: Linux slow
2.6.16.52-1smp, from the kernel version i guess distribution
pld-linux)

Greetings
   Christoph


From janis.putrams at delfi.lv  Fri Aug 10 13:49:51 2007
From: janis.putrams at delfi.lv (Janis Putrams)
Date: Fri, 10 Aug 2007 16:49:51 +0300
Subject: 1.1.1 progress
In-Reply-To: <ujrabszbj9n.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708101541.33779.janis.putrams@delfi.lv>
	<ujrabszbj9n.fsf@false.linpro.no>
Message-ID: <200708101649.51706.janis.putrams@delfi.lv>

PLD Linux Distribution <http://www.pld-linux.org/>.
PLD 2.0 (Ac)

janis

On Friday 10 August 2007 16:40, Dag-Erling Sm?rgrav wrote:
> Janis Putrams <janis.putrams at delfi.lv> writes:
> > On Thursday 09 August 2007 18:49, Dag-Erling Sm?rgrav wrote:
> > > Janis Putrams <janis.putrams at delfi.lv> writes:
> > > > I had to modify Makefiles manually for it to find curses.h but that
> > > > could as well be problem on my side.
> > >
> > > What OS are you running on, and where is your curses.h installed?
> >
> > [...]
>
> You still haven't told me what OS you're running.
>
> DES


From des at linpro.no  Fri Aug 10 13:53:41 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Fri, 10 Aug 2007 15:53:41 +0200
Subject: 1.1.1 progress
In-Reply-To: <3d62bd5f0708100649pb215cf9o6c872e42d397b454@mail.gmail.com>
	(C. Handel's message of "Fri, 10 Aug 2007 15:49:43 +0200")
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708091847.49134.janis.putrams@delfi.lv>
	<ujr3aysso60.fsf@false.linpro.no>
	<200708101541.33779.janis.putrams@delfi.lv>
	<ujrabszbj9n.fsf@false.linpro.no>
	<3d62bd5f0708100649pb215cf9o6c872e42d397b454@mail.gmail.com>
Message-ID: <ujr1webbimy.fsf@false.linpro.no>

"C. Handel" <fragfutter at gmail.com> writes:
> Dag-Erling Sm?rgrav <des at linpro.no> writes:
> > You still haven't told me what OS you're running.
> GNU/LInux (there is a uname in the last post: Linux slow
> 2.6.16.52-1smp, from the kernel version i guess distribution
> pld-linux)

Linux is not an OS.  Linux is a kernel.  I need to know what OS Janis
is running, and I don't like to guess.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From optilude at gmx.net  Sun Aug 12 21:48:43 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Sun, 12 Aug 2007 22:48:43 +0100
Subject: 1.1.1 progress
In-Reply-To: <ujrvebnbvpt.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no> <f9g01f$tgi$1@sea.gmane.org>
	<ujrvebnbvpt.fsf@false.linpro.no>
Message-ID: <f9nv85$mvc$1@sea.gmane.org>

Dag-Erling Sm?rgrav wrote:
> Martin Aspeli <optilude at gmx.net> writes:
>> Are there any OS X fixes in the 1.1 branch?
> 
> Some, yes.  At least, I hope the -flat_namespace hack is no longer
> required, but I don't have a Mac to test on right now.

I just tried it, doing the following:

  $ svn co http://varnish.projects.linpro.no/svn/branches/1.1
  $ ./autogen.sh
  $ ./configure.sh --prefix=/path/to/install/dir
  $ make
  $ make install

And it works! I no longer have to do the libtool patch from 
http://varnish.projects.linpro.no/ticket/118.

Note that my environment is maybe not 100% "normal", in that I have GNU 
versions of various tools (including libtool) installed via MacPorts. 
But I definitely had to do the workaround before, and I no longer do, so 
I assume it's fixed.

If others can confirm, you may be able to close 118 now.

Thanks!
Martin

-- 
Acquisition is a jealous mistress



From hovenko at linpro.no  Mon Aug 13 09:19:42 2007
From: hovenko at linpro.no (Knut-Olav Hoven)
Date: Mon, 13 Aug 2007 11:19:42 +0200
Subject: Custom error message
Message-ID: <200708131119.42780.hovenko@linpro.no>

How can I customize the error messages that Varnish return?

I often recieve a 503 Service Unavailable because my Apache/PHP webserver 
segfaults (probably because of the PHP op-code caching).

I don't want my users to see the default 503 error message with a link to 
Varnish. They believe that is something they need to install to see my page.


-- 
Knut-Olav Hoven
Systemutvikler               mob: +47 986 71 700
Linpro AS                    http://www.linpro.no/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part.
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070813/e28ffe94/attachment.bin>

From des at linpro.no  Mon Aug 13 10:11:47 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 13 Aug 2007 12:11:47 +0200
Subject: Custom error message
In-Reply-To: <200708131119.42780.hovenko@linpro.no> (Knut-Olav Hoven's message
	of "Mon, 13 Aug 2007 11:19:42 +0200")
References: <200708131119.42780.hovenko@linpro.no>
Message-ID: <ujrps1ru4kc.fsf@false.linpro.no>

Knut-Olav Hoven <hovenko at linpro.no> writes:
> How can I customize the error messages that Varnish return?

Not easily; edit bin/varnishd/cache_synthetic.c and recompile.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From hovenko at linpro.no  Mon Aug 13 10:23:28 2007
From: hovenko at linpro.no (Knut-Olav Hoven)
Date: Mon, 13 Aug 2007 12:23:28 +0200
Subject: Custom error message
In-Reply-To: <ujrps1ru4kc.fsf@false.linpro.no>
References: <200708131119.42780.hovenko@linpro.no>
	<ujrps1ru4kc.fsf@false.linpro.no>
Message-ID: <200708131223.39508.hovenko@linpro.no>

On Monday 13 August 2007 12:11:47 Dag-Erling Sm?rgrav wrote:
> Knut-Olav Hoven <hovenko at linpro.no> writes:
> > How can I customize the error messages that Varnish return?
>
> Not easily; edit bin/varnishd/cache_synthetic.c and recompile.

Ok.

So I can't intercept the response in vcl, detect if the response code is 503 
and then trigger a new 503 error with a different message or HTML code?



-- 
Knut-Olav Hoven
Systemutvikler               mob: +47 986 71 700
Linpro AS                    http://www.linpro.no/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part.
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070813/558bd538/attachment.bin>

From ric at digitalmarbles.com  Mon Aug 13 10:28:11 2007
From: ric at digitalmarbles.com (Ricardo Newbery)
Date: Mon, 13 Aug 2007 03:28:11 -0700
Subject: 1.1.1 progress
In-Reply-To: <f9nv85$mvc$1@sea.gmane.org>
References: <ujrk5s4ssnv.fsf@false.linpro.no> <f9g01f$tgi$1@sea.gmane.org>
	<ujrvebnbvpt.fsf@false.linpro.no> <f9nv85$mvc$1@sea.gmane.org>
Message-ID: <D9ECE76C-1F22-4AC1-B581-CFA2988572C0@digitalmarbles.com>


On Aug 12, 2007, at 2:48 PM, Martin Aspeli wrote:

> Dag-Erling Sm?rgrav wrote:
>> Martin Aspeli <optilude at gmx.net> writes:
>>> Are there any OS X fixes in the 1.1 branch?
>>
>> Some, yes.  At least, I hope the -flat_namespace hack is no longer
>> required, but I don't have a Mac to test on right now.
>
> I just tried it, doing the following:
>
>   $ svn co http://varnish.projects.linpro.no/svn/branches/1.1
>   $ ./autogen.sh
>   $ ./configure.sh --prefix=/path/to/install/dir
>   $ make
>   $ make install
>
> And it works! I no longer have to do the libtool patch from
> http://varnish.projects.linpro.no/ticket/118.
>
> Note that my environment is maybe not 100% "normal", in that I have  
> GNU
> versions of various tools (including libtool) installed via MacPorts.
> But I definitely had to do the workaround before, and I no longer  
> do, so
> I assume it's fixed.
>
> If others can confirm, you may be able to close 118 now.
>
> Thanks!
> Martin


Not so fast.  I still needed to update automake as per the  
instructions on http://varnish.projects.linpro.no/wiki/Installation  
(slightly modified since the autogen.sh file is now a little different).

Also, I think you meant  ./configure, not ./configure.sh

Running OS X 10.4.10 on an Intel Core Duo.  Mostly stock with just a  
couple of Fink and MacPorts installed tools.

Ric





From phk at phk.freebsd.dk  Mon Aug 13 10:31:04 2007
From: phk at phk.freebsd.dk (Poul-Henning Kamp)
Date: Mon, 13 Aug 2007 10:31:04 +0000
Subject: Custom error message 
In-Reply-To: Your message of "Mon, 13 Aug 2007 12:23:28 +0200."
	<200708131223.39508.hovenko@linpro.no> 
Message-ID: <93975.1187001064@critter.freebsd.dk>

In message <200708131223.39508.hovenko at linpro.no>, Knut-Olav Hoven writes:

>On Monday 13 August 2007 12:11:47 Dag-Erling Sm=F8rgrav wrote:
>> Knut-Olav Hoven <hovenko at linpro.no> writes:
>> > How can I customize the error messages that Varnish return?
>>
>> Not easily; edit bin/varnishd/cache_synthetic.c and recompile.
>
>Ok.
>
>So I can't intercept the response in vcl, detect if the response code is 503 
>and then trigger a new 503 error with a different message or HTML code?

You can change the status but not the HTML ... yet.

We have ideas for this area, basically, you would detect the 503,
edit req.url and restart the transaction with the new url.

Not yet implemented however.

We have also talked about being able to have local content on the
varnish server, likely in the form of a .tar file, but this is also
yet to be implemented.


-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.


From des at linpro.no  Mon Aug 13 10:40:49 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 13 Aug 2007 12:40:49 +0200
Subject: 1.1.1 progress
In-Reply-To: <D9ECE76C-1F22-4AC1-B581-CFA2988572C0@digitalmarbles.com>
	(Ricardo Newbery's message of "Mon, 13 Aug 2007 03:28:11 -0700")
References: <ujrk5s4ssnv.fsf@false.linpro.no> <f9g01f$tgi$1@sea.gmane.org>
	<ujrvebnbvpt.fsf@false.linpro.no> <f9nv85$mvc$1@sea.gmane.org>
	<D9ECE76C-1F22-4AC1-B581-CFA2988572C0@digitalmarbles.com>
Message-ID: <ujrlkcfu37y.fsf@false.linpro.no>

Ricardo Newbery <ric at digitalmarbles.com> writes:
> Not so fast.  I still needed to update automake as per the
> instructions on http://varnish.projects.linpro.no/wiki/Installation
> (slightly modified since the autogen.sh file is now a little
> different).

Why?  I would expect that /opt/local/bin would be in your path if you
had anything of interest installed there.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Mon Aug 13 10:49:53 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 13 Aug 2007 12:49:53 +0200
Subject: 1.1.1 progress
In-Reply-To: <ujrlkcfu37y.fsf@false.linpro.no> (Dag-Erling
	=?iso-8859-1?Q?Sm=F8rgrav's?= message
	of "Mon, 13 Aug 2007 12:40:49 +0200")
References: <ujrk5s4ssnv.fsf@false.linpro.no> <f9g01f$tgi$1@sea.gmane.org>
	<ujrvebnbvpt.fsf@false.linpro.no> <f9nv85$mvc$1@sea.gmane.org>
	<D9ECE76C-1F22-4AC1-B581-CFA2988572C0@digitalmarbles.com>
	<ujrlkcfu37y.fsf@false.linpro.no>
Message-ID: <ujrhcn3u2su.fsf@false.linpro.no>

Dag-Erling Sm?rgrav <des at linpro.no> writes:
> Ricardo Newbery <ric at digitalmarbles.com> writes:
> > Not so fast.  I still needed to update automake as per the
> > instructions on http://varnish.projects.linpro.no/wiki/Installation
> > (slightly modified since the autogen.sh file is now a little
> > different).
> Why?  I would expect that /opt/local/bin would be in your path if you
> had anything of interest installed there.

I see that these instructions say that the automake version that comes
with Mac OS X (Xcode, actually) is too old, but I haven't had any
problems with it.  Just use the system's automake and ignore the
warning from autogen.sh.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From malevo at gmail.com  Mon Aug 13 11:05:39 2007
From: malevo at gmail.com (=?ISO-8859-1?Q?Pablo_Garc=EDa?=)
Date: Mon, 13 Aug 2007 08:05:39 -0300
Subject: Custom error message
In-Reply-To: <93975.1187001064@critter.freebsd.dk>
References: <200708131223.39508.hovenko@linpro.no>
	<93975.1187001064@critter.freebsd.dk>
Message-ID: <4ec3c3f70708130405p682f4774v9e248f62dda4be0c@mail.gmail.com>

You can always customize your apache error page.

Regards, Pablo

On 8/13/07, Poul-Henning Kamp <phk at phk.freebsd.dk> wrote:
> In message <200708131223.39508.hovenko at linpro.no>, Knut-Olav Hoven writes:
>
> >On Monday 13 August 2007 12:11:47 Dag-Erling Sm=F8rgrav wrote:
> >> Knut-Olav Hoven <hovenko at linpro.no> writes:
> >> > How can I customize the error messages that Varnish return?
> >>
> >> Not easily; edit bin/varnishd/cache_synthetic.c and recompile.
> >
> >Ok.
> >
> >So I can't intercept the response in vcl, detect if the response code is 503
> >and then trigger a new 503 error with a different message or HTML code?
>
> You can change the status but not the HTML ... yet.
>
> We have ideas for this area, basically, you would detect the 503,
> edit req.url and restart the transaction with the new url.
>
> Not yet implemented however.
>
> We have also talked about being able to have local content on the
> varnish server, likely in the form of a .tar file, but this is also
> yet to be implemented.
>
>
> --
> Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
> phk at FreeBSD.ORG         | TCP/IP since RFC 956
> FreeBSD committer       | BSD since 4.3-tahoe
> Never attribute to malice what can adequately be explained by incompetence.
> _______________________________________________
> varnish-misc mailing list
> varnish-misc at projects.linpro.no
> http://projects.linpro.no/mailman/listinfo/varnish-misc
>


From hovenko at linpro.no  Mon Aug 13 11:11:59 2007
From: hovenko at linpro.no (Knut-Olav Hoven)
Date: Mon, 13 Aug 2007 13:11:59 +0200
Subject: Custom error message
In-Reply-To: <4ec3c3f70708130405p682f4774v9e248f62dda4be0c@mail.gmail.com>
References: <200708131223.39508.hovenko@linpro.no>
	<93975.1187001064@critter.freebsd.dk>
	<4ec3c3f70708130405p682f4774v9e248f62dda4be0c@mail.gmail.com>
Message-ID: <200708131312.15293.hovenko@linpro.no>

On Monday 13 August 2007 13:05:39 Pablo Garc?a wrote:
> You can always customize your apache error page.

No, I don't think I can, since PHP segfaults and takes Apache down with it.

>
> Regards, Pablo
>
> On 8/13/07, Poul-Henning Kamp <phk at phk.freebsd.dk> wrote:
> > In message <200708131223.39508.hovenko at linpro.no>, Knut-Olav Hoven writes:
> > >On Monday 13 August 2007 12:11:47 Dag-Erling Sm=F8rgrav wrote:
> > >> Knut-Olav Hoven <hovenko at linpro.no> writes:
> > >> > How can I customize the error messages that Varnish return?
> > >>
> > >> Not easily; edit bin/varnishd/cache_synthetic.c and recompile.
> > >
> > >Ok.
> > >
> > >So I can't intercept the response in vcl, detect if the response code is
> > > 503 and then trigger a new 503 error with a different message or HTML
> > > code?
> >
> > You can change the status but not the HTML ... yet.
> >
> > We have ideas for this area, basically, you would detect the 503,
> > edit req.url and restart the transaction with the new url.
> >
> > Not yet implemented however.
> >
> > We have also talked about being able to have local content on the
> > varnish server, likely in the form of a .tar file, but this is also
> > yet to be implemented.
> >
> >
> > --
> > Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
> > phk at FreeBSD.ORG         | TCP/IP since RFC 956
> > FreeBSD committer       | BSD since 4.3-tahoe
> > Never attribute to malice what can adequately be explained by
> > incompetence. _______________________________________________
> > varnish-misc mailing list
> > varnish-misc at projects.linpro.no
> > http://projects.linpro.no/mailman/listinfo/varnish-misc
>
> _______________________________________________
> varnish-misc mailing list
> varnish-misc at projects.linpro.no
> http://projects.linpro.no/mailman/listinfo/varnish-misc



-- 
Knut-Olav Hoven
Systemutvikler               mob: +47 986 71 700
Linpro AS                    http://www.linpro.no/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part.
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070813/ede7472d/attachment.bin>

From des at linpro.no  Mon Aug 13 14:03:39 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 13 Aug 2007 16:03:39 +0200
Subject: Custom error message
In-Reply-To: <200708131223.39508.hovenko@linpro.no> (Knut-Olav Hoven's message
	of "Mon, 13 Aug 2007 12:23:28 +0200")
References: <200708131119.42780.hovenko@linpro.no>
	<ujrps1ru4kc.fsf@false.linpro.no>
	<200708131223.39508.hovenko@linpro.no>
Message-ID: <ujrzm0vr0p0.fsf@false.linpro.no>

Knut-Olav Hoven <hovenko at linpro.no> writes:
> Dag-Erling Sm?rgrav <des at linpro.no> writes:
> > Knut-Olav Hoven <hovenko at linpro.no> writes:
> > > How can I customize the error messages that Varnish return?
> > Not easily; edit bin/varnishd/cache_synthetic.c and recompile.
> So I can't intercept the response in vcl, detect if the response
> code is 503 and then trigger a new 503 error with a different
> message or HTML code?

It might be possible to change req.url and issue a restart?  Poul-Henning?

Of course, if Apache is down and your error page isn't cached, you're SOL.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From hovenko at linpro.no  Mon Aug 13 14:09:18 2007
From: hovenko at linpro.no (Knut-Olav Hoven)
Date: Mon, 13 Aug 2007 16:09:18 +0200
Subject: Custom error message
In-Reply-To: <ujrzm0vr0p0.fsf@false.linpro.no>
References: <200708131119.42780.hovenko@linpro.no>
	<200708131223.39508.hovenko@linpro.no>
	<ujrzm0vr0p0.fsf@false.linpro.no>
Message-ID: <200708131609.30125.hovenko@linpro.no>

On Monday 13 August 2007 16:03:39 Dag-Erling Sm?rgrav wrote:
> Knut-Olav Hoven <hovenko at linpro.no> writes:
> > Dag-Erling Sm?rgrav <des at linpro.no> writes:
> > > Knut-Olav Hoven <hovenko at linpro.no> writes:
> > > > How can I customize the error messages that Varnish return?
> > >
> > > Not easily; edit bin/varnishd/cache_synthetic.c and recompile.
> >
> > So I can't intercept the response in vcl, detect if the response
> > code is 503 and then trigger a new 503 error with a different
> > message or HTML code?
>
> It might be possible to change req.url and issue a restart?  Poul-Henning?
>
> Of course, if Apache is down and your error page isn't cached, you're SOL.

If it is possible to issue a temporary redirect back to the user with a new 
url, that could work for my case.

The error page can then be stored on a different webserver.

>
> DES



-- 
Knut-Olav Hoven
Systemutvikler               mob: +47 986 71 700
Linpro AS                    http://www.linpro.no/
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part.
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070813/c8372624/attachment.bin>

From des at linpro.no  Mon Aug 13 14:17:09 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 13 Aug 2007 16:17:09 +0200
Subject: Custom error message
In-Reply-To: <200708131609.30125.hovenko@linpro.no> (Knut-Olav Hoven's message
	of "Mon, 13 Aug 2007 16:09:18 +0200")
References: <200708131119.42780.hovenko@linpro.no>
	<200708131223.39508.hovenko@linpro.no>
	<ujrzm0vr0p0.fsf@false.linpro.no>
	<200708131609.30125.hovenko@linpro.no>
Message-ID: <ujrvebjr02i.fsf@false.linpro.no>

Knut-Olav Hoven <hovenko at linpro.no> writes:
> If it is possible to issue a temporary redirect back to the user with a new
> url, that could work for my case.

Conceptually, something like this should work:

vcl_fetch() {
    if (!obj.valid) {
        set obj.status = 304;
        set obj.http.location = "http://error.example.com/php-sucks.html";
        pass;
    }
}

It probably doesn't, though, and there may even be cases where the
backend code issues an error page directly instead of passing control
to vcl_fetch().  This would make a good Junior Varnish Hacker
Project...

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From ric at digitalmarbles.com  Mon Aug 13 15:56:36 2007
From: ric at digitalmarbles.com (Ricardo Newbery)
Date: Mon, 13 Aug 2007 08:56:36 -0700
Subject: 1.1.1 progress
In-Reply-To: <ujrhcn3u2su.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no> <f9g01f$tgi$1@sea.gmane.org>
	<ujrvebnbvpt.fsf@false.linpro.no> <f9nv85$mvc$1@sea.gmane.org>
	<D9ECE76C-1F22-4AC1-B581-CFA2988572C0@digitalmarbles.com>
	<ujrlkcfu37y.fsf@false.linpro.no> <ujrhcn3u2su.fsf@false.linpro.no>
Message-ID: <83B81BD5-FF05-4686-AC93-66FC589D4DFE@digitalmarbles.com>


On Aug 13, 2007, at 3:49 AM, Dag-Erling Sm?rgrav wrote:

> Dag-Erling Sm?rgrav <des at linpro.no> writes:
>> Ricardo Newbery <ric at digitalmarbles.com> writes:
>>> Not so fast.  I still needed to update automake as per the
>>> instructions on http://varnish.projects.linpro.no/wiki/Installation
>>> (slightly modified since the autogen.sh file is now a little
>>> different).
>> Why?  I would expect that /opt/local/bin would be in your path if you
>> had anything of interest installed there.
>
> I see that these instructions say that the automake version that comes
> with Mac OS X (Xcode, actually) is too old, but I haven't had any
> problems with it.  Just use the system's automake and ignore the
> warning from autogen.sh.
>
> DES
> --  
> Dag-Erling Sm?rgrav
> Senior Software Developer
> Linpro AS - www.linpro.no



Without the updated automake, I get this...

$ ./autogen.sh

+ aclocal
+ glibtoolize --copy --force
You should update your `aclocal.m4' by running aclocal.
+ autoheader
+ automake --add-missing --copy --foreign
configure.ac: installing `./install-sh'
configure.ac: installing `./missing'
bin/varnishadm/Makefile.am: installing `./compile'
bin/varnishadm/Makefile.am: installing `./depcomp'
lib/libvarnish/Makefile.am:5: Libtool library used but `LIBTOOL' is  
undefined
lib/libvarnish/Makefile.am:5:
lib/libvarnish/Makefile.am:5: The usual way to define `LIBTOOL' is to  
add `AC_PROG_LIBTOOL'
lib/libvarnish/Makefile.am:5: to `configure.ac' and run `aclocal' and  
`autoconf' again.
lib/libvarnishapi/Makefile.am:5: Libtool library used but `LIBTOOL'  
is undefined
lib/libvarnishapi/Makefile.am:5:
lib/libvarnishapi/Makefile.am:5: The usual way to define `LIBTOOL' is  
to add `AC_PROG_LIBTOOL'
lib/libvarnishapi/Makefile.am:5: to `configure.ac' and run `aclocal'  
and `autoconf' again.
lib/libvarnishcompat/Makefile.am:5: Libtool library used but  
`LIBTOOL' is undefined
lib/libvarnishcompat/Makefile.am:5:
lib/libvarnishcompat/Makefile.am:5: The usual way to define `LIBTOOL'  
is to add `AC_PROG_LIBTOOL'
lib/libvarnishcompat/Makefile.am:5: to `configure.ac' and run  
`aclocal' and `autoconf' again.
lib/libvcl/Makefile.am:5: Libtool library used but `LIBTOOL' is  
undefined
lib/libvcl/Makefile.am:5:
lib/libvcl/Makefile.am:5: The usual way to define `LIBTOOL' is to add  
`AC_PROG_LIBTOOL'
lib/libvcl/Makefile.am:5: to `configure.ac' and run `aclocal' and  
`autoconf' again.

And configure is not created so ignoring the warning is not an option.

Ric




From des at linpro.no  Mon Aug 13 18:07:22 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 13 Aug 2007 20:07:22 +0200
Subject: 1.1.1 progress
In-Reply-To: <83B81BD5-FF05-4686-AC93-66FC589D4DFE@digitalmarbles.com>
	(Ricardo Newbery's message of "Mon, 13 Aug 2007 08:56:36 -0700")
References: <ujrk5s4ssnv.fsf@false.linpro.no> <f9g01f$tgi$1@sea.gmane.org>
	<ujrvebnbvpt.fsf@false.linpro.no> <f9nv85$mvc$1@sea.gmane.org>
	<D9ECE76C-1F22-4AC1-B581-CFA2988572C0@digitalmarbles.com>
	<ujrlkcfu37y.fsf@false.linpro.no> <ujrhcn3u2su.fsf@false.linpro.no>
	<83B81BD5-FF05-4686-AC93-66FC589D4DFE@digitalmarbles.com>
Message-ID: <ujrodhbz4th.fsf@false.linpro.no>

Ricardo Newbery <ric at digitalmarbles.com> writes:
> Without the updated automake, I get this...
>
> $ ./autogen.sh
>
> + aclocal
> + glibtoolize --copy --force
> You should update your `aclocal.m4' by running aclocal.
> + autoheader
> + automake --add-missing --copy --foreign
> configure.ac: installing `./install-sh'
> configure.ac: installing `./missing'
> bin/varnishadm/Makefile.am: installing `./compile'
> bin/varnishadm/Makefile.am: installing `./depcomp'
> lib/libvarnish/Makefile.am:5: Libtool library used but `LIBTOOL' is undefined

Yes, that's the usual symptom, but I didn't get that when I tested
with automake 1.6 on Tiger last month, which is why I changed
autogen.sh to only issue a warning.  Go figure...

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From jean-marc.pouchoulon at ac-montpellier.fr  Fri Aug 10 18:03:49 2007
From: jean-marc.pouchoulon at ac-montpellier.fr (jean-marc pouchoulon)
Date: Fri, 10 Aug 2007 20:03:49 +0200
Subject: varnish(log|nscsa|....) >  varnishlog,> Cannot open NONE
Message-ID: <46BCA885.8080402@ac-montpellier.fr>

helo all,
just build varnish 1.1.1 rpm from svn on linux fedora 7
#129 is fixed thanks to the developpers :-) 
But I have this strange message on varnish utility:

>  varnishlog
> Cannot open NONE/var/varnish/localhost.localdomain/_.vsl: No such file 
> or directory
I built varnish from source , I get the same "error"
Using varnishlog on varnish.log works fine.

NB :
To build varnish rpm I must add this line in .SPEC
> %define _unpackaged_files_terminate_build 0




From ingvar at linpro.no  Tue Aug 14 10:38:25 2007
From: ingvar at linpro.no (Ingvar Hagelund)
Date: Tue, 14 Aug 2007 12:38:25 +0200
Subject: varnish(log|nscsa|....) >  varnishlog,> Cannot open NONE
In-Reply-To: <46BCA885.8080402@ac-montpellier.fr>
References: <46BCA885.8080402@ac-montpellier.fr>
Message-ID: <46C18621.4090003@linpro.no>

* Jean-Marc Pouchoulon
> just build varnish 1.1.1 rpm from svn on linux fedora 7
> #129 is fixed thanks to the developpers :-) 
> But I have this strange message on varnish utility:
> 
>>  varnishlog
>> Cannot open NONE/var/varnish/localhost.localdomain/_.vsl: No such file 
>> or directory
> I built varnish from source , I get the same "error"
> Using varnishlog on varnish.log works fine.
> 
> NB :
> To build varnish rpm I must add this line in .SPEC
>> %define _unpackaged_files_terminate_build 0

These are related. The file /var/varnish does not exist on your system,
as it's not in the build (and by doing that define, you force the packge
to be built anyway). The rpm specfile is not updated to 1.1.1. It's on
my todolist.

Ingvar

-- 


From des at linpro.no  Tue Aug 14 10:46:20 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Tue, 14 Aug 2007 12:46:20 +0200
Subject: varnish(log|nscsa|....) >  varnishlog,> Cannot open NONE
In-Reply-To: <46C18621.4090003@linpro.no> (Ingvar Hagelund's message of "Tue, 
	14 Aug 2007 12:38:25 +0200")
References: <46BCA885.8080402@ac-montpellier.fr> <46C18621.4090003@linpro.no>
Message-ID: <ujreji6pf5v.fsf@false.linpro.no>

Ingvar Hagelund <ingvar at linpro.no> writes:
> These are related. The file /var/varnish does not exist on your system,
> as it's not in the build (and by doing that define, you force the packge
> to be built anyway). The rpm specfile is not updated to 1.1.1. It's on
> my todolist.

H?per du f?r fikset dette raskt - 1.1.1 skal ut p? mandag...

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From denis at startsiden.no  Wed Aug 15 10:33:27 2007
From: denis at startsiden.no (=?utf-8?Q?Denis_Br=C3=A6khus?=)
Date: Wed, 15 Aug 2007 12:33:27 +0200 (CEST)
Subject: Article in O3 magazine
Message-ID: <28356801.4841187174007992.JavaMail.root@ms1.startsiden.no>

http://www.emea.o3magazine.com/pastissues/issue6/

"Inside: Open Source Web Acceleration with Varnish"

Nice article on Varnish, I quote :

"Varnish  is an impressive web accelleration / 
reverse  proxy solution. It is used on a 
growing number of high-traffic production 
networks around the  world, and is well worth  
a look. While  the  configuration might not be 
for the faint hearted, once you start to 
experiment with  Varnish  you'll understand its 
power and appeal to high-traffic production 
networks. "


-- 
Denis Braekhus - Teknisk Ansvarlig ABC Startsiden AS
http://www.startsiden.no



From jeff at cepheid.org  Thu Aug 16 21:36:05 2007
From: jeff at cepheid.org (Jeff Bachtel)
Date: Thu, 16 Aug 2007 16:36:05 -0500
Subject: Configuration generation
Message-ID: <20070816213605.GC5106@cepheid.org>

I am currently using Squid in a reverse-proxy setup, and the ability
to have Squid query a rewrite helper to determine the backend has been
something of a godsend, as it allows us to store our configuration in
some MySQL tables, and update the in-memory rules without
interruption.

Reading VCL documentation, my understanding is that my best choice
currently would be to write a text file based on MySQL data, compile
the rules, and then have Varnish reload its configuration. Is that an
accurate assessment?

Thanks,

Jeff


From tiamo at tfr.org  Fri Aug 17 09:25:53 2007
From: tiamo at tfr.org (TiAMO)
Date: Fri, 17 Aug 2007 11:25:53 +0200
Subject: Once 404 always 404
Message-ID: <200708171125.54209.tiamo@tfr.org>

Once i get a 404 error, even if i add the object on the backend it'll still be 
404 trough varnish.

Can i change this in the vcl so it never caches 404 pages ?, if so, how =)

Also will this expire all 404 objects in cache, or how to i clear them from 
the cache ?

// Fredrik


From des at linpro.no  Fri Aug 17 10:49:44 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Fri, 17 Aug 2007 12:49:44 +0200
Subject: Once 404 always 404
In-Reply-To: <200708171125.54209.tiamo@tfr.org> (tiamo@tfr.org's message of
	"Fri, 17 Aug 2007 11:25:53 +0200")
References: <200708171125.54209.tiamo@tfr.org>
Message-ID: <ujrhcmyxwon.fsf@false.linpro.no>

TiAMO <tiamo at tfr.org> writes:
> Once i get a 404 error, even if i add the object on the backend
> it'll still be 404 trough varnish.

Only until the object times out (which by default will be after 120
seconds)

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From janis.putrams at delfi.lv  Fri Aug 17 11:04:40 2007
From: janis.putrams at delfi.lv (Janis Putrams)
Date: Fri, 17 Aug 2007 14:04:40 +0300
Subject: 1.1.1 progress
In-Reply-To: <ujrk5s4ssnv.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no>
Message-ID: <200708171404.40942.janis.putrams@delfi.lv>

Hi!
I have been running varnishd from svn @Aug 16 06:17 and I managed to capture master crash log.
It is 900MB in size but it goes as follow:

-----------------------------------------------
...
 317 VCL_call     c deliver
  317 VCL_return   c deliver
  317 TxProtocol   c HTTP/1.1
  317 TxStatus     c 304
  317 TxResponse   c Not Modified
  317 TxHeader     c Date: Fri, 17 Aug 2007 02:38:15 GMT
  317 TxHeader     c Via: 1.1 varnish
  317 TxHeader     c X-Varnish: 1235756158
  317 TxHeader     c Last-Modified: Mon, 10 Apr 2006 14:22:09 GMT
  317 TxHeader     c Connection: keep-alive
  317 ReqEnd       c 1235756158 1187318295.812228918 1187318295.812259912 0.116736889 0.000012159 0.000018835
    0 StatAddr       213.21.215.95 0 2 4 20 0 0 0 3806 32572
   69 Debug        c "Pipe Shut read(read)"
  301 Debug        c "Pipe Shut write(read)"
   69 Debug        c "Pipe Shut read(read)"
  301 Debug        c "Pipe Shut write(read)"
   69 Debug        c "Pipe Shut read(read)"
....
a lot of "Pipe Shut .." messages with some normal requests in between
....
  435 Debug        c "Pipe Shut write(read)"
   69 Debug        c "Pipe Shut read(read)"
  301 Debug        c "Pipe Shut write(read)"
  277 Debug        c "Pipe Shut read(read)"
  435 Debug        c "Pipe Shut write(read)"
   69 Debug        c "Pipe Shut read(read)"
  301 Debug        c "Pipe Shut write(read)"
  277 Debug        c "Pipe Shut read(read)"
  435 Debug        c "Pipewrite(read)%00%00ead)"
   69 Debug        c "Pipe Shut rad)%00%00%14%00EP"
 8275 (null)         hut read(read)
28773 (null)          Shut write(read)
30578 (null)         ite(read)
  277 VCL_return   c
26992 (null)         e Shut write(read)
 8306 (null)         ead(read)
25888 (null)         Shut write(read)
24932 (null)         )
  276 VCL_return   b
26992 (null)         e Shut read(read)
30578 (null)         ite(read)
....
some messages with "(null)" type
....
26992 RxURL          e Shut read(read)
30578 (null)         ite(read)
  277 VCL_return   c
26992 (null)         e Shut write(read)
 8306 (null)         ead(read)
25888 (null)         Shut write(read)
24932 (null)         )
  276 VCL_return   b
26992 (null)         e Shut read(read)
30578 (null)         ite(read)
  277 VCL_return   c
26992 ExpBan         e Shut write(read)
-----------------------------------------------

06:05:39 root[pts/1]@slow /www# cat master_crash.log |sort|uniq -c |sort -n -r|head -n 100
7414921    69 Debug        c "Pipe Shut read(read)"
7414919   301 Debug        c "Pipe Shut write(read)"
2330830   277 Debug        c "Pipe Shut read(read)"
2330825   435 Debug        c "Pipe Shut write(read)"
   8670 25641 (null)
   3419   276 VCL_return   b
   3410 24932 (null)         )
   3408 30578 (null)         ite(read)
   3399  8306 (null)         ead(read)
   3386   277 VCL_return   c
   3379 25888 (null)         Shut write(read)
   1723 26992 RxURL          e Shut read(read)
   1713 26992 (null)         e Shut write(read)
   1697 26992 (null)         e Shut read(read)
   1677 26992 ExpBan         e Shut write(read)
    742 25640 (null)         read)
    407     0 VCL_return     discard
    407     0 VCL_call       timeout
    234    61 VCL_return   c deliver
    184   799 VCL_return   c deliver
    180   722 VCL_return   c deliver
    148   719 VCL_return   c deliver

Please let me know if you need anything else.

--
janis

On Thursday 09 August 2007 17:12, Dag-Erling Sm?rgrav wrote:
> I thought I'd let you know what's currently going on at our top-secret
> underground Varnish R&D facility:
>
>  - Poul-Henning has been working hard to resolve the stability issues
>    and assertion failures some of you have reported (#136, #137, #138,
>    #139, #140, #141 and #143 should be fixed, while #132, #142 and
>    #144 are still being worked on) as well as working on 2.0 features.
>
>  - I have been working on other bugs and build issues (#128, #130,
>    #131 and #135 should be fixed, while #129 is still being worked on)
>    as well as improving our test framework (and writing additional
>    test cases) and trying to get Varnish to build and run reliably on
>    Mac OS X and Solaris 10.
>
>  - Cecilie will be back on Monday and resume work on 2.0 features.
>
>  - I just merged a ton of bug fixes from trunk to branches/1.1.
>    Please please *please*, if you are running 1.0.4 or 1.1 today, take
>    the time to test branches/1.1 and let me know about any remaining
>    bugs or regressions.  I would love to be able to close all
>    outstanding tickets on 1.0.4 and 1.1 and release 1.1.1 on August
>    20th.  Pretty please?  With sugar on top?
>
> Thanks,
>
> DES


From des at linpro.no  Sat Aug 18 10:39:35 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Sat, 18 Aug 2007 12:39:35 +0200
Subject: 1.1.1 progress
In-Reply-To: <200708171404.40942.janis.putrams@delfi.lv> (Janis Putrams's
	message of "Fri, 17 Aug 2007 14:04:40 +0300")
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708171404.40942.janis.putrams@delfi.lv>
Message-ID: <ujrodh5yvmg.fsf@false.linpro.no>

Janis Putrams <janis.putrams at delfi.lv> writes:
> I have been running varnishd from svn @Aug 16 06:17 and I managed to
> capture master crash log.

I have no idea what a "master crash log" is, but the varnish log you
included is corrupted and doesn't tell me much, except that most of
your traffic is piped to the backend rather than cached.  If you're
having trouble with the management and / or worker process crashing,
you should run varnish in the foreground (-d -d) to capture the error
messages (most likely assertion failures), and get a backtrace.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Sun Aug 19 18:38:21 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Sun, 19 Aug 2007 20:38:21 +0200
Subject: Varnish on Mac OS X
Message-ID: <ujr8x87z7xe.fsf@false.linpro.no>

I fired up my old eMac today and tried the latest trunk on it.  It
builds and installs fine (no automake trouble) with autotools from
Xcode 2.4.1.  You need to set MACOSX_DEPLOYMENT_TARGET to 10.3 or
higher to run, otherwise you get a linker error while compiling VCL
that tells you this.  However, some of the regression tests fail, and
I haven't had time to look any deeper into the reason for that.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Sun Aug 19 21:21:00 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Sun, 19 Aug 2007 23:21:00 +0200
Subject: Varnish on Mac OS X
In-Reply-To: <ujr8x87z7xe.fsf@false.linpro.no> (Dag-Erling
	=?iso-8859-1?Q?Sm=F8rgrav's?= message
	of "Sun, 19 Aug 2007 20:38:21 +0200")
References: <ujr8x87z7xe.fsf@false.linpro.no>
Message-ID: <ujrvebbxltv.fsf@false.linpro.no>

Dag-Erling Sm?rgrav <des at linpro.no> writes:
> I fired up my old eMac today and tried the latest trunk on it.  It
> builds and installs fine (no automake trouble) with autotools from
> Xcode 2.4.1.  You need to set MACOSX_DEPLOYMENT_TARGET to 10.3 or
> higher to run, otherwise you get a linker error while compiling VCL
> that tells you this.  However, some of the regression tests fail, and
> I haven't had time to look any deeper into the reason for that.

I think I figured that one out - timing issues in the test framework.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From jdouglas at bksnetworks.com  Sun Aug 19 23:52:10 2007
From: jdouglas at bksnetworks.com (jdouglas)
Date: Sun, 19 Aug 2007 19:52:10 -0400
Subject: Redhat
Message-ID: <20070819235210.422fe28b@mx-1.bksnetworks.com>

Are there instructions on installing this on Redhat systems?

I am able to get it working on FreeBSD 6.2 but not RHEL 4 with a 2.6 Kernel.

When I try to build an rpm from spec i get:

Executing(%doc): /bin/sh -e /var/tmp/rpm-tmp.27483
+ umask 022
+ cd /usr/src/redhat/BUILD
+ cd varnish-1.1
+ DOCDIR=/var/tmp/varnish-1.1-1-root-root/usr/share/doc/varnish-libs-1.1
+ export DOCDIR
+ rm -rf /var/tmp/varnish-1.1-1-root-root/usr/share/doc/varnish-libs-1.1
+ /bin/mkdir -p /var/tmp/varnish-1.1-1-root-root/usr/share/doc/varnish-libs-1.1
+ cp -pr LICENSE /var/tmp/varnish-1.1-1-root-root/usr/share/doc/varnish-libs-1.1
+ exit 0
Provides: libvarnish.so.0 libvarnishapi.so.0 libvcl.so.0
Requires(interp): /sbin/ldconfig /sbin/ldconfig
Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1
Requires(post): /sbin/ldconfig
Requires(postun): /sbin/ldconfig
Requires: libc.so.6 libc.so.6(GLIBC_2.0) libc.so.6(GLIBC_2.1) libc.so.6(GLIBC_2.1.3) libc.so.6(GLIBC_2.2) libc.so.6(GLIBC_2.3) libc.so.6(GLIBC_2.3.4) librt.so.1 librt.so.1(GLIBC_2.2)
Processing files: varnish-debuginfo-1.1-1
Provides: libvarnish.so.0.0.0.debug libvarnishapi.so.0.0.0.debug libvcl.so.0.0.0.debug
Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1
Checking for unpackaged file(s): /usr/lib/rpm/check-files /var/tmp/varnish-1.1-1-root-root
error: Installed (but unpackaged) file(s) found:
   /usr/include/varnish/shmlog.h
   /usr/include/varnish/shmlog_tags.h
   /usr/include/varnish/stat_field.h
   /usr/include/varnish/stats.h
   /usr/include/varnish/varnishapi.h
   /usr/lib/pkgconfig/varnishapi.pc


RPM build errors:
    Installed (but unpackaged) file(s) found:
   /usr/include/varnish/shmlog.h
   /usr/include/varnish/shmlog_tags.h
   /usr/include/varnish/stat_field.h
   /usr/include/varnish/stats.h
   /usr/include/varnish/varnishapi.h
   /usr/lib/pkgconfig/varnishapi.pc
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070819/60511aaf/attachment.html>

From anup at iamcool.net  Mon Aug 20 03:43:33 2007
From: anup at iamcool.net (Anup Shukla)
Date: Mon, 20 Aug 2007 09:13:33 +0530
Subject: Redhat
In-Reply-To: <20070819235210.422fe28b@mx-1.bksnetworks.com>
References: <20070819235210.422fe28b@mx-1.bksnetworks.com>
Message-ID: <46C90DE5.3080807@iamcool.net>

jdouglas wrote:
> Are there instructions on installing this on Redhat systems?
>
> I am able to get it working on FreeBSD 6.2 but not RHEL 4 with a 2.6 
> Kernel.
>
> When I try to build an rpm from spec i get:
>
> Executing(%doc): /bin/sh -e /var/tmp/rpm-tmp.27483
> + umask 022
> + cd /usr/src/redhat/BUILD
> + cd varnish-1.1
> + DOCDIR=/var/tmp/varnish-1.1-1-root-root/usr/share/doc/varnish-libs-1.1
> + export DOCDIR
> + rm -rf /var/tmp/varnish-1.1-1-root-root/usr/share/doc/varnish-libs-1.1
> + /bin/mkdir -p 
> /var/tmp/varnish-1.1-1-root-root/usr/share/doc/varnish-libs-1.1
> + cp -pr LICENSE 
> /var/tmp/varnish-1.1-1-root-root/usr/share/doc/varnish-libs-1.1
> + exit 0
> Provides: libvarnish.so.0 libvarnishapi.so.0 libvcl.so.0
> Requires(interp): /sbin/ldconfig /sbin/ldconfig
> Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 
> rpmlib(PayloadFilesHavePrefix) <= 4.0-1
> Requires(post): /sbin/ldconfig
> Requires(postun): /sbin/ldconfig
> Requires: libc.so.6 libc.so.6(GLIBC_2.0) libc.so.6(GLIBC_2.1) 
> libc.so.6(GLIBC_2.1.3) libc.so.6(GLIBC_2.2) libc.so.6(GLIBC_2.3) 
> libc.so.6(GLIBC_2.3.4) librt.so.1 librt.so.1(GLIBC_2.2)
> Processing files: varnish-debuginfo-1.1-1
> Provides: libvarnish.so.0.0.0.debug libvarnishapi.so.0.0.0.debug 
> libvcl.so.0.0.0.debug
> Requires(rpmlib): rpmlib(CompressedFileNames) <= 3.0.4-1 
> rpmlib(PayloadFilesHavePrefix) <= 4.0-1
> Checking for unpackaged file(s): /usr/lib/rpm/check-files 
> /var/tmp/varnish-1.1-1-root-root
> error: Installed (but unpackaged) file(s) found:
>    /usr/include/varnish/shmlog.h
>    /usr/include/varnish/shmlog_tags.h
>    /usr/include/varnish/stat_field.h
>    /usr/include/varnish/stats.h
>    /usr/include/varnish/varnishapi.h
>    /usr/lib/pkgconfig/varnishapi.pc
>
>
> RPM build errors:
>     Installed (but unpackaged) file(s) found:
>    /usr/include/varnish/shmlog.h
>    /usr/include/varnish/shmlog_tags.h
>    /usr/include/varnish/stat_field.h
>    /usr/include/varnish/stats.h
>    /usr/include/varnish/varnishapi.h
>    /usr/lib/pkgconfig/varnishapi.pc
>
>
rpmbuild now fails if compilation generates files that are not listed in 
the %files section of the spec.
Just add the files listed as "unpackaged" in the %files section and you 
should be good.

You can get more information here :: 
http://www.rpm.org/hintskinks/unpackaged/

Regards
A.S.
> ------------------------------------------------------------------------
>
> _______________________________________________
> varnish-misc mailing list
> varnish-misc at projects.linpro.no
> http://projects.linpro.no/mailman/listinfo/varnish-misc
>   



From des at linpro.no  Mon Aug 20 06:49:10 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 20 Aug 2007 08:49:10 +0200
Subject: Redhat
In-Reply-To: <20070819235210.422fe28b@mx-1.bksnetworks.com>
	(jdouglas@bksnetworks.com's message of "Sun, 19 Aug 2007 19:52:10
	-0400")
References: <20070819235210.422fe28b@mx-1.bksnetworks.com>
Message-ID: <ujrmywmya3d.fsf@false.linpro.no>

jdouglas <jdouglas at bksnetworks.com> writes:
> Are there instructions on installing this on Redhat systems?
>
> I am able to get it working on FreeBSD 6.2 but not RHEL 4 with a 2.6 Kernel.

You forgot to tell us which version you are trying to install.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From ingvar at linpro.no  Mon Aug 20 09:06:37 2007
From: ingvar at linpro.no (Ingvar Hagelund)
Date: Mon, 20 Aug 2007 11:06:37 +0200
Subject: Redhat
In-Reply-To: <20070819235210.422fe28b@mx-1.bksnetworks.com>
References: <20070819235210.422fe28b@mx-1.bksnetworks.com>
Message-ID: <46C9599D.10704@linpro.no>

* jdouglas
> Are there instructions on installing this on Redhat systems?
> 
> I am able to get it working on FreeBSD 6.2 but not RHEL 4 with a 2.6 Kernel.
> 
> When I try to build an rpm from spec i get:
> (...)
> 
> RPM build errors:
>     Installed (but unpackaged) file(s) found:
>    /usr/include/varnish/shmlog.h
>    /usr/include/varnish/shmlog_tags.h
>    /usr/include/varnish/stat_field.h
>    /usr/include/varnish/stats.h
>    /usr/include/varnish/varnishapi.h
>    /usr/lib/pkgconfig/varnishapi.pc

This is fixed in trunk. The fix will also be included in the upcoming
1.1.1 release.

Ingvar

-- 
At barnebokfigurer er snille er bare ljug
Mummipappa dater Barbamamma i smug


From janis.putrams at delfi.lv  Mon Aug 20 10:15:47 2007
From: janis.putrams at delfi.lv (Janis Putrams)
Date: Mon, 20 Aug 2007 13:15:47 +0300
Subject: 1.1.1 progress
In-Reply-To: <ujrodh5yvmg.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708171404.40942.janis.putrams@delfi.lv>
	<ujrodh5yvmg.fsf@false.linpro.no>
Message-ID: <200708201315.47823.janis.putrams@delfi.lv>

Hi!

With "master crash log" i meant output of varnishlog when management process dies.

Anyway I wanted to capture core file so run varnishd in foreground.

I set 
CXXFLAGS="-g"
LDFLAGS="-g"
in configure.ac. then run
./configure --prefix=/usr --enable-debug && make clean && make

05:17:28 root[pts/0]@slow ~# ulimit -a|grep core
core file size          (blocks, -c) 650000


08:06:24 root[pts/0]@slow ~# varnishd -d -d -f /etc/varnishd/varnishd.conf -T 127.0.0.1:81 -P /var/run/varnishd.pid
file /var/spool/varnishd/varnishd_storage.bin size 536870912 bytes (131072 fs-blocks, 131072 pages)
Using old SHMFILE
rolling(1)...
rolling(2)...
start
CLI <start>
start child pid 23327
200 0

Child said (2, 23327): <<Child starts
managed to mmap 536870912 bytes of 536870912
Ready
CLI ready
>>
Child said (2, 23327): <<socktest: linger=0 sndtimeo=0 rcvtimeo=0
>>
Cache child died pid=23327 status=0xb
Clean child
Child cleaned
start child pid 23404
Child said (2, 23404): <<Child starts
managed to mmap 536870912 bytes of 536870912
Ready
CLI ready
>>
Child said (2, 23404): <<socktest: linger=0 sndtimeo=0 rcvtimeo=0
>>
Cache child died pid=23404 status=0xb
Clean child
Child cleaned
start child pid 23484
...
>>
Child said (2, 28871): <<socktest: linger=0 sndtimeo=0 rcvtimeo=0
>>
Cache child died pid=28871 status=0xb
Clean child
Child cleaned
start child pid 28900
Child said (2, 28900): <<Child starts
managed to mmap 536870912 bytes of 536870912
Ready
CLI ready
>>
Child said (2, 28900): <<socktest: linger=0 sndtimeo=0 rcvtimeo=0
>>
Cache child died pid=28900 status=0xb
Clean child
Child cleaned
start child pid 28936
Pushing vcls failed:
CLI communication error
Child said (1, 28936): <<Child starts
>>
unlink ./bin.XXQ9wDR6
14:00:53 root[pts/0]@slow ~#

Though I found no core file after this. Please suggest what could I do to trace it.

Thanks,
Janis

On Saturday 18 August 2007 13:39, Dag-Erling Sm?rgrav wrote:
> Janis Putrams <janis.putrams at delfi.lv> writes:
> > I have been running varnishd from svn @Aug 16 06:17 and I managed to
> > capture master crash log.
>
> I have no idea what a "master crash log" is, but the varnish log you
> included is corrupted and doesn't tell me much, except that most of
> your traffic is piped to the backend rather than cached.  If you're
> having trouble with the management and / or worker process crashing,
> you should run varnish in the foreground (-d -d) to capture the error
> messages (most likely assertion failures), and get a backtrace.
>
> DES


From des at linpro.no  Mon Aug 20 11:13:56 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 20 Aug 2007 13:13:56 +0200
Subject: 1.1.1 progress
In-Reply-To: <200708201315.47823.janis.putrams@delfi.lv> (Janis Putrams's
	message of "Mon, 20 Aug 2007 13:15:47 +0300")
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708171404.40942.janis.putrams@delfi.lv>
	<ujrodh5yvmg.fsf@false.linpro.no>
	<200708201315.47823.janis.putrams@delfi.lv>
Message-ID: <ujrabsmxxu3.fsf@false.linpro.no>

Janis Putrams <janis.putrams at delfi.lv> writes:
> Anyway I wanted to capture core file so run varnishd in foreground.
> [...]
> 05:17:28 root[pts/0]@slow ~# ulimit -a|grep core
> core file size          (blocks, -c) 650000

you should use 'unlimited' instead; a varnishd core dump can easily
reach tens or hundreds of megabytes.

> Though I found no core file after this. Please suggest what could I
> do to trace it.

It will be in $localstatedir/varnish/$varnish_name (probably
/var/lib/varnish/`uname -n`)

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Mon Aug 20 11:21:28 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 20 Aug 2007 13:21:28 +0200
Subject: Varnish on Mac OS X
In-Reply-To: <ujrvebbxltv.fsf@false.linpro.no> (Dag-Erling
	=?iso-8859-1?Q?Sm=F8rgrav's?= message
	of "Sun, 19 Aug 2007 23:21:00 +0200")
References: <ujr8x87z7xe.fsf@false.linpro.no> <ujrvebbxltv.fsf@false.linpro.no>
Message-ID: <ujr1wdyxxhj.fsf@false.linpro.no>

With the changes I made last night and this morning, Mac OS X passes
all the tests that the other platforms also pass.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From ramon at epsem.upc.edu  Mon Aug 20 10:07:25 2007
From: ramon at epsem.upc.edu (Ramon Navarro Bosch)
Date: Mon, 20 Aug 2007 12:07:25 +0200
Subject: pass vs pipe
Message-ID: <46C967DD.8030300@epsem.upc.edu>

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi !

Doing some installations of varnish with plone instances we had some
problems:

We are using a vcl from from plone.recipe.varnish that has this part :


...

sub vcl_recv {

    if (req.request == "PURGE") {
        if (!client.ip ~ purge) {
                error 405 "Not allowed.";
        }
        lookup;
    }

    if (req.request != "GET" && req.request != "HEAD") {
        # Do not try to cache POST
        pass;
    }
    
    if (req.http.Expect) {
        pipe;
    }
...

VARNISH VERSION I USE: branch/1.1

the problem is on the not GET/HEAD rule :

if we choose pass some people get error on POST commits ( don't respond )

if we choose pipe some people get error ( it's my case ) that it takes
a long time and finally
  it gave an error complaining about upstream. In my case I can't
access directly to the backend
  as it's filtered by a firewall, maybe a reason ?

On my last tests I've just updated the 1.1 branch of varnish and now
pipe seems to work and pass don't.
Does anybody know what happens ?

Thanks !

Ramon
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFGyWfck3vgE06ET70RAmHyAJ94LyiTGKKDaPjkVYzWbmAScnlaRwCfRxTS
Rpgzxz1KjxqF0VSVP706gXI=
=zJSn
-----END PGP SIGNATURE-----



From chulmin2 at hotmail.com  Mon Aug 20 12:50:46 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Mon, 20 Aug 2007 12:50:46 +0000
Subject: Why POST methos is not work?
Message-ID: <BLU116-F9172F7CA1FBC361934DE585DB0@phx.gbl>

Hello, all.

I have setup vcl like below, and works well except POST method.
When I using POST Method like writing a message, the site is stops and 
trying to connect the backend server continuously.
and I have restarted the varnishd but the result is same.

What's the problem and is there any problem at this config?

====================================================================

backend server1 {
         set backend.host = "origin.abc.com";
         set backend.port = "80";
}


sub vcl_recv {
    if (req.http.Host == "www.abc.com")
     {
         set req.backend = server1;
         set req.http.host = "origin.abc.com";

     }
       if (req.request == "POST") {
                     pipe;
             }
        if (req.request == "GET" && req.http.cookie) {
                 lookup;
             }
        if (req.http.Authenticate) {
                  pipe;
                }

         if (req.url ~ "\.cgi|php)$") {
                  pipe;
                }

          if (req.url ~ "\.(pdf|png|gif|jpg|mp3|svf)$") {
                   lookup;
                }
        
        }

_________________________________________________________________
MSN Messenger? ?? ????? ?? ??? ??? ????.   
http://www.msn.co.kr/messenger 



From janis.putrams at delfi.lv  Mon Aug 20 13:11:31 2007
From: janis.putrams at delfi.lv (Janis Putrams)
Date: Mon, 20 Aug 2007 16:11:31 +0300
Subject: 1.1.1 progress
In-Reply-To: <ujrodh5yvmg.fsf@false.linpro.no>
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708171404.40942.janis.putrams@delfi.lv>
	<ujrodh5yvmg.fsf@false.linpro.no>
Message-ID: <200708201611.32080.janis.putrams@delfi.lv>

Hi!

Tnx for advice, i increased core file size to unlimited, run in foreground and 
wait for crash.
Meanwhile encountered slave process restart that did not kill management 
process, but gave this log:

...
Cache child died pid=25094 status=0xb
Clean child
Child cleaned
start child pid 25738
Child said (2, 25738): <<Child starts
managed to mmap 536870912 bytes of 536870912
Ready
CLI ready
>>
Child said (2, 25738): <<socktest: linger=0 sndtimeo=0 rcvtimeo=0
>>
Child said (2, 25738): <<Assert error in wrk_do_one(), cache_pool.c line 199:
  Condition(!isnan(w->used)) not true.
  errno = 104 (Connection reset by peer)
Assert error in wrk_do_one(), cache_pool.c line 199:
  Condition(!isnan(w->used)) not true.
  errno = 104 (Connection reset by peer)
>>
Cache child died pid=25738 status=0x6
Clean child
Child cleaned
start child pid 26209
Child said (2, 26209): <<Child starts
managed to mmap 536870912 bytes of 536870912
Ready
CLI ready
...

Hope that it gives some help.
Janis

p.s.
please let me know if I should be sending these messages to tickets, privately 
or smth.

On Saturday 18 August 2007 13:39, Dag-Erling Sm?rgrav wrote:
> Janis Putrams <janis.putrams at delfi.lv> writes:
> > I have been running varnishd from svn @Aug 16 06:17 and I managed to
> > capture master crash log.
>
> I have no idea what a "master crash log" is, but the varnish log you
> included is corrupted and doesn't tell me much, except that most of
> your traffic is piped to the backend rather than cached.  If you're
> having trouble with the management and / or worker process crashing,
> you should run varnish in the foreground (-d -d) to capture the error
> messages (most likely assertion failures), and get a backtrace.
>
> DES


From phk at phk.freebsd.dk  Mon Aug 20 13:20:17 2007
From: phk at phk.freebsd.dk (Poul-Henning Kamp)
Date: Mon, 20 Aug 2007 13:20:17 +0000
Subject: 1.1.1 progress 
In-Reply-To: Your message of "Mon, 20 Aug 2007 16:11:31 +0300."
	<200708201611.32080.janis.putrams@delfi.lv> 
Message-ID: <73285.1187616017@critter.freebsd.dk>

In message <200708201611.32080.janis.putrams at delfi.lv>, Janis Putrams writes:

>Assert error in wrk_do_one(), cache_pool.c line 199:
>  Condition(!isnan(w->used)) not true.
>  errno =3D 104 (Connection reset by peer)

Try this fix:

In cache_center.c, function cnt_lookup(), before the call to SES_Charge(),
insert:

		sp->wrk->used = TIM_real();

-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.


From des at linpro.no  Mon Aug 20 14:11:09 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 20 Aug 2007 16:11:09 +0200
Subject: pass vs pipe
In-Reply-To: <46C967DD.8030300@epsem.upc.edu> (Ramon Navarro Bosch's message
	of "Mon, 20 Aug 2007 12:07:25 +0200")
References: <46C967DD.8030300@epsem.upc.edu>
Message-ID: <ujr643awb2a.fsf@false.linpro.no>

Ramon Navarro Bosch <ramon at epsem.upc.edu> writes:
>     if (req.request != "GET" && req.request != "HEAD") {
>         # Do not try to cache POST
>         pass;
>     }

This is wrong, pass mode can't handle POST requests (yet).

> VARNISH VERSION I USE: branch/1.1

>From when?

> the problem is on the not GET/HEAD rule :
>
> if we choose pass some people get error on POST commits ( don't respond )
>
> if we choose pipe some people get error ( it's my case ) that it
> takes a long time and finally it gave an error complaining about
> upstream.

If this happens with the latest from branches/1.1, Try applying the
patch from r1888.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Mon Aug 20 14:16:11 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 20 Aug 2007 16:16:11 +0200
Subject: Why POST methos is not work?
In-Reply-To: <BLU116-F9172F7CA1FBC361934DE585DB0@phx.gbl> (Monty Ree's message
	of "Mon, 20 Aug 2007 12:50:46 +0000")
References: <BLU116-F9172F7CA1FBC361934DE585DB0@phx.gbl>
Message-ID: <ujr1wdywatw.fsf@false.linpro.no>

"Monty Ree" <chulmin2 at hotmail.com> writes:
> I have setup vcl like below, and works well except POST method.
> When I using POST Method like writing a message, the site is stops
> and trying to connect the backend server continuously.  and I have
> restarted the varnishd but the result is same.

Impossible to diagnose without logs.

> What's the problem and is there any problem at this config?

Yes:

 1) Do not ever use an existing domain name (abc.com in this case) in
    documentation or sample code.  The example.com domain has been
    reserved for this purpose.

 2) You've got the logic backwards.  If your site uses cookies, then
    in most cases control will reach the "lookup" in the (req.request
    == "GET" && req.http.cookie) clause and the rest of vcl_recv()
    will have no effect.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Mon Aug 20 14:17:25 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Mon, 20 Aug 2007 16:17:25 +0200
Subject: 1.1.1 progress
In-Reply-To: <200708201611.32080.janis.putrams@delfi.lv> (Janis Putrams's
	message of "Mon, 20 Aug 2007 16:11:31 +0300")
References: <ujrk5s4ssnv.fsf@false.linpro.no>
	<200708171404.40942.janis.putrams@delfi.lv>
	<ujrodh5yvmg.fsf@false.linpro.no>
	<200708201611.32080.janis.putrams@delfi.lv>
Message-ID: <ujrwsvquw7e.fsf@false.linpro.no>

Janis Putrams <janis.putrams at delfi.lv> writes:
> Child said (2, 25738): <<Assert error in wrk_do_one(), cache_pool.c line 199:
>   Condition(!isnan(w->used)) not true.
>   errno = 104 (Connection reset by peer)
>>>

See ticket #150.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From janis.putrams at delfi.lv  Tue Aug 21 13:04:39 2007
From: janis.putrams at delfi.lv (Janis Putrams)
Date: Tue, 21 Aug 2007 16:04:39 +0300
Subject: 1.1.1 progress
In-Reply-To: <73285.1187616017@critter.freebsd.dk>
References: <73285.1187616017@critter.freebsd.dk>
Message-ID: <200708211604.39498.janis.putrams@delfi.lv>

Hi!
Thank you. I added the line yesterday as soon as you sent it and seems that it 
has helped and no slave processes die with that message any more.
Slave processes do restart from time to time (with no additional information) 
but management process has been running ok so far.

janis

On Monday 20 August 2007 16:20, Poul-Henning Kamp wrote:
> In message <200708201611.32080.janis.putrams at delfi.lv>, Janis Putrams 
writes:
> >Assert error in wrk_do_one(), cache_pool.c line 199:
> >  Condition(!isnan(w->used)) not true.
> >  errno =3D 104 (Connection reset by peer)
>
> Try this fix:
>
> In cache_center.c, function cnt_lookup(), before the call to SES_Charge(),
> insert:
>
> 		sp->wrk->used = TIM_real();


From jdouglas at bksnetworks.com  Wed Aug 22 00:31:34 2007
From: jdouglas at bksnetworks.com (jdouglas)
Date: Tue, 21 Aug 2007 20:31:34 -0400
Subject: Varnish 1.1.1 FreeBSD 6.2
Message-ID: <20070822003134.dac04bb6@mx-1.bksnetworks.com>

During a ./configure I see this.

checking sys/mount.h presence... yes
configure: WARNING: sys/mount.h: present but cannot be compiled
configure: WARNING: sys/mount.h:     check for missing prerequisite headers?
configure: WARNING: sys/mount.h: see the Autoconf documentation
configure: WARNING: sys/mount.h:     section "Present But Cannot Be Compiled"
configure: WARNING: sys/mount.h: proceeding with the preprocessor's result
configure: WARNING: sys/mount.h: in the future, the compiler will take precedence
configure: WARNING:     ## --------------------------------------------- ##
configure: WARNING:     ## Report this to varnish-dev at projects.linpro.no ##
configure: WARNING:     ## --------------------------------------------- ##
checking for sys/mount.h... yes


--- 

Jonathan Douglas
Director Of Network Operations 
BKS Networks, Inc. 
1266 East Main Street 
Stamford, CT 06902
http://www.bksnetworks.com 
email: jdouglas at bksnetworks.com
phone: 203-406-0723 
mobile: 203-912-9245
fax: 860-740-6835
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070821/725a9fa1/attachment.html>

From jdouglas at bksnetworks.com  Wed Aug 22 00:33:43 2007
From: jdouglas at bksnetworks.com (jdouglas)
Date: Tue, 21 Aug 2007 20:33:43 -0400
Subject: Varnish 1.1.1 FreeBSD 6.2
Message-ID: <20070822003343.2a0bc543@mx-1.bksnetworks.com>

executing a make get's

Making all in varnishtop
gcc -DHAVE_CONFIG_H -I. -I../.. -I../../include   -include config.h -g -O2 -MT varnishtop-varnishtop.o -MD -MP -MF .deps/varnishtop-varnishtop.Tpo -c -o varnishtop-varnishtop.o `test -f 'varnishtop.c' || echo './'`varnishtop.c
mv -f .deps/varnishtop-varnishtop.Tpo .deps/varnishtop-varnishtop.Po
/usr/local/bin/bash ../../libtool --tag=CC    --mode=link gcc -include config.h  -g -O2   -o varnishtop varnishtop-varnishtop.o ../../lib/libvarnish/libvarnish.la  ../../lib/libvarnishcompat/libvarnishcompat.la  ../../lib/libvarnishapi/libvarnishapi.la  -lcurses -lthr 
gcc -include config.h -g -O2 -o .libs/varnishtop varnishtop-varnishtop.o  ../../lib/libvarnish/.libs/libvarnish.so ../../lib/libvarnishcompat/.libs/libvarnishcompat.so ../../lib/libvarnishapi/.libs/libvarnishapi.so -lcurses -lthr -Wl,--rpath -Wl,/usr/local/lib
creating varnishtop
Making all in man
Making all in etc
Making all in doc
--xinclude -o changes-1.0.4.html changes-1.0.4.xml
--xinclude:No such file or directory
*** Error code 1

Stop in /usr/local/src/varnish-1.1.1/doc.
*** Error code 1

Stop in /usr/local/src/varnish-1.1.1.
*** Error code 1

Stop in /usr/local/src/varnish-1.1.1.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070821/a4c93590/attachment.html>

From jdouglas at bksnetworks.com  Wed Aug 22 05:10:20 2007
From: jdouglas at bksnetworks.com (jdouglas)
Date: Wed, 22 Aug 2007 01:10:20 -0400
Subject: Varnish and awstats
Message-ID: <20070822051020.14c6c0a9@mx-1.bksnetworks.com>

Is there a trick to getting awstats to work with varnish?

I tried doing varnishncsa -a -w filename and then pointed awstats to this file but it gives me an error that the log format must be incorrect

Create/Update database for config "/etc/awstats/awstats.mmvk.hidden.net.conf" by AWStats version 6.7 (build 1.892) From data in log file "hidden/lb.log"... Phase 1 : First bypass old records, searching new record... Direct access after last parsed record (after line 9835) AWStats did not find any valid log lines that match your LogFormat parameter, in the 50th first non commented lines read of your log. Your log file /hidden/lb.log must have a bad format or LogFormat parameter setup does not match this format. Your AWStats LogFormat parameter is: 4 This means each line in your web server log file need to have "common log format" like this
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070822/4e235007/attachment.html>

From denis at startsiden.no  Wed Aug 22 06:05:35 2007
From: denis at startsiden.no (=?utf-8?Q?Denis_Br=C3=A6khus?=)
Date: Wed, 22 Aug 2007 08:05:35 +0200 (CEST)
Subject: Varnish and awstats
In-Reply-To: <20070822051020.14c6c0a9@mx-1.bksnetworks.com>
Message-ID: <25972044.251187762735696.JavaMail.root@ms1.startsiden.no>

From: jdouglas <jdouglas at bksnetworks.com> 
>Is there a trick to getting awstats to work with varnish? 
>
>I tried doing varnishncsa -a -w filename and then pointed awstats to this file but it gives me an error that the log format must be incorrect 
>
>a bad format or LogFormat parameter setup does not match this format. Your AWStats 
>LogFormat parameter is: 4 This means each line in your web server log file need to 
>have "common log format" like this 

Try setting the "Combined" logformat instead, which is what varnishncsa produces.. 
>From the varnishncsa man page : "Display Varnish logs in Apache / NCSA combined log format" 

Regards
-- 
Denis Braekhus - Teknisk Ansvarlig ABC Startsiden AS 
http://www.startsiden.no 



From des at linpro.no  Wed Aug 22 07:31:16 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Wed, 22 Aug 2007 09:31:16 +0200
Subject: Varnish 1.1.1 FreeBSD 6.2
In-Reply-To: <20070822003134.dac04bb6@mx-1.bksnetworks.com>
	(jdouglas@bksnetworks.com's message of "Tue, 21 Aug 2007 20:31:34
	-0400")
References: <20070822003134.dac04bb6@mx-1.bksnetworks.com>
Message-ID: <ujrr6lwc9ff.fsf@false.linpro.no>

jdouglas <jdouglas at bksnetworks.com> writes:
> During a ./configure I see this.

What's wrong with

# cd /usr/ports/www/varnish
# make install clean

?

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Wed Aug 22 07:32:22 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Wed, 22 Aug 2007 09:32:22 +0200
Subject: Varnish 1.1.1 FreeBSD 6.2
In-Reply-To: <20070822003343.2a0bc543@mx-1.bksnetworks.com>
	(jdouglas@bksnetworks.com's message of "Tue, 21 Aug 2007 20:33:43
	-0400")
References: <20070822003343.2a0bc543@mx-1.bksnetworks.com>
Message-ID: <ujrmywkc9dl.fsf@false.linpro.no>

jdouglas <jdouglas at bksnetworks.com> writes:
> Making all in doc
> --xinclude -o changes-1.0.4.html changes-1.0.4.xml
> --xinclude:No such file or directory
> *** Error code 1

You're obviously not building from the release tarball...

You need xsltproc (from textproc/libxslt) to generate the change logs.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From denis at startsiden.no  Wed Aug 22 07:58:43 2007
From: denis at startsiden.no (=?utf-8?Q?Denis_Br=C3=A6khus?=)
Date: Wed, 22 Aug 2007 09:58:43 +0200 (CEST)
Subject: Varnish and awstats
In-Reply-To: <20070822075356.3c7a5ee4@mx-1.bksnetworks.com>
Message-ID: <22395019.2271187769523497.JavaMail.root@ms1.startsiden.no>

Weird, your varnishncsa seems to output differently from mine, anything special configured? 

A line from my output :
85.19.*.* - - [22/Aug/2007:09:53:56 +0200] "GET /img/frimerkertopbg.gif HTTP/1.0" 304 - "http://www.startsiden.no/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)"

74.93.253.*** - - 22/Aug/2007:03:20:44 -0400 "GET /apps/WebObjects/BKSMMVK.woa/6/wo/bEBLQd7bB7Vl3jOsSMiiZM/11.1.0 HTTP/1.1" 3850 "Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6" 

compared, it seems your datestring misses the [] brackets, and referer bits are missing too. 

Unfortunately I do not know why this is, but a solution would of course be to specify the type of loglines in a custom logdefinition in AWStats. AFAIK that is possible with the configuration. Check up on the AWStats docs.

Regards
--
Denis

----- Original Message ----- 
From: jdouglas <jdouglas at bksnetworks.com> 
To: Denis Br?khus <denis at startsiden.no> 
Sent: Wednesday, August 22, 2007 9:53:56 AM GMT+0100 Europe/Berlin 
Subject: Re: Varnish and awstats 

>From the varnish generated log file 
74.93.253.*** - - 22/Aug/2007:03:20:44 -0400 "GET /apps/WebObjects/BKSMMVK.woa/6/wo/bEBLQd7bB7Vl3jOsSMiiZM/11.1.0 HTTP/1.1" 3850 "Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6" 

The awstats error 

Create/Update database for config "/etc/awstats/awstats.mmvk.brandkey.net.conf" by AWStats version 6.7 (build 1.892) From data in log file "/home/deploy/lb.log"... Phase 1 : First bypass old records, searching new record... Searching new records from beginning of log file... AWStats did not find any valid log lines that match your LogFormat parameter, in the 50th first non commented lines read of your log. Your log file /hidden/lb.log must have a bad format or LogFormat parameter setup does not match this format. Your AWStats LogFormat parameter is: 1 This means each line in your web server log file need to have "combined log format" like this: 111.22.33.44 - - [10/Jan/2001:02:14:14 +0200] "GET / HTTP/1.1" 200 1234 "http://www.fromserver.com/from.htm" "Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)" And this is an example of records AWStats found in your log file (the record number 50 in your log): 74.93.253.*** - - 22/Aug/2007:03:20:42 -0400 "GET /bksstdskins/039_0014M.gif HTTP/1.1" 1041 "http://hidden/apps/WebObjects/BKSMMVK.woa/6/wo/bEBLQd7bB7Vl3jOsSMiiZM/2.3.0.5.0" "Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.6) Gecko/20070725 Firefox/2.0.0.6" 



From: Denis Br?khus [mailto:denis at startsiden.no] 
To: jdouglas [mailto:jdouglas at bksnetworks.com] 
Sent: Wed, 22 Aug 2007 03:43:47 -0400 
Subject: Re: Varnish and awstats 

Could you paste one line from that log? And paste the relevant part of the AWstats conf file? 

----- Original Message ----- 
From: jdouglas < jdouglas at bksnetworks.com > 
To: Denis Br?khus < denis at startsiden.no > 
Sent: Wednesday, August 22, 2007 9:24:38 AM GMT+0100 Europe/Berlin 
Subject: Re: Varnish and awstats 

Changing this makes no difference. I get the same error. 





From: Denis Br?khus [mailto: denis at startsiden.no ] 
To: varnish-misc [mailto: varnish-misc at projects.linpro.no ] 
Cc: jdouglas [mailto: jdouglas at bksnetworks.com ] 
Sent: Wed, 22 Aug 2007 02:05:35 -0400 
Subject: Re: Varnish and awstats 

From: jdouglas < jdouglas at bksnetworks.com > 
>Is there a trick to getting awstats to work with varnish? 
> 
>I tried doing varnishncsa -a -w filename and then pointed awstats to this file but it gives me an error that the log format must be incorrect 
> 
>a bad format or LogFormat parameter setup does not match this format. Your AWStats 
>LogFormat parameter is: 4 This means each line in your web server log file need to 
>have "common log format" like this 

Try setting the "Combined" logformat instead, which is what varnishncsa produces.. 
>From the varnishncsa man page : "Display Varnish logs in Apache / NCSA combined log format" 

Regards 
-- 
Denis Braekhus - Teknisk Ansvarlig ABC Startsiden AS 
http://www.startsiden.no 



-- 
Denis Braekhus - Teknisk Ansvarlig ABC Startsiden AS 
http://www.startsiden.no 


-- 
Denis Braekhus - Teknisk Ansvarlig ABC Startsiden AS 
http://www.startsiden.no 



From sfoutrel at bcstechno.com  Fri Aug 24 09:34:13 2007
From: sfoutrel at bcstechno.com (=?iso-8859-1?Q?S=E9bastien_FOUTREL?=)
Date: Fri, 24 Aug 2007 11:34:13 +0200
Subject: docs, howto and best practices
Message-ID: <D71E8F2EEEAFB64BB0336A4D09E512F741D286@hermes.BCSTECHNO.local>

Hello,

I'am relatively new to varnish, but the more I use it, the more I like it.

There is only a black point on my pleasure.

There is not enough docs available.

I browsed the web site and google and did not find enough meat to feed my beast.

Where can I find vcl languages docs (apart man pages) ?

Could you please give me your ressources on Varnish.

I'am ready to use it and, if developers are ok, to feed the wiki to help other people like me.

Thank You,

S?bastien FOUTREL



From chulmin2 at hotmail.com  Fri Aug 24 10:06:39 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Fri, 24 Aug 2007 10:06:39 +0000
Subject: again cookies problem...
Message-ID: <BLU116-F3F9D9E2B08CC1AAB3F5C385D70@phx.gbl>

Hello, list.

I'm so sorry for bothering you.
I have met serious problem related cookies.
my varnish is 1.1.1.

If I don't set like this at vcl, the web site which using cookies, loading 
is too slow.

         if (req.request == "GET" && req.http.cookie) {
                 lookup;
         }
 
But, when I set like above, someone who visits the site, can see previous 
connected person information.

So I changed like below,

 if (req.request == "GET" && req.http.cookie && req.url ~ 
"\.(gif|jpg|swf|css|js)$") {
    lookup;
         }

After I set above, the problem which anyone can see others' information is 
solved.
But this config makes the site a bit slow too.
I don't know why.

There are lots of sites which using cookies there, so I don't know how to 
to.

So sorry for my unknowness. and please help me..


Thanks for your help in advance.

_________________________________________________________________
??? ???? ?? ??? MSN ?????!  
http://match.kr.msn.com/channel/index.aspx?trackingid=1002127 



From ingvar.hagelund at linpro.no  Fri Aug 24 20:59:38 2007
From: ingvar.hagelund at linpro.no (Ingvar Hagelund)
Date: Fri, 24 Aug 2007 22:59:38 +0200
Subject: docs, howto and best practices
In-Reply-To: <D71E8F2EEEAFB64BB0336A4D09E512F741D286@hermes.BCSTECHNO.local>
References: <D71E8F2EEEAFB64BB0336A4D09E512F741D286@hermes.BCSTECHNO.local>
Message-ID: <46CF46BA.8050906@linpro.no>

* S?bastien FOUTREL
> I'am relatively new to varnish, but the more I use it, the more I like it.
> There is only a black point on my pleasure.
> There is not enough docs available.
> I browsed the web site and google and did not find enough meat to feed my beast.
> Where can I find vcl languages docs (apart man pages) ?
> Could you please give me your ressources on Varnish.
> I'am ready to use it and, if developers are ok, to feed the wiki to help other people like me.
> Thank You,
>   

Hello, S?bastien

Unfortunately, there is still quite a lack of more fleshy documentation
than the man pages. John Buswell wrote a nice article in issue #6 of
o3magazine. It's available online at
http://www.emea.o3magazine.com/pastissues/issue6/ . It includes some
starting point vcl code and some general advice. You should start with
that article and the man pages, and then be welcome to return to the
mailing list for more help.

Regards,
Ingvar



From optilude at gmx.net  Sat Aug 25 23:46:58 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Sun, 26 Aug 2007 00:46:58 +0100
Subject: Varnish appears to hang/requests time out
Message-ID: <faqf1s$ji5$1@sea.gmane.org>

Hi guys,

I'm having some trouble with Varnish 1.1.1 tarball and 1.1 branch in svn 
(r1922), and trunk as of today.

Basically, I use a setup where I have Apache with virtual hosting, in 
front of Varnish (VCL included) in front of Zope/Plone (Plone 3 with 
CacheFu 1.1, in case that means anything to you, it hopefully shouldn't 
matter).

It's hard to debug, but Varnish appears to hang, in that requests never 
complete. Not always, but between five or ten requests, I can make a few 
do this.

I can't spot an obvious pattern, but it's normally either a page or a JS 
or CSS request. It happens sometimes on basic GET requests, and more 
often on POST requests.

Is this familiar to anyone? Can I do anything more useful to debug?

The VCL is:

backend backend_0 {
     set backend.host = "127.0.0.1";
     set backend.port = "8080";
}



acl purge {
     "localhost";
}

sub vcl_recv {


     if (req.request == "PURGE") {
         if (!client.ip ~ purge) {
                 error 405 "Not allowed.";
         }
         lookup;
     }

     if (req.request != "GET" && req.request != "HEAD") {
         # Do not try to cache POST
	pipe;
     }

     if (req.http.Expect) {
         pipe;
     }

     if (req.http.If-None-Match) {
         pass;
     }

     /* Always cache images and binaries */
     if (req.url ~ 
"\.(jpg|jpeg|gif|png|tiff|tif|svg|swf|ico|vsd|doc|ppt|pps|xls|pdf|mp3|mp4|m4a|ogg|mov|avi|wmv|sxw|zip|gz|bz2|tgz|tar|rar|odc|odb|odf|odg|odi|odp|ods|odt|sxc|sxd|sxi|sxw|dmg|torrent|deb|msi|iso|rpm)$") 
{
         lookup;
     }
     /* Always cache CSS and javascript */
     if (req.url ~ "\.(css|js)$") {
         lookup;
     }

     /* Do not cache other authorised content */
     if (req.http.Authenticate || req.http.Authorization) {
         pass;
     }

     /* We only care about the "__ac.*" cookies, used for authentication */
     if (req.http.Cookie && (req.http.Cookie ~ 
"__ac(_(name|password|persistent))?=" || req.http.Cookie ~ "_ZopeId")) {
         pass;
     }

     lookup;
}

/* Deal with purge requests */
sub vcl_hit {
     if (req.request == "PURGE") {
             set obj.ttl = 0s;
             error 200 "Purged";
     }
}

sub vcl_miss {
     if (req.http.If-Modified-Since) {
         pass;
     }

     if (req.request == "PURGE") {
             error 404 "Not in cache";
     }
}

sub vcl_fetch {
     if (!obj.valid) {
         error;
     }
     if (!obj.cacheable) {
         pass;
     }
     if (obj.http.Set-Cookie) {
         pass;
     }

     if (req.url ~ "(rss_|search_rss)") {
         set obj.ttl = 1800s;
     }
}


Cheers,
Martin

-- 
Acquisition is a jealous mistress



From optilude at gmx.net  Sun Aug 26 13:51:43 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Sun, 26 Aug 2007 14:51:43 +0100
Subject: Varnish appears to hang/requests time out
In-Reply-To: <faqf1s$ji5$1@sea.gmane.org>
References: <faqf1s$ji5$1@sea.gmane.org>
Message-ID: <fas0hq$ljn$1@sea.gmane.org>

Martin Aspeli wrote:
> Hi guys,
> 
> I'm having some trouble with Varnish 1.1.1 tarball and 1.1 branch in svn 
> (r1922), and trunk as of today.

... and worse, when this happens, Firefox 2 on OSX actually crashes and 
needs to be killed manually. :)

Martin

-- 
Acquisition is a jealous mistress



From perbu at linpro.no  Sun Aug 26 16:58:04 2007
From: perbu at linpro.no (Per Andreas Buer)
Date: Sun, 26 Aug 2007 18:58:04 +0200
Subject: docs, howto and best practices
In-Reply-To: <D71E8F2EEEAFB64BB0336A4D09E512F741D286@hermes.BCSTECHNO.local>
References: <D71E8F2EEEAFB64BB0336A4D09E512F741D286@hermes.BCSTECHNO.local>
Message-ID: <46D1B11C.9020408@linpro.no>

S?bastien FOUTREL skrev:
> Hello,
> 
> I'am relatively new to varnish, but the more I use it, the more I like it.
> 
> There is only a black point on my pleasure.
> 
> There is not enough docs available.


Check out the varnish article in O3 Magazine - available here:
http://www.emea.o3magazine.com/pastissues/issue6/


Per.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 252 bytes
Desc: OpenPGP digital signature
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070826/bb0ed535/attachment.bin>

From sfoutrel at bcstechno.com  Mon Aug 27 08:15:46 2007
From: sfoutrel at bcstechno.com (=?iso-8859-1?Q?S=E9bastien_FOUTREL?=)
Date: Mon, 27 Aug 2007 10:15:46 +0200
Subject: docs, howto and best practices
References: <D71E8F2EEEAFB64BB0336A4D09E512F741D286@hermes.BCSTECHNO.local>
	<46D1B11C.9020408@linpro.no>
Message-ID: <D71E8F2EEEAFB64BB0336A4D09E512F741D29C@hermes.BCSTECHNO.local>

 
Unfortunately, I already read that articles and it has only a bit of meat to feed my hunger.

Where can I found vcl languages docs ?
The website and my googling did not gave me good results.

I know basics but wants to go further.

Varnish is already production used on a 7M hits/D website and it works perfectly.


-----Message d'origine-----
De : Per Andreas Buer [mailto:perbu at linpro.no] 
Envoy? : dimanche 26 ao?t 2007 18:58
? : S?bastien FOUTREL
Cc : varnish-misc at projects.linpro.no
Objet : Re: docs, howto and best practices

S?bastien FOUTREL skrev:
> Hello,
> 
> I'am relatively new to varnish, but the more I use it, the more I like it.
> 
> There is only a black point on my pleasure.
> 
> There is not enough docs available.


Check out the varnish article in O3 Magazine - available here:
http://www.emea.o3magazine.com/pastissues/issue6/


Per.



From bozouhair at gmail.com  Mon Aug 27 19:19:29 2007
From: bozouhair at gmail.com (Zouhair BOUNOUALA)
Date: Mon, 27 Aug 2007 19:19:29 +0000
Subject: Varnish Install
Message-ID: <979f82860708271219n6a35bd0vb5826f5ed8ad092d@mail.gmail.com>

Hi,

It is my fisrt post in your varnish ML.
I have installed three package rpm for Vanish software.

I want to configure it to make HTTP accelerator for two Apaches nodes. How
to?

Thanks in advance.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.varnish-cache.org/lists/pipermail/vinyl-misc/attachments/20070827/ef2f5e70/attachment.html>

From ingvar at linpro.no  Tue Aug 28 09:42:20 2007
From: ingvar at linpro.no (Ingvar Hagelund)
Date: Tue, 28 Aug 2007 11:42:20 +0200
Subject: docs, howto and best practices
In-Reply-To: <D71E8F2EEEAFB64BB0336A4D09E512F741D29C@hermes.BCSTECHNO.local>
References: <D71E8F2EEEAFB64BB0336A4D09E512F741D286@hermes.BCSTECHNO.local>	<46D1B11C.9020408@linpro.no>
	<D71E8F2EEEAFB64BB0336A4D09E512F741D29C@hermes.BCSTECHNO.local>
Message-ID: <46D3EDFC.9060801@linpro.no>

* S?bastien FOUTREL
> Unfortunately, I already read that articles and it has only a bit of meat to feed my hunger.
> 
> Where can I found vcl languages docs ?
> The website and my googling did not gave me good results.

I don't think there exists more, at least not in publishable form.
Dag-Erling?

I agree that documentation of the vcl language, and some best-practice
notes and advice is poorly needed for the project. On the other hand, at
least, we now have the man pages. We all have to prioritize how we use
our time, and that of course includes the main developers, who probably
wisely use most of their varnish time on squashing bugs and programming
for varnish-2. Dag-Erling, is it possible to push some documentation
production up the prio list?

> I know basics but wants to go further.
> Varnish is already production used on a 7M hits/D website and it works perfectly.

Post your config here and ask about comments for it. Then tell us what
else you want to do with varnish, and if you are lucky, some on the list
may tell you more.

Ingvar

-- 


From perbu at linpro.no  Tue Aug 28 12:49:55 2007
From: perbu at linpro.no (Per Andreas Buer)
Date: Tue, 28 Aug 2007 14:49:55 +0200
Subject: Varnish Install
In-Reply-To: <979f82860708271219n6a35bd0vb5826f5ed8ad092d@mail.gmail.com>
References: <979f82860708271219n6a35bd0vb5826f5ed8ad092d@mail.gmail.com>
Message-ID: <46D419F3.8010103@linpro.no>

Zouhair BOUNOUALA skrev:
> Hi,
>
> It is my fisrt post in your varnish ML.
> I have installed three package rpm for Vanish software.
>
> I want to configure it to make HTTP accelerator for two Apaches nodes. 
> How to?

Check out the article in O3 magazine - 
http://www.emea.o3magazine.com/pastissues/issue6/


That shold answer most of your questions.

-- 
Per Andreas Buer / Linpro AS   t: 21 54 41 21 / m: 958 39 117                   
http://linpro.no/ - Ledende p? Linux og ?pen kildekode.



From optilude at gmx.net  Wed Aug 29 07:29:51 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Wed, 29 Aug 2007 08:29:51 +0100
Subject: Varnish appears to hang/requests time out
In-Reply-To: <faqf1s$ji5$1@sea.gmane.org>
References: <faqf1s$ji5$1@sea.gmane.org>
Message-ID: <fb37a0$j2h$1@sea.gmane.org>

Martin Aspeli wrote:
> Hi guys,
> 
> I'm having some trouble with Varnish 1.1.1 tarball and 1.1 branch in svn 
> (r1922), and trunk as of today.
> 
> Basically, I use a setup where I have Apache with virtual hosting, in 
> front of Varnish (VCL included) in front of Zope/Plone (Plone 3 with 
> CacheFu 1.1, in case that means anything to you, it hopefully shouldn't 
> matter).
> 
> It's hard to debug, but Varnish appears to hang, in that requests never 
> complete. Not always, but between five or ten requests, I can make a few 
> do this.
> 
> I can't spot an obvious pattern, but it's normally either a page or a JS 
> or CSS request. It happens sometimes on basic GET requests, and more 
> often on POST requests.
> 
> Is this familiar to anyone? Can I do anything more useful to debug?

After more testing - I know of at least one, probably two other people 
who've had the same problem with the 1.1 branch (and 1.1 final, and 
1.1.1 final, and trunk). They, like me, have reverted to 1.0 final, 
which seems a lot more stable in this regard. I'm pasting the VCL I use 
for 1.0, but it's not much difference.

Are people using 1.1.1 in production? Am I missing something in my 
configuration? How can I debug this better?

Cheers,
Martin

Varnish 1.0 config that works:
------------------------------

backend default_backend {
	set backend.host = "127.0.0.1";
	set backend.port = "8080";
}

acl purge {
	"localhost";
}

sub vcl_recv {

	if (req.request != "GET" && req.request != "HEAD") {
         	# PURGE request if zope asks nicely
         	if (req.request == "PURGE") {
         	        if (!client.ip ~ purge) {
         	                error 405 "Not allowed.";
         	        }
         	        lookup;
         	}
		pipe;
	}
	if (req.http.Expect) {
		pipe;
	}

	/* Always cache images */
	if (req.url ~ 
"\.(jpg|jpeg|gif|png|tiff|tif|svg|swf|ico|css|js|vsd|doc|ppt|pps|xls|pdf|mp3|mp4|m4a|ogg|mov|avi|wmv|sxw|zip|gz|bz2|tgz|tar|rar|odc|odb|odf|odg|odi|odp|ods|odt|sxc|sxd|sxi|sxw|dmg|torrent|deb|msi|iso|rpm)$") 
{
		lookup;
	}
	/* Always cache CSS and javascript */
	if (req.url ~ "\.(css|js)$") {
		lookup;
	}

	/* Do not cache other authorised content */
	if (req.http.Authenticate || req.http.Authorization) {
		pass;
	}
	# We only care about the "__ac.*" cookies, used for authentication
	if (req.http.Cookie && req.http.Cookie ~ 
"__ac(|_(name|password|persistent))=") {
		pass;
	}
# XXX Add a check for _ZopeId here as well so we do not cache requests which
# rely on Zope sessions
	lookup;
}

# Do the PURGE thing
sub vcl_hit {
         if (req.request == "PURGE") {
                 set obj.ttl = 0s;
                 error 200 "Purged";
         }
}
sub vcl_miss {
         if (req.request == "PURGE") {
                 error 404 "Not in cache";
         }
}


sub vcl_fetch {
	if (!obj.valid) {
		error;
	}
	if (!obj.cacheable) {
		pass;
	}
	if (resp.http.Set-Cookie) {
		pass;
	}

	if (req.url ~ "(rss_|search_rss)") {
		set obj.ttl = 1800s;
	}
}

For comparison, 1.1 config that doesn't work:
---------------------------------------------

backend backend_0 {
      set backend.host = "127.0.0.1";
      set backend.port = "8080";
}



acl purge {
      "localhost";
}

sub vcl_recv {


      if (req.request == "PURGE") {
          if (!client.ip ~ purge) {
                  error 405 "Not allowed.";
          }
          lookup;
      }

      if (req.request != "GET" && req.request != "HEAD") {
          # Do not try to cache POST
	pipe;
      }

      if (req.http.Expect) {
          pipe;
      }

      if (req.http.If-None-Match) {
          pass;
      }

      /* Always cache images and binaries */
      if (req.url ~
"\.(jpg|jpeg|gif|png|tiff|tif|svg|swf|ico|vsd|doc|ppt|pps|xls|pdf|mp3|mp4|m4a|ogg|mov|avi|wmv|sxw|zip|gz|bz2|tgz|tar|rar|odc|odb|odf|odg|odi|odp|ods|odt|sxc|sxd|sxi|sxw|dmg|torrent|deb|msi|iso|rpm)$") 

{
          lookup;
      }
      /* Always cache CSS and javascript */
      if (req.url ~ "\.(css|js)$") {
          lookup;
      }

      /* Do not cache other authorised content */
      if (req.http.Authenticate || req.http.Authorization) {
          pass;
      }

      /* We only care about the "__ac.*" cookies, used for authentication */
      if (req.http.Cookie && (req.http.Cookie ~
"__ac(_(name|password|persistent))?=" || req.http.Cookie ~ "_ZopeId")) {
          pass;
      }

      lookup;
}

/* Deal with purge requests */
sub vcl_hit {
      if (req.request == "PURGE") {
              set obj.ttl = 0s;
              error 200 "Purged";
      }
}

sub vcl_miss {
      if (req.http.If-Modified-Since) {
          pass;
      }

      if (req.request == "PURGE") {
              error 404 "Not in cache";
      }
}

sub vcl_fetch {
      if (!obj.valid) {
          error;
      }
      if (!obj.cacheable) {
          pass;
      }
      if (obj.http.Set-Cookie) {
          pass;
      }

      if (req.url ~ "(rss_|search_rss)") {
          set obj.ttl = 1800s;
      }
}

-- 
Acquisition is a jealous mistress



From des at linpro.no  Wed Aug 29 10:56:52 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Wed, 29 Aug 2007 12:56:52 +0200
Subject: Varnish appears to hang/requests time out
In-Reply-To: <faqf1s$ji5$1@sea.gmane.org> (Martin Aspeli's message of "Sun, 26
	Aug 2007 00:46:58 +0100")
References: <faqf1s$ji5$1@sea.gmane.org>
Message-ID: <ujrejhmsj63.fsf@false.linpro.no>

Martin Aspeli <optilude at gmx.net> writes:
> I'm having some trouble with Varnish 1.1.1 tarball and 1.1 branch in
> svn (r1922), and trunk as of today.  [...]

ENOLOGS

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Wed Aug 29 10:59:58 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Wed, 29 Aug 2007 12:59:58 +0200
Subject: docs, howto and best practices
In-Reply-To: <46D3EDFC.9060801@linpro.no> (Ingvar Hagelund's message of "Tue, 
	28 Aug 2007 11:42:20 +0200")
References: <D71E8F2EEEAFB64BB0336A4D09E512F741D286@hermes.BCSTECHNO.local>
	<46D1B11C.9020408@linpro.no>
	<D71E8F2EEEAFB64BB0336A4D09E512F741D29C@hermes.BCSTECHNO.local>
	<46D3EDFC.9060801@linpro.no>
Message-ID: <ujrabsasj0x.fsf@false.linpro.no>

Ingvar Hagelund <ingvar at linpro.no> writes:
> * S?bastien FOUTREL
> > Where can I found vcl languages docs ?  The website and my
> > googling did not gave me good results.
> I don't think there exists more, at least not in publishable form.
> Dag-Erling?

'man vcl'

> Dag-Erling, is it possible to push some documentation production up
> the prio list?

I'm working on a "getting started" document which will deal with
basic-to-intermediate VCL and how to measure performance.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From des at linpro.no  Wed Aug 29 11:04:17 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Wed, 29 Aug 2007 13:04:17 +0200
Subject: again cookies problem...
In-Reply-To: <BLU116-F3F9D9E2B08CC1AAB3F5C385D70@phx.gbl> (Monty Ree's message
	of "Fri, 24 Aug 2007 10:06:39 +0000")
References: <BLU116-F3F9D9E2B08CC1AAB3F5C385D70@phx.gbl>
Message-ID: <ujr642ysitq.fsf@false.linpro.no>

"Monty Ree" <chulmin2 at hotmail.com> writes:
> If I don't set like this at vcl, the web site which using cookies,
> loading is too slow.

By default, Varnish bypasses the cache if the client sends a cookie or
the server sets one.

> if (req.request == "GET" && req.http.cookie) {
>     lookup;
> }
>
> But, when I set like above, someone who visits the site, can see
> previous connected person information.

Precisely.

> So I changed like below,
>
>  if (req.request == "GET" && req.http.cookie && req.url ~ "\.(gif|jpg|swf|css|js)$") {
>      lookup;
>  }

So images, stylesheets and JavaScript will be cached no matter what,
which is usually a good idea, but other documents will not be cached
if a cookie is involved.

> After I set above, the problem which anyone can see others'
> information is solved.

Precisely.

> But this config makes the site a bit slow too.  I don't know why.

Because the cookies prevent Varnish from caching it.  There isn't
really anything you can do about it unless you redesign your site to
not use cookies.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From optilude at gmx.net  Wed Aug 29 11:06:06 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Wed, 29 Aug 2007 11:06:06 +0000 (UTC)
Subject: Varnish appears to hang/requests time out
References: <faqf1s$ji5$1@sea.gmane.org> <ujrejhmsj63.fsf@false.linpro.no>
Message-ID: <loom.20070829T130352-416@post.gmane.org>

Dag-Erling Sm?rgrav <des at ...> writes:

> 
> Martin Aspeli <optilude at ...> writes:
> > I'm having some trouble with Varnish 1.1.1 tarball and 1.1 branch in
> > svn (r1922), and trunk as of today.  [...]
> 
> ENOLOGS

varnishlog produces a *lot* of output, and this problem is intermittent and hard
to co-ordinate. I can generally make it happen by refreshing my site a few dozen
times in rapid succession, but it's difficult to pinpoint exactly which log
entry corresponds to that exact event.

If you don't mind the list spam of a few hundred lines of log output, I can
leave the log running while I try to reproduce the error (and kill it as soon as
it happens), but if there are more exact techniques I could use to debug, that
may be better for all of us.

Martin



From phk at phk.freebsd.dk  Wed Aug 29 11:08:03 2007
From: phk at phk.freebsd.dk (Poul-Henning Kamp)
Date: Wed, 29 Aug 2007 11:08:03 +0000
Subject: Varnish appears to hang/requests time out 
In-Reply-To: Your message of "Wed, 29 Aug 2007 11:06:06 GMT."
	<loom.20070829T130352-416@post.gmane.org> 
Message-ID: <32901.1188385683@critter.freebsd.dk>


Are there anything suspicious in your backends log when this happens ?

-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.


From chulmin2 at hotmail.com  Wed Aug 29 11:21:43 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Wed, 29 Aug 2007 11:21:43 +0000
Subject: how to set file parameter if file is not just one.
Message-ID: <BLU116-F1EFA01081C517121B145285CC0@phx.gbl>

Hello list.

I have set like below for the storage type.

             -s file,/data1/data1.file,10G 

But, if I have several files at different partiioons like below, how to 
set??

             /data1/data1   10G
             /data2/data2   20G 
             /data3/data3   30G 
 ....

like below is reasonable or can't do it?

         -s file,/data1/data1.file,10G 
         -s file,/data2/data2.file,20G 
         -s file,/data3/data3.file,30G 


Thanks in advance.

_________________________________________________________________
MSN Messenger? ?? ????? ?? ??? ??? ????.   
http://www.msn.co.kr/messenger 



From optilude at gmx.net  Wed Aug 29 11:22:49 2007
From: optilude at gmx.net (Martin Aspeli)
Date: Wed, 29 Aug 2007 11:22:49 +0000 (UTC)
Subject: Varnish appears to hang/requests time out
References: <loom.20070829T130352-416@post.gmane.org>
	<32901.1188385683@critter.freebsd.dk>
Message-ID: <loom.20070829T131117-871@post.gmane.org>

Poul-Henning Kamp <phk at ...> writes:

> 
> 
> Are there anything suspicious in your backends log when this happens ?

Not really, but I'm not sure how you define "suspicious". I'm definitely 
unable to reproduce this problem with Varnish 1.0, nor does it happen if I 
bypass Varnish.

The backend here, by the way, is Plone 3.0, with CacheFu 1.1. CacheFu may 
send PURGE requests from time to time, and will try to set ETags cleverly. 
I have tried without CacheFu, though, and the problem seems to persist.

As I said, it's hard to be definitive here, because it's such an intermittent
problem. 

Martin




From des at linpro.no  Wed Aug 29 11:28:46 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Wed, 29 Aug 2007 13:28:46 +0200
Subject: how to set file parameter if file is not just one.
In-Reply-To: <BLU116-F1EFA01081C517121B145285CC0@phx.gbl> (Monty Ree's message
	of "Wed, 29 Aug 2007 11:21:43 +0000")
References: <BLU116-F1EFA01081C517121B145285CC0@phx.gbl>
Message-ID: <ujrzm0ar34h.fsf@false.linpro.no>

"Monty Ree" <chulmin2 at hotmail.com> writes:
> I have set like below for the storage type.  [...]  But, if I have
> several files at different partiioons like below, how to set??

This is supported in trunk (with multiple -s) but not in 1.0 or 1.1.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From chulmin2 at hotmail.com  Wed Aug 29 12:18:11 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Wed, 29 Aug 2007 12:18:11 +0000
Subject: how to set file parameter if file is not just one.
In-Reply-To: <ujrzm0ar34h.fsf@false.linpro.no>
Message-ID: <BLU116-F145DF8B72D1C1C0E9A2E0185CC0@phx.gbl>


So thanks for your kind answer.

my varnish is 1.1.1 and I set like below at config.

             -s file,/data1/data1,10G \
             -s file,/data2/data2,20G \
             -s file,/data3/data3,30G \

and I executed varnishd, but when I execute varnishstat, 
I can see just 30Gbytes free.
It seems that the last -s file config is applied.

Is there any mistake to me??

Thanks for your help again..




>From: Dag-Erling Sm?grav <des at linpro.no>
>To: "Monty Ree" <chulmin2 at hotmail.com>
>CC: varnish-misc at projects.linpro.no
>Subject: Re: how to set file parameter if file is not just one.
>Date: Wed, 29 Aug 2007 13:28:46 +0200
>
>"Monty Ree" <chulmin2 at hotmail.com> writes:
> > I have set like below for the storage type.  [...]  But, if I have
> > several files at different partiioons like below, how to set??
>
>This is supported in trunk (with multiple -s) but not in 1.0 or 1.1.
>
>DES
>--
>Dag-Erling Sm?grav
>Senior Software Developer
>Linpro AS - www.linpro.no

_________________________________________________________________
?? ?? ?? ??? ?????? MSN ???? ?????. 
http://fortune.msn.co.kr/ 



From des at linpro.no  Wed Aug 29 12:45:57 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Wed, 29 Aug 2007 14:45:57 +0200
Subject: how to set file parameter if file is not just one.
In-Reply-To: <BLU116-F145DF8B72D1C1C0E9A2E0185CC0@phx.gbl> (Monty Ree's
	message of "Wed, 29 Aug 2007 12:18:11 +0000")
References: <BLU116-F145DF8B72D1C1C0E9A2E0185CC0@phx.gbl>
Message-ID: <ujrlkbuqzju.fsf@false.linpro.no>

"Monty Ree" <chulmin2 at hotmail.com> writes:
> So thanks for your kind answer.
>
> my varnish is 1.1.1 and I set like below at config.
>
>             -s file,/data1/data1,10G \
>             -s file,/data2/data2,20G \
>             -s file,/data3/data3,30G \
>
> and I executed varnishd, but when I execute varnishstat, I can see
> just 30Gbytes free.
> It seems that the last -s file config is applied.
>
> Is there any mistake to me??

Allow me to repeat my previous answer:

This is supported in trunk (with multiple -s) but not in 1.0 or 1.1.

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From chulmin2 at hotmail.com  Thu Aug 30 09:02:03 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Thu, 30 Aug 2007 09:02:03 +0000
Subject: why purge makes child process restart?
Message-ID: <BLU116-F1318B61F4DAC2B7BDCB3885CD0@phx.gbl>

Hello, list.

my varnishd is 1.1.1 and I found that some problem at varnish.
When I purge using squidclient  like below which in squid package, 
varnishd child process restarted and all caches are deleted.

squidclient  -m purge -r -p 80 -h example.com http://example.com/test.jpg 

Please confirm about this..

additionally, my system is linux kernel 2.6.18(x86_64) and varnishd1.1.1, 
and child process restarted so requently(about once per 5 minutes) without 
purge.


Thanks for your help.

_________________________________________________________________
?? ???? ??? MSN SMS ???? ?????.  
http://im.msn.co.kr/new/function/function_01_02.asp 



From chulmin2 at hotmail.com  Thu Aug 30 09:13:12 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Thu, 30 Aug 2007 09:13:12 +0000
Subject: why purge makes child process restart?
In-Reply-To: <BLU116-F1318B61F4DAC2B7BDCB3885CD0@phx.gbl>
Message-ID: <BLU116-F926D1936FFEBA9C15157985CD0@phx.gbl>

So sorry for bothering you.

I can see lots of messages like below at /var/log/messages. 
the error writes probably every one minute..

Aug 30 17:56:50 www kernel: varnishd[6039]: segfault at 0000000000000000 
rip 0000003111a6ff70 rsp 000000004d817c48 error 4
Aug 30 17:57:48 www kernel: varnishd[6068]: segfault at 0000000000000000 
rip 0000003111a6ff70 rsp 0000000043002c48 error 4
Aug 30 17:58:49 www kernel: varnishd[6150]: segfault at 0000000000000000 
rip 0000003111a6ff70 rsp 0000000055827c48 error 4
Aug 30 17:59:49 www kernel: varnishd[6163]: segfault at 0000000000000000 
rip 0000003111a6ff70 rsp 0000000046008c48 error 4
Aug 30 18:00:52 www kernel: varnishd[6210]: segfault at 0000000000000000 
rip 0000003111a6ff70 rsp 0000000044004c48 error 4
Aug 30 18:01:50 www kernel: varnishd[6303]: segfault at 0000000000000000 
rip 0000003111a6ff70 rsp 0000000053823c48 error 4
Aug 30 18:02:51 www kernel: varnishd[6316]: segfault at 0000000000000000 
rip 0000003111a6ff70 rsp 0000000044004c48 error 4
Aug 30 18:03:51 h-cdn04 kernel: varnishd[6381]: segfault at 
0000000000000000 rip 0000003111a6ff70 rsp 0000000046008c48 error 4


>From: "Monty Ree" <chulmin2 at hotmail.com>
>To: varnish-misc at projects.linpro.no
>Subject: why purge makes child process restart?
>Date: Thu, 30 Aug 2007 09:02:03 +0000
>
>Hello, list.
>
>my varnishd is 1.1.1 and I found that some problem at varnish.
>When I purge using squidclient  like below which in squid package,
>varnishd child process restarted and all caches are deleted.
>
>squidclient  -m purge -r -p 80 -h example.com http://example.com/test.jpg
>
>Please confirm about this..
>
>additionally, my system is linux kernel 2.6.18(x86_64) and varnishd1.1.1,
>and child process restarted so requently(about once per 5 minutes) without
>purge.
>
>
>Thanks for your help.
>
>_________________________________________________________________
>?? ???? ??? MSN SMS ???? ?????.
>http://im.msn.co.kr/new/function/function_01_02.asp
>
>_______________________________________________
>varnish-misc mailing list
>varnish-misc at projects.linpro.no
>http://projects.linpro.no/mailman/listinfo/varnish-misc

_________________________________________________________________
?? ??? ?? ???? ?? ???! 
http://match.kr.msn.com/channel/index.aspx?trackingid=1002127 



From des at linpro.no  Thu Aug 30 09:16:01 2007
From: des at linpro.no (=?iso-8859-1?Q?Dag-Erling_Sm=F8rgrav?=)
Date: Thu, 30 Aug 2007 11:16:01 +0200
Subject: why purge makes child process restart?
In-Reply-To: <BLU116-F926D1936FFEBA9C15157985CD0@phx.gbl> (Monty Ree's message
	of "Thu, 30 Aug 2007 09:13:12 +0000")
References: <BLU116-F926D1936FFEBA9C15157985CD0@phx.gbl>
Message-ID: <ujry7ftpelq.fsf@false.linpro.no>

"Monty Ree" <chulmin2 at hotmail.com> writes:
> Aug 30 17:56:50 www kernel: varnishd[6039]: segfault at 0000000000000000 
> rip 0000003111a6ff70 rsp 000000004d817c48 error 4

A stack trace would be nice...

DES
-- 
Dag-Erling Sm?rgrav
Senior Software Developer
Linpro AS - www.linpro.no


From jim at thebaacks.com  Thu Aug 30 17:53:35 2007
From: jim at thebaacks.com (Jim Baack)
Date: Thu, 30 Aug 2007 10:53:35 -0700
Subject: Varnishd startup error in mgt_vcc.c
Message-ID: <dc32e3beb9abad4b621be50f49df4b42@localhost>

I am new to Varnish and trying to get it running on FC5.

I get this error on 1.1.1 and the current 1.1 branch from SVN.

Internal error: cc(1) exit status 0xffffffff

My startup command line is

/usr/local/sbin/varnishd -a 127.0.0.1:3000 -f /etc/varnish.conf -P
/var/run/varnish.pid -u apache -g apache -sfile,/tmp/varnish.cache,1G

I did some very basic debugging and the bin.XXX file appears to be
successfully generated from the vcl.XXX file. Any idea what the problem
might be or what I should try?

Thanks.


Jim



From chulmin2 at hotmail.com  Fri Aug 31 06:53:52 2007
From: chulmin2 at hotmail.com (Monty Ree)
Date: Fri, 31 Aug 2007 06:53:52 +0000
Subject: why purge makes child process restart?
In-Reply-To: <ujry7ftpelq.fsf@false.linpro.no>
Message-ID: <BLU116-F14AB30B9239CCB14D2C62A85CE0@phx.gbl>

Hello, all.

I found that varnishd child process auto restarted, 
when "Host:" field is not exist at request header.

Please confirm about this..


Thanks for your help.. 


>From: Dag-Erling Sm?grav <des at linpro.no>
>To: "Monty Ree" <chulmin2 at hotmail.com>
>CC: varnish-misc at projects.linpro.no
>Subject: Re: why purge makes child process restart?
>Date: Thu, 30 Aug 2007 11:16:01 +0200
>
>"Monty Ree" <chulmin2 at hotmail.com> writes:
> > Aug 30 17:56:50 www kernel: varnishd[6039]: segfault at 
0000000000000000
> > rip 0000003111a6ff70 rsp 000000004d817c48 error 4
>
>A stack trace would be nice...
>
>DES
>--
>Dag-Erling Sm?grav
>Senior Software Developer
>Linpro AS - www.linpro.no

_________________________________________________________________
MSN Messenger? ?? ????? ?? ??? ??? ????.   
http://www.msn.co.kr/messenger 



From phk at phk.freebsd.dk  Fri Aug 31 07:00:07 2007
From: phk at phk.freebsd.dk (Poul-Henning Kamp)
Date: Fri, 31 Aug 2007 07:00:07 +0000
Subject: why purge makes child process restart? 
In-Reply-To: Your message of "Fri, 31 Aug 2007 06:53:52 GMT."
	<BLU116-F14AB30B9239CCB14D2C62A85CE0@phx.gbl> 
Message-ID: <3738.1188543607@critter.freebsd.dk>


You're right, I'll fix.

-- 
Poul-Henning Kamp       | UNIX since Zilog Zeus 3.20
phk at FreeBSD.ORG         | TCP/IP since RFC 956
FreeBSD committer       | BSD since 4.3-tahoe    
Never attribute to malice what can adequately be explained by incompetence.