Request/Response sizes for traffic over TCP_TUNNEL

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Request/Response sizes for traffic over TCP_TUNNEL

Jeffrey Dunham
I am using squid as a proxy and one of the tasks using the proxy is upload some large files to S3 in AWS.
I'm trying to later on aggregate how much data was going through to S3 by looking through the squid access log files.  The reality is, any way I can tell how much traffic is going through to squid to S3 would be great, I was going after the access file as it seemed most obvious.  However my logfiles don't seem to show this information. I'm wondering if it's possible to show this.  I thought that <st and >st would get me there.  I tried a few different config settings for logging here's what it's at now:

logformat squid %ts.%03tu %6tr %>a %>A %Ss/%03>Hs %<st %>st %rm %ru %un %Sh/%<A %mt

And my logs for a 200MB upload look like (this is broken into a multipart upload):

1510181731.211  53953 <ip> <vpn> TCP_TUNNEL/200 3521 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181731.991  54721 <ip> <vpn> TCP_TUNNEL/200 3865 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181733.884  56646 <ip> <vpn> TCP_TUNNEL/200 3865 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.049  59783 <ip> <vpn> TCP_TUNNEL/200 4209 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.794  61246 <ip> <vpn> TCP_TUNNEL/200 5592 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.796  60537 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.799  60529 <ip> <vpn> TCP_TUNNEL/200 3834 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.800  60535 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.801  60531 <ip> <vpn> TCP_TUNNEL/200 4178 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -
1510181737.807  60542 <ip> <vpn> TCP_TUNNEL/200 4209 41 CONNECT s3.amazonaws.com:443 - HIER_DIRECT/s3.amazonaws.com -

Obviously there's nothing indicating the real size of the file that I can tell, besides the fact that the connection is open awhile.

Any help would be appreciated!

_______________________________________________
squid-users mailing list
[hidden email]
http://lists.squid-cache.org/listinfo/squid-users
Reply | Threaded
Open this post in threaded view
|

Re: Request/Response sizes for traffic over TCP_TUNNEL

Alex Rousskov
On 11/08/2017 04:38 PM, Jeffrey Dunham wrote:

> logformat squid %ts.%03tu %6tr %>a %>A %Ss/%03>Hs %<st %>st %rm %ru %un
> %Sh/%<A %mt
>
> And my logs for a 200MB upload look like (this is broken into a
> multipart upload):
>
> 1510181731.211  53953 <ip> <vpn> TCP_TUNNEL/200 3521 41 CONNECT s3.amazonaws.com:443...
> 1510181731.991  54721 <ip> <vpn> TCP_TUNNEL/200 3865 41 CONNECT s3.amazonaws.com:443...
> 1510181733.884  56646 <ip> <vpn> TCP_TUNNEL/200 3865 41 CONNECT s3.amazonaws.com:443...
> 1510181737.049  59783 <ip> <vpn> TCP_TUNNEL/200 4209 41 CONNECT s3.amazonaws.com:443...
> 1510181737.794  61246 <ip> <vpn> TCP_TUNNEL/200 5592 41 CONNECT s3.amazonaws.com:443...

Sounds like the recently fix bug #4653 (%st lies about tunneled traffic
volumes): https://bugs.squid-cache.org/show_bug.cgi?id=4653

Alex.
_______________________________________________
squid-users mailing list
[hidden email]
http://lists.squid-cache.org/listinfo/squid-users