From viktu at rectorat.url.edu  Mon Sep  1 10:08:16 2014
From: viktu at rectorat.url.edu (Viktu Pons Colomer)
Date: Mon, 1 Sep 2014 08:08:16 +0000
Subject: [mpm-itk] Mailman issues with mpm-itk
In-Reply-To: <77788bc840e005ca00ad2f904c49371c@mail.dyn.su>
References: <86ef374edf434c338e3b63283d0faeac@DB3PR05MB348.eurprd05.prod.outlook.com>
 <77788bc840e005ca00ad2f904c49371c@mail.dyn.su>
Message-ID: <d6f4cd5366f54ad5b6fc3dc4c9dd681e@DB3PR05MB348.eurprd05.prod.outlook.com>

Sure, here it is!

<VirtualHost *:80>
ServerName llistes.foo.com
ServerAlias     mailman.foo.com

ScriptAlias /cgi-bin/mailman/ /usr/lib/cgi-bin/mailman/
Alias /pipermail/ /var/lib/mailman/archives/public/
Alias /images/mailman/ /usr/share/images/mailman/
CustomLog /var/log/apache2/mailman.access.log combined
ErrorLog        /var/log/apache2/mailman.error.log

<Directory /usr/lib/cgi-bin/mailman/>
    AllowOverride None
    Options ExecCGI
    AddHandler cgi-script .cgi
        Require all granted
</Directory>
<Directory /var/lib/mailman/archives/public/>
    Options FollowSymlinks
    AllowOverride None
        Require all granted
</Directory>
<Directory /usr/share/images/mailman/>
    AllowOverride None
        Require all granted
</Directory>
RewriteEngine on
RewriteRule ^/mailman/?$ http://mailman.foo.com/cgi-bin/mailman/listinfo [L,R]
RewriteRule ^/$ http://mailman.foo.com/cgi-bin/mailman/listinfo [L,R]

<IfModule mpm_itk_module>
AssignUserId list www-data
</IfModule>
</VirtualHost>

-------------------------
Viktu Pons i Colomer
-------------------------

De: mpm-itk [mailto:mpm-itk-bounces at err.no] En nom de admin at dyn.su
Enviat: mi?rcoles, 06 de agosto de 2014 15:37
Per a: mpm-itk at err.no
Tema: Re: [mpm-itk] Mailman issues with mpm-itk

Hi,
Can you show your mailman related apache config?



On ??, ??? 6, 2014 at 16:30, Viktu Pons Colomer <viktu at rectorat.url.edu<mailto:viktu at rectorat.url.edu>> wrote:
Hi there,

I recently upgraded Apache to 2.4.7 from 2.2, and now I am facing a problem with mailman using mpm-itk.

When I try to run any of the cgi?s from mailman, I get a Mailman CGI error and ?Operation not permitted?

It worked perfectly with mpm-itk and Apache 2.2

Where should I look at?

Thank you!

-------------------------
Viktu Pons i Colomer
-------------------------

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.err.no/pipermail/mpm-itk/attachments/20140901/0b60fba3/attachment.htm>

From arekm at maven.pl  Wed Sep 24 11:47:51 2014
From: arekm at maven.pl (Arkadiusz =?utf-8?q?Mi=C5=9Bkiewicz?=)
Date: Wed, 24 Sep 2014 11:47:51 +0200
Subject: [mpm-itk] segfaults pfn_ap_logio_get_last_bytes(r->connection)
Message-ID: <201409241147.51222.arekm@maven.pl>


Hello.

One one machine where mpm_itk (2.4.7-02) is installed I'm getting segfaults.
Restart cures them for some time and then back again. If segfaults start then
segfault rate is like few segfaults per second.

[error] [pid 21260] [client child died with signal 11 mpm_itk
[error] [pid 21105] [client child died with signal 11 mpm_itk
[error] [pid 21213] [client child died with signal 11 mpm_itk

I'm using mod_logio to log number of bytes sent per vhost and that seems to be related,

ap_increment_counts() is doing:

    if (pfn_ap_logio_get_last_bytes != NULL) {
        bytes = pfn_ap_logio_get_last_bytes(r->connection);                                                                                                                 
    }

Now not sure if that's itk fault but not hitting this on other machines with the
same software, just without itk.

Any ideas?

Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00007f8dd58f4b30 in ?? ()
(gdb) bt
#0  0x00007f8dd58f4b30 in ?? ()
#1  0x00000000004357c5 in ap_increment_counts (sb=0x4b0bec0, r=r at entry=0x4b11d00) at /usr/src/debug/httpd-2.4.10/server/scoreboard.c:369
#2  0x00000000004465c0 in eor_bucket_cleanup (data=<optimized out>) at /usr/src/debug/httpd-2.4.10/server/eor_bucket.c:37
#3  0x00007f8dd962955e in run_cleanups (cref=0x4b11cf8) at memory/unix/apr_pools.c:2352
#4  apr_pool_destroy (pool=0x4b11c88) at memory/unix/apr_pools.c:804
#5  0x00000000004466c6 in remove_empty_buckets (bb=bb at entry=0x4b0c550) at /usr/src/debug/httpd-2.4.10/server/core_filters.c:722
#6  0x0000000000446a28 in send_brigade_nonblocking (s=s at entry=0x4b0bcd0, bb=bb at entry=0x4b0c550, bytes_written=bytes_written at entry=0x4b0c448, c=c at entry=0x4b0bec0)
    at /usr/src/debug/httpd-2.4.10/server/core_filters.c:711
#7  0x0000000000447681 in send_brigade_blocking (c=<optimized out>, bytes_written=0x4b0c448, bb=0x4b0c550, s=0x4b0bcd0)
    at /usr/src/debug/httpd-2.4.10/server/core_filters.c:735
#8  ap_core_output_filter (f=0x4b0c378, new_bb=0x4b0c550) at /usr/src/debug/httpd-2.4.10/server/core_filters.c:544
#9  0x0000000000460bc9 in ap_process_request (r=r at entry=0x4b11d00) at /usr/src/debug/httpd-2.4.10/modules/http/http_request.c:369
#10 0x000000000045d622 in ap_process_http_sync_connection (c=0x4b0bec0) at /usr/src/debug/httpd-2.4.10/modules/http/http_core.c:190
#11 ap_process_http_connection (c=0x4b0bec0) at /usr/src/debug/httpd-2.4.10/modules/http/http_core.c:231
#12 0x0000000000455435 in ap_run_process_connection (c=0x4b0bec0) at /usr/src/debug/httpd-2.4.10/server/connection.c:41
#13 0x00007f8dd2dd8a87 in itk_fork_process () from /etc/httpd/modules/mpm_itk.so
#14 0x0000000000455435 in ap_run_process_connection (c=0x4b0bec0) at /usr/src/debug/httpd-2.4.10/server/connection.c:41
#15 0x0000000000455818 in ap_process_connection (c=c at entry=0x4b0bec0, csd=<optimized out>) at /usr/src/debug/httpd-2.4.10/server/connection.c:203
#16 0x00007f8dd29cb7a7 in child_main (child_num_arg=child_num_arg at entry=51) at /usr/src/debug/httpd-2.4.10/server/mpm/prefork/prefork.c:704
#17 0x00007f8dd29cb9e6 in make_child (s=0x86da80, slot=51) at /usr/src/debug/httpd-2.4.10/server/mpm/prefork/prefork.c:800
#18 0x00007f8dd29cc64e in perform_idle_server_maintenance (p=<optimized out>) at /usr/src/debug/httpd-2.4.10/server/mpm/prefork/prefork.c:902
#19 prefork_run (_pconf=<optimized out>, plog=<optimized out>, s=<optimized out>) at /usr/src/debug/httpd-2.4.10/server/mpm/prefork/prefork.c:1090
#20 0x00000000004322d3 in ap_run_mpm (pconf=0x715138, plog=0x742358, s=0x86da80) at /usr/src/debug/httpd-2.4.10/server/mpm_common.c:94
#21 0x000000000042b9a6 in main (argc=4, argv=0x7fffce5470a8) at /usr/src/debug/httpd-2.4.10/server/main.c:777
(gdb) 
#0  0x00007f8dd58f4b30 in ?? ()
#1  0x00000000004357c5 in ap_increment_counts (sb=0x4b0bec0, r=r at entry=0x4b11d00) at /usr/src/debug/httpd-2.4.10/server/scoreboard.c:369
#2  0x00000000004465c0 in eor_bucket_cleanup (data=<optimized out>) at /usr/src/debug/httpd-2.4.10/server/eor_bucket.c:37
#3  0x00007f8dd962955e in run_cleanups (cref=0x4b11cf8) at memory/unix/apr_pools.c:2352
#4  apr_pool_destroy (pool=0x4b11c88) at memory/unix/apr_pools.c:804
#5  0x00000000004466c6 in remove_empty_buckets (bb=bb at entry=0x4b0c550) at /usr/src/debug/httpd-2.4.10/server/core_filters.c:722
#6  0x0000000000446a28 in send_brigade_nonblocking (s=s at entry=0x4b0bcd0, bb=bb at entry=0x4b0c550, bytes_written=bytes_written at entry=0x4b0c448, c=c at entry=0x4b0bec0)
    at /usr/src/debug/httpd-2.4.10/server/core_filters.c:711
#7  0x0000000000447681 in send_brigade_blocking (c=<optimized out>, bytes_written=0x4b0c448, bb=0x4b0c550, s=0x4b0bcd0)
    at /usr/src/debug/httpd-2.4.10/server/core_filters.c:735
#8  ap_core_output_filter (f=0x4b0c378, new_bb=0x4b0c550) at /usr/src/debug/httpd-2.4.10/server/core_filters.c:544
#9  0x0000000000460bc9 in ap_process_request (r=r at entry=0x4b11d00) at /usr/src/debug/httpd-2.4.10/modules/http/http_request.c:369
#10 0x000000000045d622 in ap_process_http_sync_connection (c=0x4b0bec0) at /usr/src/debug/httpd-2.4.10/modules/http/http_core.c:190
#11 ap_process_http_connection (c=0x4b0bec0) at /usr/src/debug/httpd-2.4.10/modules/http/http_core.c:231
#12 0x0000000000455435 in ap_run_process_connection (c=0x4b0bec0) at /usr/src/debug/httpd-2.4.10/server/connection.c:41
#13 0x00007f8dd2dd8a87 in itk_fork_process () from /etc/httpd/modules/mpm_itk.so
#14 0x0000000000455435 in ap_run_process_connection (c=0x4b0bec0) at /usr/src/debug/httpd-2.4.10/server/connection.c:41
#15 0x0000000000455818 in ap_process_connection (c=c at entry=0x4b0bec0, csd=<optimized out>) at /usr/src/debug/httpd-2.4.10/server/connection.c:203
#16 0x00007f8dd29cb7a7 in child_main (child_num_arg=child_num_arg at entry=51) at /usr/src/debug/httpd-2.4.10/server/mpm/prefork/prefork.c:704
#17 0x00007f8dd29cb9e6 in make_child (s=0x86da80, slot=51) at /usr/src/debug/httpd-2.4.10/server/mpm/prefork/prefork.c:800
#18 0x00007f8dd29cc64e in perform_idle_server_maintenance (p=<optimized out>) at /usr/src/debug/httpd-2.4.10/server/mpm/prefork/prefork.c:902
#19 prefork_run (_pconf=<optimized out>, plog=<optimized out>, s=<optimized out>) at /usr/src/debug/httpd-2.4.10/server/mpm/prefork/prefork.c:1090
#20 0x00000000004322d3 in ap_run_mpm (pconf=0x715138, plog=0x742358, s=0x86da80) at /usr/src/debug/httpd-2.4.10/server/mpm_common.c:94
#21 0x000000000042b9a6 in main (argc=4, argv=0x7fffce5470a8) at /usr/src/debug/httpd-2.4.10/server/main.c:777
(gdb) frame 1
#1  0x00000000004357c5 in ap_increment_counts (sb=0x4b0bec0, r=r at entry=0x4b11d00) at /usr/src/debug/httpd-2.4.10/server/scoreboard.c:369
369             bytes = pfn_ap_logio_get_last_bytes(r->connection);

-- 
Arkadiusz Mi?kiewicz, arekm / maven.pl



From arekm at maven.pl  Wed Sep 24 13:59:03 2014
From: arekm at maven.pl (Arkadiusz =?utf-8?q?Mi=C5=9Bkiewicz?=)
Date: Wed, 24 Sep 2014 13:59:03 +0200
Subject: [mpm-itk] segfaults pfn_ap_logio_get_last_bytes(r->connection)
In-Reply-To: <201409241147.51222.arekm@maven.pl>
References: <201409241147.51222.arekm@maven.pl>
Message-ID: <201409241359.04124.arekm@maven.pl>

On Wednesday 24 of September 2014, Arkadiusz Mi?kiewicz wrote:
> Hello.
> 
> One one machine where mpm_itk (2.4.7-02) is installed I'm getting
> segfaults. Restart cures them for some time and then back again. If
> segfaults start then segfault rate is like few segfaults per second.
> 
> [error] [pid 21260] [client child died with signal 11 mpm_itk
> [error] [pid 21105] [client child died with signal 11 mpm_itk
> [error] [pid 21213] [client child died with signal 11 mpm_itk
> 
> I'm using mod_logio to log number of bytes sent per vhost and that seems to
> be related,
> 
> ap_increment_counts() is doing:
> 
>     if (pfn_ap_logio_get_last_bytes != NULL) {
>         bytes = pfn_ap_logio_get_last_bytes(r->connection);
>     }
> 
> Now not sure if that's itk fault but not hitting this on other machines
> with the same software, just without itk.
> 
> Any ideas?
> 
> Program terminated with signal SIGSEGV, Segmentation fault.
> #0  0x00007f8dd58f4b30 in ?? ()
> (gdb) bt
> #0  0x00007f8dd58f4b30 in ?? ()
> #1  0x00000000004357c5 in ap_increment_counts (sb=0x4b0bec0,
> r=r at entry=0x4b11d00) at

Found http://mail-archives.apache.org/mod_mbox/httpd-
dev/200912.mbox/%3C4B16CF0C.60000 at apache.org%3E

which describes similar problem. pfn_ap_logio_get_last_bytes is a pointer to a 
function provided by mod_logio module. Sometimes address of this function can 
change at reload.

httpd people update this pointer on reload in few places:
pfn_ap_logio_get_last_bytes = 
APR_RETRIEVE_OPTIONAL_FN(ap_logio_get_last_bytes);

What I think is happening is that this pointer becomes invalid in mpm created 
child. It gets called after itk->ap_run_process_connection->....-
>ap_increment_counts->pfn_ap_logio_get_last_bytes

Called function address in backtrace is such invalid pointer
#0  0x00007f8dd58f4b30 in ?? ()

So not sure (yet) if this is correct thinking and why pointer doesn't get 
updated...

-- 
Arkadiusz Mi?kiewicz, arekm / maven.pl