httpd dead but pid file exists

wirestyle22

Rebooted last night. Same error.

wirestyle22

cat httpd.pid
1848

 ps aux | grep 1848
root      3017  0.0  0.0   4024   672 pts/0    S+   09:16   0:00 grep 1848

wirestyle22

Turned on debug mode, haven't seen any debug entries yet

wirestyle22

[Tue Oct 22 10:03:19 2019] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Tue Oct 22 10:03:19 2019] [notice] Digest: generating secret for digest authentication ...
[Tue Oct 22 10:03:19 2019] [notice] Digest: done
[Tue Oct 22 10:03:19 2019] [info] APR LDAP: Built with OpenLDAP LDAP SDK
[Tue Oct 22 10:03:19 2019] [info] LDAP: SSL support available

stacksofplates

@wirestyle22 said in httpd dead but pid file exists:

I cannot stop the service

Did you try killing the pid, ensuring the pid file is removed and then restarting?

scottalanmiller

Do this...

systemctl restart httpd ; tail -f /var/log/messages

And collect about a screen's worth. Let's see if anything is reported immediately following the start up.

stacksofplates

@scottalanmiller said in httpd dead but pid file exists:

Do this...
systemctl restart httpd ; tail -f /var/log/messages
And collect about a screen's worth. Let's see if anything is reported immediately following the start up.

It's RHEL 5

scottalanmiller

@stacksofplates said in httpd dead but pid file exists:

It's RHEL 5

Ouch

wirestyle22

host (root) php -v
PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php/modules/oci8.so' - libclntsh.so.11.1: cannot open shared object file: No such file or directory in Unknown on line 0
PHP 5.1.6 (cli) (built: May 22 2018 10:25:39)
Copyright (c) 1997-2006 The PHP Group
Zend Engine v2.1.0, Copyright (c) 1998-2006 Zend Technologies
host (root)[ /home/root ] ldd /usr/lib/php/modules/oci8.so
        linux-gate.so.1 =>  (0x0087d000)
        libclntsh.so.11.1 => not found
        libc.so.6 => /lib/libc.so.6 (0x00960000)
        /lib/ld-linux.so.2 (0x00567000)

libclntsh.so.11.1 => not found

wat

stacksofplates

@wirestyle22 said in httpd dead but pid file exists:

host (root) php -v
PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php/modules/oci8.so' - libclntsh.so.11.1: cannot open shared object file: No such file or directory in Unknown on line 0
PHP 5.1.6 (cli) (built: May 22 2018 10:25:39)
Copyright (c) 1997-2006 The PHP Group
Zend Engine v2.1.0, Copyright (c) 1998-2006 Zend Technologies
host (root)[ /home/root ] ldd /usr/lib/php/modules/oci8.so
        linux-gate.so.1 =>  (0x0087d000)
        libclntsh.so.11.1 => not found
        libc.so.6 => /lib/libc.so.6 (0x00960000)
        /lib/ld-linux.so.2 (0x00567000)

libclntsh.so.11.1 => not found wat

that was in your error log before:

@wirestyle22 said in httpd dead but pid file exists:

I am seeing a new entry in the logs:

PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php/modules/oci8.so' - libclntsh.so.11.1: cannot open shared object file: No such file or directory in Unknown on line 0

Did you kill the pid and remove the pid file before restarting it?

wirestyle22

@stacksofplates said in httpd dead but pid file exists:

Did you kill the pid and remove the pid file before restarting it?

Yes I did. It just re-creates the file and gives the same error.

scottalanmiller

Is oracle-lib-compat installed?

wirestyle22

@scottalanmiller said in httpd dead but pid file exists:

oracle-lib-compat

No it's not

scottalanmiller

@wirestyle22 said in httpd dead but pid file exists:

@scottalanmiller said in httpd dead but pid file exists:

oracle-lib-compat

No it's not

That's what provides that file.

scottalanmiller

Try removing the app that Apache runs and see if Apache will start when clean before looking further.

scottalanmiller

Also, consider just moving to a maintained server. RHEL 6 is one thing today, a stretch, but one thing. RHEL 5 constitutes and abandoned server of no value. Why bother with trying to fix a workload deemed "not important enough to run?"

wirestyle22

@scottalanmiller said in httpd dead but pid file exists:

Also, consider just moving to a maintained server. RHEL 6 is one thing today, a stretch, but one thing. RHEL 5 constitutes and abandoned server of no value. Why bother with trying to fix a workload deemed "not important enough to run?"

We've been told we are phasing it out but if history is any indicator that could mean years. They like to tell us what we want to hear and then not doing anything about it.

DustinB3403

No one has asked yet (and I'm assuming this) but why haven't you restored to a known working condition?

scottalanmiller

@wirestyle22 said in httpd dead but pid file exists:

@scottalanmiller said in httpd dead but pid file exists:

Also, consider just moving to a maintained server. RHEL 6 is one thing today, a stretch, but one thing. RHEL 5 constitutes and abandoned server of no value. Why bother with trying to fix a workload deemed "not important enough to run?"

We've been told we are phasing it out but if history is any indicator that could mean years. They like to tell us what we want to hear and then not doing anything about it.

Well then, just tell them it phased itself out. Problem solved since they were planning to do this anyway. If they push back, tell them that they need to move to something supportable if phasing out wasn't the actual plan.

You need to tell them what you want to hear.

wirestyle22

@DustinB3403 said in httpd dead but pid file exists:

No one has asked yet (and I'm assuming this) but why haven't you restored to a known working condition?

I need to understand why this happened in order to prevent it from happening in the future. Nothing has turned up any answers.