Project

General

Profile

Bug #524

yum lock grows hda-updates.log file

Added by dsmialek over 10 years ago. Updated over 10 years ago.

Status:
Feedback
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
05/14/2010
Due date:
% Done:

0%


Description

The hda-updates.log file grows massive and eventually will crash the server. The log file fills with a yum lock message every two seconds. I can delete the yum.pid file and kill the yum processes which will allow the update to take place and resolve the problem, but the issue returns every couple of days. The log file can grow to over 1GB. Log files here:

Another app is currently holding the yum lock; waiting for it to exit...
The other application is: yum
Memory : 23 M RSS (232 MB VSZ)
Started: Thu May 13 03:01:44 2010 - 1 day(s) 0:59:34 ago
State : Sleeping, pid: 8065

[root@server dan]# ps guax | grep yum
root 17226 0.0 0.0 102740 848 pts/0 S+ 02:07 0:00 grep yum

Log files here:
http://db.tt/EqKbf5
http://db.tt/GSAKec
http://dl.dropbox.com/u/7109066/hda-updates.log.tar.gz

logrotate.conf View (729 Bytes) dsmialek, 05/14/2010 11:50 PM

History

#1 Updated by dsmialek over 10 years ago

In an attempt to mitigate the problem of the log file crashing the server, I added an entry to the logrotate.conf file to compress the hda-updates.log file on a daily basis. I set it to keep 10 days of history.

Here is what I added:

/var/log/hda-updates.log {
daily
notifempty
create
rotate 10
}

Maybe best to have logrotate compress all logs in the /var/log directory and keep them for a set amount of time, but I haven't figured that out yet.

I've attached my config file here.

#2 Updated by dsmialek over 10 years ago

[root@server dan]# ps guax | grep yum
root 18297 0.0 0.0 102740 844 pts/0 S+ 03:05 0:00 grep yum

#3 Updated by cpg over 10 years ago

i think this may be a solution:

rpm -e gnome-packagekit setroubleshoot setroubleshoot-server setroubleshoot-plugins

can you try it for a few days?

(clear the logs also, to make sure)

#4 Updated by cpg over 10 years ago

  • Status changed from New to Feedback
  • Assignee set to cpg

Any feedback on how it's working yet?

You should have an idea by now.

#5 Updated by dsmialek over 10 years ago

Yep, problem fixed. No yum locks for the last 3 days and the log file is staying very small.

I do notice in the hda-updates log it seems to be looking to update every hour. Not sure if that was normal before the fix we applied Friday night. I've attached the log file here: http://dl.dropbox.com/u/7109066/hda-updates.log-20100517.gz

Anyway, problem seems to be resolved. I'll watch it for the next few days and throw in a reboot and maybe a manual update through the GUI to test it out. I'll let you know here if anything changes. Thanks for your help!

Sorry for the slow update. I was away for the weekend. . .

#6 Updated by dsmialek over 10 years ago

Well, the problem has returned. As I mentioned before, the server is looking for updates every hour. Something happened at the 8pm update last night and it didn't seem to complete. At least the log for 8pm is different than all the others. Then at the 9pm update check it started filling the log with the same yum lock message every two seconds.

I can't remember doing on the server around 8pm tonight. Let me know if you want any additional logs. Not sure what triggered the problem.

hda-updates.log file here: http://dl.dropbox.com/u/7109066/hda-updates.log.tar.gz

#7 Updated by cpg over 10 years ago

try:

killall yum; killall yum
yum -y update yum

and let it simmer please. maybe reboot just to make sure it's all good.

do let us know if yum updates.

#8 Updated by dsmialek over 10 years ago

I ran the commands you suggested, but still yum would not update. I ran killall a few more times for good measure and then as you said, let it simmer for a few mins. After 5 mins or so, yum update did work.

While I was waiting for killall to do its thing, I ran the command you asked me last time and got quite a different output. Not sure if it is helpful.
~
[root@server ~]# ps guax | grep yum
root 24460 0.4 0.5 232324 21340 ? S 00:20 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24462 0.4 0.5 232324 21340 ? S 00:20 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24612 0.6 0.5 232320 21356 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24614 0.6 0.5 232320 21360 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24672 0.6 0.5 232320 21332 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24710 0.7 0.5 232320 21356 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24713 0.7 0.5 232320 21332 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24811 0.7 0.5 232320 21356 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24860 0.8 0.5 232320 21360 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24952 0.9 0.5 232320 21360 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 24966 1.0 0.5 232324 21336 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25001 1.0 0.5 232320 21332 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25046 1.2 0.5 232316 21352 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25052 1.2 0.5 232320 21356 ? S 00:21 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25145 1.8 0.5 1406172 22176 ? Sl 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25147 1.7 0.5 232320 21332 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25195 1.9 0.5 232320 21332 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25237 2.8 0.5 232320 21332 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25238 2.8 0.5 232324 21336 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25244 3.8 0.5 232324 21360 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25333 10.0 0.5 232320 21356 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25335 10.0 0.5 232324 21332 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25338 15.0 0.5 232324 21360 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25341 30.0 0.5 232320 21324 ? S 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25385 0.0 0.4 190700 16340 ? R 00:22 0:00 /usr/bin/python /usr/bin/yum -y install hda*
root 25387 0.0 0.0 102744 860 pts/0 S+ 00:22 0:00 grep yum

I suspect it will lock up again in a day or so. The logrotate is working in preventing the system from crashing.

Any other suggestions or info you need?

Also available in: Atom