Downtime Report

1--Installed new software, checked site, everything looks hunky dory.

2--In a big hurry to leave for Labor Day cookout. Leave for cookout.

3--Come home a few hours later, checked site, site gone. Uh oh!

4--Determined problem as corrupted database, don't know what happened, Double uh oh!!

5--Restore database from Monday morning automatic db backup, phew!!!

6--Only problem, we lose all essays and comments posted after enhydra lutris' open thread from early Monday morning. Dammit!!!!

7--Please re-up essays if possible. We only lost a few hours of data.

8--Sorry about that.

9--2:15 in the morning, going to bed.

10--Good night, I mean morning.

Tags: 
Share
up
0 users have voted.

Comments

janis b's picture

Wake up!

While you were cooking out, we were getting fired up.

I hate being the first to yell at you, but while everyone else sleeps, evening here is just beginning.

Really, I’m glad you enjoyed some downtime, blissfully unaware. ; )

[video:https://youtu.be/OcIiu1kQMx0]

up
0 users have voted.
janis b's picture

Now I'm embarrassed, sort of.

up
0 users have voted.

I did originally say that everyone could yell at me tomorrow, but I deleted that part thinking that everyone probably would, heh. But I knew you had read it early on and knew exactly what you were saying.

But my plan to embarrass you work like a charm, muhahahahahahaaaaaaaaaaaaa!!

up
0 users have voted.
janis b's picture

Well don't do it again, ever! ; ) ; ) ; )

up
0 users have voted.

you may.

You forgot the ALL CAPS, BOLDING and long string of exclamation points, though!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

up
0 users have voted.
riverlover's picture

I had forgotten here we could do ALL CAPS, BOLD. lol.

up
0 users have voted.

Hey! my dear friends or soon-to-be's, JtC could use the donations to keep this site functioning for those of us who can still see the life preserver or flotsam in the water.

janis b's picture

up
0 users have voted.

Also needz a few '1's scattered among the exclamation points...

The problem was clearly the result of a demand for too many rules, though: got this last night:

Fatal error: Class 'RulesEventSet' not found in /home/caucusni/public_html/sites/all/modules/rules/rules.module on line 336

We don't need no stinkin' rules here! Oh, wait, we're not Clintons...

up
0 users have voted.

Psychopathy is not a political position, whether labeled 'conservatism', 'centrism' or 'left'.

A tin labeled 'coffee' may be a can of worms or pathology identified by a lack of empathy/willingness to harm others to achieve personal desires.

snoopydawg's picture

Thank you for the work you did tonight/this morning to get the site back up.
While it was down I was hoping that you were off somewhere having fun.

up
0 users have voted.

Which AIPAC/MIC/pharma/bank bought politician are you going to vote for? Don’t be surprised when nothing changes.

Voting is like driving with a toy steering wheel.

Unabashed Liberal's picture

a major

whew smiley photo: whew whew.gif

Thank you!

Mollie


“I believe in the redemptive powers of a dog’s love. It is in recognition of each dog’s potential to lift the human spirit, and, therefore, to change society for the better, that I fight to make sure every street dog has its day.”
--Stasha Wong, Secretary, Save Our Street Dogs (SOSD)

up
0 users have voted.

Everyone thinks they have the best dog, and none of them are wrong.

MsGrin's picture

up
0 users have voted.

'What we are left with is an agency mandated to ensure transparency and disclosure that is actually working to keep the public in the dark' - Ann M. Ravel, former FEC member

LapsedLawyer's picture

Hey, I do too, when it comes down to it Wink

Anyway, I just popped in to see if anything was happening with my comments from earlier, and yep, something happened allright!

Glad to have an explanation.

P.S. Computer shit is buggy. And the internet is computer shit. How you manage to keep up with it and keep this place running at all is why I bow to your prodigious skills and am damn glad you're around to do this.

IOW, thanks, man.

up
0 users have voted.

"Our society is run by insane people for insane objectives. I think we're being run by maniacs for maniacal ends and I think I'm liable to be put away as insane for expressing that. That's what's insane about it."
-- John Lennon

Didn't know there was any maintenance planned. Given the Public Service Announcement, some of us thought you decided it was a good idea after all.

up
0 users have voted.

"Religion is what keeps the poor from murdering the rich."--Napoleon

riverlover's picture

Hope the bbq and re-updates went well. Enjoy a day back at work!

up
0 users have voted.

Hey! my dear friends or soon-to-be's, JtC could use the donations to keep this site functioning for those of us who can still see the life preserver or flotsam in the water.

The error was in "/home/.../caucusni/pathtodatabase/... line 336." Biggrin
Thanks at time and a half Johnny.

Thanks

up
0 users have voted.
elenacarlena's picture

comments. You lost my incredible wisdom. Ha! Sleep well, you deserve it.

up
0 users have voted.

Please check out Pet Vet Help, consider joining us to help pets, and follow me @ElenaCarlena on Twitter! Thank you.

mimi's picture

and shut the site down for you. So, now, would you please respect his wishes and take the whole Tuesday off from work?

I thought that you just have had it with us all. And pretended the site is down, so you can get a decent labor day cook-out. Now you tell us you labored the whole night. Are you sure you want the data back?. I thought everybody was trash talking anyhow. Look at it from the bright side, saves you some time to delete them all and dump them in the trash bin.

You are not allowed near a computer for two days. God speaking here. Obey.

Thanks for your dedication. Mr. Cake!!!

up
0 users have voted.
lotlizard's picture

from having to put up with some ill-considered “emo” from me regarding the Mecklenburg-Vorpommern election results.

up
0 users have voted.
elenacarlena's picture

Vorpommern? Sounds Martian.

up
0 users have voted.

Please check out Pet Vet Help, consider joining us to help pets, and follow me @ElenaCarlena on Twitter! Thank you.

Raggedy Ann's picture

and the universe responded with the much needed break. Isn't it amazing how the universe works in such mysterious ways to save us from ourselves?

So happy to hear you were out enjoying yourself! So happy to see we're all back together! Clapping

up
0 users have voted.

"The “jumpers” reminded us that one day we will all face only one choice and that is how we will die, not how we will live." Chris Hedges on 9/11

up
0 users have voted.
gulfgal98's picture

We all could have used a break and JtC definitely needed one! I am very happy that JtC actually was able to spend some time away from this place to be with family and friends. Smile

Thank you for this explanation of what happened and for all you do every day for us, JtC. Good

up
0 users have voted.

Do I hear the sound of guillotines being constructed?

“Those who make peaceful revolution impossible will make violent revolution inevitable." ~ President John F. Kennedy

sojourns's picture

It's been going around ya know!

up
0 users have voted.

"I can't understand why people are frightened of new ideas. I'm frightened of the old ones."
John Cage

Not Henry Kissinger's picture

up
0 users have voted.

The current working assumption appears to be that our Shroedinger's Cat system is still alive. But what if we all suspect it's not, and the real problem is we just can't bring ourselves to open the box?

Ajaradom's picture

up
0 users have voted.
davidincleveland's picture

means you're shit-stirring. Again.

up
0 users have voted.

Please consider subscribing monthly, to help keep c99 going.

gulfgal98's picture

ALL of us lost either essays, comments, or in my case, part of a draft essay. They are only words on a screen that can be reconstructed if they are that important. You are the only person who has complained. Perhaps you need to get over yourself and move on to another place.

up
0 users have voted.

Do I hear the sound of guillotines being constructed?

“Those who make peaceful revolution impossible will make violent revolution inevitable." ~ President John F. Kennedy

set up for both the database and file directory. They stay on the server for 5 days before they are overwritten. The backups are automatically done in the wee hours of the morning, around 5:00 AM central.

So I imported the most recent backup which meant everything that was posted after 5:00 am central was lost and I'm sorry you lost your draft, I hope it can be rewritten. Luckily the data lost was for only a few hours.

up
0 users have voted.
gulfgal98's picture

I only lost part of my draft and that was the part I was struggling with it anyway. Smile

up
0 users have voted.

Do I hear the sound of guillotines being constructed?

“Those who make peaceful revolution impossible will make violent revolution inevitable." ~ President John F. Kennedy

if I wake up in the middle of the night and can't go right back to sleep. Last night was one of those times, and I checked in because I was interested to see if anyone else had commented on my food-for-thought diary about coops. I saw the site was still down and checked the error message against Google out of curiosity. When I checked back into the site, it was up again on the backup. I thought to myself, "Poor JtC up at this hour getting the site back up for us. That's dedication."

Those damn updates and module additions get more difficult all the time. It's gotten so that we just maintain clone sites of our live test sites. We do the updates and any modifications on those and test them for awhile before we do anything to the live site. Even then, things can go haywire. Those sites are Joomla, Magento and WP, not Drupal, but they're PHP/MySQL as well. Especially with Joomla and WP, you're dealing with extensions from many different providers, and that really makes updates and modifications tricky.

up
0 users have voted.

where all the testing takes place. But the problem is our dynamic database, it grows by several megs every day. The only way for the dev site to be of any use use in this instance is if the dev sites db was synched with the live every day and that in no means is practical. It would be the same with a cloned site. That would be fine for the directory structure but doesn't help when it comes to the db. With a db that grows as fast as ours the only real solution is backups.

There was no reason to test this module at the dev site because I had it installed on the live site before and it worked great. Something else happened this time around.

up
0 users have voted.
mimi's picture

and if the restof the bunch follow me in that, you just have half of the increase of date in your "dbase". Problem solved, see?

up
0 users have voted.
Cant Stop the Macedonian Signal's picture

up
0 users have voted.

"More for Gore or the son of a drug lord--None of the above, fuck it, cut the cord."
--Zack de la Rocha

"I tell you I'll have nothing to do with the place...The roof of that hall is made of bones."
-- Fiver

Cant Stop the Macedonian Signal's picture

that Ajaradom didn't get the old "Liberal Basie" treatment, in which I would post Count Basie videos in response to trollish behavior.

I didn't feel that comment rated actual good music.

up
0 users have voted.

"More for Gore or the son of a drug lord--None of the above, fuck it, cut the cord."
--Zack de la Rocha

"I tell you I'll have nothing to do with the place...The roof of that hall is made of bones."
-- Fiver

TheOtherMaven's picture

up
0 users have voted.

There is no justice. There can be no peace.

Cant Stop the Macedonian Signal's picture

up
0 users have voted.

"More for Gore or the son of a drug lord--None of the above, fuck it, cut the cord."
--Zack de la Rocha

"I tell you I'll have nothing to do with the place...The roof of that hall is made of bones."
-- Fiver

hester's picture

I'm only sorry that it was it was a real issue and took up so much of your time. And already paranoia rears it's ugly head. No good deed goes unpunished.

Again Thank YOU JtC for all you do and all you put up w.

up
0 users have voted.

Don't believe everything you think.

Citizen Of Earth's picture

I was positive that Wasserman-Shultz was behind the outage.
As a software developer, I feel ya man. Every project is a 1000 details and all it takes is one bit out of place. Hope you had a great picnic.

PS. The C99 icon is missing from my browser tabs for C99 pages. metatag favicon.ico might be missing . No biggie, just reporting a nit.

up
0 users have voted.

Donnie The #ShitHole Douchebag. Fake Friend to the Working Class. Real Asshole.

lotlizard's picture

whereas I used to see a blue square with a white 99 in it.

up
0 users have voted.

a couple of bugs last night in the logs but was too tired, I'll have to iron them out today. The metatag isn't missing, that image is in the file directory and the directories weren't affected, just the database. Sometimes it takes the favicon a while to show up, hopefully later it will come back.

up
0 users have voted.
Citizen Of Earth's picture

One of those bottom of the list items fer sure.
Have a great day.

up
0 users have voted.

Donnie The #ShitHole Douchebag. Fake Friend to the Working Class. Real Asshole.

davidincleveland's picture

before coming home to work all night.

up
0 users have voted.

Please consider subscribing monthly, to help keep c99 going.

Nah, don't feel guilty. I had that software installed a couple of months ago and it worked great, and since no one was using it, I removed it.

After the new program installation the Drupal software goes through what's called "rebuilding permissions" since the software that was installed involves changing user permissions. I'm pretty sure it was that "rebuilding permissions" process that caused the problem.

Afterwards I checked the site and all looked well and being late for the cookout we rushed out the door. When I got home there was a very unpleasant surprise awaiting me.

up
0 users have voted.
lunachickie's picture

of all our juicier convos about The Candidates were up by then anyway, weren't they? Wink

Good work, Johnny! I welcomed the little break, LOL! I'm so addicted to this place it's like I have to have it literally go down so I can do other stuff for awhile without being pol-obsessed! I tried, just for fun (since we'd been talking about it), to log into HuffPo and GOS. OMG, what cesspits of depravity... That didn't last long at all...

up
0 users have voted.
elenacarlena's picture

addicted to staying in touch with each other! Ya just gotta stay on the back pages. There wasn't a whole lot to see otherwise (except my cartoon of course!). Wink

up
0 users have voted.

Please check out Pet Vet Help, consider joining us to help pets, and follow me @ElenaCarlena on Twitter! Thank you.

Lookout's picture

It was time for a day off JtC! Sorry you had to work into the night, and hope you're getting to sleep late today. I'm just back in from trade day - it is a trip every Tuesday (that it isn't raining).

Here's a few shots to give you the idea -
Trade day 1.jpg

Trade day 2.jpg

Trade day 3.jpg

A few years ago a friend moved away. He made the comment, "I don't want to live where Trade Day is the social event of the week." However, I do. You are liable to see everyone from the Judge to the town drunk. It is an education of opinions - kinda like c99 face to face.

Well JtC, thanks for hosting our digital gathering. Sorry the 0's and 1's didn't cooperate yesterday and caused you problems. All the best to you and yours!

up
0 users have voted.

“Until justice rolls down like water and righteousness like a mighty stream.”

Gerrit's picture

up
0 users have voted.

Resilience: practical action to improve things we can control.
3D+: developing language for postmodern spirituality.

Thanks so much for all you do, man. I'm sorry you had to deal with database shit in the middle of the night. :/

I'm just feeling grateful that we have this place. Smile Have a wonderful day and, please, get some damned rest for a change! Blum 3

up
0 users have voted.

I miss Colorado.

thanks for all the kind comments. When I woke up this morning I was kind of hesitant to turn on the computer. What a freaking week!

up
0 users have voted.
riverlover's picture

Other than getting used to driving behind stopping school buses at every.third.driveway in order to avoid the post 11AM appearance of college students with cars, in a few weeks a new order will settle in. And a new normal will be with us. Let's get back to caring, politeness or civility to each other, knowing that there might be clowns lurking in the woods.

I live by red squiggles now, cognitive failure is depressing.

Johnny, take a double-pay rest.

up
0 users have voted.

Hey! my dear friends or soon-to-be's, JtC could use the donations to keep this site functioning for those of us who can still see the life preserver or flotsam in the water.

elenacarlena's picture

Are you noticing some improvement, at least?

up
0 users have voted.

Please check out Pet Vet Help, consider joining us to help pets, and follow me @ElenaCarlena on Twitter! Thank you.

riverlover's picture

It makes me a bit scared to act normal in public. (word replacement there). 5 weeks now!

up
0 users have voted.

Hey! my dear friends or soon-to-be's, JtC could use the donations to keep this site functioning for those of us who can still see the life preserver or flotsam in the water.

is both a blessing & a curse. Every time you get a break and feel rested, something happens. I wish there was something we could really do to lighten your load.

up
0 users have voted.

"Religion is what keeps the poor from murdering the rich."--Napoleon

I'll bust this bronco yet!

I may whine and get all boo-boo lipped occasionally, but deep down I love it.

up
0 users have voted.

I get that.

up
0 users have voted.

"Religion is what keeps the poor from murdering the rich."--Napoleon

There was concern for your outage over at KFS... which means this site has wormed its way into the consciousness of the internets! Congrats! ;>)

up
0 users have voted.

"Without the right to offend, freedom of speech does not exist." Taslima Nasrin

riverlover's picture

In a worried way, not a happy way. Wink

up
0 users have voted.

Hey! my dear friends or soon-to-be's, JtC could use the donations to keep this site functioning for those of us who can still see the life preserver or flotsam in the water.

Cant Stop the Macedonian Signal's picture

up
0 users have voted.

"More for Gore or the son of a drug lord--None of the above, fuck it, cut the cord."
--Zack de la Rocha

"I tell you I'll have nothing to do with the place...The roof of that hall is made of bones."
-- Fiver

enhydra lutris's picture

up
0 users have voted.

That, in its essence, is fascism--ownership of government by an individual, by a group, or by any other controlling private power. -- Franklin D. Roosevelt --

enhydra lutris's picture

enjoy and celebrate the aftermath. Entropy has been having a field day at our house this last week or so, so it fit right in. Blame it on me for attracting our household's entropoids to the site if you wish.

up
0 users have voted.

That, in its essence, is fascism--ownership of government by an individual, by a group, or by any other controlling private power. -- Franklin D. Roosevelt --

thank you, I knew it couldn't be my fault.

up
0 users have voted.
ArizonaProgressive's picture

all the hard work you put into this site.

up
0 users have voted.