#ceph IRC Log

Index

IRC Log for 2013-02-15

Timestamps are in GMT/BST.

[0:00] <wer> 1 heartbeat_map is_healthy 'FileStore::op_tp thread 0x7fbdc2171700' had timed out after 60 I think this osd is headed for suicide again. just a guess though.
[0:01] * aliguori (~anthony@cpe-70-112-157-87.austin.res.rr.com) has joined #ceph
[0:03] <wer> yeah it died. So is my cluster never to be OK again? Or is there something I have not done yet to purge the incomplete/stuck pgs?
[0:04] * alexxy[home] (~alexxy@2001:470:1f14:106::2) Quit (Remote host closed the connection)
[0:05] * alexxy (~alexxy@79.173.81.171) has joined #ceph
[0:06] * drokita (~drokita@199.255.228.128) Quit (Ping timeout: 480 seconds)
[0:09] <wer> do I scrub incomplete pgs?
[0:13] * diegows (~diegows@190.188.190.11) has joined #ceph
[0:17] * gucki (~smuxi@HSI-KBW-095-208-162-072.hsi5.kabel-badenwuerttemberg.de) Quit (Ping timeout: 480 seconds)
[0:32] <wer> the silence is deafening :) is there anything I can do? adjust the osd op thread timeout? Mark the osd lost? are these 19 pgs even on the osd?
[0:35] <PerlStalker> wer: I'm no expert but, if you can do so without data loss, try taking the OSD out of the cluster, wipe the OSD data directory and re add it.
[0:36] <PerlStalker> That might be really bad advise that you should follow at your own risk.
[0:38] <sjustlaptop> wer: you need to get that osd back, I tink
[0:39] <wer> sjustlaptop: See I am confused. if I can't get that osd back have I lost data? I don't full grok what ceph is telling me. That is the problem. Or what steps need to be taken next.
[0:39] <sjustlaptop> wer: can you do 'ceph pg <pgid> query' for one of the incomplete pgs?
[0:40] <wer> I can, but don't I need one of the pgid's to do that?
[0:40] <sjustlaptop> ceph pg dump | grep incomplete
[0:40] <wer> yeah I did do that.
[0:41] <sjustlaptop> ok, so do 'ceph pg <pgid> query' with one of the incomplete pgids
[0:41] <sjustlaptop> if 0.0 is incomplete
[0:41] <sjustlaptop> ceph pg 0.0 query
[0:41] <wer> k. Lots of output... groking....
[0:42] <sjustlaptop> dump it to pastebin or similar
[0:42] <wer> k
[0:44] <wer> http://pastebin.com/2pC8uZ6S
[0:44] <wer> the lost and acting osd's are still "in" the cluster....
[0:45] <wer> 0-23 are out... they are the one I took out. 14 is the one that dies.
[0:45] <sjustlaptop> ok, can you also pastebin ceph osd tree, ceph osd dump, ceph pg dump?
[0:46] <wer> yup
[0:50] <Karcaw> what is the difference between the 'osd lost' and 'osd rm' commands
[0:50] <wer> http://pastebin.com/5yZeits3 tree and osd dump
[0:51] * PerlStalker (~PerlStalk@72.166.192.70) Quit (Quit: ...)
[0:52] <wer> I think pg dump is blowing up pastebin....
[0:55] <wer> http://pastebin.com/bceiZ6C9 all the incompletes.... There were 9380 others that are active+clean
[0:56] <sjustlaptop> ok, one host is dead?
[0:56] <wer> well I wanted to take it out.
[0:57] <wer> I reweighted the osd's.... and then took them out.
[0:57] * jlogan (~Thunderbi@72.5.59.176) Quit (Read error: Connection reset by peer)
[0:57] <sjustlaptop> according to this, all osds are up?
[0:57] * jlogan (~Thunderbi@72.5.59.176) has joined #ceph
[0:57] <wer> yeah they are up and out.
[0:58] <wer> the osd's shedded most of there disk usage.... save the journel. Escept 14 which keeps dieing.
[0:59] <wer> *except
[0:59] <sjustlaptop> what do you mean they shedded most of their disk usage?
[0:59] <sjustlaptop> oh, they are marked out and the pgs are migrating away
[0:59] <sjustlaptop> ok
[0:59] <wer> yeah. That.
[1:00] <sjustlaptop> do you have nodown set?
[1:00] <wer> no. I don't think so.
[1:00] * miroslav (~miroslav@173-228-38-131.dsl.dynamic.sonic.net) has joined #ceph
[1:00] <sjustlaptop> try restarting osd 65
[1:01] <wer> ok
[1:02] <wer> I think that kicked something loose.
[1:02] <wer> 18 pgs incomplete and degraded (0.003%)
[1:04] <wer> sjustlaptop: do I need to kick all the osd's associated with the incomplete pgs?
[1:10] <wer> It keeps making it to %0 and then starting at 0.004% degraded
[1:12] <sjustlaptop> wer: can you paste the pg query for another incomplete pg?
[1:12] <wer> sure
[1:14] <wer> http://pastebin.com/RuKZaP4d
[1:15] <wer> looks like it finished bouncing into degraded and settled on 18 pgs incomplete; 18 pgs stuck inactive; 18 pgs stuck unclean
[1:15] <wer> So we cleared one.
[1:18] * Cube (~Cube@12.248.40.138) Quit (Ping timeout: 480 seconds)
[1:18] <sjustlaptop> try restarting 50 this time
[1:19] <wer> ok
[1:22] * LeaChim (~LeaChim@5e0d73fe.bb.sky.com) Quit (Ping timeout: 480 seconds)
[1:23] <wer> I think that got one more unstuck... and degraded is bouncing down to zero hopefully.
[1:23] <wer> what does it all mean :)
[1:23] <sjustlaptop> I don't know, seems like a peering bug
[1:24] <sjustlaptop> or some kind of dropped message problem
[1:24] <sjustlaptop> no, wouldn't have been incomplete
[1:24] <wer> yeah it seemed that bug are usually what surrounds incomplete right? The docs say to file a bug...
[1:24] <sjustlaptop> if you can reproduce with debug osd = 20, debug ms = 1, debug filestore = 20
[1:25] <paravoid> I love the new kb/s / op/s indicators
[1:25] <sjustlaptop> well, incomplete means that the primary can't find any peers with enough information
[1:25] <sjustlaptop> it frequently means a bug
[1:25] <sjustlaptop> not always
[1:25] <paravoid> such a small feature and yes so useful
[1:25] <wer> Is the primary the first osd in the list?
[1:25] <sjustlaptop> yeah
[1:25] <wer> hmm.
[1:27] <wer> sjustlaptop: can I determine the loss and handle this a different way? IE is I encounter this in the real world what are my liabilities?
[1:28] <sjustlaptop> if it is working correctly, incomplete means you lost enough osds to have lost all copies of a pg
[1:28] <sjustlaptop> if this happens, you can recover by restarting the primaries for the pgs in question
[1:29] <sjustlaptop> **if this bug happens instead,
[1:29] <wer> And can I tell what has been lost?
[1:30] <wer> like it should be a certain amount of objects right? ultimately?
[1:32] <wer> sorry, I am just still unclear on what losing one pg worth of stuff means.
[1:33] <dmick> wer: yes, a pg's contents is a set of objects
[1:33] <dmick> about 1/<pg_num> of that pool's objects, in an ideal distribution
[1:34] <wer> hmm. ok. So in my case can I confirm which objects were lost?
[1:35] <sjustlaptop> not easily
[1:35] <wer> ok.
[1:37] <dmick> Fuck0ffQ
[1:37] <dmick> argh
[1:37] <wer> ??
[1:37] <dmick> wrong window.
[1:38] <wer> dmick: were you putting me in the fuckoffQ?
[1:38] * sjustlaptop is now known as Q
[1:38] <dmick> :D
[1:38] <Q> dmick: Picard never told me to fuck off!
[1:38] <wer> heh
[1:38] * Q is now known as Guest1771
[1:39] * Guest1771 is now known as sjustlaptop
[1:39] <wer> oh god
[1:39] <dmick> oh I bet he did
[1:42] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) Quit (Quit: Leaving.)
[1:43] <wer> dmick: why you hate me? is it because I ask such annoying questions?
[1:43] <dmick> wer: is your name Q? I didn't think so.
[1:44] <wer> I want to join whatever channel that you're in. cause it sounds interesting.
[1:45] <wer> sjustlaptop: should I just iterate through the stuck ones and restart the primaries then?
[1:45] <sjustlaptop> yeah, it's unsatisfying to say the least...
[1:47] <nwl> dmick: another password blown?
[1:47] * aliguori (~anthony@cpe-70-112-157-87.austin.res.rr.com) Quit (Remote host closed the connection)
[2:07] <lurbs> Prepend / to your passwords, then they won't make it past your IRC client.
[2:09] <nhm> lol
[2:15] <wer> good idea lurbs :)
[2:16] <wer> I miffed one the other day :) was pissed all day.
[2:24] * miroslav (~miroslav@173-228-38-131.dsl.dynamic.sonic.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * mtk (~mtk@ool-44c35983.dyn.optonline.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * BillK (~BillK@124-168-248-119.dyn.iinet.net.au) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * noahmehl (~noahmehl@cpe-75-186-45-161.cinci.res.rr.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * terje_ (~joey@97-118-121-147.hlrn.qwest.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * al (d@niel.cx) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * mdxi (~mdxi@74-95-29-182-Atlanta.hfc.comcastbusiness.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * jpieper (~josh@209-6-86-62.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * Karcaw (~evan@68-186-68-219.dhcp.knwc.wa.charter.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * dec (~dec@ec2-54-251-62-253.ap-southeast-1.compute.amazonaws.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * scheuk (~scheuk@204.246.67.78) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * denken (~denken@dione.pixelchaos.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * ircolle (~ircolle@c-67-172-132-164.hsd1.co.comcast.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * asadpanda (~asadpanda@2001:470:c09d:0:20c:29ff:fe4e:a66) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * dpippenger (~riven@cpe-76-166-221-185.socal.res.rr.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * chutzpah (~chutz@199.21.234.7) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * jksM (~jks@3e6b5724.rev.stofanet.dk) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * JohansGlock (~quassel@kantoor.transip.nl) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * dmick (~dmick@2607:f298:a:607:87f:9c2e:9564:d22c) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * astalsi (~astalsi@c-69-255-38-71.hsd1.md.comcast.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * lightspeed (~lightspee@fw-carp-wan.ext.lspeed.org) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * absynth_ (~absynth@irc.absynth.de) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * iggy (~iggy@theiggy.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * chftosf (uid7988@hillingdon.irccloud.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * jackhill (jackhill@pilot.trilug.org) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * l3akage (~l3akage@l3akage.de) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * dennis (~dweazle@tilaa.krul.nu) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * DLange (~DLange@dlange.user.oftc.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * diegows (~diegows@190.188.190.11) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * lxo (~aoliva@lxo.user.oftc.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * yehuda_hm (~yehuda@2602:306:330b:a40:133:7b35:e199:cb6e) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * chegk (~devnull@91.199.119.19) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * nick5 (~nick@74.222.153.12) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * wer (~wer@wer.youfarted.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * sage (~sage@76.89.177.113) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * nhm (~nh@184-97-130-55.mpls.qwest.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * Teduardo (~DW-10297@dhcp92.cmh.ee.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * cephalobot (~ceph@ds2390.dreamservers.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * Matt (matt@matt.netop.oftc.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * TMM (~hp@535240C7.cm-6-3b.dynamic.ziggo.nl) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * stefunel- (~stefunel@static.38.162.46.78.clients.your-server.de) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * Svedrin (svedrin@glint.funzt-halt.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * doubleg (~doubleg@69.167.130.11) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * `10 (~10@juke.fm) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * markl_ (~mark@tpsit.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * samppah (hemuli@namibia.aviation.fi) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * __jt__ (~james@rhyolite.bx.mathcs.emory.edu) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * xmltok (~xmltok@pool101.bizrate.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * houkouonchi-work (~linux@12.248.40.138) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * maswan (maswan@kennedy.acc.umu.se) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * SpamapS (~clint@xencbyrum2.srihosting.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * mauilion (~dcooley@crawford.dreamhost.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * Ryan_Lane (~Adium@216.38.130.167) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * KindOne (KindOne@h174.186.130.174.dynamic.ip.windstream.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * masterpe (~masterpe@2001:990:0:1674::1:82) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * NaioN (stefan@andor.naion.nl) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * jantje (~jan@paranoid.nl) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * psieklFH (psiekl@wombat.eu.org) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * dwm37_ (~dwm@northrend.tastycake.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * cclien (~cclien@ec2-50-112-123-234.us-west-2.compute.amazonaws.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * janos (~janos@static-71-176-211-4.rcmdva.fios.verizon.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * jochen_ (~jochen@laevar.de) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * via (~via@smtp2.matthewvia.info) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * Kolobok (426d18f4@ircip1.mibbit.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * ShaunR (~ShaunR@staff.ndchost.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * MooingLemur (~troy@phx-pnap.pinchaser.com) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * nolan (~nolan@2001:470:1:41:20c:29ff:fe9a:60be) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * ivan` (~ivan`@000130ca.user.oftc.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * MrNPP (~mr.npp@216.152.240.205) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * nwl (~levine@atticus.yoyo.org) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * scuttlemonkey (~scuttlemo@c-69-244-181-5.hsd1.mi.comcast.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * sagewk (~sage@2607:f298:a:607:799c:4aca:4834:466d) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * joshd (~joshd@2607:f298:a:607:221:70ff:fe33:3fe3) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * yehudasa (~yehudasa@2607:f298:a:607:51be:f300:de79:d2d2) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * Psi-jack (~psi-jack@psi-jack.user.oftc.net) Quit (reticulum.oftc.net synthon.oftc.net)
[2:24] * rtek (~sjaak@empfindlichkeit.nl) Quit (reticulum.oftc.net synthon.oftc.net)
[2:28] * andreask (~andreas@h081217068225.dyn.cm.kabsi.at) Quit (Ping timeout: 483 seconds)
[2:29] * mtk (~mtk@ool-44c35983.dyn.optonline.net) has joined #ceph
[2:29] * BillK (~BillK@124-168-248-119.dyn.iinet.net.au) has joined #ceph
[2:29] * ircolle (~ircolle@c-67-172-132-164.hsd1.co.comcast.net) has joined #ceph
[2:29] * asadpanda (~asadpanda@2001:470:c09d:0:20c:29ff:fe4e:a66) has joined #ceph
[2:29] * noahmehl (~noahmehl@cpe-75-186-45-161.cinci.res.rr.com) has joined #ceph
[2:29] * dpippenger (~riven@cpe-76-166-221-185.socal.res.rr.com) has joined #ceph
[2:29] * chutzpah (~chutz@199.21.234.7) has joined #ceph
[2:29] * jksM (~jks@3e6b5724.rev.stofanet.dk) has joined #ceph
[2:29] * JohansGlock (~quassel@kantoor.transip.nl) has joined #ceph
[2:29] * dmick (~dmick@2607:f298:a:607:87f:9c2e:9564:d22c) has joined #ceph
[2:29] * terje_ (~joey@97-118-121-147.hlrn.qwest.net) has joined #ceph
[2:29] * al (d@niel.cx) has joined #ceph
[2:29] * astalsi (~astalsi@c-69-255-38-71.hsd1.md.comcast.net) has joined #ceph
[2:29] * mdxi (~mdxi@74-95-29-182-Atlanta.hfc.comcastbusiness.net) has joined #ceph
[2:29] * lightspeed (~lightspee@fw-carp-wan.ext.lspeed.org) has joined #ceph
[2:29] * jpieper (~josh@209-6-86-62.c3-0.smr-ubr2.sbo-smr.ma.cable.rcn.com) has joined #ceph
[2:29] * Karcaw (~evan@68-186-68-219.dhcp.knwc.wa.charter.com) has joined #ceph
[2:29] * absynth_ (~absynth@irc.absynth.de) has joined #ceph
[2:29] * iggy (~iggy@theiggy.com) has joined #ceph
[2:29] * chftosf (uid7988@hillingdon.irccloud.com) has joined #ceph
[2:29] * jackhill (jackhill@pilot.trilug.org) has joined #ceph
[2:29] * l3akage (~l3akage@l3akage.de) has joined #ceph
[2:29] * dennis (~dweazle@tilaa.krul.nu) has joined #ceph
[2:29] * dec (~dec@ec2-54-251-62-253.ap-southeast-1.compute.amazonaws.com) has joined #ceph
[2:29] * DLange (~DLange@dlange.user.oftc.net) has joined #ceph
[2:29] * denken (~denken@dione.pixelchaos.net) has joined #ceph
[2:29] * scheuk (~scheuk@204.246.67.78) has joined #ceph
[2:29] * `10 (~10@juke.fm) has joined #ceph
[2:29] * markl_ (~mark@tpsit.com) has joined #ceph
[2:29] * samppah (hemuli@namibia.aviation.fi) has joined #ceph
[2:29] * doubleg (~doubleg@69.167.130.11) has joined #ceph
[2:29] * TMM (~hp@535240C7.cm-6-3b.dynamic.ziggo.nl) has joined #ceph
[2:29] * Matt (matt@matt.netop.oftc.net) has joined #ceph
[2:29] * Svedrin (svedrin@glint.funzt-halt.net) has joined #ceph
[2:29] * cephalobot (~ceph@ds2390.dreamservers.com) has joined #ceph
[2:29] * Teduardo (~DW-10297@dhcp92.cmh.ee.net) has joined #ceph
[2:29] * nhm (~nh@184-97-130-55.mpls.qwest.net) has joined #ceph
[2:29] * sage (~sage@76.89.177.113) has joined #ceph
[2:29] * wer (~wer@wer.youfarted.net) has joined #ceph
[2:29] * nick5 (~nick@74.222.153.12) has joined #ceph
[2:29] * stefunel- (~stefunel@static.38.162.46.78.clients.your-server.de) has joined #ceph
[2:29] * chegk (~devnull@91.199.119.19) has joined #ceph
[2:29] * yehuda_hm (~yehuda@2602:306:330b:a40:133:7b35:e199:cb6e) has joined #ceph
[2:29] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[2:29] * mauilion (~dcooley@crawford.dreamhost.com) has joined #ceph
[2:29] * Ryan_Lane (~Adium@216.38.130.167) has joined #ceph
[2:29] * KindOne (KindOne@h174.186.130.174.dynamic.ip.windstream.net) has joined #ceph
[2:29] * ivan` (~ivan`@000130ca.user.oftc.net) has joined #ceph
[2:29] * MooingLemur (~troy@phx-pnap.pinchaser.com) has joined #ceph
[2:29] * masterpe (~masterpe@2001:990:0:1674::1:82) has joined #ceph
[2:29] * MrNPP (~mr.npp@216.152.240.205) has joined #ceph
[2:29] * NaioN (stefan@andor.naion.nl) has joined #ceph
[2:29] * nolan (~nolan@2001:470:1:41:20c:29ff:fe9a:60be) has joined #ceph
[2:29] * jantje (~jan@paranoid.nl) has joined #ceph
[2:29] * psieklFH (psiekl@wombat.eu.org) has joined #ceph
[2:29] * dwm37_ (~dwm@northrend.tastycake.net) has joined #ceph
[2:29] * nwl (~levine@atticus.yoyo.org) has joined #ceph
[2:29] * cclien (~cclien@ec2-50-112-123-234.us-west-2.compute.amazonaws.com) has joined #ceph
[2:29] * Psi-jack (~psi-jack@psi-jack.user.oftc.net) has joined #ceph
[2:29] * rtek (~sjaak@empfindlichkeit.nl) has joined #ceph
[2:29] * janos (~janos@static-71-176-211-4.rcmdva.fios.verizon.net) has joined #ceph
[2:29] * scuttlemonkey (~scuttlemo@c-69-244-181-5.hsd1.mi.comcast.net) has joined #ceph
[2:29] * sagewk (~sage@2607:f298:a:607:799c:4aca:4834:466d) has joined #ceph
[2:29] * joshd (~joshd@2607:f298:a:607:221:70ff:fe33:3fe3) has joined #ceph
[2:29] * jochen_ (~jochen@laevar.de) has joined #ceph
[2:29] * yehudasa (~yehudasa@2607:f298:a:607:51be:f300:de79:d2d2) has joined #ceph
[2:29] * via (~via@smtp2.matthewvia.info) has joined #ceph
[2:29] * Kolobok (426d18f4@ircip1.mibbit.com) has joined #ceph
[2:29] * ShaunR (~ShaunR@staff.ndchost.com) has joined #ceph
[2:29] * __jt__ (~james@rhyolite.bx.mathcs.emory.edu) has joined #ceph
[2:29] * xmltok (~xmltok@pool101.bizrate.com) has joined #ceph
[2:29] * houkouonchi-work (~linux@12.248.40.138) has joined #ceph
[2:29] * maswan (maswan@kennedy.acc.umu.se) has joined #ceph
[2:29] * SpamapS (~clint@xencbyrum2.srihosting.com) has joined #ceph
[2:29] <- *Svedrin* "I am currently away. Please leave a message, I will see it as soon as I get back."
[2:30] * ChanServ sets mode +o sage
[2:34] * KevinPerks (~Adium@cpe-066-026-239-136.triad.res.rr.com) Quit (Quit: Leaving.)
[2:35] * dpippenger (~riven@cpe-76-166-221-185.socal.res.rr.com) Quit (Remote host closed the connection)
[2:37] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) has joined #ceph
[2:42] * Disconnected.
[2:42] -magnet.oftc.net- *** Looking up your hostname...
[2:42] -magnet.oftc.net- *** Checking Ident
[2:42] -magnet.oftc.net- *** No Ident response
[2:42] -magnet.oftc.net- *** Found your hostname

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.