#ceph IRC Log

Index

IRC Log for 2013-02-24

Timestamps are in GMT/BST.

[0:00] <lightspeed> ok
[0:00] <lightspeed> yes this is btrfs
[0:00] <jmlowe> you have a problem
[0:00] <jmlowe> I had the same one
[0:00] <lightspeed> note that I have been running kernels with the patch you linked to previously for some time already
[0:00] <lightspeed> this has been happening despite that
[0:01] <jmlowe> oh, ok
[0:01] <jmlowe> I'm a one trick pony, that's all I know
[0:01] <lightspeed> :)
[0:01] <jmlowe> I've been scrubbing clean since I started running that patch
[0:03] <lightspeed> I think I've been using that patch since around Feb 8th, not sure if it was before or after the first of the scrub errors in the logs I pasted
[0:04] <lightspeed> although it certainly didn't begin when I started using the patch either... I'd had scrub errors before too
[0:04] <lightspeed> maybe I should simply give up on btrfs
[0:04] <lightspeed> although I've had no problems with the root fs on any of these systems, which is also btrfs
[0:05] <jmlowe> I've been tempted, it seems xfs has a nasty bug and ext4 fragments until it's unusable
[0:05] <jmlowe> I'm not real clear on the xfs bug, just noticed some other people in the channel having trouble
[0:11] <lightspeed> going back to the "repair always selects the primary"...
[0:11] <lightspeed> in my case I have replication size 2, so without some other record of the digest I guess that not much else a repair could do
[0:12] <lightspeed> but if someone had replication size 3, and the two non-primary copies agreed on the digest, but differed from the primary
[0:12] <lightspeed> it would seem sensible to trust the majority
[0:12] <jmlowe> I believe the digest is calculated at scrub time, so yeah with a replication level of 3 you might have a better chance
[0:13] <jmlowe> byzantine generals
[0:17] <jmlowe> I'm now having trouble with this http://pastebin.com/SC7dHmX9
[0:22] <lightspeed> what kernel is that?
[0:23] <jmlowe> one I built from the mainline 3.7.0
[0:24] <lightspeed> oh yes, I see it does mention the version in the midst of the output
[0:25] <lightspeed> are you hitting that repeatedly?
[0:26] <jmlowe> twice now this weekend
[0:26] <jmlowe> same machine
[0:26] <jmlowe> same fs
[0:34] <lightspeed> well lacking any true understanding of how to interpret such a trace it certainly looks like its a problem btrfs (given the copious references to it)... so yet another reason to perhaps switch
[0:35] <lightspeed> *problem with btrfs
[0:45] <lightspeed> I just compared the content of the differing objects for the inconsistency in 2.1a as well
[0:45] <lightspeed> in that one the difference is a 1.5kB block
[0:46] <lightspeed> that block (again somewhere in the middle of the object) contains data in both copies, just different data
[0:46] <lightspeed> the rest of the object (both before and after that 1.5 kB section) is otherwise identical
[0:49] <lightspeed> can I force repair to use the non-primary copy if I know that one's actually correct? or could I achieve the same thing by manually copying the file corresponding to the object from one OSD to the other?
[0:50] * sjustlaptop (~sam@71-83-191-116.dhcp.gldl.ca.charter.com) has joined #ceph
[0:51] <lightspeed> in this case it's entirely likely that one of the previous repairs of the same object already used a bad copy of the data, but it was more a general question
[0:51] * yehuda_hm (~yehuda@2602:306:330b:a40:e095:f9d1:7790:8cef) Quit (Ping timeout: 480 seconds)
[1:00] <lightspeed> actually I also seem to have a copy of that object from when the digest was 1208803637 (ie the non-primary before the previous repair)
[1:00] * yehuda_hm (~yehuda@2602:306:330b:a40:6574:e6ae:1335:a48b) has joined #ceph
[1:01] <lightspeed> (I manually saved a copy of it for safe-keeping before the repair just in case)
[1:02] <lightspeed> I'll do another comparison to see whether it's the exact same chunk of data that differed on that occasion too...
[1:07] * diegows (~diegows@190.188.190.11) has joined #ceph
[1:08] <lightspeed> in fact it is the exact same 1.5kB portion of the object
[1:09] <lightspeed> and now that I look at the content, I rather suspect the genuine data was in the non-primary copy from before the last repair
[1:11] <lightspeed> so that suggests that the same OSD has corrupted the same 1.5kB portion of an object on two separate occasions in the space of a week
[1:12] <lightspeed> during which the object received no writes
[1:13] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[1:13] <lightspeed> it clearly has something against that chunk of data :)
[1:14] <jmlowe> I think you can copy it, sjust is the guy you want to talk to, whatever you do don't take my word for it
[1:15] * sjustlaptop (~sam@71-83-191-116.dhcp.gldl.ca.charter.com) Quit (Ping timeout: 480 seconds)
[1:15] <lightspeed> if he hadn't just left :)
[1:18] <darkfader> i just learned my US trip includes LA... am i right that's where the inktank office is at?
[1:21] <lightspeed> I imagine it's probably sensible to stop the OSD to which I'm copying the file before I do so though, then start it back up afterwards
[1:21] <jmlowe> I want to say they are LA based
[1:22] <jmlowe> yeah, I have no idea how files in the object store are affected by cp, there must be some complications with xattrs
[1:25] <darkfader> jmlowe: thanks
[1:25] <lightspeed> oh good point, perhaps it'd be safer to overwrite just the damaged portion of the file using dd
[1:25] <darkfader> then i gotta find a way to come and say hi there
[1:26] <darkfader> unfortunately i don't have beers for sage with me
[1:26] <darkfader> damn, gtg :)
[1:30] <jmlowe> so what is the prevailing feeling about using xfs?
[1:31] <jmlowe> I'm thinking about starting this broken osd over with xfs
[1:31] <lightspeed> sounds like a good idea to me
[1:32] <jmlowe> no problem with mixing osd's with different filesystems right?
[1:33] <lightspeed> I recall seeing that asked in here before, and the answer was "no, that's fine"
[1:37] <lightspeed> I think I'm going to switch to XFS as well, just as soon as I've satisfied my curiosity enough in trying to get to the bottom of my current problem
[1:46] <lightspeed> each of my OSDs are currently set up as follows: an SSD with 2 GPT partitions, one of the GPT partitions is an LVM PV, one of the LVs is the OSD volume (formatted with btrfs) and a different LV is the OSD journal (raw)
[1:47] <lightspeed> the btrfs mount options are: rw,noatime,ssd,space_cache,discard,compress=lzo
[1:47] <lightspeed> and the LVM config has "issue_discards = 1"
[1:49] <lightspeed> I wonder whether there's something odd about this configuration that's leading to my problems, not just the fact that I'm using btrfs
[1:50] <lightspeed> there are other LVs on the SSD for other things too, including the rootfs, but I only mentioned the bits related to the OSD
[1:50] <jmlowe> yeah, I'd be nervous using any extra btrfs options
[1:52] <lightspeed> I think it uses "ssd" by default, as it's auto-detected, but the "space_cache,discard,compress=lzo" are non-default
[1:52] <jmlowe> discard is probably good for ssd, but compress and space_cache are suspect
[1:53] <lightspeed> yeah perhaps I should get rid of those
[1:54] <jmlowe> you'd have to rewrite all the files to really get rid of compress
[1:55] <lightspeed> I see, makes sense
[1:56] * Vjarjadian (~IceChat77@5ad6d005.bb.sky.com) has joined #ceph
[1:57] <lightspeed> it'd be nice if I could repro these inconsistencies at will... then I could feasibly narrow down the cause without waiting for ages to see if I get another occurrence
[1:59] * xmltok (~xmltok@cpe-76-170-26-114.socal.res.rr.com) Quit (Read error: Connection reset by peer)
[1:59] * xmltok (~xmltok@cpe-76-170-26-114.socal.res.rr.com) has joined #ceph
[2:01] <lightspeed> essentially, switching to XFS has the greatest chance of making the problem go away, but it'll leave me none the wiser about exactly what is wrong with the current btrfs setup
[2:01] <lightspeed> but I'm not sure I have enough patience to follow through with the latter :)
[2:04] <lightspeed> anyway, time for sleep I think
[2:46] * davidz1 (~Adium@ip68-96-75-123.oc.oc.cox.net) has joined #ceph
[2:46] * davidz (~Adium@ip68-96-75-123.oc.oc.cox.net) Quit (Read error: Connection reset by peer)
[2:46] * bmjason (~bmjason@71.163.141.245) has joined #ceph
[3:04] * bmjason (~bmjason@71.163.141.245) Quit (Quit: Leaving.)
[3:14] * xmltok (~xmltok@cpe-76-170-26-114.socal.res.rr.com) Quit (Read error: Connection reset by peer)
[3:14] * xmltok (~xmltok@cpe-76-170-26-114.socal.res.rr.com) has joined #ceph
[3:18] * diegows (~diegows@190.188.190.11) Quit (Ping timeout: 480 seconds)
[4:10] * slang1 (~slang@207-229-177-80.c3-0.drb-ubr1.chi-drb.il.cable.rcn.com) Quit (Ping timeout: 480 seconds)
[5:10] * slang (~slang@207-229-177-80.c3-0.drb-ubr1.chi-drb.il.cable.rcn.com) has joined #ceph
[5:35] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) has joined #ceph
[5:43] * wschulze1 (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) has joined #ceph
[5:43] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) Quit (Read error: Connection reset by peer)
[6:04] * esammy_ (~esamuels@host-2-102-71-92.as13285.net) has joined #ceph
[6:06] * esammy (~esamuels@host-2-102-68-175.as13285.net) Quit (Ping timeout: 480 seconds)
[6:06] * esammy_ is now known as esammy
[6:08] * slang (~slang@207-229-177-80.c3-0.drb-ubr1.chi-drb.il.cable.rcn.com) Quit (Ping timeout: 480 seconds)
[6:09] * wschulze1 (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) Quit (Quit: Leaving.)
[7:46] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[9:05] * loicd (~loic@magenta.dachary.org) has joined #ceph
[9:57] * jrisch (~Adium@4505ds2-hi.0.fullrate.dk) has joined #ceph
[10:22] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[10:22] * loicd (~loic@magenta.dachary.org) has joined #ceph
[10:38] * esammy (~esamuels@host-2-102-71-92.as13285.net) Quit (Quit: esammy)
[10:53] * leseb (~leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) has joined #ceph
[10:58] * leseb (~leseb@5ED01FAC.cm-7-1a.dynamic.ziggo.nl) Quit (Remote host closed the connection)
[11:01] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[11:01] * loicd (~loic@magenta.dachary.org) has joined #ceph
[11:24] * lofejndif (~lsqavnbok@foto.ro1.torservers.net) has joined #ceph
[12:15] * lofejndif (~lsqavnbok@9KCAAAZ00.tor-irc.dnsbl.oftc.net) Quit (Quit: gone)
[13:04] * sleinen1 (~Adium@2001:620:0:26:a505:bef8:ec7:90) has joined #ceph
[13:08] * itamar (~itamar@82.166.185.149) has joined #ceph
[13:09] * itamar (~itamar@82.166.185.149) Quit ()
[13:43] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[13:43] * loicd (~loic@magenta.dachary.org) has joined #ceph
[14:01] * mtk (~mtk@ool-44c35983.dyn.optonline.net) Quit (Remote host closed the connection)
[14:05] * mtk (~mtk@ool-44c35983.dyn.optonline.net) has joined #ceph
[14:22] * test12345 (~heracliti@cpe-70-123-115-69.tx.res.rr.com) has joined #ceph
[14:22] * heraclitis (~heracliti@0001b17a.user.oftc.net) Quit (Ping timeout: 480 seconds)
[14:22] * test12345 is now known as heraclitis
[14:28] * madkiss (~madkiss@chello062178057005.20.11.vie.surfer.at) Quit (Quit: Leaving.)
[14:28] * madkiss (~madkiss@chello062178057005.20.11.vie.surfer.at) has joined #ceph
[14:32] * madkiss (~madkiss@chello062178057005.20.11.vie.surfer.at) Quit ()
[14:38] * mcclurmc_laptop (~mcclurmc@cpc10-cmbg15-2-0-cust205.5-4.cable.virginmedia.com) has joined #ceph
[14:49] * slang1 (~slang@207-229-177-80.c3-0.drb-ubr1.chi-drb.il.cable.rcn.com) has joined #ceph
[14:52] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[14:52] * loicd (~loic@magenta.dachary.org) has joined #ceph
[15:06] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[15:06] * loicd (~loic@magenta.dachary.org) has joined #ceph
[15:25] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[15:25] * loicd (~loic@2a01:e35:2eba:db10:6818:1107:b589:e432) has joined #ceph
[15:33] * rturk-away (~rturk@ds2390.dreamservers.com) Quit (Remote host closed the connection)
[15:34] * rturk-away (~rturk@ds2390.dreamservers.com) has joined #ceph
[15:46] * loicd (~loic@2a01:e35:2eba:db10:6818:1107:b589:e432) Quit (Quit: Leaving.)
[15:46] * loicd (~loic@magenta.dachary.org) has joined #ceph
[15:55] * diegows (~diegows@190.188.190.11) has joined #ceph
[16:13] * BManojlovic (~steki@121-173-222-85.adsl.verat.net) Quit (Ping timeout: 480 seconds)
[16:30] * b1tbkt (~Go@68-184-193-142.dhcp.stls.mo.charter.com) has joined #ceph
[16:33] * yehuda_hm (~yehuda@2602:306:330b:a40:6574:e6ae:1335:a48b) Quit (Ping timeout: 480 seconds)
[16:47] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) has joined #ceph
[16:50] * ScOut3R (~ScOut3R@54007948.dsl.pool.telekom.hu) has joined #ceph
[16:51] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) Quit ()
[16:56] * stxShadow (~Jens@ip-178-201-147-146.unitymediagroup.de) has joined #ceph
[17:24] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[17:24] * loicd (~loic@magenta.dachary.org) has joined #ceph
[17:24] * plut0 (~cory@pool-96-236-43-69.albyny.fios.verizon.net) has joined #ceph
[17:26] <plut0> is there any plans to add async writes?
[17:30] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) has joined #ceph
[17:34] * madkiss (~madkiss@213.129.230.10) has joined #ceph
[17:43] * mtk (~mtk@ool-44c35983.dyn.optonline.net) Quit (Remote host closed the connection)
[17:46] * leseb (~leseb@212-123-27-210.iFiber.telenet-ops.be) has joined #ceph
[17:48] * xmltok (~xmltok@cpe-76-170-26-114.socal.res.rr.com) Quit (Quit: Bye!)
[17:53] * mtk (~mtk@ool-44c35983.dyn.optonline.net) has joined #ceph
[17:58] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) Quit (Ping timeout: 480 seconds)
[18:03] <Vjarjadian> pluto, theyre working in geo replication....
[18:10] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) has joined #ceph
[18:17] * madkiss (~madkiss@213.129.230.10) Quit (Quit: Leaving.)
[18:20] <loicd> plut0: "it's on the roadmap but no ETA" ;-)
[18:21] <plut0> will you be able to specify X number of sync copies and X number of async copies?
[18:24] <Robe> plut0: since it doesn't have an ETA i think people are not very set in stone regarding the details
[18:24] <plut0> i was just thinking that would be a good way of doing it if possible
[18:24] <Vjarjadian> indeed, there are still discussions on how to do it
[18:26] * The_Bishop_ (~bishop@e179021110.adsl.alicedsl.de) has joined #ceph
[18:26] <loicd> leseb: have you used ceph-deploy ?
[18:27] * jluis (~JL@89.181.157.177) has joined #ceph
[18:30] <leseb> loicd: I tried it once
[18:30] <leseb> loicd: but it was still under-heavy development so...
[18:30] <loicd> ok. I'm tempted ;-)
[18:33] * The_Bishop__ (~bishop@e179016222.adsl.alicedsl.de) Quit (Ping timeout: 480 seconds)
[18:33] * joao (~JL@89-181-154-116.net.novis.pt) Quit (Ping timeout: 480 seconds)
[18:34] * heraclitis (~heracliti@0001b17a.user.oftc.net) Quit (Ping timeout: 480 seconds)
[18:35] * leseb (~leseb@212-123-27-210.iFiber.telenet-ops.be) Quit (Remote host closed the connection)
[18:37] * plut0 (~cory@pool-96-236-43-69.albyny.fios.verizon.net) has left #ceph
[18:42] * leseb (~leseb@212-123-27-210.iFiber.telenet-ops.be) has joined #ceph
[18:45] * leseb (~leseb@212-123-27-210.iFiber.telenet-ops.be) Quit (Read error: Connection reset by peer)
[18:46] * stxShadow1 (~Jens@ip-178-201-147-146.unitymediagroup.de) has joined #ceph
[18:49] * stxShadow (~Jens@ip-178-201-147-146.unitymediagroup.de) Quit (Ping timeout: 480 seconds)
[18:55] * mtk (~mtk@ool-44c35983.dyn.optonline.net) Quit (Remote host closed the connection)
[18:58] * mtk (~mtk@ool-44c35983.dyn.optonline.net) has joined #ceph
[18:59] * mtk (~mtk@ool-44c35983.dyn.optonline.net) Quit ()
[19:00] * ScOut3R_ (~ScOut3R@54007948.dsl.pool.telekom.hu) has joined #ceph
[19:07] * ScOut3R (~ScOut3R@54007948.dsl.pool.telekom.hu) Quit (Ping timeout: 480 seconds)
[19:09] * mtk (~mtk@ool-44c35983.dyn.optonline.net) has joined #ceph
[19:13] * danieagle (~Daniel@177.133.175.196) has joined #ceph
[19:18] * sleinen (~Adium@217-162-132-182.dynamic.hispeed.ch) has joined #ceph
[19:19] * sleinen2 (~Adium@2001:620:0:25:a937:423f:d962:cee5) has joined #ceph
[19:22] * loicd (~loic@magenta.dachary.org) Quit (Quit: Leaving.)
[19:26] * sleinen1 (~Adium@2001:620:0:26:a505:bef8:ec7:90) Quit (Ping timeout: 480 seconds)
[19:26] * sleinen (~Adium@217-162-132-182.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[19:45] * loicd (~loic@magenta.dachary.org) has joined #ceph
[20:11] * leseb (~leseb@APuteaux-552-1-120-24.w90-35.abo.wanadoo.fr) has joined #ceph
[20:25] * diegows (~diegows@190.188.190.11) Quit (Ping timeout: 480 seconds)
[20:30] <loicd> leseb: welcome to paris ;-)
[20:36] * esammy (~esamuels@host-2-102-71-92.as13285.net) has joined #ceph
[20:38] <leseb> loicd: thanks!
[20:46] * sleinen2 (~Adium@2001:620:0:25:a937:423f:d962:cee5) Quit (Ping timeout: 480 seconds)
[21:09] * sleinen1 (~Adium@217-162-132-182.dynamic.hispeed.ch) has joined #ceph
[21:10] * nick5 (~nick@74.222.153.12) Quit (Remote host closed the connection)
[21:11] * nick5 (~nick@74.222.153.12) has joined #ceph
[21:12] * nick5 (~nick@74.222.153.12) Quit (Remote host closed the connection)
[21:12] * nick5 (~nick@74.222.153.12) has joined #ceph
[21:12] * sleinen2 (~Adium@2001:620:0:26:d4d2:5c82:febc:481) has joined #ceph
[21:13] * nick5 (~nick@74.222.153.12) Quit (Remote host closed the connection)
[21:13] * nick5 (~nick@74.222.153.12) has joined #ceph
[21:14] * mtk (~mtk@ool-44c35983.dyn.optonline.net) Quit (Ping timeout: 480 seconds)
[21:14] * eschnou (~eschnou@65.72-201-80.adsl-dyn.isp.belgacom.be) has joined #ceph
[21:17] * sleinen1 (~Adium@217-162-132-182.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[21:17] * stxShadow1 (~Jens@ip-178-201-147-146.unitymediagroup.de) has left #ceph
[21:21] * davidz1 (~Adium@ip68-96-75-123.oc.oc.cox.net) Quit (Quit: Leaving.)
[21:24] * mtk (~mtk@ool-44c35983.dyn.optonline.net) has joined #ceph
[21:28] * BManojlovic (~steki@121-173-222-85.adsl.verat.net) has joined #ceph
[21:29] * BManojlovic (~steki@121-173-222-85.adsl.verat.net) Quit (Remote host closed the connection)
[21:38] * DLange (~DLange@dlange.user.oftc.net) Quit (Quit: a reboot a day keeps bugs at bay)
[21:41] * DLange (~DLange@dlange.user.oftc.net) has joined #ceph
[21:42] * Vjarjadian_ (~IceChat77@5ad6d005.bb.sky.com) has joined #ceph
[21:44] * davidz (~Adium@ip68-96-75-123.oc.oc.cox.net) has joined #ceph
[21:44] * Vjarjadian (~IceChat77@5ad6d005.bb.sky.com) Quit (Ping timeout: 480 seconds)
[21:45] * lx0 (~aoliva@lxo.user.oftc.net) has joined #ceph
[21:51] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[21:52] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) Quit (Quit: Leaving.)
[22:21] <xdeller> just checked, filestore_flusher set to true by default, very interesting..
[22:26] * wschulze (~wschulze@cpe-98-14-23-162.nyc.res.rr.com) has joined #ceph
[22:27] * sig_wall (~adjkru@185.14.185.91) has joined #ceph
[22:32] * jrisch (~Adium@4505ds2-hi.0.fullrate.dk) Quit (Ping timeout: 480 seconds)
[22:37] * eschnou (~eschnou@65.72-201-80.adsl-dyn.isp.belgacom.be) Quit (Ping timeout: 480 seconds)
[22:44] * CrashHD (~na@c-24-10-14-95.hsd1.ca.comcast.net) has joined #ceph
[22:45] <CrashHD> Hello
[22:46] <Vjarjadian_> hello
[22:46] <CrashHD> how goes it today
[22:46] <Vjarjadian_> slow
[22:46] <CrashHD> good thing or bad from your perspective?
[22:47] <Vjarjadian_> bit of both i suppose... mostly good
[22:47] <CrashHD> glad to hear it then
[22:47] <Vjarjadian_> you?
[22:48] * sleinen (~Adium@2001:620:0:26:ec7a:eccb:1530:8bf6) has joined #ceph
[22:48] <CrashHD> about the same I suppose. Working through some of my lingering projects, trying to figure out what needs priority
[22:48] <CrashHD> so many hopeful accomplishments, so little time :)
[22:49] <CrashHD> out of curiousity, do you know if ceph has any plans to support scsi reservations on it's block devices?
[22:50] <CrashHD> would make for a very nice scale out block architecture :)
[22:50] <Vjarjadian_> ceph is one of the things i've put on my back burner... other things more important
[22:50] <CrashHD> ah
[22:50] <Vjarjadian_> at the moment anyway
[22:50] <CrashHD> ya, I haven't really dove in that deep
[22:50] <CrashHD> just tinkering at the moment
[22:50] * fred1 (~fredl@2a00:1a48:7803:107:8532:c238:ff08:354) has joined #ceph
[22:51] * sleinen2 (~Adium@2001:620:0:26:d4d2:5c82:febc:481) Quit (Ping timeout: 480 seconds)
[22:53] * fred1 (~fredl@2a00:1a48:7803:107:8532:c238:ff08:354) has left #ceph
[22:54] * flepied (~fredl@2a00:1a48:7803:107:8532:c238:ff08:354) has joined #ceph
[22:58] * esammy (~esamuels@host-2-102-71-92.as13285.net) Quit (Quit: esammy)
[23:00] * danieagle (~Daniel@177.133.175.196) Quit (Quit: Inte+ :-) e Muito Obrigado Por Tudo!!! ^^)
[23:11] * CrashHD (~na@c-24-10-14-95.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[23:11] * CrashHD (~na@c-24-10-14-95.hsd1.ca.comcast.net) has joined #ceph
[23:12] * sleinen (~Adium@2001:620:0:26:ec7a:eccb:1530:8bf6) Quit (Quit: Leaving.)
[23:12] * sleinen (~Adium@217-162-132-182.dynamic.hispeed.ch) has joined #ceph
[23:19] * BManojlovic (~steki@121-173-222-85.adsl.verat.net) has joined #ceph
[23:20] * sleinen (~Adium@217-162-132-182.dynamic.hispeed.ch) Quit (Ping timeout: 480 seconds)
[23:26] * CrashHD (~na@c-24-10-14-95.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[23:29] * CrashHD (~na@c-24-10-14-95.hsd1.ca.comcast.net) has joined #ceph
[23:41] * MarkN (~nathan@142.208.70.115.static.exetel.com.au) has joined #ceph
[23:41] * MarkN (~nathan@142.208.70.115.static.exetel.com.au) has left #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.