#ceph IRC Log

Index

IRC Log for 2014-03-05

Timestamps are in GMT/BST.

[0:01] * houkouonchi-home (~linux@2001:470:c:c69::2) Quit (Ping timeout: 480 seconds)
[0:02] <andreask> a minimal ceph.conf is fine ... with mon hosts
[0:02] <andreask> some rbd options might be useful
[0:03] <andreask> rbd cache I mean
[0:03] <ponyofdeath> i just have this http://paste.ubuntu.com/7035646
[0:03] <ponyofdeath> and i get http://paste.ubuntu.com/7035649
[0:06] * houkouonchi-home (~linux@2001:470:c:c69::2) has joined #ceph
[0:08] * drokita (~drokita@199.255.228.128) Quit (Ping timeout: 480 seconds)
[0:08] <andreask> your are trying that as non-root user?
[0:09] <ponyofdeath> yup
[0:10] <andreask> then it tries to use the admin key by default IIRC
[0:13] <dmick> root or nonroot. the key is determined by the client name
[0:14] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[0:15] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) Quit (Quit: Leaving.)
[0:16] * markbby (~Adium@168.94.245.3) Quit (Quit: Leaving.)
[0:17] * carter (~carter@2600:3c03::f03c:91ff:fe6e:6c01) Quit (Quit: ZNC - http://znc.in)
[0:17] <andreask> so then the question is what is the client name of qemu-img?
[0:17] * carter (~carter@2600:3c03::f03c:91ff:fe6e:6c01) has joined #ceph
[0:18] * dis (~dis@109.110.66.152) Quit (Ping timeout: 480 seconds)
[0:18] <dmick> ISTR it's set by qemu options
[0:19] <dmick> the example in the URL above uses client.libvirt
[0:19] <andreask> the libvirt? yes ... but qemu-img too?
[0:20] <andreask> I'd assume the default id to be "admin" for it
[0:20] <dmick> true.
[0:21] * mkoderer (uid11949@id-11949.ealing.irccloud.com) Quit (Quit: Connection closed for inactivity)
[0:23] <andreask> ponyofdeath: does: qemu-img create -f rbd rbd:libvirt/test-image:id=libvirt 5G .... work better?
[0:24] * garphy is now known as garphy`aw
[0:24] * BillK (~BillK-OFT@106-68-68-206.dyn.iinet.net.au) has joined #ceph
[0:34] * valeech (~valeech@pool-71-171-123-210.clppva.fios.verizon.net) has joined #ceph
[0:41] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) Quit (Read error: Connection reset by peer)
[0:41] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) has joined #ceph
[0:46] * sarob (~sarob@216.0.106.10) Quit (Remote host closed the connection)
[0:46] * sarob (~sarob@208.116.157.10) has joined #ceph
[0:47] * hasues (~hasues@kwfw01.scrippsnetworksinteractive.com) Quit (Quit: Leaving.)
[0:53] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) Quit (Remote host closed the connection)
[0:53] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) has joined #ceph
[0:55] * PerlStalker (~PerlStalk@2620:d3:8000:192::70) Quit (Quit: ...)
[1:00] <ponyofdeath> andreask: ahh ok let me try now sorry
[1:00] <ponyofdeath> andreask: how do i pull the key from ceph
[1:01] <ponyofdeath> to verify its the right one
[1:01] <andreask> ceph auth list
[1:02] <ponyofdeath> what is the format of the keyring
[1:03] <ponyofdeath> file
[1:03] <andreask> in fact the same you can see in "ceph auth list"
[1:03] <ponyofdeath> andreask: i am getting client.libvirt: unexpeced key: req.key=
[1:04] <andreask> where?
[1:04] <ponyofdeath> on the ceph mon / osd node
[1:04] <ponyofdeath> when i try to run the qemu-img create on the kvm server
[1:05] <ponyofdeath> so its seems i dont have the auth configured right
[1:05] <andreask> yeah
[1:05] <ChrisNBlum> is it possible there is a line
[1:05] <ChrisNBlum> req.key= somewhere in /etc/ceph?
[1:07] <dmick> req.key sounds like a libvirt name, not a ceph name
[1:08] * thb (~me@0001bd58.user.oftc.net) Quit (Quit: Leaving.)
[1:08] <dmick> but it might be in the ceph message
[1:09] <ponyofdeath> where do i configure those in libvirt? i thought it used /etc/ceph/ceph.conf
[1:11] * sarob (~sarob@208.116.157.10) Quit (Remote host closed the connection)
[1:11] * sarob (~sarob@216.0.106.10) has joined #ceph
[1:13] <dmick> does ceph auth list show you client.libvirt?
[1:13] <ponyofdeath> dmick: yup and i copied that into the keyring file on the kvm node
[1:13] <ponyofdeath> then i have ceph.conf point to that keyring file
[1:13] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[1:14] <dmick> just to be sure. you copied it into which keyring file?
[1:14] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[1:14] <ponyofdeath> /etc/ceph/keyring.libvirt
[1:15] <ponyofdeath> [client.libvirt] keyring = /etc/ceph/keyring.libvirt
[1:15] <ponyofdeath> is then what i have in ceph.conf
[1:16] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) Quit (Quit: Leaving.)
[1:18] <dmick> so have you dealt with the apparmor-under-ubuntu-i-don't-know-what-under-other-distros issue of libvirt being restricted in the files it can read?
[1:18] * AfC (~andrew@101.119.14.95) has joined #ceph
[1:19] <ponyofdeath> ahh nope let me chck thought that the latest app armour update fixed that
[1:19] <dmick> but it adds /etc/ceph/ceph.conf, perhaps, and not /etc/cpeh/keyring.libvirt
[1:20] <ponyofdeath> This bug was fixed in the package libvirt - 0.9.8-2ubuntu17.3
[1:20] <ponyofdeath> https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1026404
[1:21] <ponyofdeath> only adds in ceph.conf
[1:21] <ponyofdeath> looks like you are right
[1:21] <dmick> ^
[1:21] <dmick> ISTR you can also specify the key in the libvirt conf?...don't know if that's true or not
[1:23] <lurbs> You can, yeah. Using libvirt secrets.
[1:23] <lurbs> http://ceph.com/docs/master/rbd/rbd-openstack/#setup-ceph-client-authentication
[1:23] <dmick> right, that
[1:23] <lurbs> The "Then, on the compute nodes" section.
[1:23] <dmick> so there are two paths ponyofdeath
[1:24] <ponyofdeath> ok, but would libvirt know to use that secret when using qemu-image create
[1:25] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) has left #ceph
[1:25] <dmick> I don't think it has to; the auth isn't tied to the image per se. client.admin has pretty much sudo perms on the cluster
[1:25] <dmick> so you just have to use a key that has perms to write the part of the cluster you're writing
[1:25] <dmick> and when the vm runs, it uses the lesser client.libvirt key
[1:27] <ponyofdeath> do i need to have ceph stuff installed on the kvm nodes ?
[1:27] <ponyofdeath> to use rbd
[1:28] <ponyofdeath> or does libvirt include that
[1:28] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) has joined #ceph
[1:28] * ChanServ sets mode +v andreask
[1:28] <dmick> no; libvirt needs to use librbd
[1:28] <dmick> so you at least need librados2 and librbd1; that might be enough
[1:29] <dmick> (librbd1 depends on librados2 so you can just install that)
[1:29] <ponyofdeath> well i disabled apparmor with same result
[1:29] <andreask> ponyofdeath: hmm ... what does your keyfile look like now?
[1:29] <ponyofdeath> http://paste.ubuntu.com/7035959
[1:30] <ponyofdeath> http://bpaste.net/show/iOgpaTyIi2enmowAIdQw/
[1:31] <dmick> does libvirt run as root? if not, it can't read that keyring file
[1:31] <ponyofdeath> it does
[1:31] <ponyofdeath> root 6864 1 0 Mar04 ? 00:00:00 /usr/sbin/libvirtd -d
[1:31] <andreask> ponyofdeath: sorry ... my fault ... should look like [client.libvirt] key = xxxx==
[1:32] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has joined #ceph
[1:32] <andreask> ... its not exactly the same syntax ... from ceph auth list into the key file ... would be too easy ;-)
[1:32] <dmick> "ceph auth export" has the same syntax
[1:32] * sarob (~sarob@216.0.106.10) Quit (Remote host closed the connection)
[1:32] <ponyofdeath> Formatting 'rbd:libvirt/test-image:id=libvirt', fmt=rbd size=5368709120 cluster_size=0
[1:32] <ponyofdeath> qemu-img: Formatting or formatting option not supported for file format 'rbd'
[1:32] <ponyofdeath> diff error now
[1:32] <ponyofdeath> lol
[1:32] <ponyofdeath> nice
[1:33] <ponyofdeath> http://ceph.com/docs/master/rbd/libvirt/
[1:33] <ponyofdeath> following that
[1:34] <andreask> format should be "raw"
[1:35] <ponyofdeath> http://paste.ubuntu.com/7035981
[1:40] <ponyofdeath> andreask: any ideas why its not supported? i dont see any errors on the ceph cluster side in the logs
[1:42] <andreask> ponyofdeath: your qemu version?
[1:44] * AfC (~andrew@101.119.14.95) Quit (Quit: Leaving.)
[1:46] <dmick> qemu-img -h | grep 'Supp.*rbd' shows a hit, right?
[1:46] <dmick> (and I think format should *not* be raw...)
[1:48] * Pedras (~Adium@216.207.42.132) Quit (Ping timeout: 480 seconds)
[1:49] * hasues (~hazuez@108-236-232-243.lightspeed.knvltn.sbcglobal.net) has joined #ceph
[1:50] * fdmanana (~fdmanana@bl13-134-213.dsl.telepac.pt) Quit (Quit: Leaving)
[1:51] <ponyofdeath> dmick: yeah i see rbd in there
[1:52] * cofol1986 (~xwrj@110.90.119.113) Quit (Read error: Connection reset by peer)
[2:02] * LeaChim (~LeaChim@host86-166-182-74.range86-166.btcentralplus.com) Quit (Ping timeout: 480 seconds)
[2:02] * yanzheng (~zhyan@jfdmzpr05-ext.jf.intel.com) has joined #ceph
[2:04] * kaizh (~kaizh@128-107-239-235.cisco.com) Quit (Remote host closed the connection)
[2:04] * AfC (~andrew@2407:7800:400:1011:2ad2:44ff:fe08:a4c) has joined #ceph
[2:05] * tserong (~tserong@203-57-208-132.dyn.iinet.net.au) has joined #ceph
[2:08] * davidzlap (~Adium@ip68-5-239-214.oc.oc.cox.net) Quit (Quit: Leaving.)
[2:19] <dmick> ponyofdeath: sorry, stepped away. what command led to "Formatting 'rbd:libvirt/test-image:id=libvirt', fmt=rbd size=5368709120 cluster_size=0"?
[2:25] * zidarsk8 (~zidar@89-212-142-10.dynamic.t-2.net) has joined #ceph
[2:25] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) has left #ceph
[2:30] <mo-> yea, format should be "rbd", not "raw"
[2:31] * glzhao (~glzhao@220.181.11.232) has joined #ceph
[2:31] * shang (~ShangWu@42-65-217-160.dynamic-ip.hinet.net) has joined #ceph
[2:33] * xmltok (~xmltok@216.103.134.250) Quit (Quit: Leaving...)
[2:34] * zidarsk8 (~zidar@89-212-142-10.dynamic.t-2.net) has left #ceph
[2:41] * alram (~alram@38.122.20.226) Quit (Quit: leaving)
[2:42] * Cube (~Cube@12.248.40.138) Quit (Quit: Leaving.)
[2:43] * angdraug (~angdraug@12.164.168.117) has joined #ceph
[2:51] <ponyofdeath> dmick: no worries, qemu-img create -f rbd rbd:libvirt-pool/new-libvirt-image 2G
[2:52] <ponyofdeath> sudo qemu-img create -f rbd rbd:libvirt/new-libvirt-image:id=libvirt 5G
[2:52] <ponyofdeath> this one actually
[2:52] * diegows (~diegows@190.190.5.238) Quit (Ping timeout: 480 seconds)
[2:53] * sprachgenerator (~sprachgen@c-67-167-211-254.hsd1.il.comcast.net) Quit (Quit: sprachgenerator)
[2:53] * ponyofdeath (~vladi@cpe-76-167-201-214.san.res.rr.com) Quit (Quit: Lost terminal)
[2:53] * ponyofdeath (~vladi@cpe-76-167-201-214.san.res.rr.com) has joined #ceph
[3:01] <dmick> and creating it without the "id=libvirt" doesn't work either?
[3:02] * rmoe (~quassel@12.164.168.117) Quit (Ping timeout: 480 seconds)
[3:05] * shang (~ShangWu@42-65-217-160.dynamic-ip.hinet.net) Quit (Ping timeout: 480 seconds)
[3:07] <ponyofdeath> dmick: nope
[3:07] <ponyofdeath> dmick: only with :id=libvirt
[3:09] * dalgaaf (uid15138@id-15138.ealing.irccloud.com) Quit (Quit: Connection closed for inactivity)
[3:09] * zerick (~eocrospom@190.187.21.53) Quit (Remote host closed the connection)
[3:10] <dmick> wait, so, one way does work?
[3:10] <dmick> confused
[3:11] * jjgalvez (~jjgalvez@ip98-167-16-160.lv.lv.cox.net) Quit (Quit: Leaving.)
[3:12] * erkules_ (~erkules@port-92-193-104-121.dynamic.qsc.de) has joined #ceph
[3:15] * haomaiwang (~haomaiwan@118.186.133.131) has joined #ceph
[3:15] * mikedawson (~chatzilla@c-98-220-189-67.hsd1.in.comcast.net) Quit (Quit: ChatZilla 0.9.90.1 [Firefox 27.0.1/20140212131424])
[3:16] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has left #ceph
[3:17] <ponyofdeath> dmick: yeah the one from the docs does not work
[3:17] <ponyofdeath> unless i append id=libvirt as you suggested before i think
[3:18] <dmick> ah, so that *does* work. I thought you were saying that gave the error
[3:18] <dmick> so, the question is why
[3:19] <dmick> there are two differences between the two most recent commands you typed; one is the addition of id=libvirt, the other is the addition of sudo
[3:19] * erkules (~erkules@port-92-193-50-232.dynamic.qsc.de) Quit (Ping timeout: 480 seconds)
[3:20] * reed (~reed@75-101-54-131.dsl.static.sonic.net) Quit (Ping timeout: 480 seconds)
[3:20] * haomaiwang (~haomaiwan@118.186.133.131) Quit (Remote host closed the connection)
[3:21] * haomaiwang (~haomaiwan@219-87-173-15.static.tfn.net.tw) has joined #ceph
[3:21] <dmick> and I think you should be able to create an image with the default client.admin key
[3:21] <ponyofdeath> dmick: so you think my permissions are off
[3:22] <ponyofdeath> caps: [mon] allow r
[3:22] <ponyofdeath> caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=libvirt
[3:22] <dmick> I don't know why it would be failing with sudo qemu-img create -f rbd rbd:libvirt/new-libvirt-image 5G
[3:22] <ponyofdeath> no its failing without sudo
[3:22] <dmick> sigh
[3:22] <ponyofdeath> with sudo it works i think because it can read the key :)
[3:22] <dmick> that's why I said there were *two* differences
[3:23] <ponyofdeath> sorry did not understand
[3:23] <ponyofdeath> yeah it does not work without sudo and without id=libvirt
[3:23] <dmick> so sudo without id=libvirt works
[3:23] <dmick> and no-sudo-with-id=libvirt works
[3:23] <dmick> true?
[3:24] <ponyofdeath> none work i get different errors for the two cases
[3:24] <ponyofdeath> sudo + id=libvirt gives the format rbd error
[3:25] <ponyofdeath> without sudo or without id=libvirt i get the connection failed error
[3:25] * xarses (~andreww@c-24-23-183-44.hsd1.ca.comcast.net) has joined #ceph
[3:25] <dmick> didn't even know there was a connection failed error
[3:25] <ponyofdeath> thats what i was first seeing
[3:26] <ponyofdeath> vladi@prod-ent-virt07:~$ qemu-img create -f rbd rbd:libvirt/new-libvirt-image 5G
[3:26] <ponyofdeath> Formatting 'rbd:libvirt/new-libvirt-image', fmt=rbd size=5368709120 cluster_size=0
[3:26] <ponyofdeath> qemu-img: error connecting
[3:26] <ponyofdeath> qemu-img: rbd:libvirt/new-libvirt-image: error while creating rbd: Input/output error
[3:27] <ponyofdeath> vladi@prod-ent-virt07:~$ qemu-img create -f rbd rbd:libvirt/new-libvirt-image:id=libvirt 5G
[3:27] <ponyofdeath> Formatting 'rbd:libvirt/new-libvirt-image:id=libvirt', fmt=rbd size=5368709120 cluster_size=0
[3:27] <ponyofdeath> qemu-img: error connecting
[3:27] <ponyofdeath> qemu-img: rbd:libvirt/new-libvirt-image:id=libvirt: error while creating rbd: Input/output error
[3:27] <ponyofdeath> vladi@prod-ent-virt07:~$ sudo qemu-img create -f rbd rbd:libvirt/new-libvirt-image:id=libvirt 5G
[3:27] <ponyofdeath> [sudo] password for vladi:
[3:27] <ponyofdeath> Formatting 'rbd:libvirt/new-libvirt-image:id=libvirt', fmt=rbd size=5368709120 cluster_size=0
[3:27] <ponyofdeath> qemu-img: Formatting or formatting option not supported for file format 'rbd'
[3:30] * JCL (~JCL@2601:9:5980:39b:1d8:a36b:1c93:828c) Quit (Quit: Leaving.)
[3:30] * JCL (~JCL@2601:9:5980:39b:1d8:a36b:1c93:828c) has joined #ceph
[3:30] <dmick> ok
[3:32] <ponyofdeath> cephx server client.libvirt: unexpected key: req.key=e410e760d21791c7 expected_key=cf208d5c7a9c6d74
[3:32] <ponyofdeath> i was seeing this in the logs
[3:32] <ponyofdeath> before i had the proper keyring format
[3:32] * shang (~ShangWu@42-65-217-160.dynamic-ip.hinet.net) has joined #ceph
[3:32] <ponyofdeath> now i dont see anything
[3:33] <ponyofdeath> when i attempt to do sudo qemu-img create -f rbd rbd:libvirt/test:id=libvirt 5G
[3:33] <ponyofdeath> librbd1 0.41-1ubuntu2.1
[3:33] <ponyofdeath> is the version i am running
[3:34] <ponyofdeath> do i need an kernel module for this
[3:34] <dmick> wow, that is *old*
[3:34] <dmick> no kernel module
[3:34] <ponyofdeath> :)
[3:34] <ponyofdeath> ubuntu 12.04
[3:34] <ponyofdeath> should i update
[3:34] <dmick> first thing, update that librbd/librados
[3:35] <dmick> what version of libvirt-bin?
[3:35] <ponyofdeath> 0.9.8-2ubuntu17.17
[3:36] <dmick> that should be OK I think
[3:38] * rmoe (~quassel@173-228-89-134.dsl.static.sonic.net) has joined #ceph
[3:44] <ponyofdeath> dmick: that was it
[3:45] <ponyofdeath> dmick: updated from ceph apt repo
[3:45] <ponyofdeath> and all is well on the image fromt
[3:45] <ponyofdeath> dmick: thanks !!
[3:48] <dmick> awesome
[3:51] * infernix (nix@cl-1404.ams-04.nl.sixxs.net) Quit (Quit: ZNC - http://znc.sourceforge.net)
[3:58] * dpippenger (~riven@66-192-9-78.static.twtelecom.net) Quit (Quit: Leaving.)
[3:58] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) Quit (Quit: Leaving.)
[4:01] * haomaiwa_ (~haomaiwan@117.79.232.213) has joined #ceph
[4:03] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[4:08] * haomaiwang (~haomaiwan@219-87-173-15.static.tfn.net.tw) Quit (Ping timeout: 480 seconds)
[4:16] * jjgalvez (~jjgalvez@98.167.16.160) has joined #ceph
[4:29] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) has joined #ceph
[4:33] * sjusthm (~sam@24-205-43-60.dhcp.gldl.ca.charter.com) Quit (Quit: Leaving.)
[4:40] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) Quit (Ping timeout: 480 seconds)
[5:05] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has joined #ceph
[5:05] * Cube (~Cube@66-87-67-221.pools.spcsdns.net) has joined #ceph
[5:06] * kaizh (~kaizh@c-50-131-203-4.hsd1.ca.comcast.net) has joined #ceph
[5:14] * ptone (~ptone@ip98-171-189-30.sb.sd.cox.net) Quit (Ping timeout: 480 seconds)
[5:14] * angdraug (~angdraug@12.164.168.117) Quit (Quit: Leaving)
[5:16] * jjgalvez (~jjgalvez@98.167.16.160) Quit (Quit: Leaving.)
[5:21] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[5:22] * kaizh (~kaizh@c-50-131-203-4.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[5:22] * davidzlap (~Adium@ip68-5-239-214.oc.oc.cox.net) has joined #ceph
[5:24] * Vacum_ (~vovo@i59F7A76A.versanet.de) has joined #ceph
[5:26] * dpippenger (~riven@cpe-198-72-157-189.socal.res.rr.com) has joined #ceph
[5:31] * Vacum (~vovo@88.130.196.43) Quit (Ping timeout: 480 seconds)
[5:31] * xiaoxi (~xiaoxi@192.102.204.38) Quit (Remote host closed the connection)
[5:32] * kaizh (~kaizh@c-50-131-203-4.hsd1.ca.comcast.net) has joined #ceph
[5:49] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[5:56] * yguang11 (~yguang11@2406:2000:ef96:e:f49b:906e:17c:f351) Quit (Remote host closed the connection)
[5:57] * yguang11 (~yguang11@2406:2000:ef96:e:39ab:2c42:7eb1:6ee6) has joined #ceph
[6:00] * yguang11 (~yguang11@2406:2000:ef96:e:39ab:2c42:7eb1:6ee6) Quit (Remote host closed the connection)
[6:00] * yguang11 (~yguang11@2406:2000:ef96:e:39ab:2c42:7eb1:6ee6) has joined #ceph
[6:03] * Midnightmyth (~quassel@93-167-84-102-static.dk.customer.tdc.net) has joined #ceph
[6:36] * jjgalvez (~jjgalvez@ip98-167-16-160.lv.lv.cox.net) has joined #ceph
[6:42] * mattt (~textual@cpc9-rdng20-2-0-cust565.15-3.cable.virginm.net) has joined #ceph
[6:50] * mattt (~textual@cpc9-rdng20-2-0-cust565.15-3.cable.virginm.net) Quit (Quit: Computer has gone to sleep.)
[6:56] * Ov3RS33R (~root@cpc65155-pert4-2-0-cust127.16-4.cable.virginmedia.com) has joined #ceph
[6:56] * Midnightmyth (~quassel@93-167-84-102-static.dk.customer.tdc.net) Quit (Ping timeout: 480 seconds)
[6:59] * ajazdzewski (~quassel@2001:4dd0:ff00:9081:21b7:b86a:d958:ca4c) has joined #ceph
[7:04] * hasues (~hazuez@108-236-232-243.lightspeed.knvltn.sbcglobal.net) Quit (Quit: Leaving.)
[7:15] * haomaiwa_ (~haomaiwan@117.79.232.213) Quit (Ping timeout: 480 seconds)
[7:16] * jjgalvez (~jjgalvez@ip98-167-16-160.lv.lv.cox.net) Quit (Remote host closed the connection)
[7:17] * valeech (~valeech@pool-71-171-123-210.clppva.fios.verizon.net) Quit (Quit: valeech)
[7:20] * haomaiwang (~haomaiwan@106.38.255.123) has joined #ceph
[7:24] * kaizh (~kaizh@c-50-131-203-4.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[7:25] * nerdtron (~oftc-webi@202.60.8.250) has joined #ceph
[7:25] <nerdtron> hi all
[7:26] <nerdtron> i'm trying to setup 3 node ceph
[7:26] <nerdtron> is it a requirement to use ceph-deploy and have the admin node on a seperate machine?
[7:28] * haomaiwang (~haomaiwan@106.38.255.123) Quit (Ping timeout: 480 seconds)
[7:33] * kaizh (~kaizh@c-50-131-203-4.hsd1.ca.comcast.net) has joined #ceph
[7:36] * wschulze (~wschulze@cpe-72-229-37-201.nyc.res.rr.com) Quit (Quit: Leaving.)
[7:37] * kaizh (~kaizh@c-50-131-203-4.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[7:41] * Siva (~sivat@vpnnat.eglbp.corp.yahoo.com) has joined #ceph
[7:42] * kaizh (~kaizh@128-107-239-234.cisco.com) has joined #ceph
[7:42] * codice (~toodles@97-94-175-73.static.mtpk.ca.charter.com) Quit (Remote host closed the connection)
[7:44] * ajazdzewski (~quassel@2001:4dd0:ff00:9081:21b7:b86a:d958:ca4c) Quit (Ping timeout: 480 seconds)
[7:45] * gaveen (~gaveen@220.247.234.28) has joined #ceph
[7:45] * Ov3RS33R (~root@cpc65155-pert4-2-0-cust127.16-4.cable.virginmedia.com) Quit (Quit: Leaving)
[7:50] * mattt (~textual@94.236.7.190) has joined #ceph
[7:52] * bandrus (~Adium@adsl-75-5-250-121.dsl.scrm01.sbcglobal.net) Quit (Quit: Leaving.)
[7:55] * codice (~toodles@97-94-175-73.static.mtpk.ca.charter.com) has joined #ceph
[8:00] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) Quit (Quit: Leaving.)
[8:00] * sjm (~sjm@108.53.56.179) has joined #ceph
[8:01] * ajazdzewski (~quassel@2001:4dd0:ff00:9081:21b7:b86a:d958:ca4c) has joined #ceph
[8:04] * mattt_ (~textual@94.236.7.190) has joined #ceph
[8:04] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[8:05] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) Quit ()
[8:06] * mattt (~textual@94.236.7.190) Quit (Ping timeout: 480 seconds)
[8:06] * mattt_ is now known as mattt
[8:06] * lxo (~aoliva@lxo.user.oftc.net) Quit (Ping timeout: 480 seconds)
[8:06] * bandrus (~Adium@75.5.250.121) has joined #ceph
[8:09] * haomaiwang (~haomaiwan@117.79.232.231) has joined #ceph
[8:09] * bandrus (~Adium@75.5.250.121) Quit ()
[8:15] * Siva (~sivat@vpnnat.eglbp.corp.yahoo.com) Quit (Quit: Siva)
[8:15] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[8:16] * kaizh_ (~kaizh@c-50-131-203-4.hsd1.ca.comcast.net) has joined #ceph
[8:16] * kaizh (~kaizh@128-107-239-234.cisco.com) Quit (Read error: Connection reset by peer)
[8:16] * shang (~ShangWu@42-65-217-160.dynamic-ip.hinet.net) Quit (Quit: Ex-Chat)
[8:16] * shang (~ShangWu@42-65-217-160.dynamic-ip.hinet.net) has joined #ceph
[8:18] * Cube (~Cube@66-87-67-221.pools.spcsdns.net) Quit (Quit: Leaving.)
[8:18] * kaizh_ (~kaizh@c-50-131-203-4.hsd1.ca.comcast.net) Quit (Remote host closed the connection)
[8:21] * josef_ (~josef@kungsbacka.oderland.com) Quit (Quit: Leaving)
[8:21] * isodude (~isodude@kungsbacka.oderland.com) has joined #ceph
[8:21] * dalgaaf (uid15138@id-15138.ealing.irccloud.com) has joined #ceph
[8:25] * AfC (~andrew@2407:7800:400:1011:2ad2:44ff:fe08:a4c) Quit (Quit: Leaving.)
[8:27] * ajazdzewski (~quassel@2001:4dd0:ff00:9081:21b7:b86a:d958:ca4c) Quit (Remote host closed the connection)
[8:28] * mkoderer (uid11949@id-11949.ealing.irccloud.com) has joined #ceph
[8:35] <jerker> I can report that running netatalk and serving time machine backups directly from cephfs is not stable. :-) But it worked a few times. I tried netatalk>SL6(VirtualBox)>cepfs>Ceph>Ext4>ZVOL>ZFS..
[8:36] <jerker> Will try netatalk>SL6(VirtualBox)>Ext4>RBD>Ceph>Ext4>ZVOL>ZFS instead and see if it makes any difference.
[8:37] * sarob (~sarob@2601:9:7080:13a:dcbd:15e7:1824:d6e7) has joined #ceph
[8:38] <nerdtron> i'm trying to setup 3 node ceph
[8:38] <nerdtron> is it a requirement to use ceph-deploy and have the admin node on a seperate machine?
[8:39] * Siva (~sivat@vpnnat.eglbp.corp.yahoo.com) has joined #ceph
[8:42] * joshd (~joshd@2607:f298:a:607:bcff:1536:4b89:53d9) Quit (Ping timeout: 480 seconds)
[8:45] * rotbeard (~redbeard@2a02:908:df10:6f00:76f0:6dff:fe3b:994d) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * wido (~wido@2a00:f10:121:100:4a5:76ff:fe00:199) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * mschiff (~mschiff@mx10.schiffbauer.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * verdurin (~adam@2001:8b0:281:78ec:e2cb:4eff:fe01:f767) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * mo- (~mo@2a01:4f8:141:3264::3) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * godog (~filo@0001309c.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * _are__ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * bauruine (~bauruine@2a01:4f8:150:6381::545) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * al (d@niel.cx) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * asmaps (~quassel@2a03:4000:2:3c5::80) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * codice (~toodles@97-94-175-73.static.mtpk.ca.charter.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Vacum_ (~vovo@i59F7A76A.versanet.de) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * erkules_ (~erkules@port-92-193-104-121.dynamic.qsc.de) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * ponyofdeath (~vladi@cpe-76-167-201-214.san.res.rr.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * carter (~carter@2600:3c03::f03c:91ff:fe6e:6c01) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * houkouonchi-home (~linux@2001:470:c:c69::2) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Sysadmin88 (~IceChat77@176.254.32.31) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * NaioN (stefan@andor.naion.nl) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * flaxy (~afx@78.130.174.164) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Elbandi (~ea333@elbandi.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * raso (~raso@deb-multimedia.org) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * oblu- (~o@62.109.134.112) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * garphy`aw (~garphy@frank.zone84.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * baffle (baffle@jump.stenstad.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * jeremydei (~jdeininge@ip-64-139-50-114.sjc.megapath.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * ctd (~root@00011932.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * dgc (~redacted@bikeshed.us) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * zapotah (~zapotah@dsl-hkibrasgw1-58c08e-250.dhcp.inet.fi) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * finster (~finster@cmdline.guru) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * scalability-junk (uid6422@id-6422.ealing.irccloud.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * joelio (~Joel@88.198.107.214) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * r0r_taga (~nick@greenback.pod4.org) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * amospalla (~amospalla@0001a39c.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * kuu (~kuu@virtual362.tentacle.fi) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * paradon_ (~thomas@60.234.66.253) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * swizgard_ (~swizgard@port-87-193-133-18.static.qsc.de) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * ido (~ido@00014f21.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * MK_FG (~MK_FG@00018720.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * nyerup (irc@jespernyerup.dk) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * kraken (~kraken@gw.sepia.ceph.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * dmick (~dmick@2607:f298:a:607:35:242d:72e8:b7c) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * tjikkun (~tjikkun@2001:7b8:356:0:225:22ff:fed2:9f1f) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * goerk (~goerk@ip-176-198-112-20.unitymediagroup.de) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * lxo (~aoliva@lxo.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * yanzheng (~zhyan@jfdmzpr05-ext.jf.intel.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * davidz (~Adium@ip68-5-239-214.oc.oc.cox.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * xdeller_ (~xdeller@213.33.189.50) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * capri (~capri@212.218.127.222) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * gregsfortytwo (~Adium@2607:f298:a:607:3d79:585d:5557:ffbc) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * jcsp (~Adium@0001bf3a.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Kioob`Taff (~plug-oliv@local.plusdinfo.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * lightspeed (~lightspee@2001:8b0:16e:1:216:eaff:fe59:4a3c) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * jpierre03 (~jpierre03@voyage.prunetwork.fr) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * erice (~erice@c-98-245-48-79.hsd1.co.comcast.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * fred` (fred@earthli.ng) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * jtangwk (~Adium@gateway.tchpc.tcd.ie) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * nwf_ (~nwf@67.62.51.95) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * via (~via@smtp2.matthewvia.info) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * partner_ (joonas@ajaton.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * brother (foobaz@vps1.hacking.dk) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * twx_ (~twx@rosamoln.org) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * todin (tuxadero@kudu.in-berlin.de) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * ferai (~quassel@corkblock.jefferai.org) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * erwyn (~erwyn@markelous.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * wogri (~wolf@nix.wogri.at) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * LCF (ball8@193.231.broadband16.iol.cz) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Ormod (~valtha@ohmu.fi) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * jamespage (~jamespage@culvain.gromper.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Anticimex (anticimex@95.80.32.80) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * rektide (~rektide@eldergods.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * tom2 (~jens@s11.jayr.de) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * liiwi (liiwi@idle.fi) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * NafNaf (~NafNaf@5.148.165.184) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * alexxy (~alexxy@2001:470:1f14:106::2) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * dwm (~dwm@northrend.tastycake.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * musca (musca@tyrael.eu) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * toutour (~toutour@causses.idest.org) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * wusui (~Warren@38.122.20.226) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * sherry (~sherry@mike-alien.esc.auckland.ac.nz) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * jwillem (~jwillem@thuiscomputer.xs4all.nl) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * guppy (~quassel@guppy.xxx) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * plantain (~plantain@106.187.96.118) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * sig_wall (~adjkru@185.14.185.91) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Kdecherf (~kdecherf@shaolan.kdecherf.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Svedrin (svedrin@ketos.funzt-halt.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * topro (~prousa@host-62-245-142-50.customer.m-online.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * dlan_ (~dennis@116.228.88.131) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * toabctl (~toabctl@toabctl.de) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * mancdaz (~mancdaz@2a00:1a48:7807:102:94f4:6b56:ff08:886c) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * dosaboy (~dosaboy@65.93.189.91.lcy-01.canonistack.canonical.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Guest140 (~coyo@thinks.outside.theb0x.org) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * DLange (~DLange@dlange.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * loicd (~loicd@bouncer.dachary.org) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * yeled (~yeled@spodder.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * ingard (~cake@tu.rd.vc) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * s15y (~s15y@sac91-2-88-163-166-69.fbx.proxad.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * guerby (~guerby@ip165-ipv6.tetaneutral.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * glzhao (~glzhao@220.181.11.232) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * tserong (~tserong@203-57-208-132.dyn.iinet.net.au) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * KindOne (kindone@0001a7db.user.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * TMM (~hp@c97185.upc-c.chello.nl) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * joef (~Adium@138-72-131-175.pixar.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * madkiss (~madkiss@chello062178057005.20.11.vie.surfer.at) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * ninkotech (~duplo@static-84-242-87-186.net.upcbroadband.cz) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * morse (~morse@supercomputing.univpm.it) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * neurodrone (~neurodron@static-108-30-171-7.nycmny.fios.verizon.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * semitech1ical (~adam@ip70-176-51-26.ph.ph.cox.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * athrift (~nz_monkey@203.86.205.13) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * ofu (ofu@dedi3.fuckner.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * ccooke (~ccooke@spirit.gkhs.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * bkero (~bkero@216.151.13.66) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * lurbs (user@uber.geek.nz) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * grifferz_ (~andy@bitfolk.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * psieklFH_ (psiekl@wombat.eu.org) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * vhasi (vhasi@vha.si) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * xinxinsh__ (~xinxinsh@fmdmzpr04-ext.fm.intel.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * zere (~matt@asklater.com) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Esmil (esmil@horus.0x90.dk) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * Hau_MI (~HauM1@login.univie.ac.at) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * leseb (~leseb@88-190-214-97.rev.dedibox.fr) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * tomaw (tom@tomaw.noc.oftc.net) Quit (resistance.oftc.net reticulum.oftc.net)
[8:45] * sarob (~sarob@2601:9:7080:13a:dcbd:15e7:1824:d6e7) Quit (Ping timeout: 480 seconds)
[8:46] * Siva (~sivat@vpnnat.eglbp.corp.yahoo.com) Quit (Quit: Siva)
[8:46] * calit (~thorsten@b2b-94-79-138-170.unitymedia.biz) has joined #ceph
[8:46] * lxo (~aoliva@lxo.user.oftc.net) has joined #ceph
[8:46] * codice (~toodles@97-94-175-73.static.mtpk.ca.charter.com) has joined #ceph
[8:46] * Vacum_ (~vovo@i59F7A76A.versanet.de) has joined #ceph
[8:46] * erkules_ (~erkules@port-92-193-104-121.dynamic.qsc.de) has joined #ceph
[8:46] * ponyofdeath (~vladi@cpe-76-167-201-214.san.res.rr.com) has joined #ceph
[8:46] * glzhao (~glzhao@220.181.11.232) has joined #ceph
[8:46] * tserong (~tserong@203-57-208-132.dyn.iinet.net.au) has joined #ceph
[8:46] * yanzheng (~zhyan@jfdmzpr05-ext.jf.intel.com) has joined #ceph
[8:46] * carter (~carter@2600:3c03::f03c:91ff:fe6e:6c01) has joined #ceph
[8:46] * houkouonchi-home (~linux@2001:470:c:c69::2) has joined #ceph
[8:46] * Sysadmin88 (~IceChat77@176.254.32.31) has joined #ceph
[8:46] * KindOne (kindone@0001a7db.user.oftc.net) has joined #ceph
[8:46] * davidz (~Adium@ip68-5-239-214.oc.oc.cox.net) has joined #ceph
[8:46] * NaioN (stefan@andor.naion.nl) has joined #ceph
[8:46] * TMM (~hp@c97185.upc-c.chello.nl) has joined #ceph
[8:46] * rotbeard (~redbeard@2a02:908:df10:6f00:76f0:6dff:fe3b:994d) has joined #ceph
[8:46] * dwm (~dwm@northrend.tastycake.net) has joined #ceph
[8:46] * joef (~Adium@138-72-131-175.pixar.com) has joined #ceph
[8:46] * xdeller_ (~xdeller@213.33.189.50) has joined #ceph
[8:46] * madkiss (~madkiss@chello062178057005.20.11.vie.surfer.at) has joined #ceph
[8:46] * musca (musca@tyrael.eu) has joined #ceph
[8:46] * ninkotech (~duplo@static-84-242-87-186.net.upcbroadband.cz) has joined #ceph
[8:46] * capri (~capri@212.218.127.222) has joined #ceph
[8:46] * flaxy (~afx@78.130.174.164) has joined #ceph
[8:46] * gregsfortytwo (~Adium@2607:f298:a:607:3d79:585d:5557:ffbc) has joined #ceph
[8:46] * toutour (~toutour@causses.idest.org) has joined #ceph
[8:46] * jcsp (~Adium@0001bf3a.user.oftc.net) has joined #ceph
[8:46] * Elbandi (~ea333@elbandi.net) has joined #ceph
[8:46] * Kioob`Taff (~plug-oliv@local.plusdinfo.com) has joined #ceph
[8:46] * wido (~wido@2a00:f10:121:100:4a5:76ff:fe00:199) has joined #ceph
[8:46] * morse (~morse@supercomputing.univpm.it) has joined #ceph
[8:46] * lightspeed (~lightspee@2001:8b0:16e:1:216:eaff:fe59:4a3c) has joined #ceph
[8:46] * raso (~raso@deb-multimedia.org) has joined #ceph
[8:46] * jpierre03 (~jpierre03@voyage.prunetwork.fr) has joined #ceph
[8:46] * oblu- (~o@62.109.134.112) has joined #ceph
[8:46] * erice (~erice@c-98-245-48-79.hsd1.co.comcast.net) has joined #ceph
[8:46] * fred` (fred@earthli.ng) has joined #ceph
[8:46] * amospalla (~amospalla@0001a39c.user.oftc.net) has joined #ceph
[8:46] * garphy`aw (~garphy@frank.zone84.net) has joined #ceph
[8:46] * kuu (~kuu@virtual362.tentacle.fi) has joined #ceph
[8:46] * baffle (baffle@jump.stenstad.net) has joined #ceph
[8:46] * jeremydei (~jdeininge@ip-64-139-50-114.sjc.megapath.net) has joined #ceph
[8:46] * ctd (~root@00011932.user.oftc.net) has joined #ceph
[8:46] * dgc (~redacted@bikeshed.us) has joined #ceph
[8:46] * zapotah (~zapotah@dsl-hkibrasgw1-58c08e-250.dhcp.inet.fi) has joined #ceph
[8:46] * ido (~ido@00014f21.user.oftc.net) has joined #ceph
[8:46] * MK_FG (~MK_FG@00018720.user.oftc.net) has joined #ceph
[8:46] * kraken (~kraken@gw.sepia.ceph.com) has joined #ceph
[8:46] * finster (~finster@cmdline.guru) has joined #ceph
[8:46] * swizgard_ (~swizgard@port-87-193-133-18.static.qsc.de) has joined #ceph
[8:46] * nyerup (irc@jespernyerup.dk) has joined #ceph
[8:46] * paradon_ (~thomas@60.234.66.253) has joined #ceph
[8:46] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) has joined #ceph
[8:46] * scalability-junk (uid6422@id-6422.ealing.irccloud.com) has joined #ceph
[8:46] * tjikkun (~tjikkun@2001:7b8:356:0:225:22ff:fed2:9f1f) has joined #ceph
[8:46] * dmick (~dmick@2607:f298:a:607:35:242d:72e8:b7c) has joined #ceph
[8:46] * joelio (~Joel@88.198.107.214) has joined #ceph
[8:46] * r0r_taga (~nick@greenback.pod4.org) has joined #ceph
[8:46] * goerk (~goerk@ip-176-198-112-20.unitymediagroup.de) has joined #ceph
[8:46] * liiwi (liiwi@idle.fi) has joined #ceph
[8:46] * Ormod (~valtha@ohmu.fi) has joined #ceph
[8:46] * LCF (ball8@193.231.broadband16.iol.cz) has joined #ceph
[8:46] * wogri (~wolf@nix.wogri.at) has joined #ceph
[8:46] * Anticimex (anticimex@95.80.32.80) has joined #ceph
[8:46] * tom2 (~jens@s11.jayr.de) has joined #ceph
[8:46] * erwyn (~erwyn@markelous.net) has joined #ceph
[8:46] * rektide (~rektide@eldergods.com) has joined #ceph
[8:46] * jamespage (~jamespage@culvain.gromper.net) has joined #ceph
[8:46] * ferai (~quassel@corkblock.jefferai.org) has joined #ceph
[8:46] * todin (tuxadero@kudu.in-berlin.de) has joined #ceph
[8:46] * twx_ (~twx@rosamoln.org) has joined #ceph
[8:46] * brother (foobaz@vps1.hacking.dk) has joined #ceph
[8:46] * NafNaf (~NafNaf@5.148.165.184) has joined #ceph
[8:46] * alexxy (~alexxy@2001:470:1f14:106::2) has joined #ceph
[8:46] * partner_ (joonas@ajaton.net) has joined #ceph
[8:46] * via (~via@smtp2.matthewvia.info) has joined #ceph
[8:46] * nwf_ (~nwf@67.62.51.95) has joined #ceph
[8:46] * jtangwk (~Adium@gateway.tchpc.tcd.ie) has joined #ceph
[8:46] * zere (~matt@asklater.com) has joined #ceph
[8:46] * psieklFH_ (psiekl@wombat.eu.org) has joined #ceph
[8:46] * grifferz_ (~andy@bitfolk.com) has joined #ceph
[8:46] * tomaw (tom@tomaw.noc.oftc.net) has joined #ceph
[8:46] * lurbs (user@uber.geek.nz) has joined #ceph
[8:46] * leseb (~leseb@88-190-214-97.rev.dedibox.fr) has joined #ceph
[8:46] * Jahkeup (Jahkeup@gemini.ca.us.panicbnc.net) has joined #ceph
[8:46] * vhasi (vhasi@vha.si) has joined #ceph
[8:46] * bkero (~bkero@216.151.13.66) has joined #ceph
[8:46] * ccooke (~ccooke@spirit.gkhs.net) has joined #ceph
[8:46] * ofu (ofu@dedi3.fuckner.net) has joined #ceph
[8:46] * Hau_MI (~HauM1@login.univie.ac.at) has joined #ceph
[8:46] * Esmil (esmil@horus.0x90.dk) has joined #ceph
[8:46] * s15y (~s15y@sac91-2-88-163-166-69.fbx.proxad.net) has joined #ceph
[8:46] * Guest140 (~coyo@thinks.outside.theb0x.org) has joined #ceph
[8:46] * Kdecherf (~kdecherf@shaolan.kdecherf.com) has joined #ceph
[8:46] * sig_wall (~adjkru@185.14.185.91) has joined #ceph
[8:46] * mancdaz (~mancdaz@2a00:1a48:7807:102:94f4:6b56:ff08:886c) has joined #ceph
[8:46] * toabctl (~toabctl@toabctl.de) has joined #ceph
[8:46] * xinxinsh__ (~xinxinsh@fmdmzpr04-ext.fm.intel.com) has joined #ceph
[8:46] * athrift (~nz_monkey@203.86.205.13) has joined #ceph
[8:46] * plantain (~plantain@106.187.96.118) has joined #ceph
[8:46] * guerby (~guerby@ip165-ipv6.tetaneutral.net) has joined #ceph
[8:46] * DLange (~DLange@dlange.user.oftc.net) has joined #ceph
[8:46] * dlan_ (~dennis@116.228.88.131) has joined #ceph
[8:46] * loicd (~loicd@bouncer.dachary.org) has joined #ceph
[8:46] * dosaboy (~dosaboy@65.93.189.91.lcy-01.canonistack.canonical.com) has joined #ceph
[8:46] * ingard (~cake@tu.rd.vc) has joined #ceph
[8:46] * Svedrin (svedrin@ketos.funzt-halt.net) has joined #ceph
[8:46] * guppy (~quassel@guppy.xxx) has joined #ceph
[8:46] * topro (~prousa@host-62-245-142-50.customer.m-online.net) has joined #ceph
[8:46] * semitech1ical (~adam@ip70-176-51-26.ph.ph.cox.net) has joined #ceph
[8:46] * jwillem (~jwillem@thuiscomputer.xs4all.nl) has joined #ceph
[8:46] * neurodrone (~neurodron@static-108-30-171-7.nycmny.fios.verizon.net) has joined #ceph
[8:46] * sherry (~sherry@mike-alien.esc.auckland.ac.nz) has joined #ceph
[8:46] * wusui (~Warren@38.122.20.226) has joined #ceph
[8:46] * yeled (~yeled@spodder.com) has joined #ceph
[8:46] * al (d@niel.cx) has joined #ceph
[8:46] * mo- (~mo@2a01:4f8:141:3264::3) has joined #ceph
[8:46] * bauruine (~bauruine@2a01:4f8:150:6381::545) has joined #ceph
[8:46] * verdurin (~adam@2001:8b0:281:78ec:e2cb:4eff:fe01:f767) has joined #ceph
[8:46] * asmaps (~quassel@2a03:4000:2:3c5::80) has joined #ceph
[8:46] * _are__ (~quassel@2a01:238:4325:ca00:f065:c93c:f967:9285) has joined #ceph
[8:46] * mschiff (~mschiff@mx10.schiffbauer.net) has joined #ceph
[8:46] * godog (~filo@0001309c.user.oftc.net) has joined #ceph
[8:47] <jerker> nerdtron: no. I just set up 3 nodes. I use the 1st node as admin node. I am using ceph-deploy though (for the first time) and it worked quite ok (got some warnings but it seem to work fine).
[8:47] * ChanServ sets mode +v nhm
[8:47] * ChanServ sets mode +v sage
[8:47] * ChanServ sets mode +v scuttlemonkey
[8:47] * ChanServ sets mode +v joao
[8:49] * jwillem (~jwillem@thuiscomputer.xs4all.nl) has left #ceph
[8:49] * jwillem (~jwillem@thuiscomputer.xs4all.nl) has joined #ceph
[8:51] * joshd (~joshd@2607:f298:a:607:1dc1:226f:bacc:85ae) has joined #ceph
[8:53] * Sysadmin88 (~IceChat77@176.254.32.31) Quit (Quit: Clap on! , Clap off! Clap@#&$NO CARRIER)
[9:04] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[9:05] * ajazdzewski (~quassel@lpz-66.sprd.net) has joined #ceph
[9:05] <ajazdzewski> hi
[9:05] <ajazdzewski> i like to know if somone of you use bcache and how
[9:07] <ajazdzewski> i install bcache infront of our osd disks, my idea was to delegate all random IO to the SSD and turn ist mostly into sequential IO wihlie bcache flush the data onto the HDD
[9:09] * fghaas (~florian@91-119-140-244.dynamic.xdsl-line.inode.at) has joined #ceph
[9:09] * rendar (~s@host132-182-dynamic.20-87-r.retail.telecomitalia.it) has joined #ceph
[9:13] * Kioob`Taff (~plug-oliv@local.plusdinfo.com) Quit (Quit: Leaving.)
[9:17] <jerker> ajazdzewski: i am not but I am using Ext4/ZVOL/ZFS with a log/cache on SSD which at least is design to give a similiar result... But it may be so that the overhead of the stack reduce the effects. :/
[9:19] * Cube (~Cube@66-87-67-221.pools.spcsdns.net) has joined #ceph
[9:20] <jerker> I am buying
[9:20] * Cube (~Cube@66-87-67-221.pools.spcsdns.net) Quit (Read error: Connection reset by peer)
[9:20] <jerker> two Seagate Desktop SSHD STCL4000400 now (4 TB with 8 GB integrated flash) to see if they help.
[9:20] * Cube (~Cube@66-87-67-221.pools.spcsdns.net) has joined #ceph
[9:21] <jerker> Its sort of hardware cache for every drive, independent of controller. Should work fine with ZFS and Ceph I guess to speed things up. And quite cheap.
[9:21] <jerker> At least help with bursts.
[9:22] <jerker> I hope.
[9:25] * BManojlovic (~steki@91.195.39.5) has joined #ceph
[9:27] * i_m (~ivan.miro@nat-5-carp.hcn-strela.ru) has joined #ceph
[9:27] <ajazdzewski> sounds cool, if you have som metrics it would be nice to can have a look at it
[9:31] * capri (~capri@212.218.127.222) Quit (Quit: Leaving)
[9:37] * hjjg (~hg@p3EE3200D.dip0.t-ipconnect.de) has joined #ceph
[9:38] * sarob (~sarob@c-50-161-65-119.hsd1.ca.comcast.net) has joined #ceph
[9:41] * LeaChim (~LeaChim@host86-166-182-74.range86-166.btcentralplus.com) has joined #ceph
[9:44] * b0e (~aledermue@juniper1.netways.de) has joined #ceph
[9:46] * sarob (~sarob@c-50-161-65-119.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[9:47] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) has joined #ceph
[9:47] * ChanServ sets mode +v andreask
[9:50] * The_Bishop (~bishop@2001:470:50b6:0:f8f2:2c07:82f0:cdf9) Quit (Ping timeout: 480 seconds)
[9:51] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[9:54] * rotbeard (~redbeard@2a02:908:df10:6f00:76f0:6dff:fe3b:994d) Quit (Quit: Verlassend)
[9:56] * zidarsk8 (~zidar@89-212-142-10.dynamic.t-2.net) has joined #ceph
[9:56] * shang (~ShangWu@42-65-217-160.dynamic-ip.hinet.net) Quit (Read error: Connection reset by peer)
[9:57] * shang (~ShangWu@42-65-217-160.dynamic-ip.hinet.net) has joined #ceph
[9:58] * zidarsk8 (~zidar@89-212-142-10.dynamic.t-2.net) has left #ceph
[9:58] * shang (~ShangWu@42-65-217-160.dynamic-ip.hinet.net) Quit ()
[10:00] * The_Bishop (~bishop@2001:470:50b6:0:900b:654f:cc90:7225) has joined #ceph
[10:07] * ksingh (~Adium@a91-156-75-252.elisa-laajakaista.fi) has joined #ceph
[10:09] * dis (~dis@109.110.66.129) has joined #ceph
[10:10] * TMM (~hp@c97185.upc-c.chello.nl) Quit (Ping timeout: 480 seconds)
[10:13] * yanzheng (~zhyan@jfdmzpr05-ext.jf.intel.com) Quit (Remote host closed the connection)
[10:14] <jerker> ajazdzewski: They are only 5900 rpm compared to 7200 rpm which I usually buy. But if the flash help...
[10:27] * ksingh (~Adium@a91-156-75-252.elisa-laajakaista.fi) has left #ceph
[10:29] * fdmanana (~fdmanana@bl13-134-213.dsl.telepac.pt) has joined #ceph
[10:30] * allsystemsarego (~allsystem@188.25.129.255) has joined #ceph
[10:30] * bandrus (~Adium@adsl-75-5-250-121.dsl.scrm01.sbcglobal.net) has joined #ceph
[10:32] * bandrus (~Adium@adsl-75-5-250-121.dsl.scrm01.sbcglobal.net) Quit ()
[10:37] * TMM (~hp@sams-office-nat.tomtomgroup.com) has joined #ceph
[10:39] * zidarsk8 (~zidar@prevod.fri1.uni-lj.si) has joined #ceph
[10:42] * zidarsk8 (~zidar@prevod.fri1.uni-lj.si) has left #ceph
[10:45] * Vacum_ is now known as Vacum
[10:46] <Vacum> Hi. I just tried a ceph tell osd.150 , which opened a console. Entered help, saw there is a "version" command. entered version -> all 3 mons crashed. running 0.72.2 . Known issue? Me misunderstanding ceph tell ?
[10:49] * AfC (~andrew@2001:44b8:31cb:d400:6e88:14ff:fe33:2a9c) has joined #ceph
[10:49] * Cataglottism (~Cataglott@dsl-087-195-030-184.solcon.nl) has joined #ceph
[10:50] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) has joined #ceph
[10:56] * jtangwk (~Adium@gateway.tchpc.tcd.ie) Quit (Quit: Leaving.)
[10:58] <fghaas> Vacum: whoa
[10:59] <fghaas> if you're managing to crash all your mons with a single ceph tell command, then you could be misunderstanding it all you want, that shouldn't happen
[11:00] * Siva (~sivat@vpnnat.eglbp.corp.yahoo.com) has joined #ceph
[11:02] <Vacum> 2014-03-05 09:50:36.964103 7f9120574700 -1 mon/Monitor.cc: In function 'bool Monitor::_allowed_command(MonSession*, std::string&, std::string&, std::map<std::basic_string<char>, boost::variant<std::basic_string<char>, bool, long int, d
[11:02] <Vacum> ouble, std::vector<std::basic_string<char> > > >&)' thread 7f9120574700 time 2014-03-05 09:50:36.961413
[11:02] <Vacum> mon/Monitor.cc: 1898: FAILED assert(this_cmd != __null)
[11:03] <Vacum> found that in the mon machine's mon.log
[11:05] <Vacum> then 10000 lines of "recent events"
[11:06] <Vacum> after those: 2014-03-05 09:50:37.106625 7f9120574700 -1 *** Caught signal (Aborted) ** in thread 7f9120574700
[11:07] <calit> Vacum: reproducable here with 0.72.2
[11:07] <Vacum> wow
[11:07] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) Quit (Remote host closed the connection)
[11:08] <Vacum> ok, then I'll better stop playing around with the ceph tell feature :)
[11:09] <calit> :D was a test-setup anyway
[11:09] <Vacum> here too :)
[11:10] * jbd_ (~jbd_@2001:41d0:52:a00::77) has joined #ceph
[11:11] * Cube (~Cube@66-87-67-221.pools.spcsdns.net) Quit (Quit: Leaving.)
[11:12] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) has joined #ceph
[11:13] <calit> Vacum: maybe it's fixed with firefly, but i think it should be worth a bugreport ;)
[11:14] <fghaas> yup, definitely file a bug report
[11:14] <Vacum> will do
[11:15] <fghaas> Vacum: checking this on my dumpling system
[11:16] * diegows (~diegows@190.190.5.238) has joined #ceph
[11:17] <fghaas> Vacum: not reproducible on dumpling
[11:18] <fghaas> $ sudo ceph tell osd.0
[11:18] <fghaas> ceph> version
[11:18] <fghaas> Error: 22 EINVAL
[11:18] <fghaas> Status:
[11:18] <fghaas> unrecognized command
[11:18] <fghaas> that's all (sorry for the paste)
[11:19] <calit> so the mon's keep running?
[11:19] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) Quit (Remote host closed the connection)
[11:21] * davidz (~Adium@ip68-5-239-214.oc.oc.cox.net) Quit (Ping timeout: 480 seconds)
[11:21] * davidzlap (~Adium@ip68-5-239-214.oc.oc.cox.net) Quit (Ping timeout: 480 seconds)
[11:29] * jtangwk (~Adium@gateway.tchpc.tcd.ie) has joined #ceph
[11:31] * jtangwk (~Adium@gateway.tchpc.tcd.ie) Quit ()
[11:34] <Vacum> fghaas: thanks for testing this
[11:35] <Vacum> fghaas: if you run help on the ceph> prompt, does it list version as valid command?
[11:35] <fghaas> yes it does
[11:35] * jtangwk (~Adium@gateway.tchpc.tcd.ie) has joined #ceph
[11:36] <fghaas> calit: yes they do
[11:36] * Cataglottism (~Cataglott@dsl-087-195-030-184.solcon.nl) Quit (Quit: My Mac Pro has gone to sleep. ZZZzzz???)
[11:37] * nerdtron (~oftc-webi@202.60.8.250) Quit (Quit: Page closed)
[11:40] * sarob (~sarob@2601:9:7080:13a:e997:dd90:6d72:fa11) has joined #ceph
[11:41] * hybrid512 (~walid@LPoitiers-156-86-25-85.w193-248.abo.wanadoo.fr) Quit (Ping timeout: 480 seconds)
[11:42] * garphy`aw is now known as garphy
[11:48] * sarob (~sarob@2601:9:7080:13a:e997:dd90:6d72:fa11) Quit (Ping timeout: 480 seconds)
[11:49] * haomaiwang (~haomaiwan@117.79.232.231) Quit (Remote host closed the connection)
[11:52] * diegows (~diegows@190.190.5.238) Quit (Ping timeout: 480 seconds)
[11:54] * dmick (~dmick@2607:f298:a:607:35:242d:72e8:b7c) Quit (Ping timeout: 480 seconds)
[11:58] * gaveen (~gaveen@220.247.234.28) Quit (Ping timeout: 480 seconds)
[12:00] * AfC (~andrew@2001:44b8:31cb:d400:6e88:14ff:fe33:2a9c) Quit (Quit: Leaving.)
[12:01] * hybrid512 (~walid@LPoitiers-156-86-25-85.w193-248.abo.wanadoo.fr) has joined #ceph
[12:02] * sjm (~sjm@108.53.56.179) has left #ceph
[12:03] * dmick (~dmick@2607:f298:a:607:e13c:47c4:82a:9385) has joined #ceph
[12:04] * gaveen (~gaveen@220.247.234.28) has joined #ceph
[12:13] * fghaas (~florian@91-119-140-244.dynamic.xdsl-line.inode.at) Quit (Quit: Leaving.)
[12:18] * AfC (~andrew@2001:44b8:31cb:d400:6e88:14ff:fe33:2a9c) has joined #ceph
[12:22] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) Quit (Ping timeout: 480 seconds)
[12:24] * yguang11_ (~yguang11@vpn-nat.peking.corp.yahoo.com) has joined #ceph
[12:27] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) has joined #ceph
[12:29] * yguang11 (~yguang11@2406:2000:ef96:e:39ab:2c42:7eb1:6ee6) Quit (Ping timeout: 480 seconds)
[12:34] * davidz (~Adium@ip68-5-239-214.oc.oc.cox.net) has joined #ceph
[12:35] * davidzlap (~Adium@ip68-5-239-214.oc.oc.cox.net) has joined #ceph
[12:39] * Cataglottism (~Cataglott@dsl-087-195-030-170.solcon.nl) has joined #ceph
[12:49] * ksingh (~Adium@a-v6-0012.vpn.csc.fi) has joined #ceph
[12:50] * glzhao (~glzhao@220.181.11.232) Quit (Quit: leaving)
[12:50] <ksingh> is there a way to find a pg ( 2.1566) belongs to which pool ??
[12:52] <ksingh> is the first DIGIT in pg name represent POOL ID ?????
[12:53] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) has joined #ceph
[12:57] * garphy is now known as garphy`aw
[13:03] * garphy`aw is now known as garphy
[13:10] * abique (~abique@time2market1.epfl.ch) has joined #ceph
[13:11] * ircuser-1 (~ircuser-1@35.222-62-69.ftth.swbr.surewest.net) Quit (Ping timeout: 480 seconds)
[13:18] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) has joined #ceph
[13:18] * ChanServ sets mode +v andreask
[13:26] * zidarsk8 (~zidar@2001:1470:fffe:fe01:e2ca:94ff:fe34:7822) has joined #ceph
[13:27] * dmsimard (~Adium@108.163.152.2) has joined #ceph
[13:29] * AfC (~andrew@2001:44b8:31cb:d400:6e88:14ff:fe33:2a9c) Quit (Quit: Leaving.)
[13:31] <Vacum> ksingh: yes. the number before the dot . is the pool id
[13:34] * Cataglottism (~Cataglott@dsl-087-195-030-170.solcon.nl) Quit (Quit: My Mac Pro has gone to sleep. ZZZzzz???)
[13:38] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) Quit (Quit: Leaving.)
[13:38] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) has joined #ceph
[13:41] * sarob (~sarob@c-50-161-65-119.hsd1.ca.comcast.net) has joined #ceph
[13:41] * Cataglottism (~Cataglott@dsl-087-195-030-170.solcon.nl) has joined #ceph
[13:42] * fdmanana (~fdmanana@bl13-134-213.dsl.telepac.pt) Quit (Quit: Leaving)
[13:49] * sarob (~sarob@c-50-161-65-119.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[13:50] <ksingh> cephers : any advice to get rid of health HEALTH_WARN 6 pgs peering; 6 pgs stale; 6 pgs stuck inactive; 6 pgs stuck stale; 6 pgs stuck unclean; 2 requests are blocked > 32 sec
[13:50] <ksingh> these 6 PGs are not getting clean , all my OSD,s are UP and working fine
[13:51] <ksingh> please advice some troubleshooting steps
[13:52] <ChrisNBlum> have you checked the logs? (you could also enable debug logs)
[13:52] <ChrisNBlum> http://ceph.com/docs/master/rados/troubleshooting/log-and-debug/
[13:52] <jerker> Regarding Time Machine backups for Mac OX X - it seem to work with Netatalk->Ext4->RBD->Ceph->Ext4->ZVOL->ZPOOL It is a bit slow but stable so far. But I have not tried restoring. :)
[13:53] * ircuser-1 (~ircuser-1@35.222-62-69.ftth.swbr.surewest.net) has joined #ceph
[13:57] * fghaas (~florian@91-119-140-244.dynamic.xdsl-line.inode.at) has joined #ceph
[14:00] * zidarsk8 (~zidar@2001:1470:fffe:fe01:e2ca:94ff:fe34:7822) has left #ceph
[14:00] * t0rn (~ssullivan@2607:fad0:32:a02:d227:88ff:fe02:9896) has joined #ceph
[14:03] <andreask> ksingh: I'd start here: http://ceph.com/docs/master/rados/troubleshooting/troubleshooting-pg/
[14:04] <andreask> check why the pgs are unclean
[14:04] <andreask> or in any other state
[14:15] * gaveen (~gaveen@220.247.234.28) Quit (Quit: Leaving)
[14:16] * KevinPerks (~Adium@cpe-066-026-252-218.triad.res.rr.com) has joined #ceph
[14:16] * zidarsk8 (~zidar@2001:1470:fffe:fe01:e2ca:94ff:fe34:7822) has joined #ceph
[14:16] * hijacker (~hijacker@bgva.sonic.taxback.ess.ie) Quit (Quit: Leaving)
[14:20] * zidarsk8 (~zidar@2001:1470:fffe:fe01:e2ca:94ff:fe34:7822) has left #ceph
[14:21] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[14:26] * hijacker (~hijacker@bgva.sonic.taxback.ess.ie) has joined #ceph
[14:32] * b0e1 (~aledermue@juniper1.netways.de) has joined #ceph
[14:38] * b0e (~aledermue@juniper1.netways.de) Quit (Ping timeout: 480 seconds)
[14:43] * xdeller_ (~xdeller@213.33.189.50) Quit (Ping timeout: 480 seconds)
[14:43] * xdeller_ (~xdeller@109.188.125.246) has joined #ceph
[14:50] * diegows (~diegows@190.190.5.238) has joined #ceph
[14:50] * b0e1 (~aledermue@juniper1.netways.de) Quit (Remote host closed the connection)
[14:53] * xdeller (~xdeller@213.33.189.50) has joined #ceph
[14:54] * hjjg (~hg@p3EE3200D.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[14:56] * xdeller_ (~xdeller@109.188.125.246) Quit (Ping timeout: 480 seconds)
[14:57] * hjjg (~hg@p3EE31CCB.dip0.t-ipconnect.de) has joined #ceph
[14:58] * BillK (~BillK-OFT@106-68-68-206.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[15:03] * BillK (~BillK-OFT@106-68-51-153.dyn.iinet.net.au) has joined #ceph
[15:06] <ksingh> [root@storage0101-ib ~]# ceph pg 2.1566 query
[15:06] <ksingh> Error ENOENT: i don't have pgid 2.1566
[15:06] <ksingh> [root@storage0101-ib ~]#
[15:06] <ksingh> [root@storage0101-ib ~]#
[15:06] <ksingh> [root@storage0101-ib ~]# ceph pg 29.da7 query
[15:06] <ksingh> Error ENOENT: i don't have pgid 29.da7
[15:06] <ksingh> [root@storage0101-ib ~]#
[15:07] <ksingh> yesterday i have replaced one physical disk , osd.126 and i can see 6PG that belongs to this HDD / OSD.126 is not getting clean
[15:08] <ksingh> what does this mean these 6 PGs are stale entries in my cluster that exists on OSD.126 that i replaced
[15:08] <andreask> so you definitely lost that pgs as this disk is lost?
[15:08] <ksingh> so to make my cluster healthy should i manually DELETE these 6PG
[15:09] * xdeller (~xdeller@213.33.189.50) Quit (Ping timeout: 480 seconds)
[15:10] <ksingh> disk physically got failed , all pools have rep size of 3 in my system , as soon as i removed , made my osd out , down , crush remove
[15:10] <ksingh> cluster started in recovery and after 20 minutes , recovery stopped
[15:10] * sroy (~sroy@207.96.182.162) has joined #ceph
[15:10] <ksingh> and it now say 6 PGs are stucked unclean ( looks its forever )
[15:11] <andreask> so you have no copy for this pgs in your cluster?
[15:11] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has joined #ceph
[15:11] <ksingh> yes thats what how to check them , this command ceph pg 29.da7 query
[15:11] <ksingh> does not gives any output
[15:11] * xdeller (~xdeller@109.188.126.22) has joined #ceph
[15:12] * Siva (~sivat@vpnnat.eglbp.corp.yahoo.com) Quit (Quit: Siva)
[15:14] <ksingh> what ceph is supposed to do ( what i think ) as soon as osd.126 failed ( this sunday ) , it would have replicate all PG from secondary copy to other OSD
[15:14] <andreask> but this pool is still there?
[15:15] <ksingh> yes all pools are there , but i dont know if data is consistent or not
[15:15] <andreask> what does "ceph health detail" say?
[15:16] <ksingh> sorry for long output
[15:16] <ksingh> [root@storage0101-ib ~]# ceph health detail
[15:16] <ksingh> HEALTH_WARN 6 pgs peering; 6 pgs stale; 6 pgs stuck inactive; 6 pgs stuck stale; 6 pgs stuck unclean; 2 requests are blocked > 32 sec; 1 osds have slow requests
[15:16] <ksingh> pg 2.1566 is stuck inactive for 620902.955622, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 34.1546 is stuck inactive for 711320.437550, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 29.154b is stuck inactive for 642706.324688, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 2.dc2 is stuck inactive for 620856.839348, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 29.da7 is stuck inactive for 647248.132606, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 34.da2 is stuck inactive for 621280.382233, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 2.1566 is stuck unclean for 620902.965006, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 34.1546 is stuck unclean for 711320.446930, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 29.154b is stuck unclean for 642706.334066, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 2.dc2 is stuck unclean for 620856.848727, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 29.da7 is stuck unclean for 647248.141985, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 34.da2 is stuck unclean for 621280.391612, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 2.1566 is stuck stale for 620790.268205, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 34.1546 is stuck stale for 620790.268216, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 29.154b is stuck stale for 620790.268182, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 2.dc2 is stuck stale for 620790.264263, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 29.da7 is stuck stale for 620790.264253, current state stale+peering, last acting [126]
[15:16] <ksingh> pg 34.da2 is stuck stale for 620790.264106, current state stale+peering, last acting [126]
[15:16] <ksingh> 2 ops are blocked > 134218 sec
[15:16] <ksingh> 2 ops are blocked > 134218 sec on osd.73
[15:16] <ksingh> 1 osds have slow requests
[15:16] <ksingh> [root@storage0101-ib ~]#
[15:17] <ksingh> this osd.126 is what i am talking about
[15:17] * magicrobotmonkey (~abassett@ec2-50-18-55-253.us-west-1.compute.amazonaws.com) has joined #ceph
[15:18] <andreask> oh ... use pastebin please
[15:19] <ksingh> http://pastebin.com/D7NMhzuX
[15:20] <andreask> can you also show: ceph pg dump | grep stale
[15:20] <andreask> and "ceph osd dump| grep size"
[15:21] * yanzheng (~zhyan@134.134.139.76) has joined #ceph
[15:22] * wschulze (~wschulze@cpe-72-229-37-201.nyc.res.rr.com) has joined #ceph
[15:23] * BillK (~BillK-OFT@106-68-51-153.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[15:24] <ksingh> andreask : all necessary outputs are here http://pastebin.com/D7NMhzuX
[15:26] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) Quit (Ping timeout: 480 seconds)
[15:26] * Cataglottism (~Cataglott@dsl-087-195-030-170.solcon.nl) Quit (Quit: My Mac Pro has gone to sleep. ZZZzzz???)
[15:28] <andreask> ksingh: looks like these pgs only had one copy ... have they every bin active?
[15:29] <andreask> ... they are stuck-inactive since more than 7 days ...
[15:29] <ksingh> yes before sunday cluster was healthy , and after that no new pools are created and desttoyed
[15:30] <ksingh> only osd.99 and osd.126 failed
[15:30] <ksingh> replacement for osd.99 was done successfully as i had a spare disk for replacement
[15:30] <ksingh> for osd.126 i didnt have hardware to replace
[15:31] <andreask> hmm ... both disks failed at the same time?
[15:31] <ksingh> so i removed osd.126 ( as it was down and out ) from cluster , hoping its always have pg on other OSDS to data will not loose
[15:32] <andreask> all the lost pgs are from pools with only 2 copies
[15:32] <ksingh> umm i would say no , not exactly same time , but yes on same day
[15:32] <ksingh> and these osds are physicall on different hosts
[15:34] <andreask> according to the health details, these pgs are stuck/* since more than one week
[15:35] <ksingh> yes might be before i checked on sunday ( i was in ceph day frankfurt , didnt monitor cluster )
[15:35] <andreask> only test-data?
[15:36] <ksingh> except pool id 2 which have RBD data other pools are test
[15:36] <ksingh> can we check pool consistency ( if it has lost some data or not )
[15:37] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[15:38] <andreask> well .. looks like there is no copy of these pgs ...
[15:38] * Pedras1 (~Adium@c-67-188-26-20.hsd1.ca.comcast.net) has joined #ceph
[15:39] <ksingh> do you mean these PGs these 6 PGs were located on osd.126 and osd.99 and when both got failed they were lost
[15:39] <ksingh> and it belongs to pool which has rep size of 2
[15:39] <madkiss> ksingh: you were at the Ceph Day in Frankfurt, weren't you? :)
[15:40] <ksingh> madkiss ??? i was sitting in first row ( as wear glasses ) just next to patrick
[15:40] <madkiss> :)
[15:41] <andreask> ksingh: looks like you lost both copies, yes
[15:42] * sarob (~sarob@2601:9:7080:13a:d0b4:5ed9:a41d:8745) has joined #ceph
[15:43] <ksingh> :-( :-( :-(
[15:45] <ksingh> andreask but why only 6 PGS , its a 3TB disk , so 3TB X 2 is almost 5.6 TB of disk , and if i assume its 20% fillled up
[15:45] <ksingh> so it should loose 1 TB of data
[15:45] <andreask> how many osds do you have?
[15:46] <ksingh> earlier 154 , now 153 ( as i told i replaced osd.99 yesterday )
[15:46] <ksingh> waiting for HP to deliver 1 new disk
[15:48] <andreask> so you have a lot of osds to distribute the pfs
[15:48] <andreask> pgs
[15:48] <ksingh> yep
[15:50] * dmsimard1 (~Adium@108.163.152.66) has joined #ceph
[15:50] <andreask> and how many hosts?
[15:50] <ksingh> 15 hosts , 11 disks per host
[15:51] * sarob (~sarob@2601:9:7080:13a:d0b4:5ed9:a41d:8745) Quit (Ping timeout: 480 seconds)
[15:52] * dmsimard1 is now known as dms
[15:52] * PerlStalker (~PerlStalk@2620:d3:8000:192::70) has joined #ceph
[15:52] <ksingh> sorry 14 hosts X 11 disks = 154 OSD
[15:54] <andreask> so also quite some hosts to distribute
[15:55] * dmsimard (~Adium@108.163.152.2) Quit (Ping timeout: 480 seconds)
[15:56] * diegows (~diegows@190.190.5.238) Quit (Ping timeout: 480 seconds)
[15:56] * yanzheng (~zhyan@134.134.139.76) Quit (Remote host closed the connection)
[15:57] * mdxi (~mdxi@50-199-109-154-static.hfc.comcastbusiness.net) has joined #ceph
[16:00] * fdmanana (~fdmanana@bl13-134-213.dsl.telepac.pt) has joined #ceph
[16:00] * japuzzo (~japuzzo@pok2.bluebird.ibm.com) has joined #ceph
[16:02] * markbby (~Adium@168.94.245.3) has joined #ceph
[16:03] * calit (~thorsten@b2b-94-79-138-170.unitymedia.biz) Quit (Quit: leaving)
[16:04] * linuxkidd (~linuxkidd@2001:420:2100:2258:39d3:de25:be2d:1e03) has joined #ceph
[16:11] * drokita_ (~drokita@199.255.228.128) has joined #ceph
[16:13] * gregsfortytwo1 (~Adium@cpe-172-250-69-138.socal.res.rr.com) Quit (Read error: Connection reset by peer)
[16:13] * gregsfortytwo1 (~Adium@cpe-172-250-69-138.socal.res.rr.com) has joined #ceph
[16:14] * drokita_ (~drokita@199.255.228.128) Quit ()
[16:33] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) Quit (Quit: Leaving.)
[16:34] * rmoe (~quassel@173-228-89-134.dsl.static.sonic.net) Quit (Remote host closed the connection)
[16:40] * thorus (~jonas@82.199.158.66) Quit (Remote host closed the connection)
[16:40] * valeech (~valeech@64.191.222.117) has joined #ceph
[16:42] <kitz> fio reports that my all my drives above sdz (sdaa..sdal) have 100x the ticks of the drives sdc..sdz.
[16:42] * bogus (~bogus@hetznar.boguspackets.net) has joined #ceph
[16:42] <kitz> This seems to happen when I'm benching just those drives and when I'm benching all the drives.
[16:43] <kitz> I have no idea why though. :(
[16:53] * rturk-away is now known as rturk
[16:54] <nwf_> Is there any way to "rebalance" the deep-scrub workload? A while ago I instructed all the OSDs to scrub at once and now the weekly deep-scrubs all land on top of each other and boy does our cluster slow down.
[16:57] <nwf_> (so much so that it's triggering "task blocked for 120 seconds" diagnostics in our rbd-backed qemu VMs.)
[17:01] <mattch> nwf_: probably not a 'proper' answer, but you could trigger a series of one-off manual scrubs staggered over a week to offset them?
[17:01] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) has joined #ceph
[17:03] * sprachgenerator (~sprachgen@130.202.135.181) has joined #ceph
[17:03] <nwf_> Sounds as good as anything else.
[17:04] <nwf_> Relatedly, is there any way to see the scrubbing schedule or queue?
[17:05] <fghaas> nwf_: hmmm interesting. probably a feature request to use (interval+random) for the deep scrub frequency
[17:06] * Midnightmyth (~quassel@93-167-84-102-static.dk.customer.tdc.net) has joined #ceph
[17:08] <mattch> mwf_: I've used this in the past: http://cephnotes.ksperis.com/blog/2013/08/27/deep-scrub-distribution
[17:09] <mattch> nwf_: ^^
[17:10] <nwf_> Oh ho, very nice.
[17:11] * neurodrone (~neurodron@static-108-30-171-7.nycmny.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[17:12] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) Quit (Quit: doppelgrau)
[17:12] * doppelgrau (~doppelgra@pd956d116.dip0.t-ipconnect.de) has joined #ceph
[17:15] * dmsimard (~Adium@70.38.0.246) has joined #ceph
[17:17] * tserong (~tserong@203-57-208-132.dyn.iinet.net.au) Quit (Ping timeout: 480 seconds)
[17:17] * hasues (~hasues@kwfw01.scrippsnetworksinteractive.com) has joined #ceph
[17:17] * xdeller_ (~xdeller@213.33.189.50) has joined #ceph
[17:17] * diegows (~diegows@190.173.195.54) has joined #ceph
[17:17] * dms (~Adium@108.163.152.66) Quit (Ping timeout: 480 seconds)
[17:17] * rturk is now known as rturk-away
[17:19] * jbd_ (~jbd_@2001:41d0:52:a00::77) has left #ceph
[17:22] <via> hey, i'm getting a ceph mds that dies pretty often, and this time it has this trace: https://pastee.org/euj8j
[17:22] * tserong (~tserong@203-57-208-132.dyn.iinet.net.au) has joined #ceph
[17:22] * xdeller (~xdeller@109.188.126.22) Quit (Ping timeout: 480 seconds)
[17:25] * zidarsk8 (~zidar@89-212-142-10.dynamic.t-2.net) has joined #ceph
[17:26] * zidarsk8 (~zidar@89-212-142-10.dynamic.t-2.net) has left #ceph
[17:28] * ksingh (~Adium@a-v6-0012.vpn.csc.fi) Quit (Ping timeout: 480 seconds)
[17:32] <via> in fact, on first glance it doesn't appear i can get the mds started again
[17:33] * zerick (~eocrospom@190.187.21.53) has joined #ceph
[17:34] * diegows (~diegows@190.173.195.54) Quit (Ping timeout: 480 seconds)
[17:38] * bandrus (~Adium@adsl-75-5-250-121.dsl.scrm01.sbcglobal.net) has joined #ceph
[17:38] * wrencsok (~wrencsok@wsip-174-79-34-244.ph.ph.cox.net) has left #ceph
[17:39] * wrencsok (~wrencsok@174.79.34.244) has joined #ceph
[17:41] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) Quit (Quit: Leaving.)
[17:41] * TMM (~hp@sams-office-nat.tomtomgroup.com) Quit (Quit: Ex-Chat)
[17:43] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) has joined #ceph
[17:43] * ChanServ sets mode +v andreask
[17:44] * sarob (~sarob@2601:9:7080:13a:8561:d24a:9241:8540) has joined #ceph
[17:44] * dmsimard1 (~Adium@108.163.152.2) has joined #ceph
[17:44] * dmsimard (~Adium@70.38.0.246) Quit (Read error: Connection reset by peer)
[17:50] <sage> via: opened issue 7613
[17:50] <kraken> sage might be talking about http://tracker.ceph.com/issues/7613 [mds/MDCache.cc: 216: FAILED assert(inode_map.count(in->vino()) == 0)]
[17:50] <via> sage: i was literally making a ticket right now
[17:50] <sage> heh
[17:50] <via> thank you
[17:50] <via> any idea what the cause is? i hate saying this
[17:50] <via> but we're using ceph for something really important
[17:51] <via> out of neccessity of a huge filesystem
[17:51] <jerker> how do I see Which OSD is broken in "1 near full osd(s)" in ceph status? I think I know which one but to be sure?
[17:51] <sage> np. without looking closely, my guess is that a client that is trying to reconnect is resending a request the mds doesn't like (dup ino). clearly a bug somewhere, but a workaround may be to restart the client before restarting the mds
[17:51] <sage> jerker: ceph health detail
[17:51] <via> as in there is still a serv er trying to moutn it?
[17:51] <via> so i should just stop that server
[17:51] <jerker> sage: thanks :)
[17:52] * sarob (~sarob@2601:9:7080:13a:8561:d24a:9241:8540) Quit (Ping timeout: 480 seconds)
[17:53] <jerker> It was not a good idea to run the OSD and the MON on the same file system, even on this test cluster :-)
[18:02] * ircolle (~Adium@2601:1:8380:2d9:bd49:6ad5:e126:1315) has joined #ceph
[18:04] * ivotron (~ivotron@dhcp-59-219.cse.ucsc.edu) has joined #ceph
[18:05] * xarses (~andreww@c-24-23-183-44.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[18:06] * mattt (~textual@94.236.7.190) Quit (Ping timeout: 480 seconds)
[18:06] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[18:06] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[18:06] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) Quit ()
[18:09] * BManojlovic (~steki@91.195.39.5) Quit (Quit: Ja odoh a vi sta 'ocete...)
[18:12] * Cataglottism (~Cataglott@dsl-087-195-030-184.solcon.nl) has joined #ceph
[18:13] * Siva (~sivat@vpnnat.eglbp.corp.yahoo.com) has joined #ceph
[18:16] * Hau_MI (~HauM1@login.univie.ac.at) Quit (Remote host closed the connection)
[18:17] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) Quit (Ping timeout: 480 seconds)
[18:24] * Cube (~Cube@38.122.20.226) has joined #ceph
[18:24] * Cataglottism (~Cataglott@dsl-087-195-030-184.solcon.nl) Quit (Quit: My Mac Pro has gone to sleep. ZZZzzz???)
[18:28] * xdeller_ (~xdeller@213.33.189.50) Quit (Ping timeout: 480 seconds)
[18:28] * xdeller_ (~xdeller@109.188.125.249) has joined #ceph
[18:30] * hjjg (~hg@p3EE31CCB.dip0.t-ipconnect.de) Quit (Ping timeout: 480 seconds)
[18:31] * Pedras1 (~Adium@c-67-188-26-20.hsd1.ca.comcast.net) Quit (Quit: Leaving.)
[18:34] * kaizh (~kaizh@128-107-239-235.cisco.com) has joined #ceph
[18:36] * nwat (~textual@eduroam-230-155.ucsc.edu) has joined #ceph
[18:40] <via> sage: restarting the clients to force unmount seemed to let me start them
[18:40] <via> thank you
[18:40] <via> start the mds, rather
[18:40] <via> would you like me to comment that in the ticket?
[18:43] <sage> yes please
[18:43] <sage> via: also if you can attach the full log that would be nice for the record; the pastee will probably expire
[18:46] * garphy is now known as garphy`aw
[18:46] <via> i only copied the last 500 lines
[18:46] <via> aka whats in the pastee
[18:46] <via> but i can attqach that
[18:47] * xarses (~andreww@12.164.168.117) has joined #ceph
[18:47] * rmoe (~quassel@12.164.168.117) has joined #ceph
[18:48] * diegows (~diegows@190.173.195.54) has joined #ceph
[18:53] <via> nope, it just happened again
[18:54] <via> with a fresh mount
[18:56] * infernixx (nix@cl-1404.ams-04.nl.sixxs.net) has joined #ceph
[18:56] * joef (~Adium@138-72-131-175.pixar.com) Quit (Remote host closed the connection)
[18:56] * infernixx is now known as infernix
[18:59] * rotbeard (~redbeard@b2b-94-79-138-170.unitymedia.biz) Quit (Quit: Leaving)
[18:59] * gregmark (~Adium@68.87.42.115) has joined #ceph
[18:59] * sputnik13 (~sputnik13@client64-80.sdsc.edu) has joined #ceph
[19:03] <sage> via: what kind of client is it?
[19:03] <sage> and, can you reproduce the problem with a full log (debug mds = 20, debug ms = 1 on teh mds)?
[19:03] <sage> and attach that to the bug?
[19:03] * sputnik13 (~sputnik13@client64-80.sdsc.edu) Quit ()
[19:04] * sputnik13 (~sputnik13@client64-80.sdsc.edu) has joined #ceph
[19:05] <via> they are ceph kernel clients, 3.12
[19:05] <via> i could send a mds=20 log but i can't post it publicly
[19:05] <via> brb
[19:09] * gregmark (~Adium@68.87.42.115) Quit (Ping timeout: 480 seconds)
[19:09] * ksingh (~Adium@a91-156-75-252.elisa-laajakaista.fi) has joined #ceph
[19:10] * ksingh (~Adium@a91-156-75-252.elisa-laajakaista.fi) Quit (Read error: Connection reset by peer)
[19:11] * ksingh (~Adium@a-v6-0007.vpn.csc.fi) has joined #ceph
[19:13] * erice_ (~erice@c-98-245-48-79.hsd1.co.comcast.net) has joined #ceph
[19:13] * Siva (~sivat@vpnnat.eglbp.corp.yahoo.com) Quit (Quit: Siva)
[19:14] * sjusthm (~sam@24-205-43-60.dhcp.gldl.ca.charter.com) has joined #ceph
[19:14] * erice (~erice@c-98-245-48-79.hsd1.co.comcast.net) Quit (Ping timeout: 480 seconds)
[19:15] * JoeGruher (~JoeGruher@134.134.137.75) has joined #ceph
[19:15] <JoeGruher> setting up a separate cluster network for the first time - is this how I do it? http://pastebin.com/WyhN35z8
[19:18] * sputnik13 (~sputnik13@client64-80.sdsc.edu) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[19:20] * Pedras (~Adium@216.207.42.132) has joined #ceph
[19:22] * The_Bishop (~bishop@2001:470:50b6:0:900b:654f:cc90:7225) Quit (Ping timeout: 480 seconds)
[19:23] * reed (~reed@75-101-54-131.dsl.static.sonic.net) has joined #ceph
[19:24] * sputnik13 (~sputnik13@client64-80.sdsc.edu) has joined #ceph
[19:27] * erice (~erice@c-98-245-48-79.hsd1.co.comcast.net) has joined #ceph
[19:29] * erice_ (~erice@c-98-245-48-79.hsd1.co.comcast.net) Quit (Ping timeout: 480 seconds)
[19:29] <bandrus> JoeGruher: You can specify it once under the [global] section, no need to specify each individual OSD address.
[19:30] <bandrus> as long as routes are setup properly (i.e. default), it will work fine
[19:30] * sputnik13 (~sputnik13@client64-80.sdsc.edu) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[19:31] * The_Bishop (~bishop@2001:470:50b6:0:f997:65f0:1a92:e01d) has joined #ceph
[19:32] * sputnik13 (~sputnik13@client64-80.sdsc.edu) has joined #ceph
[19:32] * ircolle (~Adium@2601:1:8380:2d9:bd49:6ad5:e126:1315) Quit (Quit: Leaving.)
[19:35] * med (~medberry@ec2-50-17-21-207.compute-1.amazonaws.com) has joined #ceph
[19:41] * sputnik13 (~sputnik13@client64-80.sdsc.edu) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[19:45] * sputnik13 (~sputnik13@client64-80.sdsc.edu) has joined #ceph
[19:47] * jjgalvez (~jjgalvez@ip98-167-16-160.lv.lv.cox.net) has joined #ceph
[19:48] * markbby (~Adium@168.94.245.3) Quit (Quit: Leaving.)
[19:49] * xmltok (~xmltok@216.103.134.250) has joined #ceph
[19:49] * markbby (~Adium@168.94.245.3) has joined #ceph
[19:53] * xdeller_ (~xdeller@109.188.125.249) Quit (Quit: Leaving)
[19:57] * JCL1 (~JCL@2601:9:5980:39b:f93b:20a1:62d8:8759) has joined #ceph
[19:57] * Kioob (~kioob@2a01:e34:ec0a:c0f0:21e:8cff:fe07:45b6) has joined #ceph
[19:59] * adam__ (~adam@rincewind.universalconflicts.com) has joined #ceph
[19:59] * [caveman] (~quassel@boxacle.net) has joined #ceph
[20:00] * JCL (~JCL@2601:9:5980:39b:1d8:a36b:1c93:828c) Quit (Ping timeout: 480 seconds)
[20:00] * Meistarin (sid19523@0001c3c8.user.oftc.net) Quit (Ping timeout: 480 seconds)
[20:01] * adam_ (~adam@rincewind.universalconflicts.com) Quit (Ping timeout: 483 seconds)
[20:01] * zerick (~eocrospom@190.187.21.53) Quit (Ping timeout: 483 seconds)
[20:01] * isodude (~isodude@kungsbacka.oderland.com) Quit (Ping timeout: 483 seconds)
[20:02] * isodude (~isodude@kungsbacka.oderland.com) has joined #ceph
[20:02] * leochill (~leochill@nyc-333.nycbit.com) Quit (Ping timeout: 480 seconds)
[20:02] * leochilll (~leochill@nyc-333.nycbit.com) has joined #ceph
[20:02] * carter (~carter@2600:3c03::f03c:91ff:fe6e:6c01) Quit (Ping timeout: 480 seconds)
[20:02] * [cave] (~quassel@boxacle.net) Quit (Ping timeout: 483 seconds)
[20:02] * mdjp (~mdjp@213.229.87.114) Quit (Ping timeout: 483 seconds)
[20:03] * mdjp (~mdjp@213.229.87.114) has joined #ceph
[20:03] * Meistarin (sid19523@0001c3c8.user.oftc.net) has joined #ceph
[20:03] * zerick (~eocrospom@190.187.21.53) has joined #ceph
[20:04] * carter (~carter@2600:3c03::f03c:91ff:fe6e:6c01) has joined #ceph
[20:08] * chris_lu_ (~ccc2@bolin.Lib.lehigh.EDU) Quit (Read error: Operation timed out)
[20:10] * topro (~prousa@host-62-245-142-50.customer.m-online.net) Quit (Quit: Konversation terminated!)
[20:11] * chris_lu_ (~ccc2@bolin.Lib.lehigh.EDU) has joined #ceph
[20:12] * dpippenger (~riven@cpe-198-72-157-189.socal.res.rr.com) Quit (Remote host closed the connection)
[20:20] * sputnik13 (~sputnik13@client64-80.sdsc.edu) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[20:25] * hijacker (~hijacker@bgva.sonic.taxback.ess.ie) Quit (Ping timeout: 480 seconds)
[20:29] * topro (~prousa@host-62-245-142-50.customer.m-online.net) has joined #ceph
[20:33] * simulx (~simulx@66-194-114-178.static.twtelecom.net) has joined #ceph
[20:33] * yuriw1 (~Adium@c-71-202-126-141.hsd1.ca.comcast.net) has joined #ceph
[20:35] <JoeGruher> cool thanks bandrus, that makes it easier
[20:37] * simulx2 (~simulx@66-194-114-178.static.twtelecom.net) Quit (Ping timeout: 480 seconds)
[20:37] * pieterl_ (~pieterl@194.134.32.8) has joined #ceph
[20:37] * pieterl (~pieterl@194.134.32.8) Quit (Read error: Connection reset by peer)
[20:38] * yuriw (~Adium@c-71-202-126-141.hsd1.ca.comcast.net) Quit (Ping timeout: 480 seconds)
[20:45] * sarob (~sarob@mobile-166-137-179-221.mycingular.net) has joined #ceph
[20:47] * hijacker (~hijacker@bgva.sonic.taxback.ess.ie) has joined #ceph
[20:49] <JoeGruher> alfredodeza: ping
[20:49] <alfredodeza> JoeGruher: pong
[20:49] <JoeGruher> alfredodeza: can you tell me why gatherkeys is failing here? looks like keys don't exist, but why weren't they created? http://pastebin.com/wLX25E4i
[20:51] <alfredodeza> I would advice to use 'ceph-deploy mon create-initial' rather than create and then attempt to gatherkeys
[20:51] <alfredodeza> let me explain a bit
[20:52] <alfredodeza> create-initial will take the initially defined monitor hosts
[20:52] * pieterl_ is now known as pieterl
[20:52] <alfredodeza> and then not only create them remotely
[20:52] <alfredodeza> but will also wait for them to form quorum
[20:53] <alfredodeza> that command will actually wait and loop a few times while the monitors sort out what they need
[20:53] <alfredodeza> from your output JoeGruher it looks like your monitors are probing
[20:53] * dpippenger (~riven@66-192-9-78.static.twtelecom.net) has joined #ceph
[20:53] <JoeGruher> alfredodeza: ah, OK, I'll give it a shot
[20:53] * sarob (~sarob@mobile-166-137-179-221.mycingular.net) Quit (Ping timeout: 480 seconds)
[20:54] <alfredodeza> not that just creating a monitor would cause problems but running create-initial is way more robust
[20:56] <JoeGruher> alfredodeza: got it. i'll change our install notes to always do it that way then. should let you know the result in just a minute. :)
[20:56] <alfredodeza> JoeGruher: great. The docs have been updated to point to the usefulness too btw
[21:01] <JoeGruher> alfredodeza: with create-initial looks like it is timing out waiting for quorum so i guess i must have something preventing quorom from being achieved. i think i may know the problem, they can ping each other by hostname, but it doesn't resolve to the public network IP, it resolves to another IP on another network, so maybe that's it. i probably just need to put the static public network IPs
[21:01] <JoeGruher> in /etc/hosts and try again from the start.
[21:02] <alfredodeza> yep that is probably a good hint as to why they are not forming quorum
[21:02] <alfredodeza> and you see, you are already harvesting the benefits of create-initial :)
[21:03] <JoeGruher> alfredodeza: i sure am... otherwise who knows how long it would have taken me to make that leap :)
[21:05] * mattt (~textual@cpc9-rdng20-2-0-cust565.15-3.cable.virginm.net) has joined #ceph
[21:09] * ChrisNBlum (~Adium@dhcp-ip-189.dorf.rwth-aachen.de) Quit (Quit: Leaving.)
[21:14] * kaizh (~kaizh@128-107-239-235.cisco.com) Quit (Remote host closed the connection)
[21:27] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has left #ceph
[21:28] * linuxkidd (~linuxkidd@2001:420:2100:2258:39d3:de25:be2d:1e03) Quit (Quit: Leaving)
[21:31] * kaizh (~kaizh@128-107-239-234.cisco.com) has joined #ceph
[21:32] * dmsimard1 (~Adium@108.163.152.2) Quit (Ping timeout: 480 seconds)
[21:34] * TMM (~hp@c97185.upc-c.chello.nl) has joined #ceph
[21:36] * thb (~me@2a02:2028:78:f140:6267:20ff:fec9:4e40) has joined #ceph
[21:36] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has joined #ceph
[22:02] * fghaas (~florian@91-119-140-244.dynamic.xdsl-line.inode.at) has left #ceph
[22:07] * ksingh (~Adium@a-v6-0007.vpn.csc.fi) has left #ceph
[22:08] * rmoe_ (~quassel@12.164.168.117) has joined #ceph
[22:10] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has left #ceph
[22:12] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) has joined #ceph
[22:12] * ChanServ sets mode +v andreask
[22:13] * rmoe (~quassel@12.164.168.117) Quit (Ping timeout: 480 seconds)
[22:13] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has joined #ceph
[22:13] * andreask (~andreask@h081217067008.dyn.cm.kabsi.at) has left #ceph
[22:13] * diegows (~diegows@190.173.195.54) Quit (Ping timeout: 480 seconds)
[22:15] * Kioob (~kioob@2a01:e34:ec0a:c0f0:21e:8cff:fe07:45b6) Quit (Quit: Leaving.)
[22:16] * Sysadmin88 (~IceChat77@176.254.32.31) has joined #ceph
[22:18] * mattt (~textual@cpc9-rdng20-2-0-cust565.15-3.cable.virginm.net) Quit (Quit: Computer has gone to sleep.)
[22:20] * marrusl (~mark@209-150-43-182.c3-0.wsd-ubr2.qens-wsd.ny.cable.rcn.com) Quit (Remote host closed the connection)
[22:23] * xmltok (~xmltok@216.103.134.250) Quit (Quit: Leaving...)
[22:25] * t0rn (~ssullivan@2607:fad0:32:a02:d227:88ff:fe02:9896) Quit (Quit: Leaving.)
[22:26] <via> is there a way to make ceph prefer a mds? i've tried using standby for rank to make it so my third mds is preferred if it coems back
[22:27] <via> but now it seems if i take that one down the other two do nothing (they don't takeover)
[22:30] * marrusl (~mark@209-150-43-182.c3-0.wsd-ubr2.qens-wsd.ny.cable.rcn.com) has joined #ceph
[22:33] * alram (~alram@38.122.20.226) has joined #ceph
[22:33] * linuxkidd (~linuxkidd@rtp-isp-nat1.cisco.com) has joined #ceph
[22:39] * MarkN (~nathan@142.208.70.115.static.exetel.com.au) has joined #ceph
[22:39] * MarkN (~nathan@142.208.70.115.static.exetel.com.au) has left #ceph
[22:42] * sputnik13 (~sputnik13@207.8.121.241) has joined #ceph
[22:43] * ircolle (~Adium@2601:1:8380:2d9:4d17:65d8:6f86:3d40) has joined #ceph
[22:47] * BManojlovic (~steki@fo-d-130.180.254.37.targo.rs) has joined #ceph
[22:51] * xarses (~andreww@12.164.168.117) Quit (Ping timeout: 480 seconds)
[22:53] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) Quit (Ping timeout: 480 seconds)
[22:54] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has joined #ceph
[22:56] * JoeGruher (~JoeGruher@134.134.137.75) Quit (Remote host closed the connection)
[22:57] * zerick (~eocrospom@190.187.21.53) Quit (Read error: Operation timed out)
[22:57] * sarob (~sarob@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) has joined #ceph
[22:59] * japuzzo (~japuzzo@pok2.bluebird.ibm.com) Quit (Quit: Leaving)
[23:02] * xarses (~andreww@12.164.168.117) has joined #ceph
[23:04] * xmltok (~xmltok@cpe-76-90-130-65.socal.res.rr.com) has joined #ceph
[23:04] * markbby (~Adium@168.94.245.3) Quit (Quit: Leaving.)
[23:05] * sarob (~sarob@nat-dip30-wl-d.cfw-a-gci.corp.yahoo.com) Quit (Ping timeout: 480 seconds)
[23:09] * xmltok_ (~xmltok@cpe-76-90-130-65.socal.res.rr.com) has joined #ceph
[23:10] * xmltok (~xmltok@cpe-76-90-130-65.socal.res.rr.com) Quit (Quit: Bye!)
[23:10] * PerlStalker (~PerlStalk@2620:d3:8000:192::70) Quit (Quit: ..)
[23:12] * zerick (~eocrospom@190.187.21.53) has joined #ceph
[23:12] * sarob (~sarob@2001:4998:effd:600:2144:3dab:d3c3:48ed) has joined #ceph
[23:14] * valeech (~valeech@64.191.222.117) Quit (Quit: valeech)
[23:18] * doubleg (~doubleg@69.167.130.11) has joined #ceph
[23:21] * sroy (~sroy@207.96.182.162) Quit (Quit: Quitte)
[23:22] * diegows (~diegows@190.190.5.238) has joined #ceph
[23:25] * reed (~reed@75-101-54-131.dsl.static.sonic.net) Quit (Quit: Ex-Chat)
[23:27] * xarses (~andreww@12.164.168.117) Quit (Read error: Operation timed out)
[23:31] * Midnightmyth (~quassel@93-167-84-102-static.dk.customer.tdc.net) Quit (Ping timeout: 480 seconds)
[23:32] * rendar (~s@host132-182-dynamic.20-87-r.retail.telecomitalia.it) Quit ()
[23:33] * nwat (~textual@eduroam-230-155.ucsc.edu) Quit (Quit: My MacBook has gone to sleep. ZZZzzz???)
[23:38] * zidarsk8 (~zidar@89-212-142-10.dynamic.t-2.net) has joined #ceph
[23:39] * yanzheng (~zhyan@134.134.139.74) has joined #ceph
[23:42] * zidarsk8 (~zidar@89-212-142-10.dynamic.t-2.net) has left #ceph
[23:42] * hasues (~hasues@kwfw01.scrippsnetworksinteractive.com) Quit (Quit: Leaving.)
[23:43] * c74d (~c74d@2002:4404:712c:0:76de:2bff:fed4:2766) Quit (Ping timeout: 480 seconds)
[23:46] * allsystemsarego (~allsystem@188.25.129.255) Quit (Quit: Leaving)
[23:49] * markbby (~Adium@168.94.245.4) has joined #ceph
[23:58] * nwat (~textual@c-50-131-197-174.hsd1.ca.comcast.net) has joined #ceph
[23:59] * sjm (~sjm@pool-108-53-56-179.nwrknj.fios.verizon.net) has left #ceph

These logs were automatically created by CephLogBot on irc.oftc.net using the Java IRC LogBot.